Information processing method and device and electronic equipment

Abstract

The invention provides an information processing method and device and electronic equipment, and relates to the technical field of communication, and the method comprises the steps: obtaining first information which comprises at least one of collected information and received information; a target processing mode is determined according to the first information, the target processing mode comprises a first processing mode or a second processing mode, the information processing speed of the first processing mode is higher than that of the second processing mode, or the information processing speed of the second processing mode is higher than that of the first processing mode. The information processing complexity of the first processing mode is lower than that of the second processing mode; and performing response processing on the first information by adopting the target processing mode. Through the method provided by the invention, the flexibility of response processing on the acquired information can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technologies, and in particular to an information processing method, device, and electronic device. Background Art

[0002] Existing electronic devices such as voice interaction devices usually respond to and process user input information based on a single processing mode. For example, related technologies usually respond to and process user input information based on a fixed processing mode of deep learning models, which cannot effectively distinguish the complexity of tasks, resulting in low efficiency when processing complex tasks, or wasting computing resources in simple tasks. Summary of the Invention

[0003] The embodiments of the present disclosure provide an information processing method, apparatus, and electronic device, which can solve the problem of low flexibility and poor timeliness in responding to information in the prior art.

[0004] In a first aspect, an embodiment of the present disclosure provides an information processing method, the method comprising:

[0005] Acquiring first information, where the first information includes at least one of collected information and received information;

[0006] determining a target processing mode according to the first information, the target processing mode including a first processing mode or a second processing mode, an information processing speed of the first processing mode being faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode being lower than an information processing complexity of the second processing mode;

[0007] The target processing mode is used to perform response processing on the first information.

[0008] In a second aspect, an embodiment of the present disclosure provides an information processing device, the device comprising:

[0009] An acquisition module, configured to acquire first information, where the first information includes at least one of collected information and received information;

[0010] a determination module, configured to determine a target processing mode based on the first information, the target processing mode including a first processing mode or a second processing mode, wherein an information processing speed of the first processing mode is faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode is lower than an information processing complexity of the second processing mode;

[0011] The first processing module is configured to perform response processing on the first information using the target processing mode.

[0012] In a third aspect, an embodiment of the present disclosure provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps in the information processing method described in the first aspect are implemented.

[0013] In a fourth aspect, an embodiment of the present disclosure provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps in the information processing method described in the first aspect are implemented.

[0014] In a fifth aspect, an embodiment of the present disclosure provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method described in the first aspect.

[0015] In a sixth aspect, an embodiment of the present disclosure provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the method described in the first aspect.

[0016] In an embodiment of the present disclosure, a processing mode is selected from the first processing mode and the second processing mode according to the first information to respond to the first information, which can improve the flexibility of responding to the acquired information. In addition, since the information processing speed of the first processing mode is faster than the information processing speed of the second processing mode, or the information processing complexity of the first processing mode is lower than the information processing complexity of the second processing mode, when the first information is non-urgent or has a high processing complexity, the first information can be responded to and processed through the second processing mode, which can ensure the accuracy of the information response processing; when the first information is urgent or has a low processing complexity, the first information can be responded to and processed through the first processing mode, which can effectively distinguish the complexity of the task, which can not only improve the timeliness of information response processing, but also save computing resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a flow chart of an information processing method provided by an embodiment of the present disclosure;

[0018] Figure 2 is a schematic diagram of functional modules for implementing the information processing method provided by an embodiment of the present disclosure;

[0019] Figure 3 is a structural diagram of an information processing device provided by an embodiment of the present disclosure;

[0020] Figure 4 It is a structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] The following will be combined with the accompanying drawings in the embodiments of the present disclosure to clearly describe the technical solutions in the embodiments of the present disclosure. Obviously, the embodiments described are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of the present disclosure.

[0022] The terms "first", "second", etc. in the specification and claims of the present disclosure are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present disclosure can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of the same type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects related to each other are in an "or" relationship.

[0023] The information processing method, device, and electronic device provided by the embodiments of the present disclosure are described in detail below with reference to specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0024] See also Figure 1 , Figure 1 This is a flow chart of an information processing method provided by an embodiment of the present disclosure. The information processing method can be applied to electronic devices, such as interactive devices such as smart assistants, robots, and call center devices. Figure 1 As shown, the information processing method includes the following steps:

[0025] Step 101: Acquire first information, where the first information includes at least one of collected information and received information.

[0026] The first information may include information collected by the electronic device, information input by the electronic device and received by the electronic device, or information received by the electronic device from a peer device with which the electronic device interacts.

[0027] Exemplarily, the first information may include at least one of an audio signal, text information, video information, and image information. The audio signal may include at least one of a captured audio signal and a received audio signal. The text information may include at least one of received text information and text information describing or representing captured environmental status information. The environmental status information may include at least one of ambient temperature information, air quality information, and air humidity information. Exemplarily, the environmental status information may be information about the state of the environment in which the electronic device is currently located. It will be appreciated that captured environmental status information is typically represented or described in the form of text information. Therefore, the environmental status information may be included as a type of text information. The video information may include at least one of captured video information and received video information. The image information may include at least one of captured image information and received image information.

[0028] For example, the above-mentioned audio signal may include an audio signal collected by an electronic device, such as a voice signal collected by an electronic device (for example, a smart assistant, a smart speaker, etc.) through a microphone or an audio signal in the environment, or an audio signal received from a peer device, etc. For example, an electronic device (for example, a customer service robot, a call center device) receives a voice signal from a user-side device. The above-mentioned text information may include text information input by a user received by the electronic device, or text information received from a peer device, or text information used to describe or represent the collected environmental status information, etc. The above-mentioned video information may include video information captured by the electronic device, or video information received by the user input, or video information received from a peer device, etc. The above-mentioned image information may include image information captured by the electronic device, or image information received by the user input, or image information received from a peer device, etc.

[0029] Step 102: Determine a target processing mode based on the first information, where the target processing mode includes a first processing mode or a second processing mode, and the information processing speed of the first processing mode is faster than the information processing speed of the second processing mode, or the information processing complexity of the first processing mode is lower than the information processing complexity of the second processing mode.

[0030] Exemplarily, the content of the first information can be identified. If it is identified that the information content of the first information includes information content of a preset category, the target processing mode is determined to be the first processing mode; otherwise, the target processing mode is determined to be the second processing mode, wherein the above-mentioned preset category can be reasonably set according to actual needs, for example, information content related to emergency situations such as fire and help; or, the processing mode of the first information can be identified through a recognition model to determine the target processing mode, wherein the above-mentioned recognition model can be a pre-trained classification model, which is used to divide different processing modes. For example, the information content of the input first information can be identified through the above-mentioned recognition model to obtain the type of the information content of the first information, and the target processing mode can be output based on the type of the information content of the first information through the above-mentioned recognition model. Of course, the identification of information content can also be performed through other recognition models, which is not limited by the present disclosure.

[0031] Exemplarily, the first processing mode may be to respond to the acquired information using a relatively simpler processing method or processing logic, for example, respond to the acquired information based on preset processing rules or processing templates; the second processing mode may be to respond to the acquired information using a relatively more complex processing method or processing logic, for example, respond to the acquired information based on a large language model.

[0032] In some optional embodiments, when the first information includes at least two of audio signals, text information, video information, image information and environmental status information, processing mode recognition can be performed on each of the at least two pieces of information separately.

[0033] In some optional embodiments, the first processing mode may also be referred to as a fast system mode, and the second processing mode may also be referred to as a slow system mode.

[0034] Step 103: Use the target processing mode to perform response processing on the first information.

[0035] Exemplarily, the above-mentioned response processing to the first information can be understood as analyzing the acquired first information, determining a response behavior based on the analysis result and executing the corresponding response behavior. For example, for a voice signal received from the user input of "open the curtains", the voice signal can be analyzed. If the analysis result indicates that the user's intention is to open the curtains, the behavior of opening the curtains can be executed; or, for the collected image information of the environment, the collected image information can be analyzed. If the analysis result indicates that the floor of the environment is dirty, the sweeping robot can be started to clean the floor; or, for the collected audio signal of the environment, the audio signal can be analyzed. If the analysis result indicates that there is a fire alarm, the fire alarm can be dialed; or, for the collected air quality information of the environment, the air quality information can be analyzed. If the analysis result indicates that the air quality is poor, the air purifier can be started; or, for the text information received from the opposite device, the text information can be analyzed, and a reply message can be generated based on the analysis result and sent to the opposite device.

[0036] In the embodiment of the present disclosure, the complexity of the task can be effectively distinguished, and a processing mode can be selected from the first processing mode and the second processing mode according to the first information to respond to the first information. This can improve the flexibility of responding to the acquired information. In addition, since the information processing speed of the first processing mode is faster than the information processing speed of the second processing mode, or the information processing complexity of the first processing mode is lower than the information processing complexity of the second processing mode, the first information can be responded to and processed through the second processing mode when the first information is non-urgent or has a higher processing complexity. This can ensure the accuracy of the information response processing; when the first information is urgent or has a lower processing complexity, the first information can be responded to and processed through the first processing mode. This can not only improve the timeliness of the information response processing, but also save computing resources.

[0037] In some optional embodiments, determining the target information processing mode according to the first information includes:

[0038] Using a recognition model corresponding to second information, performing processing mode recognition on the first information to obtain the target processing mode; wherein the second information includes at least one of the following: current application scenario information, and an information format type of the first information; the information format type including at least one of an audio format, a text format, and an image format;

[0039] or,

[0040] The type of information content of the first information is identified, and the target processing mode is determined according to the type of information content of the first information.

[0041] In some optional embodiments, the above-mentioned application scenario information is used to indicate the application scenario, wherein the application scenario can be reasonably divided according to actual needs, for example, it can include indoor scenes, outdoor scenes, etc., or it can include home scenes, commercial scenes, etc. Exemplarily, the current application scenario information can be identified by collecting image information or video information of the current environment; or, the application scenario information pre-set by the user can be used as the current application scenario information. For example, before the information processing method provided by the embodiment of the present disclosure is enabled or before the first information is obtained, the application scenario information set by the user can be received, so that the recognition model can be selected based on the application scenario information set by the user most recently.

[0042] The aforementioned information format types include at least one of audio format, text format, and image format. It will be appreciated that audio format is used to represent the information format of audio signals, text format is used to represent the format of text information, and image format is used to represent the format of image information. In other words, information in audio format is an audio signal, information in text format is text information, and information in image format is image information.

[0043] For example, corresponding recognition models can be trained for different application scenarios. Since the same information may represent different meanings in different application scenarios, obtaining the corresponding recognition model based on the current application scenario information to perform processing mode recognition is conducive to improving the accuracy of processing mode recognition; or, corresponding recognition models can be trained for different information format types. For example, corresponding recognition models can be trained for audio format, text format and image format respectively. In this way, for the acquired audio signal, the recognition model corresponding to the audio format is used to perform processing mode recognition, for the acquired text information, the recognition model corresponding to the text format is used to perform processing mode recognition, and for the acquired image information, the recognition model corresponding to the image format is used to perform processing mode recognition; or, the recognition model can be trained separately based on the two parameters of application scenario and information format type, that is, the recognition model can be trained separately for different combinations of application scenarios and information format types.

[0044] It can be understood that the above video information includes audio signals and image information, and at least one of the recognition mode corresponding to the audio format and the recognition model corresponding to the image format can be used to perform processing mode recognition on the video information.

[0045] The model algorithms of the recognition models corresponding to the above-mentioned different information format categories can be reasonably selected according to needs. Among them, the model algorithms of the recognition models corresponding to different information format categories can be the same, or they can be different. For example, for audio format, the model algorithm of the corresponding recognition model can be Support Vector Machine (SVM); for text format, the model algorithm of the corresponding recognition model can be a language model, such as Llama, Gemma, and other small language models. Optionally, the small language model can be a language model within 0.5B; for image format, the model algorithm of the corresponding recognition model can be SVM or convolutional neural network, etc.

[0046] Exemplarily, the initial model corresponding to each information format type can be trained based on training samples of each information format type to obtain a recognition model for each information format type, wherein the above training samples are all labeled with a processing mode label and an information content type label. The processing mode label is used to indicate the processing mode corresponding to the training sample. The processing mode may include but is not limited to a first processing mode and a second processing mode. For example, the processing mode may include a first processing mode, a second processing mode, and an ignore mode, and the ignore mode indicates that the training sample is not processed. The above information content type label is used to indicate the type of information content of the training sample, such as fire alarm-related content, rescue-related content, explosion-related content, other content, etc., wherein the above information content type can be reasonably set according to actual needs. In this way, the recognition model trained based on the above training samples can identify the type of information content of the acquired information, and then the above recognition model can identify the processing mode of the acquired information based on the type of information content of the acquired information.

[0047] Exemplarily, when the recognition model corresponding to the second information is determined, the information content of the input first information can be identified through the recognition model to obtain the type of the information content of the first information, and then the processing mode of the information content type of the first information can be identified through the recognition model to output the target processing mode. For example, when the type of the information content of the above-mentioned first information is an information content type related to emergency situations such as fire and rescue, the output target processing mode can be the first processing mode, otherwise the output target processing mode can be the second processing mode.

[0048] In this embodiment, the corresponding recognition model is determined based on the current application scenario information and the information format type of the first information, and the processing mode recognition of the first information is performed based on the determined recognition model, which is conducive to improving the accuracy of the processing mode recognition of the acquired information.

[0049] In other optional embodiments, the type of the information content of the first information can be identified, and then the target processing mode can be determined based on the type of the information content of the first information. It should be noted that the above-mentioned identification of the type of the information content of the first information can be based on a pre-trained model to identify the type of the information content of the first information, or it can be based on a non-model method to identify the type of the information content of the first information, wherein the above-mentioned non-model method can be relative to the method based on pre-trained model identification, and is used to characterize that the type of the information content of the first information is not identified through a pre-trained model. This embodiment is described below with reference to examples.

[0050] In the case where the first information includes text information, the type of information content of the text information can be identified by regular matching or the like. For example, regular matching can be used to identify whether the text information includes at least one preset word, wherein the preset word can be reasonably set according to needs, for example, words related to help, alarm, etc. If the text information includes at least one preset word, it can be determined that the type of information content of the text information is an information content type related to emergency situations such as fire and help. In this case, the target processing mode can be determined to be the first processing mode; if the text information does not include the preset word, it can be determined that the type of information content of the text information is not an information content type related to emergency situations such as fire and help. In this case, the target processing mode can be determined to be the second processing mode.

[0051] In the case where the first information includes image information, the type of information content of the image information is identified by image feature analysis (e.g., color feature analysis, shape feature analysis, texture feature analysis, posture analysis, motion analysis, etc.). For example, image analysis can be used to identify whether the image information includes smoke features, flame features, preset postures, preset actions, etc., wherein the preset posture features and preset actions can be reasonably set according to actual needs. For example, the preset postures can include lying down, covering the mouth and nose with hands, etc.; the preset actions can include falling, asking for help (e.g., a hand gesture), physical conflict between objects, and violent destruction of objects. If it is identified that the image information includes at least one of the smoke features, flame features, preset postures, and preset actions, it can be determined that the type of information content of the image information is information content related to emergency situations such as fires and calls for help. In this case, the target processing mode can be determined to be the first processing mode. If the image information does not include smoke features, flame features, preset postures, and preset actions, it can be determined that the type of information content of the image information is not information content related to emergency situations such as fires and calls for help. In this case, the target processing mode can be determined to be the second processing mode.

[0052] In the case where the first information includes an audio signal, the type of information content of the audio signal can be identified through audio feature analysis (time domain feature analysis, frequency domain feature analysis, inverse frequency domain feature analysis, etc.). For example, audio feature analysis can be used to identify whether the audio signal includes audio features that match explosions, alarms, etc. If the audio signal includes audio features that match explosions, alarms, etc., then the type of information content of the audio signal can be determined to be an information content type related to emergency situations such as fires and calls for help. In this case, the target processing mode can be determined to be the first processing mode. If the audio signal does not include audio features that match explosions, alarms, etc., then the type of information content of the audio signal can be determined not to be an information content type related to emergency situations such as fires and calls for help. In this case, the target processing mode can be determined to be the second processing mode.

[0053] When the first information includes video information, the type of the information content of the video information can be identified by at least one of image feature analysis, audio feature analysis, etc. The methods based on image feature analysis and audio feature analysis can be found in the above description and will not be elaborated here.

[0054] In this embodiment, the type of information content of the first information is identified, and the target processing mode is determined based on the type of information content of the first information. This can reduce the implementation complexity and hardware requirements while ensuring the accuracy of processing mode identification for the acquired information.

[0055] In some optional embodiments, when the processing mode includes an ignore mode in addition to the first processing mode and the second processing mode, if the first information is identified as invalid or meaningless information or information that does not need to be processed, etc., the processing mode of the first information can be determined to be the ignore mode; if the first information is identified as not invalid or meaningless information or information that does not need to be processed, etc., it can be identified whether the type of information content of the first information is an information content type related to emergency situations such as fire and rescue. If so, the target processing mode can be determined to be the first processing mode; otherwise, the target processing mode can be determined to be the second processing mode. It should be noted that if the processing mode of the first information is determined to be the ignore mode, the process can be terminated and the step of obtaining the first information can be returned to.

[0056] For example, in the case where the first information is an audio signal, if the audio signal is identified as a noise signal, an interference signal, or a meaningless signal, etc., then the processing mode of the first information can be determined to be the ignore mode; in the case where the first information is text information, if the text information is identified as meaningless or invalid text information (for example, text information that only includes modal particles) or text information that does not need to be processed (for example, text information that is exactly the same as the text information processed previously, etc.), then the processing mode of the first information can be determined to be the ignore mode; in the case where the first information is image information, if the image information is identified as meaningless or invalid image information (for example, a noise image or image information that does not include any valid information content, etc.) or image information that does not need to be processed If the first information is video information (for example, image information with exactly the same information content as the image information processed previously), etc., then the processing mode of the first information can be determined to be the ignore mode; in the case where the first information is video information, it can be determined based on at least one of the image information and audio signal of the video information whether the video information is invalid or meaningless information or information that does not need to be processed, etc. For example, if it is identified that the image information and audio signal of the video information are both invalid or meaningless information or information that does not need to be processed, etc., then the processing mode of the first information can be determined to be the ignore mode, or if it is identified that any one of the image information and audio signal of the video information is invalid or meaningless information or information that does not need to be processed, etc., then the processing mode of the first information can be determined to be the ignore mode.

[0057] In some optional embodiments, when the first information includes the text information, determining the target processing mode based on the first information may include: performing processing mode identification on the text information, obtaining the processing mode corresponding to the text information, and determining the processing mode corresponding to the text information as the target processing mode.

[0058] Exemplarily, when the first information includes text information, the text information can be identified based on the recognition model corresponding to the text format to obtain the processing mode corresponding to the text information. For example, the type of information content of the text information can be identified based on the recognition model corresponding to the text format, and the processing mode corresponding to the text information can be output based on the type of information content of the text information through the recognition model corresponding to the text format, and the processing mode corresponding to the text information can be used as the target processing mode.

[0059] In some optional embodiments, when the first information includes audio information, determining the target processing mode based on the first information may include: performing processing mode identification on the audio information, obtaining the processing mode corresponding to the audio information, and determining the processing mode corresponding to the audio information as the target processing mode.

[0060] Exemplarily, when the first information includes an audio signal, the audio signal can be identified based on a recognition model corresponding to the audio format to obtain a processing mode corresponding to the audio signal. For example, the type of information content of the audio signal can be identified based on the recognition model corresponding to the audio format, and the processing mode corresponding to the audio signal can be output based on the type of information content of the audio signal through the recognition model corresponding to the audio format, and the processing mode corresponding to the audio signal can be used as the target processing mode.

[0061] In some optional embodiments, the first information includes an audio signal, and determining the target processing mode according to the first information includes:

[0062] Performing processing mode recognition on the audio signal to obtain a processing mode corresponding to the audio signal;

[0063] When the processing mode corresponding to the audio signal is the first processing mode, determining that the target processing mode is the first processing mode;

[0064] When the processing mode corresponding to the audio signal is the second processing mode, processing mode recognition is performed on the first text information corresponding to the audio signal to obtain the processing mode corresponding to the first text information, and the target processing mode is determined to be the processing mode corresponding to the first text information, where the first text information is text information obtained by performing speech recognition on the audio signal.

[0065] Exemplarily, an audio analog signal can be collected by a microphone, the collected audio analog signal can be converted into an audio digital signal, and processing mode recognition can be performed on the audio digital signal. If the processing mode is recognized as the first processing mode, the target processing mode is determined to be the first processing mode. If the processing mode is recognized as the second processing mode, the audio digital signal can be converted into text information through speech recognition, and processing mode recognition can be performed on the text information, wherein the target processing mode is the result of processing mode recognition of the text information.

[0066] Exemplarily, the above-mentioned processing mode recognition of the audio signal may be to perform processing mode recognition on the audio signal using a recognition model corresponding to the audio format; the above-mentioned processing mode recognition of the first text information may be to perform processing mode recognition on the first text information using a recognition model corresponding to the text format.

[0067] In this embodiment, for the acquired audio signal, processing mode identification can be performed from two dimensions: audio and text. Specifically, when the processing mode of the audio signal is identified as the first processing mode from the audio dimension, the target processing mode can be determined to be the first processing mode; when the processing mode of the audio signal is identified as the second processing mode from the audio dimension, processing mode identification can be continued for the text information converted from the audio signal from the text dimension, wherein the target processing mode is the processing mode identified based on the text information. This is conducive to more comprehensive identification of emergencies, and thus helps to improve the speed of responding to emergencies.

[0068] In some optional embodiments, when the first information includes image information, determining the target processing mode based on the first information may include: performing processing mode identification on the image information, obtaining the processing mode corresponding to the image information, and determining the processing mode corresponding to the image information as the target processing mode.

[0069] Exemplarily, when the first information includes image information, the image information can be identified based on the recognition model corresponding to the image format to obtain a processing mode corresponding to the image information. For example, the type of information content of the image information can be identified based on the recognition model corresponding to the image format, and the processing mode corresponding to the image information can be output based on the type of information content of the image information through the recognition model corresponding to the image format, and the processing mode corresponding to the image information can be used as the target processing mode.

[0070] Exemplarily, when the above-mentioned first information includes multiple frames of image information, the processing mode recognition can be performed on each frame of image information separately. For example, the processing mode recognition can be performed on each frame of image information separately through the recognition model corresponding to the image format to obtain the processing mode corresponding to each frame of image information. If there is at least one frame of image information whose corresponding processing mode is the first processing mode, the target processing mode is determined to be the first processing mode. If the processing modes corresponding to all image information are the second processing mode, the target processing mode is determined to be the second processing mode. Alternatively, action recognition can be performed based on multiple frames of image information, and the processing mode corresponding to the above-mentioned multiple frames of image information can be determined according to the recognized action. For example, action recognition can be performed on the input multiple frames of image information through the recognition model corresponding to the image format, and the processing mode corresponding to the above-mentioned multiple frames of image information can be determined according to the recognized action. In this case, the above-mentioned multiple frames of image information correspond to the same processing mode.

[0071] In some optional embodiments, the first information includes video information, and determining the target processing mode according to the first information includes:

[0072] performing processing mode recognition on the image information in the video information to obtain a processing mode corresponding to the image information, and determining the processing mode corresponding to the image information as the target processing mode;

[0073] or,

[0074] performing processing mode recognition on the audio signal in the video information to obtain a processing mode corresponding to the audio signal, and determining the processing mode corresponding to the audio signal as the target processing mode;

[0075] or,

[0076] Perform processing mode identification on the image information in the video information to obtain the processing mode corresponding to the image information, and perform processing mode identification on the audio signal in the video information to obtain the processing mode corresponding to the audio signal. When either the processing mode corresponding to the audio signal or the processing mode corresponding to the image information is the first processing mode, determine that the target processing mode is the first processing mode; otherwise, determine that the target processing mode is the second processing mode.

[0077] In some optional embodiments, when the first information includes video information, the target processing mode can be determined based on the image information in the video information. This method is relatively simple to implement and is conducive to saving computing resources. For example, the processing mode of the image information in the video information can be identified based on the recognition model corresponding to the image format, and the identified processing mode of the image information can be used as the target processing mode.

[0078] It should be noted that, for the specific implementation of determining the target processing mode based on the image information in the video information, reference may be made to the aforementioned related description of determining the target processing mode based on the image information, which will not be elaborated here.

[0079] In other optional embodiments, the target processing mode can be determined based on the audio signal in the video information. This approach is relatively simple to implement and helps save computing resources. For example, the processing mode of the audio signal in the video information can be identified based on the recognition model corresponding to the audio format, and the identified processing mode of the audio signal can be used as the target processing mode.

[0080] It should be noted that the specific implementation of determining the target processing mode based on the audio signal in the video information can refer to the above-mentioned related description of determining the target processing mode based on image information, which will not be repeated here.

[0081] In other optional embodiments, the target processing mode can be determined by combining the image information and audio signals in the video information. This approach is conducive to more comprehensive identification of emergency situations, and thus is conducive to improving the speed of responding to emergency situations. For example, the processing mode of the image information in the video information can be identified based on the recognition model corresponding to the image format, and the processing mode of the audio signal in the video information can be identified based on the recognition model corresponding to the audio format. If either the processing mode of the identified image signal or the processing mode of the identified audio signal is the first processing mode, the target processing mode is determined to be the first processing mode; otherwise, the target processing mode is determined to be the second processing mode.

[0082] In some optional embodiments, the first information includes video information, and determining the target processing mode according to the first information includes:

[0083] performing processing mode identification on the third information in the video information to obtain a processing mode corresponding to the third information;

[0084] When the processing mode corresponding to the third information is the first processing mode, determining that the target processing mode is the first processing mode;

[0085] When the processing mode corresponding to the third information is the second processing mode, performing processing mode recognition on the fourth information in the video information to obtain the processing mode corresponding to the fourth information, and determining the target processing mode according to the processing mode corresponding to the fourth information;

[0086] Wherein, one of the third information and the fourth information is image information, and the other is an audio signal.

[0087] Exemplarily, the above-mentioned processing mode recognition of the audio signal in the video information may be to perform processing mode recognition on the audio signal in the video information using a recognition model corresponding to the audio format; the above-mentioned processing mode recognition of the image information in the video information may be to perform processing mode recognition on the image information in the video information using a recognition model corresponding to the image format.

[0088] It should be noted that, for the specific processing method of performing processing mode recognition on the audio signal in the video information, reference can be made to the relevant description of performing processing mode recognition on the audio signal in the aforementioned embodiment, which will not be repeated here; for the specific processing method of performing processing mode recognition on the image information in the video information, reference can be made to the relevant description of performing processing mode recognition on the image information in the aforementioned embodiment, which will not be repeated here.

[0089] In some optional embodiments, the third information may be image information, and the fourth information may be an audio signal. That is, this embodiment prioritizes recognition from the image dimension. When the processing mode of the image information in the video information is recognized as the first processing mode from the image dimension, the target processing mode can be determined to be the first processing mode. For example, the processing mode can be recognized for each frame of image information in the video information. If the processing mode corresponding to at least one frame of image information in the video information is the first processing mode, the target processing mode is determined to be the first processing mode. Alternatively, action recognition can be performed based on all frames of image information in the video information, and the processing mode of the image information in the video information is determined based on the recognized action. When the processing mode of the image information in the video information is recognized as the second processing mode from the image dimension, for example, the processing mode corresponding to all image information in the video information is the second processing mode, the processing mode recognition of the audio signal in the video information can be continued from the audio dimension, and the target processing mode can be determined based on the processing mode corresponding to the audio signal in the video information.

[0090] Because this embodiment integrates image and audio dimensions to identify emergency-related content, it facilitates more comprehensive identification of emergencies, thereby improving the speed of emergency response. Furthermore, because this embodiment prioritizes recognition based on image dimensions, and only proceeds to audio dimensions if emergency-related content cannot be identified based on image dimensions, this helps conserve computing resources.

[0091] In other optional embodiments, the third information may be an audio signal, and the fourth information may be image information. That is, this embodiment prioritizes recognition from the audio dimension. When the processing mode of the audio signal in the video information is recognized as the first processing mode from the audio dimension, the target processing mode may be determined to be the first processing mode. When the processing mode of the audio signal in the video information is recognized as the second processing mode from the audio dimension, the processing mode recognition may continue from the image dimension for the image information in the video information, and the target processing mode may be determined based on the processing mode corresponding to the image information in the video information. For example, the processing mode recognition may be performed for each frame of image information in the video information. If the processing mode corresponding to at least one frame of image information is the first processing mode, the target processing mode may be determined to be the first processing mode. If the processing mode corresponding to all frames of image information in the video information is the second processing mode, the target processing mode may be determined to be the second processing mode. Alternatively, action recognition may be performed based on all frames of image information in the video information, and the processing mode of the image information in the video information may be determined based on the recognized action.

[0092] Because this embodiment integrates audio and image dimensions to identify emergency-related content, it facilitates more comprehensive identification of emergencies, thereby improving the speed of emergency response. In addition, because this embodiment prioritizes recognition based on the audio dimension and only proceeds to image dimensions if emergency-related content cannot be identified based on the audio dimension, this helps conserve computing resources.

[0093] In some optional embodiments, the processing mode of the text information converted from the audio signal in the video signal can be further identified. For example, when the processing mode corresponding to the fourth information is the second processing mode, the processing mode of the second text information converted from the audio signal in the video signal is identified, and the target processing mode is determined to be the processing mode corresponding to the second text information.

[0094] In some optional embodiments, the adopting the target processing mode to perform response processing on the first information includes:

[0095] When the target processing mode is the first processing mode, determining a first response behavior corresponding to the first information based on a preset mapping relationship between information content type and response behavior, and executing the first response behavior;

[0096] and / or,

[0097] When the target processing mode is the second processing mode, performing intent recognition on the first information based on a preset model to obtain a target intent;

[0098] A task request is generated according to the target intention, and a service module corresponding to the task request is called to process the task request.

[0099] In this embodiment, the above-mentioned first processing mode is used to respond to the first information based on the mapping relationship between the type of information content and the response behavior. The type of the above-mentioned information content can be reasonably set according to actual needs, for example, fire alarm-related content, medical rescue-related content, illegal infringement-related content, etc. Optionally, the type of each of the above-mentioned information contents can be further subdivided into multiple subtypes, for example, further divided into multiple subtypes according to the degree of fire. The response behavior corresponding to each type of information content can also be reasonably set according to actual needs. For example, the response behavior corresponding to the above-mentioned fire alarm-related content may include dialing the fire alarm, starting the installed fire-fighting equipment to extinguish the fire, starting the fire alarm, etc. The response behavior corresponding to the above-mentioned medical rescue-related content may include dialing the medical rescue phone, notifying relevant personnel, etc. The response behavior corresponding to the above-mentioned illegal infringement-related content may include dialing the police phone, notifying relevant personnel, etc.

[0100] Specifically, when the target processing mode is the first processing mode, a response action corresponding to the type of the first message's content can be obtained based on the preset mapping relationship and the type of the first message's content, and the response action can be executed. For example, if the first message's content is identified as a fire alarm, a fire alarm can be dialed and installed firefighting equipment can be activated to extinguish the fire.

[0101] In some optional embodiments, in the process of identifying the processing mode of the first information through the recognition pattern, the type of the information content of the first information can be identified through the recognition model. Then, when the processing mode of the first information is the first processing mode, the first response behavior can be determined directly based on the type of the information content of the first information identified by the recognition model and the preset mapping relationship, which can further improve the response speed.

[0102] The above-mentioned second processing mode is used to respond to the first information based on a preset model. The above-mentioned preset model can be a large model, for example, a large language model such as LLaMA2, PaLM2, GPT-4, etc. Specifically, when the target processing mode is the second processing mode, the first information can be subjected to intent recognition based on the preset model to obtain the target intent, generate a task request according to the target intent, and call the service module corresponding to the task request to process the task request, wherein the above-mentioned service module can include but is not limited to a knowledge base query module, a weather query module, an email processing module, a payment module, a music module, a video module, a smart home control module, etc. For example, in the case where the first information is a voice signal input by the user "What's the weather like today", if the target intention identified based on the preset model is to query today's weather, a task request can be generated based on the target intention, and the weather query module can be called based on the task request to obtain weather information, and a reply message can be generated based on the obtained weather information and voice broadcast can be performed; in the case where the first information is the collected image information of the environment, if the target intention identified based on the preset model is to clean the floor, a task request can be generated based on the target intention, and the smart home control module can be called based on the task request to start the sweeping robot to clean the floor.

[0103] In some optional embodiments, the above service module may also be referred to as an external tool.

[0104] In some optional embodiments, in the process of identifying the processing mode of the first information through the recognition model, the type of information content of the first information can be identified through the recognition model, and the type of information content of the first information and the first information can be input into the preset model for intent recognition, which is conducive to improving the efficiency and accuracy of intent recognition.

[0105] In some optional embodiments, the target intent may include multiple intents. In this case, a corresponding task request may be generated based on each of the multiple intents, and the corresponding service module may be called to process the task request. Each task request may include a task type and task parameters, and optionally, a task priority.

[0106] In some optional embodiments, a task management module may be provided to manage task requests. For example, the task management module receives each generated task request, calls a corresponding service module for processing based on each task request, and returns the processing results of each service module.

[0107] In this embodiment, when the target processing mode is the first processing mode, the first information is response-processed based on the mapping relationship between the type of information content and the response behavior, which is conducive to further improving the speed of response processing; when the target processing mode is the second processing mode, the first information is response-processed based on the preset model, which can ensure the accuracy of response processing and ensure response processing for complex tasks.

[0108] In some optional embodiments, when the target processing mode is the first processing mode, after responding to the first information using the target processing mode, the method further includes:

[0109] Performing response processing on the first information using the second processing mode to obtain a first processing result, where the first processing result is used to indicate a response behavior to the first information based on the second processing mode;

[0110] When the response behavior indicated by the first processing result is inconsistent with the second response behavior, the response behavior indicated by the first processing result is executed and the second response behavior is canceled. The second response behavior is the response behavior determined by responding to the first information using the first processing mode.

[0111] In this embodiment, after the first information is quickly responded to and processed based on the first processing mode, the second processing mode can be used to respond to and process the first information to obtain a first processing result. For example, the intention of the first information can be identified based on a preset model, and the corresponding response behavior, i.e., the first processing result, can be determined based on the identified intention. If the response behavior indicated by the first processing result is inconsistent with the response behavior (i.e., the second response behavior) determined by responding to and processing the first information using the target processing mode, the response behavior indicated by the first processing result can be executed, and the second response behavior can be stopped.

[0112] For example, the first information is a voice signal input by the user "Play the roof is on fire". By performing processing mode recognition on the text information converted from the voice signal, the target processing mode is obtained as the first processing mode. The response behavior determined by the response processing of the first information based on the first processing mode is to turn on the fire alarm and activate the fire alarm. Afterwards, the first information can be responded to based on the second processing mode, and the response behavior indicated by the first processing result obtained is to play the song Roof is on Fire. In this case, the fire alarm can be canceled, and the music module can be called to play the song Roof is on Fire.

[0113] It can be understood that, when the response behavior indicated by the first processing result is consistent with the second response behavior, the process can be terminated.

[0114] This embodiment checks the processing result based on the first processing mode through the second processing mode, which is conducive to improving the accuracy and reliability of information processing.

[0115] In some optional embodiments, obtaining the first information includes:

[0116] receiving first information input by a user;

[0117] After the target processing mode is used to respond to the first information, the method further includes:

[0118] generating a reply message according to third information, wherein the third information includes the second processing result, or the third information includes the second processing result and current context information, wherein the second processing result is a processing result obtained by responding to the first information using the target processing mode;

[0119] The reply information is output.

[0120] Exemplarily, the above-mentioned situation information may include at least one of information about the current environment (eg, noisy, quiet, etc.), the user's current state (eg, the user's current behavior, the user's current mood, etc.), and the like.

[0121] For scenarios of interaction with users, after the target processing mode is used to respond to the first information, a reply message can be generated based on the processing result and output to improve the user's interactive experience. For example, when the first information is a voice signal input by the user "What is the weather like today", the above-mentioned second processing result can be the weather information obtained by calling the weather query module, and the above-mentioned reply information can be a voice reply message "The weather today is light rain".

[0122] In some optional embodiments, a reply message may be generated based on the second processing result and the current situational information. For example, when the current situational information indicates that the current environment is relatively noisy, the volume of the generated voice reply message may be higher; when the current situational information indicates that the current environment is relatively quiet, the volume of the generated voice reply message may be lower. This helps to make the output reply message more in line with user needs.

[0123] The following is an example of the functional modules used to implement the information processing method provided in this embodiment:

[0124] For example, Figure 2 As shown, the above-mentioned electronic device (for example, interactive device) may include an information access processing module, an information processing module, a task management module, a reply control module, an external tool docking module and an information storage module.

[0125] Among them, the above-mentioned information access processing module can be used to: collect external audio signals through a microphone, identify the processing mode corresponding to the audio signal through the recognition model corresponding to the audio signal (for example, SVM), if the processing mode is a fast system mode, then the voice signal and the type of information content of the recognized voice signal are stored in the information storage module, and a notification message corresponding to the fast system mode is sent to the reply control module; if the processing mode is a slow system mode, then the voice signal is converted into text information through voice recognition, and the processing mode corresponding to the text information is identified through the recognition model corresponding to the text information (for example, a small language model), if the processing mode is a slow system mode, then the text information and the type of information content of the recognized text information are stored in the information storage module, and a notification message corresponding to the slow system mode is sent to the information processing module; if the processing mode is a fast system mode, then the text information and the type of information content of the recognized text information are stored in the information storage module, and a notification message corresponding to the fast system mode is sent to the reply control module.

[0126] The above-mentioned information processing module can be used to: when receiving a notification message sent by the information access processing model, obtain the information to be processed from the information storage module for processing, store the result in the information storage module after processing is completed, and notify the reply control module.

[0127] Exemplarily, the information processing module may process the information to be processed by:

[0128] Identify intent, determine priority, split tasks, submit tasks to the task management module, receive task feedback returned by the task management module, and call the large language model to process task feedback.

[0129] For example, the above-mentioned information processing module can summarize the information in the slow system notification, interrupt information queue and task status information of the same time period, that is, information aggregation, wherein the slow system notification represents the notification message corresponding to the slow system mode, the interrupt information queue is used to record the processing results of the fast system mode, the interrupt processing information, etc., and the task status information may include the status information of the task request execution (for example, the task request execution is completed, the task request is being executed, etc.). After information aggregation, the above-mentioned information processing module can pass the summarized information to the large model for intent recognition and multi-intent splitting, and can generate a task request based on the recognized intent, and can pass the task request to the large model for task request splitting and task parameter extraction, as well as start a new task or stop an existing task according to the task request, etc. Specifically, the above-mentioned information processing module can send the task request to the task management module, start a new task or stop an existing task through the task management module, and receive task feedback from the information processing module, such as task results or status information, and pass the task feedback and current scenario information to the large model, and the large model generates a processing result, and stores the processing result in the processing result queue.

[0130] The task management module can be used to receive task requests from the information processing module, call the external tool docking module to execute tasks, and feed back the external tool execution results (ie, task feedback) to the information processing module.

[0131] The external tool docking module can be used to call the corresponding external tool, ie, the service module, according to the type of task request.

[0132] The reply control module may be configured to: upon receiving a reply request, convert the reply information into a voice signal and feed it back to the user.

[0133] Exemplarily, the reply control module can obtain the processing result from the processing result queue, convert it into an audio signal through voice synthesis, and output it to the speaker for playback; in addition, when the reply control module receives the notification message corresponding to the fast system mode, it can stop the processing result currently being processed, and respond to the pending information corresponding to the notification message based on the fast system mode, generate a reply message, convert it into an audio signal through voice synthesis, and output it to the speaker for playback; wherein, the reply control module can record the processing result corresponding to the fast system mode and the processing result of the current interrupt processing in the interrupt information queue.

[0134] The information processing method provided in the embodiment of the present disclosure can be executed by an information processing device. In the embodiment of the present disclosure, the information processing device provided in the embodiment of the present disclosure is described by taking the information processing device executing the information processing method as an example.

[0135] See also Figure 3 , Figure 3is a structural diagram of an information processing device provided by an embodiment of the present disclosure, such as Figure 3 As shown, the information processing device 300 includes:

[0136] An acquisition module 301 is configured to acquire first information, where the first information includes at least one of collected information and received information;

[0137] a determination module 302, configured to determine a target processing mode based on the first information, where the target processing mode includes a first processing mode or a second processing mode, wherein an information processing speed of the first processing mode is faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode is lower than an information processing complexity of the second processing mode;

[0138] The first processing module 303 is configured to perform response processing on the first information using the target processing mode.

[0139] In some optional embodiments, the determining module 302 is specifically configured to:

[0140] Using a recognition model corresponding to second information, performing processing mode recognition on the first information to obtain the target processing mode; wherein the second information includes at least one of the following: current application scenario information, and an information format type of the first information; the information format type including at least one of an audio format, a text format, and an image format;

[0141] or,

[0142] The type of information content of the first information is identified, and the target processing mode is determined according to the type of information content of the first information.

[0143] In some optional embodiments, the first information includes an audio signal, and the determining module 302 is specifically configured to:

[0144] Performing processing mode recognition on the audio signal to obtain a processing mode corresponding to the audio signal;

[0145] When the processing mode corresponding to the audio signal is the first processing mode, determining that the target processing mode is the first processing mode;

[0146] When the processing mode corresponding to the audio signal is the second processing mode, processing mode recognition is performed on the first text information to obtain the processing mode corresponding to the first text information, and the target processing mode is determined to be the processing mode corresponding to the first text information, where the first text information is text information obtained by performing speech recognition on the audio signal.

[0147] In some optional embodiments, the first information includes video information, and the determining module 302 is specifically configured to:

[0148] performing processing mode recognition on the image information in the video information to obtain a processing mode corresponding to the image information, and determining the processing mode corresponding to the image information as the target processing mode;

[0149] or,

[0150] performing processing mode recognition on the audio signal in the video information to obtain a processing mode corresponding to the audio signal, and determining the processing mode corresponding to the audio signal as the target processing mode;

[0151] or,

[0152] performing processing mode recognition on image information in the video information to obtain a processing mode corresponding to the image information, and performing processing mode recognition on an audio signal in the video information to obtain a processing mode corresponding to the audio signal, and if either the processing mode corresponding to the audio signal or the processing mode corresponding to the image information is the first processing mode, determining the target processing mode to be the first processing mode; otherwise, determining the target processing mode to be the second processing mode;

[0153] or,

[0154] Perform processing mode identification on the third information in the video information to obtain the processing mode corresponding to the third information; when the processing mode corresponding to the third information is the first processing mode, determine the target processing mode to be the first processing mode; when the processing mode corresponding to the third information is the second processing mode, perform processing mode identification on the fourth information in the video information to obtain the processing mode corresponding to the fourth information, and determine the target processing mode according to the processing mode corresponding to the fourth information; wherein, one of the third information and the fourth information is image information, and the other is an audio signal.

[0155] In some optional embodiments, the first processing module 303 is specifically configured to:

[0156] When the target processing mode is the first processing mode, determining a first response behavior corresponding to the first information based on a preset mapping relationship between information content type and response behavior, and executing the first response behavior;

[0157] and / or,

[0158] When the target processing mode is the second processing mode, performing intent recognition on the first information based on a preset model to obtain a target intent;

[0159] A task request is generated according to the target intention, and a service module corresponding to the task request is called to process the task request.

[0160] In some optional embodiments, the device further comprises:

[0161] a second processing module configured to, when the target processing mode is the first processing mode, after performing response processing on the first information using the target processing mode, perform response processing on the first information using the second processing mode to obtain a first processing result, where the first processing result is used to indicate a response behavior to the first information based on the second processing mode;

[0162] The third processing module is used to execute the response behavior indicated by the first processing result and cancel the second response behavior when the response behavior indicated by the first processing result is inconsistent with the second response behavior. The second response behavior is the response behavior determined by responding to the first information using the first processing mode.

[0163] In some optional embodiments, the acquisition module 301 is specifically configured to receive first information input by a user;

[0164] The device further comprises:

[0165] a generating module configured to generate reply information based on third information after the first information is processed in response to the target processing mode, wherein the third information includes a second processing result, or the third information includes the second processing result and current context information, and the second processing result is a processing result obtained by processing the first information in response to the target processing mode;

[0166] An output module is used to output the reply information.

[0167] The information processing device in the embodiment of the present disclosure may be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or a device other than a terminal. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present disclosure does not specifically limit it.

[0168] The information processing device in the embodiments of the present disclosure may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present disclosure.

[0169] The information processing device provided by the embodiment of the present disclosure can realize Figure 1 To avoid repetition, the various processes implemented in the method embodiment are not described here.

[0170] See also Figure 4 , Figure 4 is a schematic diagram of the structure of an electronic device provided by the present disclosure, such as Figure 4 As shown, the electronic device 400 includes: a processor 401, a memory 402, and a computer program stored in the memory 402 and executable on the processor. When the computer program is executed by the processor 401, the following steps are implemented:

[0171] Acquiring first information, where the first information includes at least one of collected information and received information;

[0172] determining a target processing mode according to the first information, the target processing mode including a first processing mode or a second processing mode, an information processing speed of the first processing mode being faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode being lower than an information processing complexity of the second processing mode;

[0173] The target processing mode is used to perform response processing on the first information.

[0174] It should be understood that in the embodiment of the present disclosure, when the computer program is executed by the processor 401, it can implement each process in the above-mentioned information processing method embodiment. To avoid repetition, it will not be described here.

[0175] An embodiment of the present disclosure also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned information processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0176] The embodiments of the present disclosure also provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned information processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0177] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0178] An embodiment of the present disclosure further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned information processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0179] It should be understood that the chip mentioned in the embodiments of the present disclosure can also be called a system-level chip, a system chip, a chip system, or a system-on-chip chip, etc.

[0180] An embodiment of the present disclosure provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned information processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0181] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present disclosure is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0182] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present disclosure is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present disclosure.

[0183] The embodiments of the present disclosure are described above in conjunction with the accompanying drawings, but the present disclosure is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present disclosure, ordinary technicians in this field can also make many forms without departing from the scope of protection of the purpose of the present disclosure and the claims, all of which are protected by the present disclosure.

Claims

1. An information processing method, characterized in that: Applied to electronic equipment, the method includes: Acquiring first information, where the first information includes at least one of collected information and received information; determining a target processing mode according to the first information, the target processing mode including a first processing mode or a second processing mode, an information processing speed of the first processing mode being faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode being lower than an information processing complexity of the second processing mode; The target processing mode is used to perform response processing on the first information.

2. The method according to claim 1, characterized in that The determining of the target information processing mode according to the first information includes: Using a recognition model corresponding to second information, performing processing mode recognition on the first information to obtain the target processing mode; wherein the second information includes at least one of the following: current application scenario information, and an information format type of the first information; the information format type including at least one of an audio format, a text format, and an image format; or, The type of information content of the first information is identified, and the target processing mode is determined according to the type of information content of the first information.

3. The method according to claim 1, characterized in that The first information includes an audio signal, and determining a target processing mode according to the first information includes: Performing processing mode recognition on the audio signal to obtain a processing mode corresponding to the audio signal; When the processing mode corresponding to the audio signal is the first processing mode, determining that the target processing mode is the first processing mode; When the processing mode corresponding to the audio signal is the second processing mode, processing mode recognition is performed on the first text information corresponding to the audio signal to obtain the processing mode corresponding to the first text information, and the target processing mode is determined to be the processing mode corresponding to the first text information, where the first text information is text information obtained by performing speech recognition on the audio signal.

4. The method according to claim 1, wherein The first information includes video information, and determining the target processing mode according to the first information includes: performing processing mode recognition on the image information in the video information to obtain a processing mode corresponding to the image information, and determining the processing mode corresponding to the image information as the target processing mode; or, performing processing mode recognition on the audio signal in the video information to obtain a processing mode corresponding to the audio signal, and determining the processing mode corresponding to the audio signal as the target processing mode; or, performing processing mode recognition on image information in the video information to obtain a processing mode corresponding to the image information, and performing processing mode recognition on an audio signal in the video information to obtain a processing mode corresponding to the audio signal, and if either the processing mode corresponding to the audio signal or the processing mode corresponding to the image information is the first processing mode, determining the target processing mode to be the first processing mode; otherwise, determining the target processing mode to be the second processing mode; or, Perform processing mode identification on the third information in the video information to obtain the processing mode corresponding to the third information; when the processing mode corresponding to the third information is the first processing mode, determine the target processing mode to be the first processing mode; when the processing mode corresponding to the third information is the second processing mode, perform processing mode identification on the fourth information in the video information to obtain the processing mode corresponding to the fourth information, and determine the target processing mode according to the processing mode corresponding to the fourth information; wherein, one of the third information and the fourth information is image information, and the other is an audio signal.

5. The method according to claim 1, wherein The adopting the target processing mode to perform response processing on the first information includes: When the target processing mode is the first processing mode, determining a first response behavior corresponding to the first information based on a preset mapping relationship between information content type and response behavior, and executing the first response behavior; and / or, When the target processing mode is the second processing mode, performing intent recognition on the first information based on a preset model to obtain a target intent; A task request is generated according to the target intention, and a service module corresponding to the task request is called to process the task request.

6. The method according to any one of claims 1 to 5, characterized in that When the target processing mode is the first processing mode, after responding to the first information using the target processing mode, the method further includes: Performing response processing on the first information using the second processing mode to obtain a first processing result, where the first processing result is used to indicate a response behavior to the first information based on the second processing mode; When the response behavior indicated by the first processing result is inconsistent with the second response behavior, the response behavior indicated by the first processing result is executed and the second response behavior is canceled. The second response behavior is the response behavior determined by responding to the first information using the first processing mode.

7. The method according to any one of claims 1 to 5, characterized in that The obtaining of the first information includes: receiving first information input by a user; After the target processing mode is used to respond to the first information, the method further includes: generating a reply message according to the third information, the third information including the second processing result, or the third information including the second processing result and current context information, the second processing result being a processing result obtained by responding to the first information using the target processing mode; The reply information is output.

8. An information processing device, characterized in that Applied to electronic equipment, the device comprises: An acquisition module, configured to acquire first information, where the first information includes at least one of collected information and received information; a determination module, configured to determine a target processing mode based on the first information, the target processing mode including a first processing mode or a second processing mode, wherein an information processing speed of the first processing mode is faster than an information processing speed of the second processing mode, or an information processing complexity of the first processing mode is lower than an information processing complexity of the second processing mode; The first processing module is configured to perform response processing on the first information using the target processing mode.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the information processing method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the information processing method according to any one of claims 1 to 7 are implemented.

Images