Intelligent perception interaction method and system based on large model, terminal and medium

Abstract

The invention provides an intelligent perception interaction method and system based on a large model, a terminal and a medium. The method comprises the following steps: acquiring environment data when a user uses intelligent equipment and dynamic scene data of user behavior habits; scene data modeling is carried out according to the dynamic scene data, and an intelligent sensing interaction scene is constructed according to scene features of modeling data; judging whether the intelligent sensing interaction scene is a pre-defined intelligent sensing interaction scene in an intelligent sensing scene feature library or not; if not, scene reasoning and interactive reasoning are carried out through a pre-trained intelligent sensing large model according to the modeling data; and triggering the target intelligent perception interaction scene to interact with the user according to the reasoned target intelligent perception interaction strategy. According to the method, non-predefined interaction scenes are recognized, analyzed and reasoned by the intelligent sensing large model, the reasoned scenes and strategies are presented to the user, the user completes intelligent sensing interaction according to needs, and better interaction experience is provided for the user.

Description

Technical Field

[0001] The present invention relates to the field of intelligent interaction technology, and in particular to an intelligent perception interaction method, system, terminal and medium based on a large model. Background Art

[0002] With the advancement of science and technology, intelligent perception and interaction capabilities have become an inevitable development trend of human-computer interaction in smart devices.

[0003] Current smart terminals have begun to be equipped with intelligent hardware such as millimeter waves, light sensors, cameras, and voice, which have the ability to perceive user usage environment and user interaction. With the development of AI (Artificial Intelligence) technology, especially the arrival of AI big models in recent years, the comprehensive application of these intelligent hardware has brought about huge technological breakthroughs.

[0004] However, most of the current user perception of smart TVs is still at the level of using big data analysis to perceive user behavior habits, and making targeted content recommendations and building application scenarios through algorithm analysis. This kind of perception can only perceive the scenes generated by the user's control behavior with the TV, and does not have the perception ability outside the TV system and the scene recognition, analysis, and interaction capabilities.

[0005] Therefore, the prior art has defects and needs to be improved and developed. Summary of the invention

[0006] The technical problem to be solved by the present invention is that, in view of the above-mentioned defects of the prior art, an intelligent perception interaction method, system, terminal and medium based on a large model are provided, aiming to solve the problem that the prior art can only perceive the scenes generated by the control behaviors of users and TVs, but does not have the perception ability outside the TV system and the scene recognition, analysis and interaction capabilities.

[0007] The technical solution adopted by the present invention to solve the technical problem is as follows: A large-model-based intelligent perception interaction method, wherein the method comprises: Acquire user interaction data collected by the intelligent sensing hardware and AI algorithm in the smart device, and generate corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device; Performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to scene features of the modeling data; Determining whether the intelligent perception interaction scenario is an intelligent perception interaction scenario predefined in an intelligent perception scenario feature library; When the intelligent perception interaction scenario is not an intelligent perception interaction scenario predefined in the intelligent perception scenario feature library, a pre-trained intelligent perception large model is used to perform scenario reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scenario data to obtain a corresponding target intelligent perception interaction scenario and its corresponding target intelligent perception interaction strategy; The target intelligent perception interaction scenario is triggered according to the target intelligent perception interaction strategy to interact with the user.

[0008] In one implementation, generating corresponding dynamic scene data according to the user interaction data includes: In one implementation, the corresponding dynamic scene data is generated based on the user interaction data and the time axis as the baseline, and after determining whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library, it also includes: If the intelligent perception interaction scenario is an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, the intelligent perception interaction scenario is determined as a target intelligent perception interaction scenario, and a pre-defined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario is obtained from the intelligent perception scenario feature library to obtain a corresponding target intelligent perception interaction strategy.

[0009] In one implementation, after acquiring the predefined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario from the intelligent perception scenario feature library and obtaining the corresponding target intelligent perception interaction strategy, the method further includes: Determining whether the target intelligent perception interaction strategy is effective; The triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy includes: When the target intelligent perception interaction strategy is valid, triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy; When the target intelligent perception interaction strategy fails, the pre-trained intelligent perception big model is used to infer the corresponding intelligent perception interaction strategy based on the target intelligent perception interaction scenario to obtain a new target intelligent perception interaction strategy, and the new target intelligent perception interaction strategy is used to replace the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario, and then the target intelligent perception interaction scenario is triggered to interact with the user according to the new target intelligent perception interaction strategy.

[0010] In one implementation, the determining whether the target intelligent perception interaction strategy is effective includes: Determining the user's satisfaction with the target intelligent perception interaction strategy, and judging whether the satisfaction reaches a preset satisfaction threshold; When the satisfaction reaches the preset satisfaction threshold, it is determined that the target intelligent perception interaction strategy is effective; When the satisfaction level does not reach the preset satisfaction level threshold, it is determined that the target intelligent perception interaction strategy is invalid.

[0011] In one implementation, the pre-trained intelligent perception big model performs scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data to obtain the corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy, including: Performing scene reasoning based on the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model to obtain a corresponding intelligent perception interaction scene set; According to the acquired user characteristics and the user behavior habits in the dynamic scene data, a corresponding target intelligent perception interaction scene is inferred from the intelligent perception interaction scene set, and a corresponding target intelligent perception interaction strategy is constructed according to the target intelligent perception interaction scene.

[0012] In one implementation, after triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy, the method further includes: Determine the user's target scenario satisfaction with the target intelligent perception interaction scenario and the target strategy satisfaction with the target intelligent perception interaction strategy; The intelligent interaction scenario reasoning logic and the intelligent interaction strategy reasoning logic of the intelligent perception big model are optimized according to the target scenario satisfaction and the target strategy satisfaction.

[0013] The present invention also discloses an intelligent perception interaction system based on a large model, wherein the system comprises: The data acquisition module is used to obtain the user interaction data collected by the intelligent sensing hardware and AI algorithms in the smart device; A data generation module, used to generate corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device; A data modeling module, used for performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data; A scene construction module, used to construct a corresponding intelligent perception interaction scene according to the scene characteristics of the modeling data; A scene judgment module, used to judge whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library; A scene reasoning module, used for, when the intelligent perception interaction scene is not the intelligent perception interaction scene predefined in the intelligent perception scene feature library, performing scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model, to obtain a corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy; The interaction triggering module is used to trigger the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

[0014] The present invention also discloses a terminal, which includes: a memory, a processor, and a large model-based intelligent perception interaction program stored in the memory and executable on the processor. When the large model-based intelligent perception interaction program is executed by the processor, the steps of the large model-based intelligent perception interaction method as described above are implemented.

[0015] The present invention also discloses a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program can be executed to implement the steps of the large model-based intelligent perception interaction method as described above.

[0016] The present invention provides a method, system, terminal and medium for intelligent perception interaction based on a large model. The method for intelligent perception interaction based on a large model includes: obtaining user interaction data collected by intelligent perception hardware and AI algorithms in intelligent devices, and generating corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the intelligent device; performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to the scene features of the modeling data; judging whether the intelligent perception interaction scene is an intelligent perception interaction scene pre-defined in an intelligent perception scene feature library; when the intelligent perception interaction scene is not an intelligent perception interaction scene pre-defined in the intelligent perception scene feature library, performing scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model to obtain a corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy; triggering the target intelligent perception interaction scene to interact with the user according to the target intelligent perception interaction strategy. It can be seen from this that the present invention obtains dynamic scene data including environmental data and user behavior habits when the user uses a smart device, performs scene data modeling and intelligent perception interaction scene construction based on the dynamic scene data, that is, constructs an intelligent perception interaction scene based on the scene characteristics of the modeling data, and the intelligent perception interaction scene pre-defined in the non-intelligent perception scene feature library is handed over to the intelligent perception big model for identification, analysis and reasoning, that is, through the pre-trained intelligent perception big model, the modeling data corresponding to the dynamic scene data is subjected to scene reasoning and interaction reasoning, and a target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy are generated, and the target intelligent perception interaction scene is triggered to interact with the user according to the target intelligent perception interaction strategy, and the user completes the intelligent perception interaction as needed, thereby providing the user with a better interactive experience based on intelligent perception. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flow chart of a preferred embodiment of the intelligent perception interaction method based on a large model in the present invention; Figure 2 It is a flow chart of a preferred embodiment of the intelligent perception interaction method based on a large model in the present invention; Figure 3 It is a flow chart of the intelligent perception interaction strategy process based on the large model in the present invention; Figure 4 It is a flow chart of a preferred embodiment of the intelligent perception interaction method based on a large model in the present invention; Figure 5 It is a functional principle block diagram of a preferred embodiment of the intelligent perception interaction system based on a large model in the present invention; Figure 6It is a specific functional principle block diagram of the intelligent perception interaction system based on the large model in the present invention; Figure 7 It is a functional principle block diagram of a preferred embodiment of the terminal in the present invention. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the present invention clearer and more specific, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0019] See also Figure 1 , Figure 1 Flowchart of the intelligent perception interaction method based on the large model in the present invention. Figure 1 As shown, the intelligent perception interaction method based on a large model described in an embodiment of the present invention includes: Step S11, obtaining user interaction data collected by the intelligent sensing hardware and AI algorithm in the smart device, and generating corresponding dynamic scene data based on the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device.

[0020] In this embodiment, the smart device is equipped with smart sensing hardware and AI algorithms, and user interaction data can be collected through the smart sensing hardware and AI algorithms, and then the user interaction data collected by the smart sensing hardware and AI algorithms are obtained, and then the corresponding dynamic scene data is generated according to the user interaction data. Specifically, the corresponding dynamic scene data is generated according to the user interaction data and based on the time axis. It can be understood that the dynamic scene data is constructed based on the time axis as the baseline, so that the data collected by the smart sensing hardware at the time point, the data recognized by the algorithm, and the data of the user's behavior habits can be reproduced through the time point. That is to say, the dynamic scene data includes the environment data and user behavior habit data of the user using the smart device collected by the smart sensing hardware and AI algorithms. For example, the dynamic scene data of the smart TV is obtained through the smart sensing hardware and AI algorithms built in the smart TV. The dynamic scene data includes the environment data of the user using the smart TV and the corresponding user behavior habit data in the environment, wherein the environment data of the user using the smart TV can be who is using it, how many people are using it, in what environment, what is used, what is said, what is done, etc.

[0021] It should be pointed out that user behavior habits can be determined through TV big data analysis, and intelligent perception capabilities can be dynamically constructed based on the intelligent perception hardware equipped with the TV system. The intelligent perception hardware may include but is not limited to millimeter wave, light sensing modules, far-field voice and cameras, and other intelligent hardware and perception modules equipped with smart TVs, and AI algorithms may include but are not limited to millimeter wave recognition algorithms, voice recognition algorithms, voiceprint recognition algorithms, face recognition algorithms, gesture recognition algorithms, and ambient light perception algorithms.

[0022] Step S12: performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to the scene features of the modeling data.

[0023] In this embodiment, after obtaining dynamic scene data including environmental data when the user uses the smart device and the user's behavior habits, scene data modeling and intelligent perception interaction scene construction can be performed according to the dynamic scene data, that is, the intelligent perception interaction scene is constructed according to the scene characteristics of the modeling data. It can be understood that scene data modeling is performed on the dynamic scene data, and then the intelligent perception interaction scene is constructed by the characteristics of the modeling data.

[0024] Step S13: determining whether the intelligent perception interaction scenario is an intelligent perception interaction scenario predefined in an intelligent perception scenario feature library.

[0025] In this embodiment, after constructing the corresponding intelligent perception interaction scene according to the scene characteristics of the modeling data, it is determined whether the intelligent perception interaction scene is an intelligent perception interaction scene pre-defined in the intelligent perception scene feature library, that is, it is identified whether the intelligent perception interaction scene is a known intelligent perception interaction scene that already exists in the intelligent perception scene feature library and corresponds to the dynamic scene data.

[0026] It should be pointed out that the intelligent perception scene feature library includes but is not limited to the intelligent perception hardware feature library, the application scenario feature library and the user interaction feature library, among which the intelligent perception hardware feature library obtains dynamic scene data through intelligent perception hardware, and constructs some data models through the scene feature values ​​of the modeling data corresponding to the dynamic scene data. For example, the millimeter wave module built in the smart TV can obtain information such as whether there is a user, which user, the distance and direction of the user from the TV, how many people are watching TV, etc., and when determining which user, the specific user can be identified by binding the user features; the user's voice data, voiceprint data, and ambient sound are obtained through the far-field voice module. The user's voice data includes but is not limited to the direction in which the user is speaking, how many people are speaking, and which people are watching TV. When speaking and what is said, the voiceprint data can be bound to user features to identify the specific user. The ambient sound mainly includes whether there is noise, the size of the noise, the source, etc. The brightness of the ambient light can be obtained through the light sensing module; the camera module can be bound to user features to identify the specific user, including gestures, faces, behaviors, etc. Then, based on these data and the algorithm capabilities of the intelligent perception hardware, the corresponding feature points are generated, and then the intelligent perception hardware feature library is defined for the intelligent perception hardware equipped on the smart TV, that is, the data of the intelligent perception hardware feature library is used to construct or infer information about what the intelligent perception hardware has recognized at a certain point in time, whether there is a user, which user it is, or which group of users, what they are doing, what they are saying, and what the environment around the smart TV is like. In addition, the application scenario feature library is an application scenario feature library constructed based on the current state of the smart TV and in combination with the smart sensing hardware feature library. For example, through the smart sensing hardware combined with the system application, it constructs or infers leisure movie watching, gathering, chatting, lying down, multi-person fitness, etc., that is, it is composed of users in combination with the TV environment and application usage scenarios, etc., and the composition can be disassembled or combined. For example, when users A and B chat, they are used to turning down the TV volume, which is 10 decibels lower than the chat volume, and the users do not care about the TV content in the chat scene. The user interaction feature library is the interactive behavior generated by the user when the characteristic value of the smart hardware data is identified. For example, as long as the millimeter wave module detects that user A is lying on the sofa and watching a movie alone, no matter what the ambient light detected by the light sensing module is, the lights will be turned off, the sound will be modulated to the maximum, and the user's behavior analysis when using the smart TV.

[0027] Step S14: When the intelligent perception interaction scenario is not an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, a pre-trained intelligent perception large model is used to perform scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data to obtain a corresponding target intelligent perception interaction scenario and its corresponding target intelligent perception interaction strategy.

[0028] In this embodiment, it is determined whether the intelligent perception interaction scene is an intelligent perception interaction scene pre-defined in the intelligent perception scene feature library, and when the intelligent perception interaction scene is not an intelligent perception interaction scene pre-defined in the intelligent perception scene feature library, that is, when it is identified that the intelligent perception interaction scene is not a known intelligent perception interaction scene existing in the intelligent perception scene feature library, the pre-trained intelligent perception big model performs scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data to obtain the corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy. It can be understood that the intelligent perception interaction scene pre-defined in the non-intelligent perception scene feature library is handed over to the intelligent perception big model for identification, analysis and reasoning to obtain the target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy.

[0029] Specifically, the pre-trained intelligent perception big model performs scene reasoning according to the modeling data corresponding to the dynamic scene data to obtain a corresponding intelligent perception interaction scene set; the corresponding target intelligent perception interaction scene is inferred from the intelligent perception interaction scene set according to the acquired user characteristics and the user behavior habits in the dynamic scene data, and the corresponding target intelligent perception interaction strategy is constructed according to the target intelligent perception interaction scene, that is, the intelligent perception big model performs scene reasoning and interaction reasoning on the dynamic scene data to generate one or more intelligent perception interaction scenes and one or more corresponding intelligent perception interaction strategies. It can be understood that if the constructed intelligent perception interaction scene is not a scene defined in the intelligent perception scene feature library, the intelligent perception big model performs scene reasoning according to the modeling data of the dynamic scene data, and one or more scenes may appear according to the algorithm of the intelligent perception big model, and then the most reasonable 1 to 2 scenes are introduced according to the user characteristics and behavior habits to construct the intelligent perception interaction strategy, and presented to the user, which can be limited to display only 1, or all.

[0030] Step S15: triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

[0031] In this embodiment, a target intelligent perception interaction scenario and a target intelligent perception interaction strategy are determined, and the target intelligent perception interaction scenario is triggered to interact with the user according to the target intelligent perception interaction strategy. The user completes the intelligent perception interaction according to the needs. That is to say, the user completes the interaction with the smart TV according to the interaction method provided by the intelligent perception interaction strategy, wherein the interaction method includes but is not limited to a single interaction method or a combination of multiple interaction methods for voice interaction, gesture interaction, automated execution, application call, service launch, and system function effectiveness.

[0032] It can be seen that in the embodiments of the present application, dynamic scene data including environmental data and user behavior habits when the user uses a smart device is obtained, and scene data modeling and intelligent perception interaction scene construction are performed according to the dynamic scene data, that is, the intelligent perception interaction scene is constructed according to the scene characteristics of the modeling data, and the intelligent perception interaction scene pre-defined in the non-intelligent perception scene feature library is handed over to the intelligent perception big model for identification, analysis and reasoning, that is, through the pre-trained intelligent perception big model, the modeling data corresponding to the dynamic scene data is subjected to scene reasoning and interaction reasoning, and the target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy are generated, and the target intelligent perception interaction scene is triggered to interact with the user according to the target intelligent perception interaction strategy, and the user completes the intelligent perception interaction according to the needs, thereby providing the user with a better interactive experience based on intelligent perception.

[0033] See also Figure 2 As shown, the embodiment of the present invention discloses a specific intelligent perception interaction method based on a large model. Compared with the previous embodiment, this embodiment further illustrates and optimizes the technical solution.

[0034] Step S21, obtaining user interaction data collected by the intelligent sensing hardware and AI algorithm in the smart device, and generating corresponding dynamic scene data based on the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device.

[0035] Step S22: performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to the scene features of the modeling data.

[0036] Step S23: determining whether the intelligent perception interaction scenario is an intelligent perception interaction scenario predefined in an intelligent perception scenario feature library.

[0037] Step S24: If the intelligent perception interaction scenario is an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, the intelligent perception interaction scenario is determined as a target intelligent perception interaction scenario, and a pre-defined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario is obtained from the intelligent perception scene feature library to obtain a corresponding target intelligent perception interaction strategy.

[0038] In this embodiment, it is determined whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library, and when the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library, that is, when the intelligent perception interaction scene is identified as a known intelligent perception interaction scene existing in the intelligent perception scene feature library, the intelligent perception interaction scene is determined as the target intelligent perception interaction scene, and the predefined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scene is obtained from the intelligent perception scene feature library to obtain the corresponding target intelligent perception interaction strategy. It can be understood that the constructed intelligent perception interaction scene has been defined in the intelligent perception scene feature library and has an executable intelligent perception interaction strategy, wherein the executable intelligent perception interaction strategy means that each predefined intelligent perception interaction scene has a corresponding intelligent perception interaction strategy at the initial stage.

[0039] It should be pointed out that in order to better provide general intelligent perception services, a series of intelligent perception interaction scenarios and corresponding intelligent perception interaction strategies are pre-defined. For example, when the light sensing device detects that the ambient light has dimmed and the millimeter wave module detects that there is no user in the viewing range of the smart TV, and the current user is playing film and television content, a smart perception interaction strategy will be defined to put the TV in standby mode and resume the video content being played when it detects that there is a user in the visible range of the TV and the user has walked towards the TV, and adjust the brightness of the ambient light source according to the user's viewing environment light habits.

[0040] Step S25: Determine whether the target intelligent perception interaction strategy is effective.

[0041] In this embodiment, the intelligent perception interaction scenario is an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, the intelligent perception interaction scenario is determined as the target intelligent perception interaction scenario, and the pre-defined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario is obtained from the intelligent perception scene feature library. After obtaining the corresponding target intelligent perception interaction strategy, whether the target intelligent perception interaction strategy is effective is judged by tracking the user's satisfaction with the target intelligent perception interaction strategy. Specifically, the user's satisfaction with the target intelligent perception interaction strategy is determined, and whether the satisfaction reaches a preset satisfaction threshold; when the satisfaction reaches the preset satisfaction threshold, the target intelligent perception interaction strategy is judged to be effective; when the satisfaction does not reach the preset satisfaction threshold, the target intelligent perception interaction strategy is judged to be invalid.

[0042] Step S26: When the target intelligent perception interaction strategy is valid, triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

[0043] In this embodiment, when the target intelligent perception interaction scene is a known intelligent perception interaction scene existing in the intelligent perception scene feature library and the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scene is valid, the target intelligent perception interaction scene is triggered to interact with the user according to the effective target intelligent perception interaction strategy. In other words, the constructed intelligent perception interaction scene is a known intelligent perception interaction scene of the dynamic scene data, and the known intelligent perception interaction scene is triggered to interact with the user according to the effective target intelligent perception interaction strategy corresponding to the known intelligent perception interaction scene.

[0044] Step S27: When the target intelligent perception interaction strategy fails, the corresponding intelligent perception interaction strategy is inferred based on the target intelligent perception interaction scenario by using the pre-trained intelligent perception large model to obtain a new target intelligent perception interaction strategy, and the new target intelligent perception interaction strategy is used to replace the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario in the intelligent perception scenario feature library, and then the target intelligent perception interaction scenario is triggered to interact with the user according to the new target intelligent perception interaction strategy.

[0045] In this embodiment, when the target intelligent perception interaction scenario is a known intelligent perception interaction scenario existing in the intelligent perception scenario feature library, but the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario is invalid, it is necessary to re-perform interaction reasoning through the intelligent perception big model. When the new target intelligent perception interaction strategy reasoned out by the interaction is a valid strategy, the new target intelligent perception interaction strategy is used to replace the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario in the intelligent perception scene feature library, and then the target intelligent perception interaction scene is triggered to interact with the user according to the new target intelligent perception interaction strategy.

[0046] For example, when the current user's interactive actions triggered by the customized intelligent perception interaction strategy are less than 80%, and the user's behavioral habits do not have the interactive actions of the intelligent perception interaction strategy, the strategy is an invalid strategy and the intelligent perception large model needs to re-perform interactive reasoning. When the interactively reasoned strategy reaches the user's satisfaction threshold, such as 95%, it indicates that a new strategy is generated and the new strategy is used to replace the customized strategy corresponding to the customized scenario. The strategy generation mechanism is dynamically adjusted according to the intelligent perception process to match the user's interaction.

[0047] For the specific contents of the above steps S21 to S23, reference may be made to the corresponding contents disclosed in the above embodiments, which will not be repeated here.

[0048] For example, see Figure 3As shown, a corresponding intelligent perception interaction scene is constructed according to the scene features of the modeling data corresponding to the dynamic scene data, and it is determined whether the constructed intelligent perception interaction scene is a scene defined in the intelligent perception scene feature library. When the constructed intelligent perception interaction scene is a scene defined in the intelligent perception scene feature library, a pre-defined intelligent perception interaction strategy corresponding to the constructed intelligent perception interaction scene is obtained to determine whether the intelligent perception interaction strategy is valid. If it is valid, the known intelligent perception interaction scene is triggered to interact with the user according to the valid target intelligent perception interaction strategy corresponding to the known intelligent perception interaction scene. If it is invalid, the interaction strategy is inferred through the intelligent perception big model to obtain a new interaction strategy, and the interaction scene is triggered to interact with the user according to the new interaction strategy; when the constructed intelligent perception interaction scene is not a scene defined in the intelligent perception scene feature library, the scene inference is performed through the intelligent perception big model, and the intelligent perception interaction strategy inference corresponding to the interaction scene is performed to obtain an intelligent perception scene library and an intelligent perception interaction strategy set.

[0049] It can be seen that in the embodiments of the present application, dynamic scene data including environmental data and user behavior habits when the user uses a smart device is obtained, scene data modeling and intelligent perception interaction scene construction are performed based on the dynamic scene data, that is, an intelligent perception interaction scene is constructed based on the scene characteristics of the modeling data, and for the intelligent perception interaction scenes pre-defined in the intelligent perception scene feature library, the intelligent perception interaction scene is triggered to interact with the user according to the effective customized intelligent perception interaction strategy corresponding to the pre-defined intelligent perception interaction scene, and the user completes the intelligent perception interaction as needed, thereby providing the user with a better intelligent perception-based interaction experience.

[0050] See also Figure 4 As shown, the embodiment of the present invention discloses a specific intelligent perception interaction method based on a large model. Compared with the previous embodiment, this embodiment further illustrates and optimizes the technical solution.

[0051] Step S31, obtaining user interaction data collected by the intelligent sensing hardware and AI algorithm in the smart device, and generating corresponding dynamic scene data based on the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device.

[0052] Step S32: performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to the scene features of the modeling data.

[0053] Step S33: determine whether the intelligent perception interaction scenario is an intelligent perception interaction scenario predefined in the intelligent perception scenario feature library.

[0054] Step S34: When the intelligent perception interaction scenario is not an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, the pre-trained intelligent perception large model is used to perform scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data to obtain the corresponding target intelligent perception interaction scenario and its corresponding target intelligent perception interaction strategy.

[0055] Step S35: triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

[0056] Step S36, determine the user's target scenario satisfaction with the target intelligent perception interaction scenario and the target strategy satisfaction with the target intelligent perception interaction strategy, and optimize the intelligent interaction scenario reasoning logic and the intelligent interaction strategy reasoning logic of the intelligent perception big model according to the target scenario satisfaction and the target strategy satisfaction.

[0057] In this embodiment, the user's target scenario satisfaction with the target intelligent perception interaction scenario inferred by the intelligent perception big model and the target strategy satisfaction with the target intelligent perception interaction strategy inferred by the intelligent perception big model are determined by following up the user satisfaction with the intelligent perception interaction scenario data and the intelligent perception interaction strategy in real time. That is, the target scenario satisfaction and target strategy satisfaction are obtained by analyzing the scenario satisfaction and interaction strategy satisfaction with the user behavior data, and then the intelligent interaction scenario reasoning logic and the intelligent interaction strategy reasoning logic of the intelligent perception big model are optimized according to the target scenario satisfaction and the target strategy satisfaction.

[0058] For the specific contents of the above steps S31 to S35, reference may be made to the corresponding contents disclosed in the above embodiments, which will not be elaborated here.

[0059] It can be seen that in the embodiment of the present application, dynamic scene data including environmental data and user behavior habits when the user uses the smart device is obtained, scene data modeling and intelligent perception interaction scene construction are performed according to the dynamic scene data, that is, the intelligent perception interaction scene is constructed according to the scene characteristics of the modeling data, and the intelligent perception interaction scene pre-defined in the non-intelligent perception scene feature library is handed over to the intelligent perception big model for identification, analysis and reasoning, that is, through the pre-trained intelligent perception big model, the modeling data corresponding to the dynamic scene data is subjected to scene reasoning and interaction reasoning, and the target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy are generated, and the target intelligent perception interaction scene is triggered according to the target intelligent perception interaction strategy to interact with the user, and the user completes the intelligent perception interaction according to the needs, thereby providing the user with a better interaction experience based on intelligent perception, and continuously optimizing the intelligent interaction scene reasoning logic and intelligent interaction strategy reasoning logic of the intelligent perception big model through the analysis of scene satisfaction and interaction strategy satisfaction of user behavior data, thereby further improving the accuracy of human-computer interaction and improving the user's interactive experience.

[0060] In one embodiment, if Figure 5 As shown, based on the above-mentioned intelligent perception interaction method based on a large model, the present invention also provides an intelligent perception interaction system based on a large model, including: The data acquisition module 100 is used to acquire user interaction data collected by the intelligent sensing hardware and AI algorithm in the intelligent device; The data generation module 200 is used to generate corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes the environment data and user behavior habits when the user uses the smart device; A data modeling module 300 is used to perform scene data modeling according to the dynamic scene data to obtain corresponding modeling data; A scene construction module 400 is used to construct a corresponding intelligent perception interaction scene according to the scene characteristics of the modeling data; A scene determination module 500 is used to determine whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in an intelligent perception scene feature library; A scene reasoning module 600 is used for, when the intelligent perception interaction scene is not a predefined intelligent perception interaction scene in the intelligent perception scene feature library, performing scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model, to obtain a corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy; The interaction triggering module 700 is used to trigger the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

[0061] See also Figure 6 As shown, when the smart TV is turned on, the smart perception hardware is initialized, and the smart perception interaction system based on the big model is loaded. The smart perception interaction system based on the big model implements scene data modeling and smart perception interaction scene construction. Then, for known scenes, the smart perception interaction scene is triggered to interact with the user. For unknown scenes, the scene reasoning, interaction reasoning and interaction strategy reasoning are implemented through the smart perception big model. Finally, the smart perception interaction is implemented, that is, the user interacts with the smart TV according to the interaction method provided by the interaction strategy. The interaction method can be voice interaction, video interaction, scene interaction, system interaction, etc.

[0062] Specifically, when the intelligent perception interaction system is running, the intelligent perception hardware and AI algorithm built in the smart TV collect user interaction data, and perform data cleaning on the user interaction data collected by the intelligent perception hardware and AI algorithm to eliminate invalid user interaction data, and then generate corresponding dynamic scene data based on the cleaned user interaction data and the timeline as the baseline, that is, the dynamic scene data includes the environmental data and user behavior habit data of the user using the smart TV collected by the intelligent perception hardware and AI algorithm, wherein the intelligent perception hardware may include but is not limited to millimeter wave, light sensing module, far-field voice and camera and other intelligent hardware and perception modules carried by the smart TV, and then perform scene data modeling based on the dynamic scene data, and construct the scene feature of the modeling data Construct an intelligent perception interaction scene, determine whether the intelligent perception interaction scene is a scene defined in an intelligent perception scene feature library, and the intelligent perception scene feature library includes but is not limited to other feature libraries such as an intelligent perception hardware feature library, an application scene feature library, and a user interaction feature library, that is, identify whether there is a known intelligent perception interaction scene corresponding to the dynamic scene data in the intelligent perception scene feature library and its corresponding intelligent perception interaction strategy, and when the constructed intelligent perception interaction scene is a known scene in the intelligent perception scene feature library, the user interacts with the smart TV according to the interaction method provided by the known intelligent perception interaction strategy corresponding to the known intelligent perception interaction scene, and the interaction methods include voice interaction, image interaction, AIGC (AI-Generated Content, artificial intelligence generated content) interaction, interface interaction, system interaction, etc., real-time tracking of user satisfaction with intelligent perception interaction strategies to determine whether the intelligent perception interaction strategy is effective; when the constructed intelligent perception interaction scenario is not a scenario defined in the intelligent perception scenario feature library, it means that the constructed scenario is a new scenario, and the intelligent perception big model is used to perform scenario reasoning to construct a new intelligent perception interaction scenario. Then, the intelligent perception big model performs intelligent perception interaction strategy reasoning corresponding to the interaction scenario based on the constructed new intelligent perception interaction scenario, and obtains one or more intelligent perception interaction scenarios and their corresponding one or more intelligent perception interaction strategies. Based on the intelligent perception of the big model The interactive system generates intelligent perception interaction scenarios and intelligent perception interaction strategies based on the intelligent perception interaction scenarios and intelligent perception interaction strategies inferred by the intelligent perception big model, that is, through the scenario reasoning and interaction strategy reasoning of the intelligent perception big model, and then presents them to the user through the intelligent interaction method. According to the user's interaction, the smart TV is called to respond to the intelligent perception interaction strategy to complete the intelligent perception interaction. Finally, according to the intelligent perception interaction strategy and the intelligent perception interaction results, the intelligent perception big model reasoning logic and intelligent interaction strategy are optimized to achieve the optimization of the intelligent perception big model algorithm. That is, when the user triggers the intelligent perception interaction scenario, the intelligent perception interaction strategy is triggered, and continuous optimization is performed according to the satisfaction of the scenario and strategy.From this, we can see that by building a more intelligent intelligent perception interaction system based on big models based on intelligent hardware modules, AI algorithms and big models, we can provide users with a better interactive experience.

[0063] For example, through the intelligent perception interaction system based on the large model, it is obtained that three users are in the living room (party scene), and through user information it is obtained that one user has a birthday today. Then, when the smart TV obtains that the user stays in front of the TV (user behavior), it generates a birthday card in the TV window (interaction strategy) through AI images and the photo of the birthday user, and is equipped with birthday music, etc.

[0064] It should be pointed out that the intelligent perception interaction system based on the large model obtains dynamic scene data and determines the corresponding intelligent perception interaction scene and intelligent perception interaction strategy. Then, when the smart TV is equipped with intelligent hardware with user feature recognition and group feature recognition, it has user attributes and will only be triggered when the corresponding user and user group meet the intelligent perception interaction scene feature library. Among them, user feature recognition refers to individual users or single people, such as confirming who the user is through face recognition, confirming who the user is through voiceprint, and determining individual users through the characteristic value of millimeter waves; group feature recognition refers to the collection and determination of voice, image, millimeter waves and other intelligent perception hardware by multiple users.

[0065] Figure 7 A schematic diagram of the structure of a terminal provided in an embodiment of the present application. The terminal may include: A memory 501 , a processor 502 , and a computer program stored in the memory 501 and executable on the processor 502 .

[0066] When the processor 502 executes the program, the intelligent perception interaction method based on the large model provided in the above embodiment is implemented.

[0067] Furthermore, the terminal further includes: The communication interface 503 is used for communication between the memory 501 and the processor 502 .

[0068] The memory 501 is used to store computer programs that can be executed on the processor 502 .

[0069] The memory 501 may include a high-speed RAM memory, and may also include a non-volatile memory, such as at least one disk memory.

[0070] If the memory 501, the processor 502 and the communication interface 503 are implemented independently, the communication interface 503, the memory 501 and the processor 502 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0071] Optionally, in a specific implementation, if the memory 501, the processor 502 and the communication interface 503 are integrated on a chip, the memory 501, the processor 502 and the communication interface 503 can communicate with each other through an internal interface.

[0072] The processor 502 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0073] This embodiment also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the above-mentioned intelligent perception interaction method based on a large model is implemented.

[0074] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0075] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0076] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes additional implementations, in which the order shown or discussed may not be followed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0077] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can read instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary and then storing it in a computer memory.

[0078] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0079] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0080] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0081] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

[0082] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A large-model-based intelligent perception interaction method, characterized in that: The method comprises: Acquire user interaction data collected by the intelligent sensing hardware and AI algorithm in the smart device, and generate corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device; Performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data, and constructing a corresponding intelligent perception interaction scene according to scene features of the modeling data; Determining whether the intelligent perception interaction scenario is an intelligent perception interaction scenario predefined in an intelligent perception scenario feature library; When the intelligent perception interaction scenario is not an intelligent perception interaction scenario predefined in the intelligent perception scenario feature library, a pre-trained intelligent perception large model is used to perform scenario reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scenario data to obtain a corresponding target intelligent perception interaction scenario and its corresponding target intelligent perception interaction strategy; The target intelligent perception interaction scenario is triggered according to the target intelligent perception interaction strategy to interact with the user.

2. The intelligent perception interaction method based on a large model according to claim 1 is characterized in that: The generating corresponding dynamic scene data according to the user interaction data comprises: According to the user interaction data, corresponding dynamic scene data is generated with the time axis as a baseline.

3. The intelligent perception interaction method based on a large model according to claim 1 is characterized in that: After determining whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library, the method further includes: If the intelligent perception interaction scenario is an intelligent perception interaction scenario pre-defined in the intelligent perception scenario feature library, the intelligent perception interaction scenario is determined as a target intelligent perception interaction scenario, and a pre-defined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario is obtained from the intelligent perception scenario feature library to obtain a corresponding target intelligent perception interaction strategy.

4. The intelligent perception interaction method based on a large model according to claim 3 is characterized in that: After acquiring the predefined intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario from the intelligent perception scenario feature library and obtaining the corresponding target intelligent perception interaction strategy, the method further includes: Determining whether the target intelligent perception interaction strategy is effective; The step of triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy includes: When the target intelligent perception interaction strategy is valid, triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy; When the target intelligent perception interaction strategy fails, the pre-trained intelligent perception big model is used to infer the corresponding intelligent perception interaction strategy based on the target intelligent perception interaction scenario to obtain a new target intelligent perception interaction strategy, and the new target intelligent perception interaction strategy is used to replace the target intelligent perception interaction strategy corresponding to the target intelligent perception interaction scenario in the intelligent perception scenario feature library, and then the step of triggering the target intelligent perception interaction scenario to interact with the user is performed according to the new target intelligent perception interaction strategy.

5. The intelligent perception interaction method based on a large model according to claim 4 is characterized in that: The determining whether the target intelligent perception interaction strategy is effective includes: Determining the user's satisfaction with the target intelligent perception interaction strategy, and judging whether the satisfaction reaches a preset satisfaction threshold; When the satisfaction reaches the preset satisfaction threshold, it is determined that the target intelligent perception interaction strategy is effective; When the satisfaction level does not reach the preset satisfaction level threshold, it is determined that the target intelligent perception interaction strategy is invalid.

6. The large model-based intelligent perception interaction method according to claim 1, characterized in that: The pre-trained intelligent perception big model performs scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data to obtain the corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy, including: Performing scene reasoning based on the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model to obtain a corresponding intelligent perception interaction scene set; According to the acquired user characteristics and the user behavior habits in the dynamic scene data, a corresponding target intelligent perception interaction scene is inferred from the intelligent perception interaction scene set, and a corresponding target intelligent perception interaction strategy is constructed according to the target intelligent perception interaction scene.

7. The intelligent perception interaction method based on a large model according to any one of claims 1 to 6, characterized in that: After triggering the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy, the method further includes: Determine the user's target scenario satisfaction with the target intelligent perception interaction scenario and the target strategy satisfaction with the target intelligent perception interaction strategy; The intelligent interaction scenario reasoning logic and the intelligent interaction strategy reasoning logic of the intelligent perception big model are optimized according to the target scenario satisfaction and the target strategy satisfaction.

8. An intelligent perception interaction system based on a large model, characterized in that: The system comprises: The data acquisition module is used to obtain user interaction data collected by the intelligent sensing hardware and AI algorithms in the smart device; A data generation module, used to generate corresponding dynamic scene data according to the user interaction data; wherein the dynamic scene data includes environmental data and user behavior habits when the user uses the smart device; A data modeling module, used for performing scene data modeling according to the dynamic scene data to obtain corresponding modeling data; A scene construction module, used to construct a corresponding intelligent perception interaction scene according to the scene characteristics of the modeling data; A scene judgment module, used to judge whether the intelligent perception interaction scene is an intelligent perception interaction scene predefined in the intelligent perception scene feature library; A scene reasoning module, used for, when the intelligent perception interaction scene is not the intelligent perception interaction scene predefined in the intelligent perception scene feature library, performing scene reasoning and interaction reasoning according to the modeling data corresponding to the dynamic scene data through a pre-trained intelligent perception large model, to obtain a corresponding target intelligent perception interaction scene and its corresponding target intelligent perception interaction strategy; The interaction triggering module is used to trigger the target intelligent perception interaction scenario to interact with the user according to the target intelligent perception interaction strategy.

9. A terminal, characterized in that: include: A memory, a processor, and a large model-based intelligent perception interaction program stored in the memory and executable on the processor, wherein the large model-based intelligent perception interaction program, when executed by the processor, implements the steps of the large model-based intelligent perception interaction method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which can be executed to implement the steps of the large model-based intelligent perception interaction method as described in any one of claims 1 to 7.

Images