Method, device, electronic device and storage medium for determining interaction mode
By obtaining the behavior data of the target object in the smart device, determining its interaction characteristics and automatically selecting the interaction method, the problem of single and inefficient information interaction methods of the smart device is solved, and intelligent interaction and user experience are improved.
Patent Information
- Application Number
- CN202011166110.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-10-27
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2040-11-01
AI Technical Summary
The information interaction method of existing smart devices is single and inefficient, resulting in poor user interaction experience.
By obtaining the behavioral data of the target object, determining its interactive feature data, and automatically selecting the appropriate interaction method based on the interactive feature data to achieve intelligent interaction.
It enriches information interaction methods, improves interaction efficiency, and improves user information interaction experience.
Smart Images

Figure CN112306238B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method, device, electronic device, and storage medium for determining an interaction mode. Background Art
[0002] With the continuous advancement of electronic technology, smart devices have become very popular. Most smart devices have multiple sensors. When users need to interact with information, they can interact with users by selecting an interaction method. However, related interaction technologies still have technical problems such as a single information interaction method and low information interaction efficiency, which reduces the user's information interaction experience. Summary of the invention
[0003] The embodiments of the present disclosure provide a method, device, electronic device and storage medium for determining an interaction mode.
[0004] In a first aspect, an embodiment of the present disclosure provides a method for determining an interaction mode, the method comprising:
[0005] If the target object is located in the data collection area, acquiring the first behavior data of the target object;
[0006] Determining interaction feature data of the target object according to the first behavior data;
[0007] A target interaction mode corresponding to the target object is determined according to the interaction feature data.
[0008] In a second aspect, an embodiment of the present disclosure further provides a device for determining an interaction mode, the device comprising:
[0009] A first behavior data acquisition module, configured to acquire first behavior data of the target object if the target object is located in the data collection area;
[0010] An interaction feature data determination module, configured to determine the interaction feature data of the target object according to the first behavior data;
[0011] The target interaction mode determination module is used to determine the target interaction mode corresponding to the target object according to the interaction feature data.
[0012] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:
[0013] one or more processors;
[0014] a storage device for storing one or more programs,
[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the interaction mode as described in any one of the embodiments of the present disclosure.
[0016] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute a method for determining an interaction mode as described in any one of the embodiments of the present disclosure.
[0017] The technical solution of the disclosed embodiment, by acquiring the first behavior data of the target object when the target object is located in the data collection area, can automatically acquire the first behavior data of the target object after the target object appears, and then determine the interaction feature data of the target object according to the first behavior data, so as to determine the interaction intention of the target object through the first behavior data of the target object, and finally determine the target interaction mode corresponding to the target object according to the interaction feature data. It is particularly suitable for the situation that the target object is located in the data collection area but does not actively send a clear interaction request, which fully enhances the initiative of the interaction device or interaction system in the interaction scene, realizes the intelligent interaction between the interaction device or interaction system and the target object, and solves the technical problems of single information interaction mode and low information interaction efficiency in related technologies, thereby achieving the technical effect of enriching the information interaction mode, improving the information interaction efficiency, and enhancing the information interaction experience of the target object. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0019] Figure 1 A flowchart of a method for determining an interaction mode provided in the first embodiment of the present disclosure;
[0020] Figure 2 A flowchart of a method for determining an interaction mode provided in Embodiment 2 of the present disclosure;
[0021] Figure 3 A flowchart of a method for determining an interaction mode provided in Embodiment 3 of the present disclosure;
[0022] Figure 4 A flowchart of a method for determining an interaction mode provided in a fourth embodiment of the present disclosure;
[0023] Figure 5 A flowchart of a method for determining an interaction mode provided in Embodiment 5 of the present disclosure;
[0024] Figure 6 A flowchart of a preferred example of a method for determining an interaction mode provided in Embodiment 6 of the present disclosure;
[0025] Figure 7 A schematic diagram of a structure of a device for determining an interaction mode provided in Embodiment 7 of the present disclosure;
[0026] Figure 8 A schematic diagram of the structure of an electronic device provided in Embodiment 8 of the present disclosure. DETAILED DESCRIPTION
[0027] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0029] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0030] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0031] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0032] Embodiment 1
[0033] Figure 1This is a flow chart of a method for determining an interaction mode provided in the first embodiment of the present disclosure. The present embodiment is particularly suitable for automatically selecting an information interaction mode to interact with a user. The method can be executed by a device for determining an interaction mode, which can be implemented in the form of software and / or hardware. The device can be configured in a server to cooperate with a terminal to implement the method for determining an interaction mode in the present disclosure. Here, the server can be a single server, or it can be a server cluster consisting of multiple communication-connected servers that can provide one or more functions.
[0034] like Figure 1 As shown, the method for determining the interaction mode provided in this embodiment may specifically include:
[0035] S110: If the target object is located in the data collection area, obtain the first behavior data of the target object.
[0036] Wherein, the target object refers to an object used to determine the interaction mode. Exemplarily, the target object may include a target user and a target object. Typically, the target user includes a target person. Optionally, the data collection area is determined based on the collection parameters of the data collection device, wherein the collection parameters may include a collection range and a collection method, etc. The first behavior data may include static behavior data and dynamic behavior data. Taking the target object as a target user as an example, the first behavior data may include facial data, gesture data, eye data, body posture data, and sound data of the target user, etc. Taking the target object as a target object as an example, the first behavior data may include the display state of the target object and the display content of the target object, etc. For example, when the target object is a book, the display state of the book may be an open state or a closed state; the display content of the book may include text content and / or picture content. It can be understood that data that can characterize the behavior state of the target object can be used as the first behavior data, and the above first behavior data is only an exemplary description and not a limitation.
[0037] In the embodiment of the present disclosure, the target object is located in the data collection area, which can be understood as the first behavior data of the target object can be collected by the data collection device in the data collection area. Exemplarily, the first behavior data of the target object can be collected by a data collection device such as a shooting device, a sound collection device, and an infrared sensing device. It should be noted that whether the first behavior data is actually collected and what behavior data is collected must be determined based on the actual collection results. When the target object is located in the data collection area, the collected behavior data of the target object is used as the first behavior data, thereby obtaining the first behavior data of the target object.
[0038] It should be noted that the target object may be one, or two or more. If the target object is two or more, the first behavior data may include independent behavior data of each target object, or behavior data of the interaction between the target objects. For example, in a learning scenario, the target object may be a hand, a pen, and a workbook.
[0039] S120: Determine interaction feature data of the target object according to the first behavior data.
[0040] Considering that in actual application scenarios, there are often multiple first behavior data obtained, and they are generally the original behavior performance data of the target object. Therefore, the first behavior data can be analyzed to determine the interaction feature data of the target object. Among them, the interaction feature data can be understood as feature data in the first behavior data that can identify interaction intentions or meet interaction response conditions. For example, it can be specifically that the first behavior data is feature extracted based on the interaction data type of preset interaction data, and the extracted behavior data belonging to the interaction data type is used as interaction feature data. Among them, the interaction data type is related to the object type of the target object.
[0041] Taking the target object as the target user as an example, the interaction data type may include object attribute data, emotion data, body posture data, concentration state data, and sound data. Among them, the object attribute data may include the gender and age of the target object. Exemplarily, the emotion data may include facial expression data and / or limb movement data. Optionally, the body posture data may include standing, sitting or lying posture. Exemplarily, the concentration state data may include eye data and / or limb movement data. Exemplarily, the sound data may include voice data and / or noise data.
[0042] It should be noted that determining the interaction characteristic data of the target object based on the first behavior data may be based on a certain behavior data in the first behavior data of the target object, or may be based on a combination of two or more behavior data in the first behavior data of the target object. Optionally, when a combination of two or more behavior data is used, a weight may be set for each behavior data according to the interaction scenario, interaction object, and / or data collection method, and each behavior data may be weighted, and then the interaction characteristic data of the target object may be determined by the weighted behavior data.
[0043] S130: Determine a target interaction mode corresponding to the target object according to the interaction feature data.
[0044] The interaction feature data is determined based on the first behavior data of the target object, and then the target interaction mode for information interaction with the target object is determined based on the specific content of the interaction feature data. That is, the behavior intention of the target object is determined through the interaction feature data, and then the target interaction mode corresponding to the behavior intention is automatically determined. Among them, the target interaction mode may include the target interaction device and / or the target interaction content, etc.
[0045] Optionally, before determining the target interaction mode corresponding to the target object according to the interaction feature data, the method further includes: pre-establishing a correspondence between each feature interaction data and at least one target interaction mode. That is, at least one target interaction mode can be set for each feature interaction data, and the target interaction modes corresponding to different feature interaction data can be the same or different, which is not specifically limited here.
[0046] Exemplarily, determining the target interaction mode corresponding to the target object according to the interaction feature data may include: determining the target interaction state of the target object according to at least one of the interaction feature data, and determining the target interaction mode corresponding to the target object based on the target interaction state. The target interaction state may include posture information and emotion information of the target object, etc., which can represent the user's behavioral intention.
[0047] For example, if the target object is a target user, and the target interaction state of the target user is determined to be a sad state based on at least one of the interaction feature data, then the target interaction mode of the target object determined based on the target object's sad state may be an interaction mode for alleviating sadness. For example, it may be to display heartwarming and comforting texts, pictures, and animations through a display device, or to play caring or comforting sentences, or to play soothing songs, etc.
[0048] If the target object is a target book, and the target interaction state of the target book is determined to be a reading state, a parsing state, a recording state, or an uploading state according to at least one of the interaction characteristic data, then the target interaction mode corresponding to the target book may be to respectively start a book reading function, a parsing function, a recording function, or an uploading function according to the book content. The embodiment of the present invention does not specifically limit the specific target interaction mode for interacting with the target object.
[0049] The technical solution of the disclosed embodiment, by obtaining the first behavior data of the target object when the target object is located in the data collection area, can automatically obtain the first behavior data of the target object after the target object appears, and then automatically determine the interaction feature data of the target object according to the first behavior data, so as to determine the interaction intention of the target object through the first behavior data of the target object, and finally determine the target interaction mode corresponding to the target object according to the interaction feature data. It is particularly suitable for the situation that the target object is located in the data collection area but does not actively send a clear interaction request, which fully enhances the initiative of the interaction device or interaction system in the interaction scene, realizes the intelligent interaction between the interaction device or interaction system and the target object, and greatly solves the technical problems of single information interaction mode and low information interaction efficiency in the related technology, thereby achieving the technical effect of enriching the information interaction mode, improving the information interaction efficiency, and enhancing the information interaction experience of the target object.
[0050] Embodiment 2
[0051] Figure 2 A flow chart of a method for determining an interaction mode provided in the second embodiment of the present disclosure. This embodiment can be combined with the various optional schemes in the above embodiments. In this embodiment, optionally, the target object includes a target user; the method may also include: determining the identity information of the target object; accordingly, determining the interaction feature data of the target object based on the first behavior data may include: determining the interaction feature data of the target object based on the identity information and the first behavior data.
[0052] like Figure 2 As shown, the method for determining the interaction mode provided in this embodiment may specifically include:
[0053] S210: If the target object is located in the data collection area, obtain the first behavior data of the target object.
[0054] S220: Determine identity information of the target object, and determine interaction feature data of the target object according to the identity information and the first behavior data.
[0055] Before determining the interaction mode for information interaction with the target user, the identity information of the target user may be determined first. Optionally, the target object includes the target user and / or the target object. When the target object includes the target user, the identity information includes the age and / or gender of the target user.
[0056] Optionally, determining the identity information of the target object includes: collecting data for determining the identity information of the target user through a data collection device, and determining the identity information of the target object through the collected data. Exemplarily, image information of the target object can be collected through an image collection device, and the identity information of the target object can be determined based on the image information.
[0057] Exemplarily, determining the identity information of the target object based on the image information includes: performing image recognition on the collected image information, and determining the identity information of the target object based on the recognition result; or, comparing the collected image information with pre-stored image information, and determining the identity information of the target object based on the comparison result.
[0058] As mentioned above, since the acquired first behavior data may be very rich, the interaction characteristics of the target object can also be determined in combination with the identity information of the target object and the first behavior data. Optionally, determining the interaction characteristic data of the target object based on the identity information and the first behavior data includes: determining the interaction behavior type based on the identity information, and determining the interaction characteristic data of the target object based on the first behavior data and the interaction behavior type. Among them, determining the interaction characteristic data of the target object based on the first behavior data and the interaction behavior type may include: determining the target behavior data belonging to the interaction behavior type in the first behavior data, and determining the interaction characteristic data of the target object based on the target data. It can be understood that the interaction behavior types corresponding to target objects with different identity information may be the same or different.
[0059] Taking the target object as a target user as an example, facial image information of the target user can be collected, and the age group of the target user can be determined based on the facial image information; the interactive behavior type of the target user can be determined based on the age group, and then the interactive feature data of the target object can be determined based on the first behavior data and the interactive behavior type. For example, if the age group of the target user is determined to be 3-7 years old based on the facial image information, the voice data and body movement data can be determined as the interactive behavior type of the target user.
[0060] Taking the target object as an example, the first behavior data in which the interaction behavior type is a change in the state of the target object can be used as the target behavior data.
[0061] S230: Determine a target interaction mode corresponding to the target object according to the interaction feature data.
[0062] Optionally, determining the target interaction mode corresponding to the target object according to the interaction feature data includes: determining a preset interaction mode corresponding to the target object according to the identity information, and determining the target interaction mode under the preset interaction mode according to the first behavior data. The preset interaction mode may include a variety of interaction information, for example, an interaction device and specific interaction content.
[0063] It is understandable that before determining the preset interaction mode corresponding to the target object according to the identity information, it also includes: establishing a corresponding relationship between the identity information of the interaction object and the preset interaction mode. The interaction object includes the target object. Furthermore, the preset interaction mode corresponding to the target object can be determined according to the identity information and the interaction relationship. It should be noted that the target interaction methods in different preset interaction modes can be the same or different.
[0064] Exemplarily, if the target object is a target user and the identity information includes age information, the preset interaction mode may be a preset interaction mode corresponding to at least one age group, for example, it may be divided into an adult mode and a child mode. Specifically, the preset interaction mode corresponding to the target object may be determined according to the age information of the target object, and then the target interaction mode under the preset interaction mode may be determined according to the first behavior data. Exemplarily, the target age group of the target user is determined according to the age information of the target object. If the preset interaction mode corresponding to the target age group is a child mode, the target interaction mode under the child mode is determined according to the first behavior data.
[0065] Exemplarily, if the target object is a target book, and the identity information includes the content of the book, the preset interaction mode may be a reading mode, an uploading mode, and / or a parsing mode, etc.
[0066] Of course, in this embodiment, the target interaction mode corresponding to the target object can be determined only based on the interaction feature data, without distinguishing the identity information of the target object, and a technical solution similar to S130 is adopted. The specific implementation method can refer to the aforementioned content and will not be repeated here.
[0067] The technical solution of the disclosed embodiment obtains the first behavior data of the target object and determines the identity information of the target object, and then determines the interaction feature data of the target object based on the identity information and the first behavior data. The target interaction mode determined based on the interaction feature data can better meet the personalized needs of the target object, thereby greatly improving the user experience.
[0068] Embodiment 3
[0069] Figure 3A flowchart of a method for determining an interaction mode provided in Embodiment 3 of the present disclosure. This embodiment can be combined with the various optional schemes in the above embodiments. In this embodiment, optionally, after determining the target interaction mode corresponding to the target object according to the interaction feature data, it also includes: starting a target interaction device corresponding to the target interaction mode.
[0070] like Figure 3 As shown, the method for determining the interaction mode of this embodiment may specifically include:
[0071] S310: If the target object is located in the data collection area, the first behavior of the target object is obtained as data.
[0072] In the embodiment of the present disclosure, when the target object is located in the data collection area, the first behavior data of the target object can be obtained by at least one data collection device. That is, the first behavior data of the target object can be obtained by one, two or more data collection devices, which is not specifically limited here.
[0073] S320: Determine interaction feature data of the target object according to the first behavior data.
[0074] S330: Determine a target interaction mode corresponding to the target object according to the interaction feature data.
[0075] Generally, the target interaction mode is implemented based on the target interaction device. Different target interaction modes may require different target interaction devices to implement. For example, when the target interaction mode is to shoot the target image, it needs to rely on the shooting device to implement; when the target interaction mode is to receive sound information, it needs to rely on the sound collection device to implement; when the target interaction mode is to receive control instructions, it needs to rely on the control element to implement; when the target interaction mode is to monitor the changes of certain data, it may need to rely on one or several sensors to implement, etc.
[0076] S340: Start a target interaction device corresponding to the target interaction mode.
[0077] Among them, the target interaction device can be understood as a data acquisition device corresponding to the target interaction mode. Similarly, there can be one, two or more target interaction devices corresponding to the target interaction mode. The embodiments of the present disclosure do not specifically limit the specific number and specific type of target interaction devices. Exemplarily, the target interaction device includes at least one of an infrared sensor, a shooting device, a control element, and a sound collection device; wherein the control element includes a virtual control element and / or a physical control element.
[0078] It is understandable that starting the target interaction device corresponding to the target interaction mode includes: if the target interaction device corresponding to the target interaction mode is in a closed state, turning on the target interaction device. Of course, if the target interaction device corresponding to the target interaction mode is in an open state, maintaining the open state of the target interaction device.
[0079] After determining the target interaction mode for information interaction with the target object, the target interaction device can be started in a targeted manner to realize information interaction with the target object. Optionally, after starting the target interaction device corresponding to the target interaction mode, it also includes: shutting down the remaining interaction devices. That is, shutting down the interaction devices except the target interaction device corresponding to the target interaction mode. The advantage of such a setting is that only the devices required for interaction are used, and the unnecessary devices are shut down, which saves electricity, reduces the server resource occupation, and optimizes resource allocation.
[0080] The technical solution of this embodiment, after determining the target interaction mode corresponding to the target object according to the interaction feature data, starts the target interaction device corresponding to the target interaction mode, and can enable the target interaction device in a targeted manner. This technical solution is particularly suitable for the case where multiple interaction devices are set up. Compared with the related art of starting all interaction devices by default, it can achieve the technical effect of optimizing resource allocation.
[0081] Embodiment 4
[0082] Figure 4 A flow chart of a method for determining an interaction mode provided in Embodiment 4 of the present disclosure. This embodiment can be combined with the various optional schemes in the above embodiments. In this embodiment, optionally, after starting the target interaction device corresponding to the target interaction mode, it also includes: collecting second behavior data of the target object based on the target interaction device, and determining the target application to be run according to the second behavior data.
[0083] like Figure 4 As shown, the method for determining the interaction mode of this embodiment may specifically include:
[0084] S410: If the target object is located in the data collection area, the first behavior of the target object is obtained as data.
[0085] Optionally, the first behavior data includes preset behavior data and autonomous behavior data. The preset behavior data includes control behavior data that is pre-set for the purpose of interaction and is intended to control and enable a certain application through the line of data, which can be simply understood as preset control behavior data. Generally, the preset behavior data is often behavior data input in a targeted manner. The autonomous behavior data can be understood as behavior data that is spontaneously generated by the target object without a clear purpose of interaction.
[0086] Optionally, the target object includes a target user; the autonomous behavior data includes state information and / or action information of the target user, wherein the state information includes facial expression information, eye information and / or posture information; the posture information includes sitting posture and standing posture. The facial expression information may be a daily calm state, a smile, a frown, and sadness, etc. The eye action information may include eye muscle activity information, eye opening and closing information, eye sclera state information, tear state information, and / or pupil state information, etc.
[0087] Taking the target object as the target user as an example, the preset behavior data may include inputting preset voice control instructions, following specific rules to trigger the behavior of preset control elements, and inputting specific interactive gestures and other behavior data; the autonomous behavior data may include the facial expression data of the target user, etc.
[0088] S420: Determine interaction feature data of the target object according to the first behavior data.
[0089] S430: Determine a target interaction mode corresponding to the target object according to the interaction feature data.
[0090] S440: Start a target interaction device corresponding to the target interaction mode.
[0091] S450: Collect second behavior data of the target object based on the target interactive device, and determine a target application to be run according to the second behavior data.
[0092] In the process of information interaction with the target object using a determined target interaction method, the second behavior data of the target object can be collected through the target interaction device, and the corresponding target application is executed in response to the second behavior data to realize information interaction with the target object. The second behavior data can be the same as the first behavior data or different. Similarly, the second behavior data can also include preset behavior data and autonomous behavior data. For the explanation of preset behavior data and autonomous behavior data, please refer to the explanation content of part S410, which will not be repeated here.
[0093] There are many ways to determine the target application to be run based on the second behavior data. For example, when interacting with the target user by playing songs, the sound collection device collects the voice of the user saying "stop playing" or similar to terminate the playback, that is, the second behavior data is the voice of "stop playing" issued by the user. Accordingly, the target application to be run determined based on the second behavior data of the user is the target application for stopping the playback of the current song. For example, the collected second behavior data is the operation of the target user turning the pages of a book, and the target application to be run determined can be a target application for reading the text content of the next page, etc. The specific data content of the second behavior data and the specific recommended target application are not limited here.
[0094] Optionally, when the second behavior data includes preset behavior data, the target interaction device collects the second behavior data of the target object, and determines the target application according to the second behavior data, including: if the target interaction device collects the preset behavior data of the target object, then execute the target application corresponding to the preset behavior data. Exemplarily, the preset behavior data is waving hands, and the corresponding target application is playing a dance video. If the shooting device collects the waving hand behavior of the target object, then the target application that plays the relevant dance video is executed accordingly.
[0095] When the second behavior data also includes autonomous behavior data, the target interaction device collects the second behavior data of the target object, and determines the target application based on the second behavior data, including: if the preset behavior data of the target object is not collected by the target interaction device within a preset time period, then obtaining the autonomous behavior data of the target object, and determining the target application to be run based on the autonomous behavior data.
[0096] Among them, autonomous behavior data refers to the behavior actively performed by the target object collected by the target interaction device. If the target interaction device does not collect the preset behavior data of the target object within the preset time period, the target interaction device actively obtains the autonomous behavior data of the target object and determines the target application to be run based on the autonomous behavior data. Exemplarily, if the target user does not perform any behavior related to the preset behavior data within the preset time period, for example, just standing in the data collection area of the target interaction device, the facial expression information of the target user can be further obtained. If it is determined that the target user is in a daily calm state based on the facial expression information, the target application such as displaying time and / or weather information can be executed.
[0097] Optionally, determining the target application to be run according to the autonomous behavior data includes: determining the working state of the target object according to the autonomous behavior data, and determining the target application to be run based on the working state. Exemplarily, the working state may include a continuous working state and a disengaged working state. When the target object is a target user, the disengaged working state may include a fatigue state, a distracted state, etc.
[0098] Optionally, determining the working state of the target object according to the autonomous behavior data includes: determining the working state of the target object according to the autonomous behavior data and the historical behavior data. Exemplarily, the autonomous behavior data of the target object is compared with the historical behavior data, and the working state of the target object is determined according to the comparison result. For example, the autonomous behavior data of the target object can be analyzed to obtain the behavior pattern of the target object and / or the target behavior characteristics corresponding to the working state, and then the working state of the target object is determined according to the autonomous behavior data, and the behavior pattern of the target object and / or the target behavior characteristics corresponding to the working state. The advantage of such a setting is that it can assist the target object to complete the work more intelligently.
[0099] For example, by analyzing the historical behavior data, it is determined that the target user will be in a fatigued state after studying for about two hours. Then, the target user's study duration can be determined based on the current behavior data, and then whether the target user is fatigued can be determined based on whether the study duration reaches two hours. If the study duration reaches two hours, it can be determined that the target user is in a fatigued state. Of course, it can also be combined with other behavior data to further determine whether the target user is in a fatigued state. If the study duration does not reach two hours, it can be combined with other behavior data to further determine whether the target user is in a distracted state.
[0100] The target behavior characteristics corresponding to the working state can be understood as the specific behavior characteristics exhibited by the target user when in a certain working state. For example, when the target user is in a fatigued state, he or she may rub his or her eyes or yawn for many times within a period of time.
[0101] On the basis of the above-mentioned technical solutions, optionally, the method for determining the interaction mode also includes: determining the identity information of the target object, and determining the historical program running data corresponding to the identity information; accordingly, determining the target application to be run according to the second behavior data, including: accordingly, determining the target application to be run according to the second behavior data, including: determining the target application to be run according to the historical program running data and the second behavior data.
[0102] Among them, the historical program running data refers to the target application that the target object has run within a preset historical time period. The target application to be run is determined based on the historical program running data and the second behavior data. Specifically, it can be that the historical application that the target object ran based on the second behavior data in the time period closest to the current time is obtained based on the historical program running data, and the historical application is used as the target application to be run. That is, the application that was run when the user performed similar second behavior data most recently is obtained as the target application. Alternatively, the historical application that has been run the most times based on the second behavior data in the historical program running data is obtained, and the historical application is used as the target application to be run. That is, the application that the target object uses most frequently based on the second behavior data is recommended.
[0103] Optionally, after determining the target application to be run according to the second behavior data, it also includes: running the target application. In order to enhance the interactive experience of the target object and meet the personalized needs of the target object, before executing the target application, the target object may be asked whether to run the target application. Optionally, after determining the target application to be run according to the second behavior data, it also includes: generating inquiry information for asking the target object whether to run the target application, responding to feedback information from the target object to the inquiry information, and determining whether to run the target application according to the feedback information. The advantage of this setting is that it makes the interaction process more user-friendly and can more accurately respond to the needs of the target user.
[0104] The technical solution of the disclosed embodiment can, after enabling the target interaction device corresponding to the target interaction mode, collect the second behavior data of the target object based on the target interaction device, so as to more accurately determine the user's behavior intention through the second behavior data, and then determine the target application to be run according to the second behavior data, so as to improve the accuracy of responding to user needs and further enhance the user's information interaction experience.
[0105] Embodiment 5
[0106] Figure 5 A flow chart of a method for determining an interaction mode provided in Embodiment 5 of the present disclosure. This embodiment can be combined with the various optional schemes in the above embodiments. In this embodiment, optionally, the method for determining the interaction mode also includes: acquiring environmental data of the data collection area; accordingly, determining the target interaction mode corresponding to the target object according to the interaction feature data includes: determining the target interaction mode corresponding to the target object according to the environmental data and the interaction feature data.
[0107] Based on the above optional solutions, optionally, determining the target application to be run according to the second behavior data includes: determining the target application to be run according to the environment data and the second behavior data.
[0108] like Figure 5 As shown, the method for determining the interaction mode of this embodiment may specifically include:
[0109] S510: If the target object is located in the data collection area, the first behavior of the target object is obtained as data.
[0110] S520: Determine interaction feature data of the target object according to the first behavior data.
[0111] S530: Acquire environmental data of the data collection area.
[0112] In the embodiments of the present disclosure, the situation that environmental information in the interactive scene may often affect the interactive effect is fully considered. Therefore, the environmental data of the data collection area can be obtained. Specifically, the environmental data of the data collection area can be collected based on the environmental collection device. Among them, the environmental collection device can be a shooting device and / or a sound collection device. Optionally, the shooting device can be a front shooting device or a top shooting device.
[0113] For example, a camera can be used to collect the light intensity of the environment to automatically adjust the light or screen brightness according to the collected ambient light intensity. An overhead camera can also be used to collect image information of the work surface to determine whether the work surface is tidy, so as to remind the target user to tidy up the work surface and keep it tidy, etc. An overhead camera can also be used to collect the target user's writing screen, etc., and a front camera can be used to determine the target object's sitting posture, expression or eyes, etc., to determine whether the target object has bad behavior habits, for example, to remind and correct bad sitting posture, correct eye hygiene, etc. A sound collection device can also be used to collect environmental sounds, etc.
[0114] S540: Determine a target interaction mode corresponding to the target object according to the environment data and the interaction feature data.
[0115] In the disclosed embodiments, the current environment of the current object can be determined based on the acquired environmental data, and the behavioral intention with the target object can be determined based on the interaction feature data, so as to recommend a target interaction method suitable for the target object in the current environment. For example, when the environmental data shows that the target object is in a noisy environment, a prompt message can be generated and displayed. Among them, there can be multiple ways to display the prompt message, for example, by enabling voice broadcast, indicator light indication and / or display screen display to display the prompt message. It is also possible to determine the target interaction method corresponding to the target object under the environmental data based on the interaction feature data. It should be noted that the target interaction method determined based on the environmental data and the interaction feature data is a method that is conducive to improving the accuracy of the interaction, and its specific form can be determined according to actual needs, and is not specifically limited here.
[0116] On the basis of the above-mentioned optional technical solutions, optionally, after determining the target interaction mode corresponding to the target object according to the environmental data and the interactive feature data, it may also include: starting a target interaction device corresponding to the target interaction mode. Furthermore, the second behavior data of the target object is collected based on the target interaction device, and the target application to be run is determined according to the environmental data and the second behavior data. For example, if it is determined according to the environmental data that there is a lot of noise in the environment where the target object is currently located, then it can be selected to recommend a target application that responds to the second behavior data of the target user in the form of text, pictures or videos, so as to better adapt to the environment and enhance the user's interactive experience.
[0117] The technical solution of the disclosed embodiment fully considers the impact of environmental factors on the interaction process, and combines the acquired environmental data and the first behavior data to determine the most appropriate target interaction method in response to the first behavior data in the current environment, effectively ensuring the interaction effect and greatly improving the user experience.
[0118] Embodiment 6
[0119] Figure 6 This is a flow chart of a preferred example of a method for determining an interaction mode provided in Embodiment 6 of the present disclosure, see Figure 6When the target object is in the data collection area, infrared sensors and other sensors can be used to determine whether the target object is recognized within a period of time, microphones can be used to collect voice data to determine whether there is interaction with the target object within a period of time, cameras can be used to collect image data to determine whether the target object is recognized within a period of time, and touch screens can be used to determine whether there is information interaction with the target object within a period of time; to determine whether the target object is currently in front of the target interaction device. The judgment can be made by whether one or more sensors interact or recognize a specific target object / human body within a period of time (such as 5s).
[0120] Specifically, the first behavior data of the target object can be obtained based on one or more of the above-mentioned sensors, cameras, microphones, touch screens, etc.; the interaction feature data of the target object can be determined based on the first behavior data, and whether the target object has a specific behavior intention in the current scene can be judged through the interaction feature data. It is also possible to judge whether the first behavior data is a feature that meets a certain behavior intention by whether the system runs historical applications within a period of time (such as one day, one hour, 10 seconds, etc.).
[0121] Optionally, the historical record data may be used to determine whether the target object at the current moment is a historical object, that is, to determine the user's identity information. The historical record data may include historical behavior data of the historical object, or a portrait of the target object, etc., so as to more accurately determine the target interaction method or target application based on the identity information and the first behavior information and / or second behavior information of the target object. The recommendation of the target interaction method or target application includes automatically opening, automatically identifying and / or automatically running the target application, etc.
[0122] The method for determining the interaction mode provided in this embodiment can use multiple behavioral data to cross-judge and determine the interaction mode. For example, it can determine whether the target object is seated or not, whether it is working or not, the concentration, writing speed, fatigue level of the target user, etc., and determine the interaction mode in combination with multiple behavioral data and specific scenarios.
[0123] The working status of the target object can also be evaluated. For example, the learning status of the target user can be evaluated through the target user's concentration or fatigue. At the same time, performance management can be achieved by intervening in the target object. According to the actual learning data results, there are closed-loop target plans and incentive values. Personalized recommendations on interaction methods can be made based on the target object's behavioral data.
[0124] The technical solution of the disclosed embodiment is particularly suitable for the situation where the target object is located in the data collection area but has not actively issued a clear interaction request. It fully improves the initiative of the interactive device or interactive system in the interactive scenario, realizes the intelligent interaction between the interactive device or interactive system and the target object, and solves the technical problems of the related technology such as the single information interaction mode and the low information interaction efficiency, thereby achieving the technical effect of enriching the information interaction mode, improving the information interaction efficiency, and enhancing the information interaction experience of the target object.
[0125] Embodiment 7
[0126] Figure 7 This is a schematic diagram of a structure of a device for determining an interactive mode provided in Embodiment 7 of the present disclosure, such as Figure 7 As shown, the interaction mode determination device in the embodiment of the present disclosure includes: a first behavior data acquisition module 710, an interaction feature data determination module 720 and a target interaction mode determination module 730.
[0127] Among them, the first behavior data acquisition module 710 is used to obtain the first behavior data of the target object if the target object is located in the data collection area; the interaction feature data determination module 720 is used to determine the interaction feature data of the target object according to the first behavior data; the target interaction mode determination module 730 is used to determine the target interaction mode corresponding to the target object according to the interaction feature data.
[0128] Based on the above optional technical solutions, the device for determining the interaction mode may further include:
[0129] The target interaction device starting module is used to start the target interaction device corresponding to the target interaction mode.
[0130] Based on the above optional technical solutions, the target interaction device includes at least one of an infrared sensor, a shooting device, a control element and a sound collection device; wherein the control element includes a virtual control element and / or a physical control element.
[0131] Based on the above optional technical solutions, the device for determining the interaction mode may further include:
[0132] The target application recommendation module is used to collect the second behavior data of the target object based on the target interaction device after starting the target interaction device corresponding to the target interaction mode, and determine the target application to be run according to the second behavior data.
[0133] On the basis of the above optional technical solutions, the second behavior data includes preset behavior data; accordingly, the target application recommendation module includes:
[0134] The target application execution unit is used to execute the target application corresponding to the preset behavior data if the preset behavior data of the target object is collected based on the target interaction device.
[0135] Based on the above optional technical solutions, the second behavior data also includes autonomous behavior data;
[0136] Accordingly, the target application recommendation module also includes:
[0137] The target application recommendation unit is used to obtain the autonomous behavior data of the target object if the preset behavior data of the target object is not collected by the target interactive device within a preset time period, and determine the target application to be run according to the autonomous behavior data.
[0138] Based on the above optional technical solutions, the target application recommendation unit can be used to:
[0139] The working state of the target object is determined according to the autonomous behavior data, and the target application to be run is determined based on the working state.
[0140] Based on the above optional technical solutions, the target object includes the target user; the autonomous behavior data includes the state information and / or action information of the target user, wherein the state information includes facial expression information, eye information and / or posture information; the posture information includes sitting posture and standing posture.
[0141] Based on the above optional technical solutions, the device for determining the interaction mode may further include:
[0142] The environmental data acquisition module is used to acquire environmental data in the data collection area.
[0143] Accordingly, the target interaction mode determination module may include:
[0144] The first target interaction mode determining unit is used to determine the target interaction mode corresponding to the target object according to the environment data and the interaction feature data.
[0145] Based on the above optional technical solutions, the target application recommendation module can be used to determine the target application to be run according to the environmental data and the second behavior data.
[0146] On the basis of the above optional technical solutions, the target object includes a target user; the interaction mode determination device may further include:
[0147] An identity information determination module, used to determine the identity information of a target user;
[0148] Accordingly, the interaction feature data determination module may be used to:
[0149] Determine the interactive feature data of the target user according to the identity information and the first behavior data.
[0150] Based on the above optional technical solutions, the target interaction mode determination module may include:
[0151] Determine the identity information of the target object, and determine the historical program running data corresponding to the identity information;
[0152] Accordingly, the target application recommendation module may be used to:
[0153] A target application program to be run is determined according to the historical program running data and the second behavior data.
[0154] Based on the above optional technical solutions, the device for determining the interaction mode may further include:
[0155] After determining the target application to be run according to the second behavior data, running the target application; or,
[0156] After determining the target application to be run according to the second behavior data, generating inquiry information for inquiring the target object whether to run the target application, responding to feedback information of the target object to the inquiry information, determining whether to run the target application according to the feedback information.
[0157] Based on the above optional technical solutions, the target interaction mode determination module may include:
[0158] The first target interaction mode determining unit is used to determine a preset interaction mode corresponding to the target object according to the identity information, and determine a target interaction mode in the preset interaction mode according to the first behavior data.
[0159] Optionally, the target object includes a target user; and the identity information includes the age and / or gender of the target user.
[0160] The technical solution of the disclosed embodiment, by acquiring the first behavior data of the target object when the target object is located in the data collection area, can automatically acquire the first behavior data of the target object after the target object appears, and then determine the interaction feature data of the target object according to the first behavior data, so as to determine the interaction intention of the target object through the first behavior data of the target object, and finally determine the target interaction mode corresponding to the target object according to the interaction feature data. It is particularly suitable for the situation that the target object is located in the data collection area but does not actively send a clear interaction request, which fully enhances the initiative of the interaction device or interaction system in the interaction scene, realizes the intelligent interaction between the interaction device or interaction system and the target object, and solves the technical problems of single information interaction mode and low information interaction efficiency in related technologies, thereby achieving the technical effect of enriching the information interaction mode, improving the information interaction efficiency, and enhancing the information interaction experience of the target object.
[0161] The device for determining the interaction mode provided in the embodiments of the present disclosure can execute the method for determining the interaction mode provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
[0162] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
[0163] In addition, the embodiments of the present disclosure further provide an information interaction system, which is implemented based on the method for determining the interaction mode in the embodiments of the present disclosure. The system may include a data acquisition device, wherein the data acquisition device may be provided with at least one data acquisition module. Optionally, the target interaction device includes at least one of an infrared sensor, a shooting device, a control element, and a sound acquisition device; wherein the control element includes a virtual control element and / or a physical control element. Exemplarily, the data acquisition device may be integrated on a desk lamp. wherein the shooting device may include a front camera and / or a top camera. The display device may be a display device with an input function, such as a touch screen. The sound acquisition device may be a microphone, etc. The information interaction system provided by the embodiments of the present disclosure can execute the method for determining the interaction mode provided by any embodiment of the present disclosure, and has the functional modules and beneficial effects corresponding to the execution method.
[0164] Embodiment 8
[0165] refer to Figure 8, which shows a schematic diagram of the structure of an electronic device (such as a terminal device or a server) 800 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0166] like Figure 8 As shown, the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 806 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0167] Typically, the following devices may be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 806 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 809. The communication devices 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 8 The electronic device 800 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0168] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 809, or installed from a storage device 806, or installed from a ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0169] The electronic device provided in the embodiment of the present disclosure and the method for determining the interaction mode provided in the above embodiment belong to the same disclosed concept. The technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
[0170] Embodiment 9
[0171] Embodiment 5 of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the method for determining an interacting party provided in the above embodiment is implemented.
[0172] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0173] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0174] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0175] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:
[0176] If the target object is located in the data collection area, acquiring the first behavior data of the target object;
[0177] Determining interaction feature data of the target object according to the first behavior data;
[0178] A target interaction mode corresponding to the target object is determined according to the interaction feature data.
[0179] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0180] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0181] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The names of the units and modules do not, in some cases, limit the units and modules themselves. For example, the target video playback module may also be described as a "video playback module".
[0182] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0183] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0184] According to one or more embodiments of the present disclosure, [Example 1] provides a method for determining an interaction mode, the method comprising:
[0185] If the target object is located in the data collection area, acquiring the first behavior data of the target object;
[0186] Determining interaction feature data of the target object according to the first behavior data;
[0187] Determine the target interaction mode corresponding to the target object according to the interaction feature data
[0188] According to one or more embodiments of the present disclosure, [Example 2] provides a method for determining an interaction mode, further comprising:
[0189] Optionally, after determining the target interaction mode corresponding to the target object according to the interaction feature data, the method further includes:
[0190] A target interaction device corresponding to the target interaction mode is started.
[0191] According to one or more embodiments of the present disclosure, [Example 3] provides a method for determining an interaction mode, further comprising:
[0192] Optionally, the target interaction device includes at least one of an infrared sensor, a shooting device, a control element and a sound collection device; wherein the control element includes a virtual control element and / or a physical control element.
[0193] Optionally, according to one or more embodiments of the present disclosure, [Example 4] provides a method for determining an interaction mode, further comprising:
[0194] Optionally, after starting the target interaction device corresponding to the target interaction mode, the method further includes:
[0195] The second behavior data of the target object is collected based on the target interaction device, and a target application to be run is determined according to the second behavior data.
[0196] According to one or more embodiments of the present disclosure, [Example 5] provides a method for determining an interacting party, further comprising:
[0197] Optionally, the second behavior data includes preset behavior data;
[0198] Correspondingly, collecting the second behavior data of the target object based on the target interaction device and determining the target application according to the second behavior data includes:
[0199] If the preset behavior data of the target object is collected based on the target interaction device, a target application program corresponding to the preset behavior data is executed.
[0200] According to one or more embodiments of the present disclosure, [Example 6] provides a method for determining an interacting party, further comprising:
[0201] Optionally, the second behavior data further includes autonomous behavior data;
[0202] Correspondingly, collecting the second behavior data of the target object based on the target interaction device and determining the target application according to the second behavior data includes:
[0203] If the preset behavior data of the target object is not collected by the target interactive device within the preset time period, the autonomous behavior data of the target object is acquired, and the target application to be run is determined according to the autonomous behavior data.
[0204] According to one or more embodiments of the present disclosure, [Example 7] provides a method for determining an interaction mode, further comprising:
[0205] Optionally, determining a target application to be run according to the autonomous behavior data includes:
[0206] The working state of the target object is determined according to the autonomous behavior data, and the target application to be run is determined based on the working state.
[0207] According to one or more embodiments of the present disclosure, [Example 8] provides a method for determining an interaction mode, further comprising:
[0208] Optionally, the target object includes a target user; the autonomous behavior data includes state information and / or action information of the target user, wherein the state information includes facial expression information, eye information and / or posture information; and the posture information includes sitting posture and standing posture.
[0209] According to one or more embodiments of the present disclosure, [Example 9] provides a method for determining an interaction mode, further comprising:
[0210] Optionally, obtaining environmental data of the data collection area;
[0211] Correspondingly, determining the target interaction mode corresponding to the target object according to the interaction feature data includes:
[0212] A target interaction mode corresponding to the target object is determined according to the environment data and the interaction feature data.
[0213] According to one or more embodiments of the present disclosure, [Example 10] provides a method for determining an interaction mode, further comprising:
[0214] Optionally, determining a target application to be run according to the second behavior data includes:
[0215] A target application to be run is determined according to the environment data and the second behavior data.
[0216] According to one or more embodiments of the present disclosure, [Example 11] provides a method for determining an interaction mode, further comprising:
[0217] Optionally, the identity information of the target object is determined, and historical program running data corresponding to the identity information is determined;
[0218] Accordingly, determining the target application to be run according to the second behavior data includes:
[0219] A target application to be run is determined according to the identity information and the second behavior data.
[0220] According to one or more embodiments of the present disclosure, [Example 12] provides a method for determining an interaction mode, further comprising:
[0221] Optionally, after determining the target application to be run according to the second behavior data, the method further includes:
[0222] running the target application; or,
[0223] Inquiry information for inquiring the target object whether to run the target application is generated, and in response to feedback information of the target object to the inquiry information, whether to run the target application is determined according to the feedback information.
[0224] According to one or more embodiments of the present disclosure, [Example 13] provides a method for determining an interaction mode, further comprising:
[0225] Optionally, the target object includes a target user; the solution further includes:
[0226] Determining identity information of the target user;
[0227] Correspondingly, determining the interaction feature data of the target object according to the first behavior data includes:
[0228] Determine the interaction feature data of the target user according to the identity information and the first behavior data.
[0229] According to one or more embodiments of the present disclosure, [Example 14] provides a method for determining an interaction mode, further comprising:
[0230] Optionally, determining a target interaction mode corresponding to the target object according to the interaction feature data includes:
[0231] A preset interaction mode corresponding to the target object is determined according to the identity information, and a target interaction mode under the preset interaction mode is determined according to the first behavior data.
[0232] According to one or more embodiments of the present disclosure, [Example 15] provides a method for determining an interaction mode, further comprising:
[0233] The target object includes a target user; the identity information includes the age and / or gender of the target user.
[0234] According to one or more embodiments of the present disclosure, [Example 16] provides a device for determining an interaction mode, the device comprising:
[0235] A first behavior data acquisition module, configured to acquire first behavior data of the target object if the target object is located in the data collection area;
[0236] An interaction feature data determination module, configured to determine the interaction feature data of the target object according to the first behavior data;
[0237] The target interaction mode determination module is used to determine the target interaction mode corresponding to the target object according to the interaction feature data.
[0238] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0239] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0240] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
Claims
1. A method for determining an interaction mode, characterized in that: include: If the target object is located in the data collection area, acquiring first behavior data of the target object, wherein the target object includes a target user and a target object; Determining interaction feature data of the target object according to the first behavior data; Determine a target interaction mode corresponding to the target object according to the interaction feature data, the target interaction mode including a target interaction device and a target interaction content, the target interaction device interacting with the target object based on the interaction content; The determining the interaction feature data of the target object according to the first behavior data includes: Based on the interaction data type of preset interaction data, feature extraction is performed on the first behavior data, and the extracted behavior data belonging to the interaction data type is used as interaction feature data; wherein, the interaction data type is related to the object type of the target object, and the interaction feature data is feature data in the first behavior data that can be identified as having interaction intention or satisfying interaction response conditions.
2. The method according to claim 1, characterized in that After determining the target interaction mode corresponding to the target object according to the interaction feature data, the method further includes: A target interaction device corresponding to the target interaction mode is started.
3. The method according to claim 2, characterized in that The target interaction device includes at least one of an infrared sensor, a shooting device, a control element, and a sound collection device; wherein the control element includes a virtual control element and / or a physical control element.
4. The method according to claim 2, characterized in that After starting the target interaction device corresponding to the target interaction mode, the method further includes: The target interactive device collects second behavior data of the target object, and determines a target application to be run according to the second behavior data.
5. The method according to claim 4, characterized in that The second behavior data includes preset behavior data; Correspondingly, collecting the second behavior data of the target object based on the target interaction device and determining the target application according to the second behavior data includes: If the preset behavior data of the target object is collected based on the target interaction device, the target application corresponding to the preset behavior data is executed.
6. The method according to claim 4, characterized in that The second behavior data also includes autonomous behavior data; Correspondingly, collecting the second behavior data of the target object based on the target interaction device and determining the target application according to the second behavior data includes: If the preset behavior data of the target object is not collected by the target interactive device within the preset time period, the autonomous behavior data of the target object is acquired, and the target application to be run is determined according to the autonomous behavior data.
7. The method according to claim 6, characterized in that The step of determining a target application to be run according to the autonomous behavior data includes: The working state of the target object is determined according to the autonomous behavior data, and the target application to be run is determined based on the working state.
8. The method according to claim 6 or 7, characterized in that: The target object includes a target user; the autonomous behavior data includes state information and / or action information of the target object, wherein the state information includes facial expression information, eye information and / or posture information; the posture information includes sitting posture and standing posture.
9. The method according to claim 4, characterized in that Also includes: Acquiring environmental data of the data collection area; Correspondingly, determining the target interaction mode corresponding to the target object according to the interaction feature data includes: A target interaction mode corresponding to the target object is determined according to the environment data and the interaction feature data.
10. The method according to claim 9, characterized in that The step of determining the target application to be run according to the second behavior data includes: A target application to be run is determined according to the environment data and the second behavior data.
11. The method according to claim 4, characterized in that Also includes: Determine the identity information of the target object, and determine the historical program running data corresponding to the identity information; Accordingly, determining the target application to be run according to the second behavior data includes: A target application program to be run is determined according to the historical program running data and the second behavior data.
12. The method according to claim 4, characterized in that After determining the target application to be run according to the second behavior data, the method further includes: running the target application; or, Inquiry information for inquiring the target object whether to run the target application is generated, and in response to feedback information of the target object to the inquiry information, whether to run the target application is determined according to the feedback information.
13. The method according to claim 1, characterized in that The target object includes a target user; the method further includes: Determining identity information of the target object; Correspondingly, determining the interaction feature data of the target object according to the first behavior data includes: Determine the interactive feature data of the target object according to the identity information and the first behavior data.
14. The method according to claim 13, characterized in that The determining, according to the interaction feature data, a target interaction mode corresponding to the target object comprises: A preset interaction mode corresponding to the target object is determined according to the identity information, and a target interaction mode under the preset interaction mode is determined according to the first behavior data.
15. The method according to claim 14, characterized in that The target object includes a target user; the identity information includes the age and / or gender of the target object.
16. A device for determining an interaction mode, characterized in that: include: A first behavior data acquisition module, configured to acquire first behavior data of a target object if the target object is located in the data collection area; wherein the target object may include a target user and a target object; An interaction feature data determination module, configured to determine the interaction feature data of the target object according to the first behavior data; A target interaction mode determination module, configured to determine a target interaction mode corresponding to the target object according to the interaction feature data, wherein the target interaction mode includes a target interaction device and a target interaction content, and the target interaction device interacts with the target object based on the interaction content; The interaction feature data determination module is further used for: Based on the interaction data type of preset interaction data, feature extraction is performed on the first behavior data, and the extracted behavior data belonging to the interaction data type is used as interaction feature data; wherein, the interaction data type is related to the object type of the target object, and the interaction feature data is feature data in the first behavior data that can be identified as having interaction intention or satisfying interaction response conditions.
17. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the interaction mode as described in any one of claims 1-15.
18. A storage medium comprising computer executable instructions, wherein the computer executable instructions are used to perform the method for determining an interaction mode according to any one of claims 1 to 15 when executed by a computer processor.
