Equipment control method and device based on user emotion, equipment and storage medium

Abstract

The invention provides an equipment control method and device based on user emotion, equipment and a storage medium. The method comprises the steps that if current state information of a user meets a preset emotion detection condition, detection prompt information is sent out; wherein the current state information represents current position information or behavior actions of the user, and the detection prompt information is used for prompting the user to confirm whether emotion detection is allowed or not; if a detection confirmation instruction of the user is received, obtaining current emotion information of the user and current environment information of an environment where the user is located; wherein the detection confirmation instruction represents that the user allows emotion detection; according to the current emotion information and the current environment information, to-be-controlled equipment in the environment where the user is located is determined, and the to-be-controlled equipment is controlled; wherein the to-be-controlled equipment is used for adjusting the environment information. According to the method provided by the invention, the accuracy of emotion recognition and the interaction experience of the user are improved, and the balance between the privacy and personalization of the user is obviously improved.

Description

Technical Field

[0001] This application relates to the field of resource recommendation technology, and in particular to a device control method, apparatus, device and storage medium based on user emotions. Background Technology

[0002] With the advancement of information technology, various methods are available to detect users' physiological indicators and higher-level emotional information. Based on the detected results, relevant content can be recommended to users, or the operation of surrounding devices can be personalized.

[0003] With the increasing number of methods for detecting user emotions, how to conduct comfortable and accurate emotion detection for users is an urgent problem to be solved. Summary of the Invention

[0004] This application provides a device control method, apparatus, device, and storage medium based on user emotions, to improve the accuracy of emotion recognition and user interaction experience, and to improve the balance between user privacy and personalization.

[0005] Firstly, this application provides a device control method based on user emotions, including:

[0006] If the user's current state information meets the preset emotion detection conditions, a detection prompt message is issued; wherein, the current state information represents the user's current location information or behavior, and the detection prompt message is used to prompt the user to confirm whether to allow emotion detection;

[0007] If a user's confirmation instruction is received, the user's current emotional information and the current environmental information of the user's environment are obtained; wherein, the confirmation instruction indicates that the user allows the emotional detection to be performed;

[0008] Based on the current emotional information and the current environmental information, determine the device to be controlled in the user's environment, and control the device to be controlled; wherein, the device to be controlled is used to adjust the environmental information.

[0009] Secondly, this application provides a device control apparatus based on user emotions, comprising:

[0010] Detection prompt module: If the user's current state information meets the preset emotion detection conditions, a detection prompt message is issued; wherein, the current state information represents the user's current location information or behavior, and the detection prompt message is used to prompt the user to confirm whether to allow emotion detection;

[0011] Detection and confirmation module: If a detection and confirmation instruction is received from the user, the module acquires the user's current emotional information and the current environmental information of the user's environment; wherein, the detection and confirmation instruction indicates that the user allows the emotion detection to be performed;

[0012] Personalized application module: Based on the current emotion information and the current environment information, determine the device to be controlled in the user's environment, and control the device to be controlled; wherein, the device to be controlled is used to adjust the environment information.

[0013] Thirdly, this application provides an electronic device, including: a memory and a processor;

[0014] Memory; memory for storing executable instructions of the processor;

[0015] The processor executes computer execution instructions stored in the memory to implement the method as described in the first aspect.

[0016] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method described in the first aspect.

[0017] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the method described in the first aspect.

[0018] This application provides a device control method, apparatus, device, and storage medium based on user emotions. If the user's current state information meets preset emotion detection conditions, the management system issues a detection prompt message. This prompt message asks the user to confirm whether emotion detection is permitted, avoiding user discomfort and improving user comfort. If the user's confirmation is received, the system acquires the user's current emotion information and the current environmental information of the user's environment. Finally, based on the current emotion and environmental information, the system determines the device to be controlled in the user's environment and adjusts the environmental information by controlling the device. This application's embodiments achieve personalized recommendations based on user emotions and adjust environmental information accordingly, improving the user's interactive experience and balancing user privacy and personalization. Attached Figure Description

[0019] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0020] Figure 1A flowchart illustrating a device control method based on user emotions provided in an embodiment of this application;

[0021] Figure 2 A schematic diagram illustrating the process of collecting emotions and personal preferences as provided in the embodiments of this application;

[0022] Figure 3 A flowchart illustrating the personalized recommendation process provided in this application embodiment;

[0023] Figure 4 A flowchart illustrating a device control method based on user emotions provided in an embodiment of this application;

[0024] Figure 5 This is an example diagram of the state library shown in the embodiment;

[0025] Figure 6 A structural block diagram of a device control apparatus based on user emotions provided in an embodiment of this application;

[0026] Figure 7 A structural block diagram of an electronic device provided in an embodiment of this application;

[0027] Figure 8 This is a block diagram illustrating an electronic device according to an exemplary embodiment.

[0028] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0030] It should be understood that the described embodiments are merely some, not all, of the embodiments in this application. All other embodiments obtained by those skilled in the art based on the embodiments in this application without inventive effort are within the scope of protection of this application.

[0031] In the following description, when referring to the accompanying drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0032] In the description of this application, it should be understood that the terms "first," "second," "third," etc., are used only to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor should they be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0033] It should be noted that, due to space limitations, this application specification does not exhaustively list all possible implementation methods. Those skilled in the art, after reading this application specification, should be able to deduce that, as long as the technical features do not contradict each other, any combination of technical features can constitute an optional implementation method. The following provides a detailed description of each embodiment.

[0034] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with relevant laws, regulations and standards, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0035] With the advancement of information technology, various methods are available to detect users' physiological indicators and higher-level emotional information. Based on the detected results, relevant content can be recommended to users. This recommendation can include digital content and services from the internet, as well as personalized control of device operation.

[0036] Current technologies mostly rely on direct detection of users' physiological indicators and higher-level emotional information, without fully considering how to protect personal privacy when detecting emotional information. Furthermore, they require users to actively output voice and text information, and then the system changes the behavior of smart home devices based on the emotional analysis of the voice and the converted text. This method cannot achieve automatic emotion detection without users actively outputting content, nor can it solve the problem of changing the behavior of smart devices based on the user's emotional state.

[0037] In addition, existing technologies mostly rely on summarizing users' past preferences to influence device behavior. The limitation is that the analysis of past user preferences does not align with the user's current emotional state, and it is confined to a relatively shallow level of human-device interaction.

[0038] This application provides a device control method, apparatus, device, and storage medium based on user emotions, aiming to solve the above-mentioned technical problems in the prior art.

[0039] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0040] Figure 1 This is a flowchart illustrating a device control method based on user emotions according to an embodiment of this application. This method can be executed by a device control device based on user emotions. Figure 1 As shown, the method includes the following steps:

[0041] S101. If the user's current state information meets the preset emotion detection conditions, a detection prompt message is issued; wherein, the current state information represents the user's current location information or behavior, and the detection prompt message is used to prompt the user to confirm whether to allow emotion detection.

[0042] For example, the user's current state information can be obtained in real time. This current state information could represent the user's current location or actions. Pre-set emotion detection conditions are defined as behaviors or actions that trigger the system to provide detection prompts to the user.

[0043] It can determine in real time whether the user's current state information meets preset emotion detection conditions. For example, the emotion detection conditions may include preset actions. If the user's current action is a preset action, then the preset emotion detection conditions are met. If met, a detection prompt message can be sent to the user to confirm whether they allow the emotion detection; if not met, no detection prompt message is sent. The detection prompt message can be played as voice in the user's environment or sent to the user's terminal device.

[0044] In this embodiment, if the user's current state information meets the preset emotion detection conditions, a detection prompt message is issued, including: if the user's current location information is within a preset location range, and the user's dwell time at the current location information exceeds a preset time threshold, then the user's current state information is determined to meet the preset emotion detection conditions, and a detection prompt message is issued; or, if the user's current behavior is determined to be a preset action, then the user's current state information is determined to meet the preset emotion detection conditions, and a detection prompt message is issued.

[0045] Specifically, the current state information represents the user's current location or behavior. Taking two scenarios as examples, one is when a person is in a physical space. Various technologies can be used for detection, such as infrared sensors or connecting the user's mobile device to the physical space's Wi-Fi to obtain the user's current state information. If a person is detected in the physical space, stays for a certain period, or performs a specific action (such as exercising), the detection operation is triggered. The other scenario is when a person is in a digital space, such as online shopping, chatting on chat tools, or watching short videos. Detection can also be triggered when the user is using these applications. Detection prompts are used to ask the user to confirm whether they allow emotion detection. Examples include using a specific flashing frequency, a specific color indicator light, a specific sound effect from the speaker, or a special vibration from the user's smartwatch.

[0046] The advantage of this setup is that it makes it easier to inform users of the intention to start monitoring their status, ensuring that users have the right to know and fully considering the issue of user privacy protection.

[0047] S102. If a user's detection confirmation instruction is received, the user's current emotional information and the current environmental information of the user's environment are obtained; wherein, the detection confirmation instruction indicates that the user allows the emotion detection to be performed.

[0048] For example, a user can issue a confirmation command in response to the detection prompt. For instance, a user can say "agree to detection" via voice or click the "agree to detection" control on the terminal device. If the user's confirmation command is received, the system can obtain the user's current emotional information and the current environmental information of the user's environment. For example, the current emotional information could be the user's facial expressions and body language, while the current environmental information could be the ambient temperature, humidity, wind speed, wind direction, and light intensity.

[0049] Figure 2The example illustrates a flowchart of emotion and personal preference collection according to an embodiment. The detection confirmation instruction indicates that the user currently agrees to emotion detection. Emotion information is divided into a first emotion and a second emotion. Current environmental information includes information such as light intensity and air conditioning temperature. For example, a user is passing through the lobby of a building. There are cameras on the way to the elevator. The user's mobile terminal has a built-in detection confirmation module. When the user walks near the cameras, the mobile terminal receives a message from the lobby management module asking the user to confirm whether their facial expression can be detected. If the user agrees, they select "agree" on the mobile terminal and inform the management module. If the user does not agree to the detection, the next steps are not performed. If the user does not respond, the preferred approach is not to detect. If the user is in a public place where mandatory detection is required, the detection result is not saved in the state database. The user's feedback method is not limited, for example: through voice dialogue, through operation on the mobile terminal, through the control panel of a smart home, etc.

[0050] In this embodiment, determining the controllable device in the user's environment based on the current emotion information and the current environment information includes: if the emotion information is a preset first emotion, then obtaining the target environment information from a preset state database, wherein the preset state database stores the environment information when the user is in a preset second emotion within a preset historical time period, the preset first emotion represents a negative emotion, and the preset second emotion represents a positive emotion; determining the controllable device in the user's environment based on the target environment information and the current environment information.

[0051] Specifically, the current emotion information represents the user's current emotional state, including primary and secondary emotions. The current environmental information can include ambient temperature, humidity, wind speed, wind direction, light intensity, etc. A state database is pre-set, containing preset emotion and environmental information for historical time periods. The target environmental information is the environmental information corresponding to when the user's emotional state is positive. For example, when the user's emotion is sadness, the target environmental information for a happy emotion is retrieved from the system's state database. Then, based on the preset target environmental information in the state database, the device to be controlled in the user's current environment is determined.

[0052] The advantage of this setup is that it makes it easier to identify the device to be controlled by the user, thereby improving the user's control efficiency over the device.

[0053] S103. Based on the current emotional information and the current environmental information, determine the device to be controlled in the user's environment and control the device to be controlled; wherein, the device to be controlled is used to adjust the environmental information.

[0054] For example, a database is pre-set as a state database. If the user's current emotional state is happy, the user's current emotional state is associated with the current environmental information and stored in the state database. When the user selects a preference in the state database, the device to be controlled is determined accordingly. For example, if the user selects a low-temperature air conditioner, the device to be controlled is determined to be an air conditioner. The target environmental information is determined based on the weight of the environmental information in the state database. For example, if the device control parameter selected based on the weight is: temperature = 23 degrees, then the air conditioner temperature is adjusted to 23 degrees.

[0055] In this embodiment, determining the device to be controlled in the user's environment based on the target environment information and the current environment information includes: determining the environment information to be adjusted in the current environment information based on the target environment information and the current environment information; and determining the device to be controlled based on the environment information to be adjusted.

[0056] Figure 3 The flowchart illustrating personalized recommendations according to an embodiment is shown below. This method can be performed by a device control device based on user emotions.

[0057] Specifically, the target environmental information is the environmental information corresponding to when the user's emotional state is positive. The current environmental information can be the temperature, humidity, wind force, wind direction, light intensity, etc. Based on the target environmental information, the environmental information to be adjusted in the current environmental information is determined, thereby determining the equipment to be controlled.

[0058] If the user's current emotional state is happy, the user's emotional state and the current environmental information are stored in the state database. When the user selects a preference in the state database, the device to be controlled is determined accordingly. For example, if the user selects a preference for low temperature air conditioning, the device to be controlled is determined to be air conditioning. If the user also selects a preference for soothing background music, but there is no background music system in the space, the preference for soothing background music is ignored, and only air conditioning is selected as the target device.

[0059] The advantage of this setup is that it facilitates the rapid identification of environmental information to be adjusted and equipment to be controlled, thereby improving the efficiency of environmental adjustment for users.

[0060] In this embodiment, if the user's current state information meets the preset emotion detection conditions, the management system issues a detection prompt message. This prompt message asks the user to confirm whether they wish to allow emotion detection, avoiding user discomfort and improving user comfort. If the user's confirmation is received, the system acquires the user's current emotion information and the current environmental information of the user's environment. Finally, based on the current emotion and environmental information, the system determines the controllable device in the user's environment and adjusts the environmental information by controlling the device. This embodiment achieves personalized recommendations based on user emotion information and adjusts environmental information accordingly, improving the user's interactive experience and balancing user privacy and personalization.

[0061] Figure 4 This is a flowchart illustrating a device control method based on user emotions, provided in an embodiment of this application. This method can be executed by a device control device based on user emotions.

[0062] In this embodiment, if the current emotional information is a preset second emotion, the current environmental information is stored in a preset state database; the information category corresponding to the current environmental information is determined according to the preset information categories in the preset state database; the category weight of the information category corresponding to the current environmental information is determined according to the number of environmental information in the information category corresponding to the current environmental information; wherein, the category weight represents the user's preference for the environmental information in the information category.

[0063] like Figure 4 As shown, the method includes the following steps:

[0064] S401. If the current emotional information is the preset second emotion, then store the current environmental information in the preset state database.

[0065] For example, the preset second emotion represents a positive emotion, such as happiness or joy. The current environmental information represents the temperature, humidity, wind force, wind direction, light intensity, and other information of the environment when the user is in a positive emotion. There is a preset database as a state database for storing user preferences. If the user's emotion in the current environment is happiness, the collected environmental information such as temperature, humidity, wind force, wind direction, light intensity, etc. are stored as user preferences in the preset state database.

[0066] The advantage of this setup is that it facilitates the collection of users' secondary emotions and current environmental information, enriches the user preference information in the state database, and gives users more choices when selecting preferences.

[0067] S402. Determine the information category corresponding to the current environment information based on the preset information categories in the preset state database.

[0068] For example, a database is preset as a state database. The preset information categories are information pre-stored in the state database, namely emotional information and environmental information. The emotional information category includes information such as happy, joyful, and sad, and the environmental information category includes information such as light intensity and air conditioning temperature. For example, the information category corresponding to the current environment can be determined as air conditioning temperature by combining the different classifications of the preset information categories in the state database.

[0069] The advantage of this setup is that it categorizes different types of information, making it easier for the system to store information in an orderly manner and for users to make selections when inputting preference information.

[0070] S403. Determine the category weight of the information category corresponding to the current environmental information based on the quantity of environmental information in the information category corresponding to the current environmental information; wherein, the category weight represents the user's preference for environmental information in the information category.

[0071] For example, the weights represent the importance of various types of information in the state database, which accumulates the user's personal preferences collected over a period of time, in certain physical spaces, and under certain scenarios. Chronologically, older states have lower weights, while more recent states have higher weights; if the same state is collected multiple times along a certain dimension, its weight accumulates and becomes even higher.

[0072] Figure 5 An example diagram of the state library in the embodiment is shown in the figure below, such as Figure 5 As shown, the state database contains users' emotional information and corresponding environmental information stored in a timeline. The longer the time, the lower the weight; the more times the data is collected, the higher the weight. The weights are accumulated to obtain the state database after the individual's state is accumulated.

[0073] The advantage of this setup is that it facilitates the classification and management of emotional and environmental information, and helps to determine the user's level of preference.

[0074] In this embodiment, if the emotion information is a preset first emotion, then the target environment information is obtained from a preset database, including: if the emotion information is a preset first emotion, then the target category is determined according to the category weight of the information category in the preset state database; and the environment information corresponding to the target category is determined as the target environment information.

[0075] For example, the preset first emotion represents a negative emotion, and the target environmental information is the environmental information corresponding to when the user's emotional state is positive. The preset database serves as a state library for storing emotional and environmental information. For example, if the user's emotion is sadness, then the user's emotional information and air conditioning temperature information at this time are collected. The environmental information at this time is not directly used as the user's preference, but is formed as a temporary record. The air conditioning temperature corresponding to happiness is obtained from the state library. Based on the category weight of the air conditioning temperature in the state library, the one with the higher weight is used as the target air conditioning temperature.

[0076] The advantage of this setup is that it facilitates the classification and management of emotional and environmental information, and helps to determine the user's level of preference.

[0077] In this embodiment, in response to the user's instruction to select an information category in a preset state database, the information category selected by the user is determined; the environmental information corresponding to the information category selected by the user is determined as the target environmental information.

[0078] For example, the information categories are emotional information and environmental information. The emotional information category includes information such as happy, joyful, and sad, while the environmental information category includes information such as light intensity and air conditioning temperature. The selection instruction is the user's preferred information. For instance, when the user inputs the preferred information as low brightness light, if the user's information category is determined to be light intensity, then light intensity is determined as the environmental information to be adjusted.

[0079] The advantage of this setup is that it allows for faster determination of target environmental information, making it easier for users to adjust the device and improving the efficiency of adjusting environmental information.

[0080] In this embodiment, the user wears a terminal device; issuing a detection prompt message includes: if it is determined that the user's terminal device has enabled a preset connection method, then sending the detection prompt message to the user's terminal device; wherein, the preset connection method is Bluetooth connection or Wi-Fi connection.

[0081] For example, the terminal device includes devices such as smartwatches or mobile phones. When a user enters a preset scene, if the terminal device carried by the user connects to the preset Bluetooth or Wi-Fi of the current scene, a detection prompt will be triggered, and a detection prompt message will be sent to the user's terminal device. The detection prompt message can be implemented in various ways, such as: using a specific flashing frequency, a specific color indicator light; a speaker emitting a specific sound effect; or the user's own smartwatch emitting a special vibration, etc.

[0082] The advantage of this setup is that the detection prompts clearly inform users of the intent to detect their personal privacy information, thus fully considering the issue of user privacy protection.

[0083] In this embodiment, if the user's current state information meets the preset emotion detection conditions, the management system issues a detection prompt message. This prompt message asks the user to confirm whether they wish to allow emotion detection. If the user confirms, the system acquires the user's current emotion information and the current environmental information of the user's environment. Finally, based on the current emotion information and environmental information, the system determines the device to be controlled in the user's environment and adjusts the environmental information by controlling the device. This embodiment achieves personalized recommendations based on user emotion information and adjusts environmental information accordingly, improving the user's interactive experience and balancing user privacy and personalization.

[0084] Figure 6 This is a structural block diagram of a device control apparatus based on user emotions, provided as an embodiment of this application. For ease of explanation, only the parts relevant to the embodiments of this disclosure are shown. (Refer to...) Figure 6 The device control device 600 based on user emotions includes: a detection prompt module 601, a detection confirmation module 602, and a personalized application module 603.

[0085] The detection prompt module 601 is used to issue a detection prompt if the user's current state information meets the preset emotion detection conditions; wherein, the current state information represents the user's current location information or behavior, and the detection prompt is used to prompt the user to confirm whether to allow emotion detection.

[0086] The detection confirmation module 602 is used to obtain the user's current emotion information and the current environment information of the user's environment if it receives a detection confirmation instruction from the user; wherein, the detection confirmation instruction indicates that the user allows emotion detection;

[0087] The personalized application module 603 determines the device to be controlled in the user's environment based on the current emotion information and the current environment information, and controls the device to be controlled; wherein the device to be controlled is used to adjust the environmental information.

[0088] In one example, the detection prompt module is specifically used for:

[0089] If the user's current location information is within a preset location range, and the user's dwell time at the current location information exceeds a preset time threshold, then the user's current state information is determined to meet preset emotion detection conditions, and a detection prompt message is issued; or,

[0090] If the user's current behavior is determined to be a preset action, then the user's current state information is determined to meet the preset emotion detection conditions, and a detection prompt message is issued.

[0091] In one example, the detection confirmation module 602 includes:

[0092] An information acquisition unit is used to acquire target environment information from a preset state database if the emotion information is a preset first emotion.

[0093] The device determination unit is used to determine the device to be controlled in the user's environment based on the target environment information and the current environment information.

[0094] In one example, the personalization application module 603 includes:

[0095] The first determining unit is configured to determine the environmental information to be adjusted in the current environmental information based on the target environmental information and the current environmental information.

[0096] The second determining unit is used to determine the device to be controlled based on the environmental information to be adjusted.

[0097] One example also includes:

[0098] The storage module is used to store the current environment information into a preset state database if the current emotion information is a preset second emotion;

[0099] The information determination module determines the information category corresponding to the current environment information based on the preset information categories in the preset state database.

[0100] The weight determination module is used to determine the category weight of the information category corresponding to the current environmental information based on the quantity of environmental information in the information category corresponding to the current environmental information; wherein, the category weight represents the degree of user preference for environmental information in the information category.

[0101] One example also includes:

[0102] The category determination module is used to determine the target category based on the category weight of the information category in the preset state database if the emotion information is a preset first emotion.

[0103] The environmental information determination module is used to determine the environmental information corresponding to the target category as the target environmental information.

[0104] In one example, if the user's current state information meets preset emotion detection conditions, a detection prompt message is issued, which also includes:

[0105] The response module is used to respond to the user's selection instruction for information categories in the preset state library and determine the information category selected by the user;

[0106] The confirmation module is used to determine the environmental information corresponding to the information category selected by the user as the target environmental information.

[0107] In one example, the user wears a terminal device; the detection prompt message also includes:

[0108] The sending module is used to send the detection prompt information to the user's terminal device if it is determined that the user's terminal device has enabled a preset connection method; wherein the preset connection method is Bluetooth connection or Wi-Fi connection.

[0109] Figure 7 This is a structural block diagram of an electronic device provided in an embodiment of this application. Figure 7 As shown, the electronic device includes: a memory 71 and a processor 72; the memory 71 is a memory for storing executable instructions of the processor 72.

[0110] The processor 72 is configured to perform the method provided in the above embodiments.

[0111] The electronic device also includes a receiver 73 and a transmitter 74. The receiver 73 is used to receive instructions and data sent by other devices, and the transmitter 74 is used to send instructions and data to external devices.

[0112] Figure 8 This is a block diagram illustrating an electronic device according to an exemplary embodiment. The device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc.

[0113] The device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0114] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0115] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0116] Power supply component 806 provides power to various components of device 800. Power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 800.

[0117] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0118] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0119] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0120] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0121] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0122] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0123] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0124] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a terminal device, enables the terminal device to perform a user emotion-based device control method for the aforementioned electronic device.

[0125] This application also discloses a computer program product, including a computer program that, when executed by a processor, implements the method described in this embodiment.

[0126] Various embodiments of the systems and technologies described above in this application can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0127] The program code used to implement the methods of this application may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that when executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or electronic device.

[0128] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0129] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0130] The systems and technologies described herein can be implemented in computing systems that include back-end components (e.g., as data electronic devices), or computing systems that include middleware components (e.g., application electronic devices), or computing systems that include front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and technologies described herein), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0131] Computer systems can include client and electronic devices. Clients and electronic devices are generally geographically separated and typically interact via communication networks. The client-electronic device relationship is created by computer programs running on the respective computers and having a client-electronic device relationship with each other. The electronic device can be a cloud electronic device, also known as a cloud computing electronic device or cloud host, a host product within the cloud computing service system, addressing the shortcomings of traditional physical hosts and VPS services ("Virtual Private Server," or simply "VPS") in terms of management difficulty and weak business scalability. The electronic device can also be an electronic device in a distributed system or an electronic device incorporating blockchain technology. It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this application is achieved, and this is not limited herein.

[0132] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0133] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A device control method based on user emotions, characterized in that, include: If the user's current state information meets the preset emotion detection conditions, a detection prompt message is issued; wherein, the current state information represents the user's current location information or behavior, and the detection prompt message is used to prompt the user to confirm whether to allow emotion detection; If a user's confirmation instruction is received, the user's current emotional information and the current environmental information of the user's environment are obtained; wherein, the confirmation instruction indicates that the user allows the emotional detection to be performed; Based on the current emotional information and the current environmental information, determine the device to be controlled in the user's environment, and control the device to be controlled; wherein, the device to be controlled is used to adjust the environmental information.

2. The method according to claim 1, characterized in that, Based on the current emotion information and the current environment information, determine the devices to be controlled in the user's environment, including: If the emotional information is a preset first emotion, then the target environment information is obtained from a preset state database; wherein, the preset state database stores the environment information when the user is in a preset second emotion within a preset historical time period; the preset first emotion represents a negative emotion, and the preset second emotion represents a positive emotion; Based on the target environment information and the current environment information, determine the devices to be controlled in the user's environment.

3. The method according to claim 2, characterized in that, Also includes: If the current emotion information is a preset second emotion, then the current environment information is stored in a preset state database; The information category corresponding to the current environment information is determined based on the preset information categories in the preset state database; The category weight of the information category corresponding to the current environmental information is determined based on the number of environmental information items in the information category corresponding to the current environmental information; wherein, the category weight represents the degree of user preference for environmental information in the information category.

4. The method according to claim 3, characterized in that, If the emotional information is a preset first emotion, then target environment information is obtained from a preset database, including: If the emotional information is a preset first emotion, then the target category is determined according to the category weight of the information category in the preset state library; The environmental information corresponding to the target category is determined as the target environmental information.

5. The method according to claim 4, characterized in that, Based on the target environment information and the current environment information, determine the devices to be controlled in the user's environment, including: Based on the target environment information and the current environment information, determine the environment information to be adjusted in the current environment information; Based on the information about the environment to be adjusted, the device to be controlled is determined.

6. The method according to claim 3, characterized in that, Also includes: In response to the user's instruction to select an information category from a preset state library, determine the information category selected by the user; The environmental information corresponding to the information category selected by the user will be determined as the target environmental information.

7. The method according to any one of claims 1-6, characterized in that, If the user's current state information meets the preset emotion detection conditions, a detection prompt message will be issued, including: If the user's current location information is within a preset location range, and the user's dwell time at the current location information exceeds a preset time threshold, then the user's current state information is determined to meet preset emotion detection conditions, and a detection prompt message is issued; or, If the user's current behavior is determined to be a preset action, then the user's current state information is determined to meet the preset emotion detection conditions, and a detection prompt message is issued.

8. The method according to claim 7, characterized in that, The user is wearing a terminal device; a detection prompt message is issued, including: If it is determined that the user's terminal device has enabled a preset connection method, then the detection prompt information is sent to the user's terminal device; wherein, the preset connection method is Bluetooth connection or Wi-Fi connection.

9. A device control apparatus based on user emotions, characterized in that, include: The detection prompt module is used to issue a detection prompt if the user's current state information meets the preset emotion detection conditions; wherein, the current state information represents the user's current location information or behavior, and the detection prompt is used to prompt the user to confirm whether to allow emotion detection. The detection confirmation module is used to obtain the user's current emotional information and the current environmental information of the user's environment if it receives a detection confirmation instruction from the user; wherein, the detection confirmation instruction indicates that the user allows the emotional detection to be performed; The device control module is used to determine the device to be controlled in the user's environment based on the current emotion information and the current environment information, and to control the device to be controlled; wherein the device to be controlled is used to adjust the environmental information.

10. An electronic device, characterized in that, include: Memory, processor; Memory; Memory used to store the processor's executable instructions; The processor is configured to execute the method as described in any one of claims 1-8 according to the executable instructions.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-8.

12. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1-8.

Images