Device recommendation method, related device and communication system

Abstract

The invention discloses an equipment recommendation method, a related device and a communication system, in the method, electronic equipment can obtain information such as historical records of intelligent household equipment controlled by a user and the position of the electronic equipment, and sends the information to a server; the server can predict the smart home device to be controlled by the user based on the information and the own state information sent by the smart home device, and sends the predicted information (such as control information, state information and the like) of the smart home device to the electronic device. The electronic equipment can display the information of the smart home equipment predicted by the server so as to recommend the information to the user. Therefore, the time of searching the equipment by the user can be saved, the efficiency of controlling the equipment by the user is improved, and the aim of quickly controlling massive equipment by the user is fulfilled. Besides, in the method, the electronic equipment can also support the user to autonomously set the equipment recommendation rule, so that the purpose of more accurately recommending the equipment is achieved, and the user experience is further improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a device recommendation method, related devices and a communication system. Background Art

[0002] With the development of the Internet of Things (IoT) technology and the popularization of whole-house intelligence, the use of smart home devices is becoming more and more common. Users can control smart home devices through smart home applications (APPs) in electronic devices such as mobile phones and tablets.

[0003] However, when a user owns a large number of smart home devices, if the user wants to control a certain smart home device, the user needs to swipe up or turn the page on the smart home device display page of the above-mentioned smart home application to find the corresponding smart home device and then control it. The whole process is complicated and cumbersome, and the interaction efficiency is low.

[0004] Therefore, when there are a large number of smart home devices, how to enable users to find target devices efficiently and quickly is a problem that needs to be solved urgently. Summary of the invention

[0005] The embodiments of the present application provide a device recommendation method, related devices and communication system. The device recommendation method can save users time in searching for devices and improve the efficiency of users in controlling devices.

[0006] In a first aspect, an embodiment of the present application provides a device recommendation method, the method comprising: an electronic device displays a first component, the first component presents at least one control on the electronic device for controlling or triggering control of at least one smart device, the at least one smart device is a smart device determined as a priority recommended smart device included in the user's environment, and the at least one control includes a first control; the electronic device detects a first operation of the user on the first control; in response to the first operation, the electronic device controls at least one smart device corresponding to the first control.

[0007] Among them, the above-mentioned first component can be a component with a display style such as a card, 3D, etc., and the electronic device can display information of one or more recommended devices (such as smart devices of the home type, etc.) through the first component (for example, at least one control for controlling or triggering control of the smart device, etc.), the first control can be a control for controlling at least one recommended device (such as a switch control, etc.), and the first operation can be, for example, a click operation, etc.

[0008] By implementing the method provided in the first aspect, an electronic device can display controls for one or more smart devices in a user interface such as a desktop, without the need for the user to enter an application for managing the one or more smart devices to search for and control the smart devices. This can solve the problem of low efficiency in users actively searching for devices, and upgrade the process from people looking for devices to devices looking for people. This saves users time in searching for devices, improves the efficiency of users controlling devices, and enables users to quickly control a large number of devices.

[0009] In one possible implementation, the electronic device displays a first component at a first moment. After the electronic device displays the first component, the method further includes: the electronic device updates and displays the first component at a second moment, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.

[0010] The first moment is different from the second moment, and the first moment is earlier than the second moment. In this way, the electronic device can automatically update and display the first component at different moments, so as to present the user with the information of one or more smart devices that are currently recommended.

[0011] In one possible implementation, after the electronic device displays the first component, the method also includes: the electronic device detects that the position of the electronic device switches from the first position to the second position; in response to the switch, the electronic device updates the display of the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.

[0012] In this way, when the user is in a different position (for example, switching from a first position to a second position), the electronic device can automatically update and display the first component based on the user's current position (i.e., the second position) so that information of smart devices that are closer to the user's current position can be presented, thereby facilitating the user to control the smart device and improving the user experience.

[0013] In one possible implementation, after the electronic device displays the first component, the method also includes: the electronic device detects a second operation of the user on the first component; in response to the second operation, the electronic device updates and displays the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.

[0014] The second operation may be, for example, Figure 3A The exemplary example includes a click operation on option 311E, or a sliding operation on the first component.

[0015] In this way, the user can trigger the electronic device to update the display of the first component through active operation.

[0016] In a possible implementation, the first component is displayed floating on a first user interface of the electronic device; or, the first component is displayed in the first user interface.

[0017] That is to say, the first component can be independent of the first user interface and not belong to the first user interface, for example, displayed on the first user interface in the form of a floating window; or it can be a part of the first user interface and displayed in the first user interface. In this way, different visual experiences can be provided to users.

[0018] In a possible implementation, the first user interface is one or more of the following interfaces: desktop, screen-off display interface, lock screen interface, negative one screen interface, and control center interface.

[0019] That is to say, the above-mentioned first component can be displayed on only one interface, or can be displayed on multiple interfaces at the same time, so that the efficiency of users finding and controlling smart devices can be improved.

[0020] In a possible implementation, before the electronic device displays the first component, the method further includes: the electronic device detects a third operation of the user; the electronic device displays the first component, specifically including: in response to the third operation, the electronic device displays the first component.

[0021] The third operation may be, for example, an operation in which a user unlocks the electronic device to enter the desktop, a user slides up on the desktop, or a user clicks on the desktop. Fig. 9A Operations of icon 911 shown, etc.

[0022] In this way, the user can trigger the electronic device to display the first component through active operation.

[0023] In a possible implementation, before the electronic device displays the first component, the method further includes: the electronic device obtains status information of at least one smart device; the electronic device displays the first component, specifically including: the electronic device displays the first component based on the status information of at least one smart device.

[0024] In this way, the electronic device can automatically make device recommendations based on the status information of the smart device, so that the user can timely check the current status of the smart device and further control the recommended smart device in a timely manner.

[0025] In a possible implementation, the first component is displayed in the style of a resident card.

[0026] In this way, the user can see the information of the recommended device in time when using the electronic device, without the need for manual operation by the user, which is convenient and quick.

[0027] In a possible implementation, the first component is displayed in a non-resident card style.

[0028] In this way, the user can trigger the electronic device to display the information of the recommended device through manual operation, and the user can have more initiative to choose whether to display the information of the recommended device. When the information of the recommended device does not need to be displayed, the display space of the electronic device will not be occupied.

[0029] In a possible implementation, before the electronic device displays the first component, the electronic device also displays a second control, and the third operation is an operation of the user on the second control.

[0030] The second control may be, for example, Fig. 9A As shown in the icon 911 , the user can trigger the display of the information of the recommended device by clicking the icon 911 , so that the user can quickly control the recommended device.

[0031] In a possible implementation manner, the first component is displayed in 3D style.

[0032] In this way, it is convenient for users to perform three-dimensional control operations on the recommended devices, thereby providing users with better visual experience and operation experience.

[0033] In a possible implementation manner, the first control is used to control one or more smart devices among the priority recommended smart devices.

[0034] In this way, the user can control a single smart device by operating the first control, or can control multiple smart devices with one click.

[0035] In one possible implementation, the first control is a control for controlling a switch of a smart device; the first operation is an on operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device turns on at least one smart device corresponding to the first control; or, the first operation is a off operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device turns off at least one smart device corresponding to the first control.

[0036] In this way, when the user performs an opening operation on the first control, the electronic device can turn on at least one smart device, and when the user performs a closing operation on the first control, the electronic device can turn off at least one smart device, which is convenient, fast and efficient.

[0037] In a possible implementation, the first control is a control for adjusting a function parameter of the smart device, and the first operation is an operation of a user adjusting the function parameter.

[0038] Among them, the above-mentioned functional parameters may refer to parameters corresponding to one or more functions (such as brightness, temperature, volume, wind speed, color temperature, etc.) provided by the smart device.

[0039] In this way, users can quickly adjust the functional parameters of smart devices and improve the efficiency of user control of devices.

[0040] In a possible implementation, the functional parameter is brightness, the first operation is a brightness adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the brightness of at least one smart device corresponding to the first control; or, the functional parameter is temperature, the first operation is a temperature adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the temperature of at least one smart device corresponding to the first control; or, the functional parameter is volume, the first operation is a volume adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the volume of at least one smart device corresponding to the first control.

[0041] In this way, users can easily and quickly adjust the brightness, temperature, volume and other functional parameters of smart devices.

[0042] In one possible implementation, at least one smart device includes a first smart device, and at least one control includes a third control, where the third control is used to trigger control of the first smart device. The method also includes: the electronic device detects a fourth operation of the user on the third control; in response to the fourth operation, the electronic device displays a second component, on which at least one control for controlling the first smart device is presented, and the at least one control includes a fourth control; the method also includes: the electronic device detects a fifth operation of the user on the fourth control; in response to the fifth operation, the electronic device controls the first smart device.

[0043] Among them, the above-mentioned first smart device may be a smart device with more complex functions, the third control may be a control for triggering control of the smart device, the fourth operation may be, for example, a click operation, the second component may be a component for presenting at least one control of the smart device, the fourth control may be a control for controlling the smart device, and the fifth operation may be an operation on the control (such as a click operation, a sliding operation, etc.).

[0044] In this way, users can also quickly control some smart devices with complex functions.

[0045] In one possible implementation, at least one smart device satisfies one or more of the following conditions: being used periodically by a user, being at a distance from the electronic device that is less than a preset distance threshold, being operated by a user within a preset time period, being on the same network as the electronic device, and being in an abnormal state.

[0046] In this way, the electronic device can automatically recommend devices when the smart device meets the above conditions, and can provide users with an intelligent experience.

[0047] In a possible implementation, at least one smart device is determined based on a first preset condition, where the first preset condition includes one or more of the following: a first preset time has arrived, the electronic device is at a first preset location, and the user is in a first preset scene.

[0048] In this way, the electronic device can make device recommendations when the smart device meets the user's preset conditions, which can achieve the purpose of making device recommendations more accurately and give the user a personalized experience.

[0049] In a second aspect, an embodiment of the present application provides an electronic device, which includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method described in any possible implementation method of the first aspect above.

[0050] In a third aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed on an electronic device, the electronic device executes the method described in any possible implementation of the first aspect above.

[0051] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1A-1F is a user interface diagram for a group of users to search for smart home devices provided by an embodiment of the present application;

[0053] Figure 2 It is a schematic diagram of the architecture of a communication system provided by an embodiment of the present application;

[0054] Figure 3A-3EIt is a schematic diagram of a user interface for performing device recommendation in a single device dimension provided by an embodiment of the present application;

[0055] Figure 4A-4B is another set of user interface schematic diagrams for performing device recommendation in a single device dimension provided by an embodiment of the present application;

[0056] Figure 5A-5C is another set of user interface schematic diagrams for performing device recommendation in a single device dimension provided by an embodiment of the present application;

[0057] Figure 6A-6C is a schematic diagram of a user interface for performing device recommendation in a spatial dimension provided by an embodiment of the present application;

[0058] Figure 7A-7C It is a schematic diagram of a user interface for making device recommendations in a functional dimension provided by an embodiment of the present application;

[0059] Figure 8A-8D It is a schematic diagram of a user interface for performing device recommendation in a scenario dimension provided by an embodiment of the present application;

[0060] Figure 9A-9C It is a user interface diagram of a group of contents recommended on a desktop display device provided by an embodiment of the present application;

[0061] Figure 10A-10B It is a user interface schematic diagram of a group of contents recommended by a device displayed on an off-screen display interface provided by an embodiment of the present application;

[0062] Figures 11A-11D A user interface diagram of a group of contents recommended by a device displayed on a lock screen interface provided by an embodiment of the present application;

[0063] Figure 12A-12B is a schematic diagram of a user interface for a group of users to independently set device recommendation rules provided in an embodiment of the present application;

[0064] Figures 13A-13F is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0065] Figures 14A-14D is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0066] Figures 15A-15D is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0067] Figure 16A-16B is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0068] Figures 17A-17D is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0069] Figures 18A-18D is a schematic diagram of a user interface for another group of user-defined device recommendation rules provided in an embodiment of the present application;

[0070] Fig.19 is a schematic diagram of a software architecture of an electronic device 100 provided in an embodiment of the present application;

[0071] Fig. 20 is a structural diagram of an electronic device 100 provided in an embodiment of the present application;

[0072] Fig.21 It is a structural diagram of a server 200 provided in an embodiment of the present application. DETAILED DESCRIPTION

[0073] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0074] It should be understood that the terms "first", "second", etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0075] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.

[0076] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0077] With the current development of Internet of Things technology and the popularization of whole-house intelligence, the use of smart home devices is becoming more and more common, and the number of smart home devices owned by each user is also increasing.

[0078] Although there are many interactive modes such as voice user interface (VUI) and graphical user interface (GUI), most users are still accustomed to using GUI to control smart home devices. For example, users usually control smart home devices through smart home applications in electronic devices such as mobile phones and tablets.

[0079] The widespread use of smart home devices can make people's lives at home more comfortable, safe and convenient. However, the increase in the number of smart home devices at home has also brought some troubles to users.

[0080] For example, if a user owns a large number of smart home devices and wants to control a certain smart home device, the user needs to swipe up or turn the page on the smart home device display page of the above-mentioned smart home application to find the corresponding smart home device and then control it.

[0081] For example, see Figure 1A, taking the above-mentioned smart home application as a smart life application as an example, the electronic device 100 can display a user interface 110. The user interface 110 displays a page with application icons. The page may include icons of multiple applications (such as icon 111 of the smart life application, etc.). A page indicator may also be displayed below the icons of the above-mentioned multiple applications to indicate the positional relationship between the currently displayed page and other pages. There are multiple tray icons (for example, an icon for a camera application, an icon for a contact application, an icon for a dialing application, and an icon for an information application) below the page indicator. The tray icon remains displayed when the page is switched. The embodiment of the present application does not limit the content displayed on the user interface 110. In response to the user's operation (such as a click operation) on the icon or tray icon of the above-mentioned application, the electronic device 100 can open the application corresponding to the icon of the application or the tray icon.

[0082] The electronic device 100 may detect a user operation (such as a click operation) on the icon 111 of the smart life application. In response to the operation, the electronic device 100 may open the smart life application and may display Figure 1B The user interface 120 is shown as an example.

[0083] See also Figure 1B The user interface 120 may be a user interface provided by a smart life application, and the user interface 120 may include a home name 121, a home management control 122, a number of devices 123, an add control 124, a device option 125, a space option 126, a home option 127, a device card display area 128, and a page option display area 129. Among them:

[0084] The page option display area 129 may include multiple page options. The multiple page options may include home options, mall options, discovery options, scene options, and my options. The above multiple page options can be used to switch the content presented by the user interface in the smart life application. For example, when the home option is Figure 1B In the selected state shown, the content presented in the user interface of the smart life application may include the control interface and smart home device data of the smart home device that has established a binding relationship with the electronic device 100. The embodiment of the present application does not limit the page options included in the page option display area 129.

[0085] That is to say, the user can view the smart home devices in his home and control the smart home devices under the home option in the page option display area 129.

[0086] The home name 121 may be used to indicate the name of a home. The name of a home may be set by a user. For example, the home name 121 may be "Lily's Home". A home may have one or more smart home devices. Figure 1B In the case of "Lily's Home" shown in the figure, the control interface and smart home device data of the smart home devices in the home named "Lily's Home" can be presented in the user interface of the smart life application.

[0087] The family management control 122 can be used to manage the family in the smart life application. The above management may include modifying the family name, switching the family presented in the user interface of the smart life application, deleting the family, creating a new family, adding or deleting members in a family, etc. The embodiment of the present application does not limit the management method of the family in the smart life application.

[0088] The number of devices 123 may be used to indicate the number of smart home devices in a home. For example, a home named "Lily's Home" may have 25 smart home devices.

[0089] Add controls 124 may be used to add smart home devices to a home.

[0090] The device option 125 can be used to trigger the electronic device 100 to display the smart home devices included in a home. Figure 1B As shown, when the device option 125 is in the selected state, the electronic device 100 can display the device card corresponding to the smart home device in the device card display area 128. For example, a router card, an air conditioner card, a speaker card, a curtain card, a TV card, a camera card, an air purifier card, a table lamp card, and the like. The above-mentioned device cards may include the space where the smart home device is located in the home, the networking status of the smart home device, the working status of the smart home device, and the controls for turning on or off the smart home device. The electronic device 100 can detect the user's operation on a device card (such as a click operation). In response to the operation, the electronic device 100 can display more detailed information (such as power, operating mode, etc.) and more functional controls (such as temperature adjustment controls, brightness adjustment controls, etc.) of the smart home device indicated by the device card.

[0091] The smart home device indicated by the device card in the device card display area 128 may be a smart home device in a home named “Lily’s Home”.

[0092] The space option 126 can be used to trigger the electronic device 100 to display the division of smart home devices contained in a home according to space, as well as control controls for controlling all smart home devices that can provide a function in a space.

[0093] The above-mentioned space can represent different areas in a home. The space may include a porch, a living room, a kitchen, a master bedroom, a second bedroom, a study, a balcony, a bathroom, an audio-visual room, a basement, and the like. The embodiment of the present application does not limit the specific division method of different areas in a home. Among them, each smart home device may have a spatial attribute. The spatial attribute may be set by the user for the smart home device when adding the smart home device. The spatial attribute of the smart home device may indicate the location of the smart home device. For example, the spatial attribute of the smart home device is a kitchen, which may indicate that the smart home device is located in the kitchen. According to the spatial attributes of the smart home device, the electronic device 100 may support dividing a plurality of smart home devices into device groups corresponding to each space. For example, a device group may include a plurality of smart home devices with the same spatial attributes. The electronic device may provide a control for controlling all smart home devices in a device group with one click. For example, one click turns on smart home devices such as lights and air conditioners in the living room.

[0094] The My Home option 127 can be used to trigger the electronic device 100 to display the functional classification of the smart home devices contained in a home. That is, the user can view the home device data of the smart home device that provides a function (such as an environmental monitoring function) under the My Home option 127.

[0095] Continue reading Figure 1B It is easy to see that when the device option 125 is in the selected state, the electronic device 100 can display the device card corresponding to each smart home in the home separately. In a possible implementation, the electronic device 100 can detect the user's sliding operation on the user interface 120. In response to the operation, the electronic device 100 can display Figure 1C More cards corresponding to smart home devices are shown as examples. That is, the user can view the smart home devices in his home under the device option 125 and control each smart home device separately.

[0096] It is understandable that, due to the limited screen size of the electronic device 100, when the number of device cards is large, the electronic device 100 cannot simultaneously present all device cards on the user interface. The electronic device 100 can adjust the device cards displayed in the user interface in response to the user sliding up and down in the user interface. In other words, the user can view different device cards by sliding up and down.

[0097] For example, if a user wants to find Figure 1C If you want to find a smart home device (such as a desk lamp, air conditioner, curtain, etc.) shown in the figure, then the user needs to determine Figure 1B If the smart home devices displayed in the search result do not include the target device to be found, Figure 1B The user interface 120 is shown as a slide up operation to find the target device to be found. It can be seen that if the number of smart home devices owned by the user is very large, it is very time-consuming and inefficient for the user to find the target device, and the user experience is very poor.

[0098] In response to the above problem, one solution is that the electronic device 100 can support users to add preset static tags to devices, such as a "frequently used" tag. In this way, the electronic device 100 can display devices with the "frequently used" tag in the front. However, when there are a large number of devices, users still need to search for them one by one, which is still very time-consuming.

[0099] Another solution is that the electronic device 100 can group and display the smart home devices in a home according to the spatial attributes of the smart home devices (i.e., the locations of the smart home devices), and the user can search for the target device in the corresponding spatial group according to the space where the target device is located.

[0100] For example, see Figure 1B The electronic device 100 may detect a user operation (eg, a click operation) on the space option 126. In response to the operation, the electronic device 100 may Figure 1D The user interface 130 is shown as an example.

[0101] See also Figure 1D When the space option 126 is selected, the electronic device 100 may display a space card display area 131 in the user interface 130. The space card display area 131 may include space cards corresponding to various spaces in a home. For example, a living room card 132, a master bedroom card, a kitchen card, and so on. In a possible implementation, the electronic device 100 may detect a user's upward swipe operation on the user interface 130, and in response to the operation, the electronic device 100 may display Figure 1E More space cards shown as examples.

[0102] See also Figure 1E The space card display area 131 in the user interface 130 may include a kitchen card, a balcony card, a porch card 133 and a basement card.

[0103] It is understandable that, due to the limited screen size of the electronic device 100, when there are a large number of space cards, the electronic device 100 cannot simultaneously present all space cards on the user interface. The electronic device 100 can adjust the space cards displayed in the user interface in response to the user sliding up and down in the user interface. In other words, the user can view different space cards by sliding up and down.

[0104] For example, if a user wants to find Figure 1E If a smart home device is located in the space of the entrance shown in the figure, then the user needs to determine Figure 1D If the space card displayed in the video does not include the entrance card, then Figure 1D The user interface 130 shown in the figure is swiped up to find the entrance card. After finding the entrance card, the electronic device 100 can detect that the user has directed Figure 1E The electronic device 100 may display the following information in response to the operation (e.g., click operation) of the portal card 133 shown in FIG. Figure 1F User interface 140 is shown as an example.

[0105] See also Figure 1F , the user interface 140 may include device cards (such as speaker cards and camera cards) corresponding to one or more smart home devices in the space where the entrance is located, so that the user can find the target device in the space where the entrance is located. It can be seen that when there are many space cards, it is still time-consuming for the user to find the target device.

[0106] Another solution is that the electronic device 100 can group and display the smart home devices in a home according to their functional attributes, and the user can search for the target device in the corresponding functional group according to the function of the target device. Among them, the types of functions may include lighting function, sunshade function, environmental monitoring function, safety protection function, network function, water use function, etc. For example, if the user wants to find the lights in the home, then the user can search in the lighting function group. It is easy to see that, similar to the above two solutions, when there are many functional groups, it is still time-consuming for the user to find the target device.

[0107] From the current solutions, it can be seen that when there are a large number of smart home devices, the process of users finding target devices is still relatively complicated and cumbersome, the human-computer interaction efficiency is low, and the user experience is poor. Therefore, how to enable users to find and quickly hit the target device more efficiently is an urgent problem to be solved.

[0108] Based on the above problems, an embodiment of the present application provides a device recommendation method, in which an electronic device can obtain the historical records of users controlling smart home devices (such as control methods, control time, etc.), the location of the electronic device and other information, and send this information to a server. The server can predict the smart home device that the user is about to control based on this information and the status information of the smart home device itself sent by the smart home device, and send the predicted smart home device information (such as control information, status information, etc.) to the electronic device. The electronic device can display the information of the smart home device predicted by the server to recommend it to the user. In this way, the problem of low efficiency of users actively searching for devices can be solved, and the process of upgrading from people looking for devices to devices looking for people can be upgraded, which saves users time in searching for devices, improves the efficiency of users controlling devices, and achieves the purpose of users quickly controlling massive devices. In addition, in this method, the electronic device can also support users to independently set device recommendation rules, so as to achieve the purpose of more accurate device recommendation and further improve user experience.

[0109] A communication system provided by an embodiment of the present application is introduced below.

[0110] Figure 2 A communication system provided by an embodiment of the present application is exemplified.

[0111] See also Figure 2 The communication system may include: an electronic device 100, one or more smart home devices, and a server 200.

[0112] The one or more smart home devices may include: lights 201, curtains 202, air conditioners 203, electric fans 204, air purifiers 205, cameras 206, and routers 207. Figure 2 The smart home devices shown in the figure may also include more or fewer smart home devices in the communication system.

[0113] The electronic device 100 can be used by the user to control the smart home devices, and can also be used by the user to view the operating status and monitoring data of the smart home devices. An application for managing smart home devices (such as a smart life application) can be installed on the electronic device 100. The electronic device 100 can provide a control interface for controlling the smart home devices through the smart life application. The control interface can be a control for controlling the smart home devices displayed on the electronic device 100 (such as the aforementioned Figure 1D The exemplary controls shown include a light full on control, a light full off control, an air conditioning on or off control, a humidifier on or off control, etc.).

[0114] The electronic device 100 can also be used to display information of smart home devices recommended by the server 200 (such as control information, status information, etc.) so that users can quickly control smart home devices and achieve the effect that smart home devices are visible and controllable. In addition, it is also convenient for users to know the status of smart home devices in a timely manner.

[0115] It is easy to understand that the electronic device 100 can display the information of the smart home devices recommended by the server 200 based on the installed application for managing smart home devices.

[0116] It should be noted that the embodiment of the present application does not limit the display position and display style of the information of the smart home device recommended by the server 200. The display position may include but is not limited to the desktop, lock screen interface, always on display (AOD) interface, notification bar, negative one screen interface, and control center interface of the electronic device 100; the display style may include but is not limited to card style, 3D style, and ordinary text style.

[0117] In the embodiment of the present application, the electronic device 100 can display the information of the smart home devices recommended by the server 200 through components. The display style of the components may include but is not limited to card style and 3D style.

[0118] It should be noted that the embodiment of the present application does not limit the timing when the electronic device 100 displays the information of the smart home device recommended by the server 200. For example, the electronic device 100 can automatically display the information of the smart home devices automatically recommended by the server 200 or the information of the smart home devices recommended by the server 200 requested by the electronic device 100 on the display locations such as the desktop after the screen is unlocked, the lock screen AOD interface, the lock screen interface after the screen is unlocked, and the notification bar (that is, the electronic device 100 actively requests the server 200 to query the information of the recommended devices, and then displays the information after receiving the recommended device information sent by the server 200); for another example, when the screen is turned on (for example, the screen is unlocked or not unlocked) or a special event occurs in the smart home device (for example, alarm events such as door locks being pried open or gas leaks), the information of the smart home devices automatically recommended by the server 200 or the information of the smart home devices recommended by the server 200 is automatically displayed; for another example, based on the conditions set by the user (for example, recommending one or some smart home devices in a certain time period and geographic fence), the electronic device 100 is triggered to automatically display the information of the smart home devices automatically recommended by the server 200 or the information of the smart home devices recommended by the server 200 requested by the electronic device 100.

[0119] In a possible implementation, all smart home devices other than the electronic device 100 and the router 207 are connected to the router 207. The router 207 can provide network access services for the devices connected to it. The electronic device 100 can send control instructions to the smart home devices through the router 207, thereby realizing the control of the smart home devices. The electronic device 100 can also communicate with the server 200 through the router 207 (for example, sending the historical records of the user's manipulation of the smart home devices, the location of the electronic device 100, and other information to the server 200). The smart home devices can communicate with the server 200 through the router 207 (for example, sending their own status information such as the switch status, filter status, and alarm information to the server 200).

[0120] In another possible implementation, a short-range communication connection such as a Bluetooth connection / ZigBee communication connection / wireless local area network (WLAN) direct connection may be established between the electronic device 100 and the smart home device. The electronic device 100 may send a control instruction to the smart home device through the short-range communication connection, thereby controlling the smart home device.

[0121] The electronic device 100 may be equipped with Or portable electronic devices (or handheld terminal devices) with other operating systems, such as mobile phones, tablet computers, smart watches, smart bracelets, etc., can also be laptop computers with touch-sensitive surfaces or touch panels, desktop computers with touch-sensitive surfaces or touch panels, whole-house central control screens, vehicle-mounted devices, home LCD screens, and other non-portable electronic devices. The specific type of the electronic device 100 is not limited in the present embodiment.

[0122] Smart home devices can refer to home devices with networking capabilities (such as various smart IoT devices). Figure 2 The smart home devices shown in the figure may also include door locks, speakers, sweeping robots, sockets, body fat scales, desk lamps, refrigerators, washing machines, water heaters, microwave ovens, televisions, set-top boxes, humidifiers, dehumidifiers, water purifiers, buzzers, human motion sensors, air quality monitors, gas monitors, flood monitors, smoke alarms, valve monitors, etc. The smart home devices may be connected to the Internet via a network access device (such as router 207).

[0123] The above-mentioned smart home device may be manufactured by one or more smart home device manufacturers, and the above-mentioned one or more smart home device manufacturers may include the manufacturer of the above-mentioned electronic device 100.

[0124] In a possible implementation, the electronic device 100 can establish a binding relationship with multiple smart home devices. Among them, the binding relationship between the electronic device 100 and the smart home device can be established through an account, that is, the account logged in on the application for managing smart home devices in the electronic device 100 is the same as the account logged in on the smart home device. Optionally, the binding relationship between the electronic device 100 and the smart home device can also be established by scanning a QR code, Bluetooth pairing, etc. The embodiment of the present application does not specifically limit the method for establishing a binding relationship between the electronic device 100 and the smart home device.

[0125] The server 200 can be used to build a recommendation engine to automatically learn and calculate the historical records (or historical data) of users' manipulation of smart home devices, combine the location information of the electronic device 100 and the smart home device's own status information to predict the smart home device that the user is about to control, and make device recommendations to the electronic device 100.

[0126] The server 200 can also be used to perform various services related to smart home devices. For example, managing the relationship between the electronic device 100 and the smart home device; for example, obtaining the operating status and monitoring data of the smart home device; for example, obtaining the location information of the smart home device; for example, sending the operating status and monitoring data of the smart home device to the electronic device 100; for example, sending control instructions to the smart home device; and so on.

[0127] The server 200 can also be used to store the binding relationship between the electronic device 100 and the smart home device. In this way, the server 200 can act as an intermediate device to send the control instructions of the electronic device 100 to the smart home device with which the electronic device 100 has established a binding relationship, and send the operating status and monitoring data of the smart home device to the electronic device 100 with which the smart home device has established a binding relationship.

[0128] The server 200 can also be used to store the ways in which smart home devices can be controlled and the functions that smart home devices can provide. In some embodiments, the electronic device 100 can obtain from the server 200 the functions that can be provided by the smart home devices (i.e., the smart home devices in the user's home) that have established a binding relationship with the electronic device 100, so as to provide the user with a control interface for controlling multiple smart home devices with one click according to the above functions.

[0129] In some embodiments, the server 200 may be an application server corresponding to an application for managing smart home devices (eg, a smart life application).

[0130] The server 200 may be a traditional server or a cloud server. The embodiment of the present application does not limit the specific type of the server 200.

[0131] The specific functions of the electronic device 100 and the server 200 will be described in detail in subsequent embodiments and will not be expanded here.

[0132] It should be understood that Figure 2 This is only a schematic diagram of the architecture of the communication system and should not be construed as limiting the present application. The present embodiment of the application does not limit the number of electronic devices 100, the number of servers 200, and the number of smart home devices included in the communication system.

[0133] To facilitate understanding, some concepts involved in the device recommendation method in this application are specifically introduced here.

[0134] 1. Control Intention

[0135] Control intent may refer to the user's intention to control a smart home device. Control intent may be determined by the type and ability of the smart home device. For example, the user's control intent for a light may include turning on the light, turning off the light, adjusting the brightness, and adjusting the color temperature; for another example, the user's control intent for an air conditioner may include turning on the air conditioner, turning off the air conditioner, and adjusting the temperature; for another example, the user's control intent for curtains may include opening the curtains, closing the curtains, and adjusting the opening and closing degree of the curtains; for another example, the user's control intent for a speaker may include adjusting the volume and adjusting the playback; and so on.

[0136] There are many ways for users to control smart home devices. For example, users can control smart home devices by operating the GUI (for example, by clicking on the switch control on the electronic device 100 to control the on or off state of the smart home device); for another example, users can also control smart home devices through VUI (for example, by controlling the on or off state of the smart home device through voice commands); for another example, users can also set up scenes in advance for triggering the control of smart home devices (for example, automatically turning on or off one or some smart home devices in the home scene), and as long as the scene is triggered, the state of the smart home device (for example, on or off state) can be automatically controlled.

[0137] 2. Function (or skill)

[0138] Functions may include a combination of different control intentions, that is, different control intentions of users for smart home devices can be combined to provide a function, and a function can meet a type of user demand, where the types of functions may include but are not limited to lighting function, shading function, environmental monitoring function, safety protection function, network function, water use function, and audio and video entertainment function.

[0139] The control intentions in the lighting function may include: turning on the light, turning off the light, adjusting the brightness, and adjusting the color temperature. That is, smart home devices (such as electric lights) with the ability to adjust the brightness and color temperature can be used to provide lighting functions. The lighting function can meet the lighting needs of users.

[0140] The control intentions in the sunshade function may include: opening curtains, closing curtains, and adjusting the opening and closing degree of curtains. That is, curtains with the ability to adjust the opening and closing degree of curtains can be used to provide sunshade functions. The sunshade function can meet the user's needs for sunshade and sun protection.

[0141] The control intentions in the environmental monitoring function may include: turning on or off the air quality monitor, turning on or off the air purifier, adjusting the air purification mode, turning on or off the temperature monitor, turning on or off the air conditioner, adjusting the temperature, turning on or off the humidity monitor, turning on or off the humidifier, turning on or off the dehumidifier. That is, smart home devices with the capabilities of air quality monitoring, air purification, temperature monitoring, temperature adjustment, humidity monitoring, humidity adjustment, etc. can be used to provide environmental monitoring functions. The environmental monitoring function can meet the user's needs for air purification, temperature adjustment, and humidity adjustment.

[0142] The control intentions in the security protection function may include: turning on or off the camera, turning on or off the door lock, turning on or off the human motion sensor, and turning on or off the buzzer. That is, smart home devices with the capabilities of taking photos, recording, guarding and alarming can be used to provide security protection functions. The security protection function can meet the user's needs for monitoring and protecting the safety of the home.

[0143] The control intention in the network function can include: turning on or off the network access device, network acceleration, and managing the devices connected to the network access device. That is, smart home devices (such as routers) with the capabilities of network acceleration and management of network access devices can be used to provide network functions. The network function can meet the user's needs for Internet access.

[0144] The control intentions in the water use function may include: turning on or off the water quality monitor, turning on or off the water heater, adjusting the water temperature, and turning on or off the water quantity monitor. That is, smart home devices with the capabilities of water quality monitoring, water quantity monitoring, and water temperature adjustment can be used to provide water use functions. The water use function can meet the user's water needs.

[0145] The control intentions in the audio-visual entertainment function may include: turning on or off the speaker, turning on or off the large-screen device, adjusting the volume, adjusting the playback progress, and switching the playback content. That is, smart home devices with the capabilities of music playback and film and television playback can be used to provide audio-visual entertainment functions. The audio-visual entertainment function can meet the user's leisure and entertainment needs.

[0146] 3. Space

[0147] Space may refer to a specific location, and space may be divided in different ways. The embodiment of the present application does not limit the way in which space is divided.

[0148] For example, different locations in a home can have different uses. In a home, a space can be a location with one use. Spaces in a home can include a porch, a living room, a kitchen, a master bedroom, a second bedroom, a study, a balcony, a bathroom, and the like.

[0149] For another example, a house has different floors. The space in this house can be divided into floors. The space in this house can include the first floor, the second floor, the third floor, etc.

[0150] For another example, a house has different rooms. Different rooms are separated by physical objects (such as walls). The space in this house can be divided into rooms separated by physical objects. The space in this house can include room A, room B, room C, etc.

[0151] For another example, a house can also be considered as an entire space, and can also be called a whole house or a home.

[0152] 4. Scene

[0153] A scene (or scenario) can refer to a combination of factors such as environment, time, place, space, etc. under certain conditions. Only when these conditions are met can relevant needs be met.

[0154] Scenes can be user-defined. Users can independently set different scenes (such as home scenes, leaving home scenes, sleeping scenes, meeting scenes, watching movies, etc.) in applications used to manage smart home devices (such as smart life applications). When setting scenes, users can not only set scene trigger conditions, but also set tasks to be performed when the scene is triggered, such as automatically controlling the status of one or more smart home devices (such as on or off status). Among them, scene trigger conditions can be used to identify scene categories and can trigger electronic devices to perform tasks set under the scene. Scene trigger conditions can include one or more, such as time, location, device status, voice commands, etc.

[0155] By implementing the device recommendation method provided in the embodiment of the present application, the electronic device 100 can not only support the recommendation of a single smart home device, but also support the recommendation of multiple smart home devices.

[0156] In the embodiment of the present application, device recommendations may be made according to four dimensions: single device dimension, space dimension, function dimension (also referred to as skill dimension), and scenario dimension.

[0157] Among them, in the single device dimension, the content of the device recommendation made by the electronic device 100 (i.e., the information of the recommended device) may include but is not limited to: the status of a single device (for example, on or off status, brightness status, temperature status, alarm status, etc.), the controls of a single device (for example, on or off controls, volume adjustment controls, playback adjustment controls, etc.).

[0158] Among them, in the spatial dimension, the content of the device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) of a certain category (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) of equipment in a certain space in the home (such as living room, bedroom, kitchen, balcony, porch, etc.), controls (such as turning controls on or off, etc.), and environmental information in the space (such as temperature information, air humidity information, air quality information, etc.).

[0159] Among them, under the functional dimension, the content of the device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) and controls (such as turning on or off controls, etc.) of a certain category of equipment in the entire family (or whole house) (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.).

[0160] Among them, under the scene dimension, the content of device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) and controls (such as turning on or off controls, etc.) of one or more devices associated with a triggered scene (such as a homecoming scene, a leaving home scene, a sleeping scene, a meeting scene, a movie watching scene, etc.).

[0161] By implementing the device recommendation method provided in the embodiment of the present application, the electronic device 100 can not only support automatic recommendation of devices based on the device recommendation rules preset by the server 200 (i.e., the automatic recommendation algorithm model), but also support customized recommendation of devices based on the device recommendation rules set by the user. The following are introduced respectively.

[0162] Example 1: Automatic recommendation

[0163] Taking the above-mentioned four dimensions, namely, single device dimension, spatial dimension, functional dimension (also called skill dimension), and scene dimension, as examples, the following is a detailed introduction to the device recommendation content that may be displayed by the electronic device 100 when automatically recommending devices, in combination with a series of exemplary user interfaces.

[0164] It should be noted that the embodiments of the present application do not limit the display position and display style of the content recommended by the above-mentioned device, and may include multiple display positions and multiple display styles. For example, the above-mentioned display position may include but is not limited to: the desktop, lock screen interface, always on display (AOD) interface, notification bar, negative one screen interface, control center interface of the electronic device 100; for another example, the above-mentioned display style may include but is not limited to: card style, 3D style, ordinary text style.

[0165] The following description will be made by taking the display of device recommended content in a card style on the desktop of the electronic device 100 as an example.

[0166] The device recommended content may be displayed in a resident card style on the desktop of the electronic device 100, and the card may refresh the device recommended content according to certain rules, so as to automatically recommend different devices to the user. The resident card may refer to a card presented along with the presentation of the user interface where the card is located.

[0167] 1. Single device dimension

[0168] See also Figure 3A , Figure 3A The user interface 310 exemplarily shown may be a desktop of the electronic device 100 . The user interface 310 may include a card 311 . The card 311 may be used to display content recommended by the device in a single device dimension.

[0169] Continue reading Figure 3A , the card 311 may include one or more components corresponding to the recommended device, for example, a speaker component 311A, a main light component 311B, a curtain component 311C, and an air purifier component 311D. It is easy to see from the card 311 that the devices currently recommended by the electronic device 100 include a speaker, a main light, a curtain, and an air purifier.

[0170] The speaker component 311A ​​may include a speaker on or off control, and the name of the device (e.g., "speaker"). The speaker on or off control may be used to turn the speaker on or off. In some embodiments, there is a speaker in the living room, and the speaker on or off control is in the following state: Figure 3AThe turned-on state shown may indicate that the speaker in the living room is turned on. When the speaker control on or off is in the turned-on state, the electronic device 100 may detect the user's operation (e.g., a click operation) for turning the speaker control on or off. In response to the operation, the electronic device 100 may instruct the speaker in the living room to turn off and switch the speaker control on or off to the turned-off state. When the speaker control on or off is in the turned-off state, the electronic device 100 may detect the user's operation (e.g., a click operation) for turning the speaker control on or off. In response to the operation, the electronic device 100 may instruct the speaker in the living room to turn on and switch the speaker control on or off to the turned-on state.

[0171] The main light assembly 311B may include a main light on / off control and a device name (e.g., "main light"). The main light on / off control may be used to turn the main light on or off. The method for turning the main light on or off by turning the main light on or off control may refer to the method for turning the speaker on or off by turning the speaker on or off control.

[0172] The curtain component 311C may include a curtain opening or closing control and a device name (e.g., "curtain"). The curtain opening or closing control may be used to open or close the curtain. The method of opening or closing the curtain by the curtain opening or closing control may refer to the method of opening or closing the speaker by the speaker opening or closing control.

[0173] The air purifier component 311D may include an air purifier control for turning on or off, and the name of the device (e.g., "air purifier"). The air purifier control for turning on or off may be used to turn the air purifier on or off. The method for turning on or off the air purifier control for turning on or off the air purifier may refer to the method for turning on or off the speaker control for turning on or off the speaker.

[0174] It is easy to understand that in the embodiment of the present application, the devices recommended by the electronic device 100 can all be devices that the user is likely to control. It can be seen that the electronic device 100 can facilitate the user to directly control (for example, turn on or off) the device by displaying control controls (for example, turn on or off controls) of one or more recommended devices on the card 311. The user no longer needs to enter the application for managing smart home devices (for example, a smart life application) to find the corresponding device and then control the device, thereby simplifying user operations and improving the efficiency of user control of the device and user experience.

[0175] Since the size of a card is limited, the device recommendation content (such as the number of recommended devices, etc.) displayed on a card is also limited. Therefore, in some embodiments, card 311 may also include option 311E, and option 311E may be used to refresh the information of one or more other recommended devices. For example, assuming that the user wants to view more other recommended devices, then electronic device 100 may detect the user's operation (such as a click operation) on option 311E, and in response to the operation, refer to the Figure 3B , the electronic device 100 can refresh and display the information of one or more other recommended devices (such as cameras, air conditioners, routers, TVs, etc.). Figure 3B The method of the recommended device shown can refer to the method of turning on or off the speaker control to turn on or off the speaker.

[0176] In some embodiments, the user can also trigger the electronic device 100 to refresh and display the information of one or more other recommended devices by sliding left or right on the card 311 .

[0177] In some embodiments, the electronic device 100 may also automatically refresh and display the information of one or more other devices that are recommended. For example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended at different time points (for example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended after detecting that a certain time point has arrived); for another example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended at different locations (for example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended after detecting that the electronic device 100 has switched from one location to another).

[0178] In some embodiments, Figure 3A The priority of the device being recommended (i.e., the probability of being recommended) can be higher than Figure 3B The device shown is recommended by priority. That is, when the user clicks Figure 3A After option 311E is shown, the electronic device 100 may be triggered to display information of one or more devices of recommended second priority.

[0179] Optionally, continue to Figure 3A The card 311 may also include a time mark 311F, which may be used to indicate the recommendation time, so that the user can know at which time the information of the recommended device displayed in the current card 311 is recommended.

[0180] In some embodiments, the user clicks Figure 3A After option 311E is shown, the electronic device 100 may also be triggered to display a later Figure 3A Information about one or more devices recommended at the time point shown. For example, assuming the current time point is 8:10, Figure 3A The recommended time for the device shown is 8 o'clock. Figure 3A After the operation of the option 311E shown, the electronic device 100 can display the information of one or more devices recommended later than 8 o'clock (for example, 8:10). In this way, the information of one or more devices currently recommended can be presented to the user.

[0181] from Figure 3A and Figure 3B It can be seen that although a large number of recommended devices are displayed in card 311, the controls for each recommended device displayed in card 311 only include on or off controls. In this way, the user can only turn the device on or off through card 311. If the user wants to perform more other control operations, he still has to find the corresponding device and its more other controls in the application that provides card 311 (such as a smart life application), and then perform more other control operations, which is rather cumbersome.

[0182] Therefore, in order to facilitate the user to conveniently and quickly perform more control operations on the recommended device, the electronic device 100 can display more controls of the recommended device when making device recommendations. Figure 3C-Figure 3E An exemplary introduction is given.

[0183] See also Figure 3C , the card 312 may include an identification 312A, one or more controls (such as an on or off control 312B, a brightness adjustment bar 312C, etc.), and an option 312D. Among them, the identification 312A can be used to indicate the name of the recommended device (such as "lighting main light"), the on or off control 312B can be used to turn on or off the recommended device, the brightness adjustment bar 312C can be used to adjust the brightness of the recommended device, and the option 312D can be used to refresh the information of one or more other recommended devices. It can be seen that since the card 312 includes multiple controls corresponding to the recommended devices, it can support users to perform multiple control operations on the recommended devices, which is convenient and fast.

[0184] Continue reading Figure 3C The card 312 may also include a mark 312E and a mark 312F, wherein the mark 312E may be used to indicate the on or off state of the recommended device, and the mark 312F may be used to indicate the location of the recommended device. It can be seen that the main lighting lamp of the currently recommended device is on, and the location thereof is the living room.

[0185] In some embodiments, when the amount of information about the recommended device included in the card 312 remains unchanged, the display style of the card 312 can be more concise and more vivid, thereby providing the user with a better visual experience.

[0186] See also Figure 3D , Figure 3D The example shows that compared with Figure 3C A more concise and vivid card 312. The card 312 may include a logo 312G, one or more controls (eg, a control 312H, a brightness adjustment bar, etc.).

[0187] Among them, the logo 312G can be used not only to indicate the name of the recommended device (such as "ceiling light"), but also to indicate the location of the recommended device (such as "living room"). In this way, one logo can indicate multiple information in a concise and clear manner.

[0188] Among them, the control 312H can not only be used to turn on or off the ceiling light in the living room, but also be used to indicate the on or off status of the recommended device. In addition, the display style of the control 312H is the "light" style, so the control 312H can also be used to indicate that the type of the recommended device is a light. In this way, a control can not only support the user to control the recommended device, but also be used to indicate a variety of information, which is convenient, concise and vivid.

[0189] In some embodiments, when the recommended device has many functions, in order to facilitate the user to adjust its various functions quickly and conveniently, the electronic device 100 can display controls corresponding to the various functions of the recommended device. In this way, the number of controls displayed by the electronic device 100 will be very large, which may cause the size of the card to become larger. However, larger cards will waste display space. Therefore, in this case, the electronic device 100 can support hiding the card, and the electronic device 100 can be triggered to display the card when the user needs to view the card.

[0190] For example, see Figure 3E It can be seen that the number of controls corresponding to the recommended devices included in card 313 (such as on or off controls, color temperature controls, color controls, brightness adjustment bars, etc.) is significantly larger than the aforementioned Figure 3C and Figure 3D The number of controls corresponding to the recommended device (such as on or off controls, brightness adjustment bars, etc.) included in the card 312 shown is larger, but the size of the card 313 is smaller than that of the aforementioned Figure 3C and Figure 3D The size of the card 312 shown is also significantly larger. Therefore, the card 313 can be a card that can be hidden.

[0191] It should be noted that the embodiment of the present application does not limit the method of triggering the electronic device 100 to hide the card 313. In one possible implementation, the user can trigger the electronic device 100 to hide the card 313 by sliding down the card 313 or sliding to the edge of the screen. In another possible implementation, the user can also trigger the electronic device 100 to hide the card 313 by clicking any position in the display area other than the display area of ​​the card 313.

[0192] It should be noted that the embodiment of the present application does not limit the method of triggering the electronic device 100 to display the card 313. In a possible implementation, the user can trigger the electronic device 100 to display the card 313 by sliding up the user interface 310 or sliding out from the edge of the screen (for example, sliding from the edge of the screen of the electronic device 100 to the center of the screen).

[0193] It should be noted that the embodiment of the present application does not limit how the electronic device 100 determines which or which controls corresponding to the recommended device to be displayed. In one possible implementation, the controls corresponding to the recommended device displayed by the electronic device 100 may be determined based on the usage records of most users. For example, the electronic device 100 may display the controls commonly used by most users corresponding to the recommended device (such as turning on or off controls, etc.). In another possible implementation, the controls corresponding to the recommended device displayed by the electronic device 100 may be determined based on the usage records of the current user. For example, the electronic device 100 may predict the high-frequency control actions of the current user on the recommended device through the historical usage records of the current user, so as to determine the controls to be displayed based on the high-frequency control actions. For example, the electronic device 100 may display the controls commonly used by the current user corresponding to the recommended device (such as controls whose frequency of use by the user exceeds a certain preset frequency, controls whose cumulative use time or continuous use time by the user exceeds a certain preset time, etc.), controls used by the user periodically, controls used by the user in a recent period of time, etc. In this way, different controls can be recommended and displayed for different users, which can provide users with a personalized experience.

[0194] from Figure 3A-3EIt can be seen that the recommended devices displayed by the electronic device 100 are all devices in a normal state. In the embodiment of the present application, the recommended devices displayed by the electronic device 100 may also be devices in an abnormal state. In this way, the user can be reminded in time that the device is in an abnormal state so that the user can perform control operations on the device in time to avoid safety accidents. Among them, the above-mentioned abnormal state may include but is not limited to: the consumables required by the device are in a missing state (for example, the humidifier is in a water shortage state, etc.), the device is in a faulty state (for example, the air conditioner is running too noisy, the router network signal is poor, etc.), and the device is in an emergency safety alarm state (for example, the door lock is pried open, gas leaks, water leaks, etc.). The following is combined with Figure 4A-4B , Figure 5A-5C An exemplary introduction is given.

[0195] 1) The consumables required by the equipment are missing

[0196] For example, see Figure 4A , card 314 can be used to display information of the recommended device in the state of consumable shortage. Taking the humidifier in the living room as an example, when the humidifier in the living room is in the state of water shortage, the recommended device displayed by the electronic device 100 can be the humidifier in the living room, and the card 314 can include the name of the recommended device (such as "humidifier"), the status reminder information of the recommended device (such as "water shortage reminder"), the location of the recommended device (such as "living room"), etc.

[0197] In some embodiments, the card 314 may further include an on or off control 314A, which may be used to turn on or off the humidifier in the living room. Thus, when the humidifier in the living room is in a water shortage state, the on or off control 314A may be displayed on the card 314 to facilitate the user to quickly turn off the humidifier in the living room, so as to avoid damage to the humidifier due to water shortage.

[0198] In some embodiments, the card 314 may further include an option 314B, and the option 314B may be used to refresh the information of one or more other recommended devices so that the user can view more other recommended devices.

[0199] 2) The device is in a faulty state

[0200] For example, see Figure 4B , card 314 can be used to display information of the recommended device in a faulty state. Taking the air conditioner in the living room as an example, when the air conditioner in the living room is in a state of excessive noise, the recommended device displayed by the electronic device 100 can be the air conditioner in the living room, and the card 314 can include the name of the recommended device (e.g., "air conditioner"), the status reminder information of the recommended device (e.g., "excessive noise reminder"), the location of the recommended device (e.g., "living room"), etc.

[0201] In some embodiments, the card 314 may further include an on or off control 314C, which may be used to turn on or off the air conditioner in the living room. Thus, when the air conditioner in the living room is making too much noise, the on or off control 314C may be displayed on the card 314 to facilitate the user to quickly turn off the air conditioner in the living room, so as to avoid noise disturbance to family members due to excessive noise from the air conditioner.

[0202] 3) The equipment is in emergency safety warning state

[0203] See also Figure 5A-5C , Figure 5A-5C The illustrated card 315 may be used to display information of recommended equipment in an emergency safety alert state.

[0204] For example, see Figure 5A Taking a door lock as an example, when the door lock is in a prying state, the recommended device displayed by the electronic device 100 may be a door lock, and the card 315 may include the name of the recommended device (e.g., "door lock"), the status alarm information of the recommended device (e.g., "prying alarm"), etc. In this way, the user can be reminded in time that the door lock is pried, so that the user can replace the door lock in time to ensure safety.

[0205] For example, see Figure 5B Taking the gas stove in the kitchen as an example, when the gas stove in the kitchen is in a gas leakage state, the recommended device displayed by the electronic device 100 may be the gas stove in the kitchen, and the card 315 may include the name of the recommended device (e.g., "gas stove"), the status alarm information of the recommended device (e.g., "gas leakage alarm"), the location of the recommended device (e.g., "kitchen"), etc. In this way, the user can be reminded in time that a gas leakage event occurs in the gas stove.

[0206] In some embodiments, Figure 5B The card 315 shown may also include an on / off control 315A, which may be used to turn on or off the gas stove in the kitchen. In this way, when a gas leak occurs in the kitchen gas stove, the user can quickly turn off the kitchen gas stove to avoid fire.

[0207] For example, see Figure 5C Taking the water heater in the bathroom as an example, when the water heater in the bathroom is in a water leakage state, the recommended device displayed by the electronic device 100 may be the water heater in the bathroom, and the card 315 may include the name of the recommended device (e.g., "water heater"), the status alarm information of the recommended device (e.g., "water leakage alarm"), the location of the recommended device (e.g., "bathroom"), etc. In this way, the user can be reminded in time that the water heater has a water leakage event.

[0208] In some embodiments, Figure 5C The card 315 shown may also include an on / off control 315B, which may be used to turn on or off the water heater in the bathroom. In this way, when a water leak occurs in the bathroom water heater, the user can quickly turn off the bathroom water heater to avoid electric shock caused by water leakage.

[0209] In one possible implementation, the smart home device may actively send its own status information (e.g., normal status information, abnormal status information) to the server 200, or the server 200 may actively obtain the status information of the smart home device. Furthermore, the server 200 may determine the information of the smart home device to be recommended based on the smart home device's own status information, and may send the information to the electronic device 100, so that the electronic device 100 may display the information of the recommended device.

[0210] In the embodiment of the present application, device recommendation can be performed based on preset principles to determine the device to be recommended, wherein the preset principles may include but are not limited to: time principle, space principle, nearest principle, near field principle, and emergency principle.

[0211] Among them, the time principle can be to analyze the user's historical operating habits under the time dimension to determine the equipment to be recommended. For example, if the user operates a device periodically (for example, every day) or on a fixed date (for example, a weekday, a holiday) at a fixed time point or time period (for example, morning, afternoon, evening), then the probability of the device being recommended at or near the fixed time point / time period will increase. For example, assuming that the user turns on the main light at 8 o'clock every night, then the main light will most likely be recommended at or around 8 o'clock every night (for example, 7:59). For example, assuming that the user turns on the speaker every Saturday morning, then the speaker will most likely be recommended every Saturday morning.

[0212] Among them, the spatial principle can be to analyze the spatial position of the user to determine the device to be recommended. For example, if the current location of the user is within a preset distance range (for example, overlapped) with the location of the device that the user has historically controlled, then the probability of the device being recommended will increase. Among them, the device that the user has historically controlled can be a device that the user has controlled in the recent period of time (for example, within an hour, within a day, etc.), or it can be a device that the user has controlled a long time ago (for example, within a week, within a month, etc.). Exemplarily, assuming that the current location of the user is the location of the speaker in the living room, and the user has previously controlled the speaker in the living room, then the speaker in the living room is likely to be recommended. It is easy to understand that the current location of the electronic device 100 can be used to indicate the current location of the user, and the location of the device that the user has historically controlled can be determined in a variety of ways. For example, when the user previously controlled the device through the electronic device 100, the location of the electronic device 100 can be used to indicate the location of the device that the user has historically controlled; for example, when the user binds the device to the electronic device 100 for an account, the location of the electronic device 100 can be used to indicate the location of the device that the user has historically controlled; and so on.

[0213] Among them, the recent principle can be to analyze the state information of the device itself in the time dimension to determine the device to be recommended. For example, if the user changes the state of the device itself (such as on state, off state, etc.) by manipulating a certain device in the recent period of time (such as within one minute, within five minutes, etc.), then the probability of the device being recommended in the next period of time will increase. For example, assuming that the user turned on the speaker in the living room to play songs a few minutes ago, then the user is very likely to manipulate the speaker again in the next period of time (such as adjusting the volume, switching to play songs, turning off the speaker, etc.), therefore, the speaker in the living room will most likely be recommended in the next period of time to facilitate the user to control it.

[0214] Among them, the near-field principle can be to analyze the devices (i.e., near-field devices) in the same short-range network connection (e.g., Bluetooth connection, WiFi connection, etc.) as the electronic device 100 to determine the devices to be recommended. For example, if the electronic device 100 can detect one or more smart home devices in the same short-range network connection as it, then the probability of the one or more smart home devices being recommended will increase. Exemplarily, assuming that the electronic device 100 is connected to a WiFi network named xxx, then one or more smart home devices (e.g., speakers, TVs, etc.) connected to the WiFi network will most likely be recommended.

[0215] Among them, the emergency principle can be to analyze the urgency of the event that triggers the change of the device's own state to determine the device to be recommended. The above-mentioned events that trigger the change of the device's own state can be divided into three categories based on the urgency: general events, consumables / fault events, and emergency safety alarm events, wherein general events can include events of changes in the state of switches, brightness, temperature, volume, etc., consumables / fault events can include consumables missing events (such as humidifier missing events, etc.), fault events (such as excessive air conditioning noise / insufficient air supply / poor cooling effect, etc.), and emergency safety alarm events can include door locks being pried, gas leaks, water leaks, etc., which involve family safety. The probability of a device being recommended can increase in the order of general events, consumables / fault events, and emergency safety alarm events. That is, in the case of a general event, the probability of the device being recommended is the smallest, and in the case of an emergency safety alarm event, the probability of the device being recommended is the largest. For example, if a humidifier is short of water, this event is a consumable shortage event, and if a gas stove leaks gas, this event is an emergency safety alarm event. Therefore, between humidifiers and gas stoves, the gas stove is the preferred device so that users can detect and stop gas leaks in time to avoid safety accidents.

[0216] It should be noted that the recommended device may be determined based on one of the above-mentioned preset principles, or may be determined based on a combination of multiple principles of the above-mentioned preset principles, and the embodiments of the present application are not limited to this.

[0217] 2. Spatial Dimension

[0218] See also Fig. 6A , Fig. 6A The user interface 310 exemplarily shown may be a desktop of the electronic device 100 . The user interface 310 may include a card 316 . The card 316 may be used to display content recommended by the device in a spatial dimension.

[0219] In the spatial dimension, the electronic device 100 can display information about a certain category of equipment (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) in a recommended space in the home (such as a living room, bedroom, kitchen, balcony, porch, etc.) through a card 316.

[0220] Continue reading Fig. 6A Taking the recommended device as a lighting device in the living room as an example, the card 316 may include a light assembly 316A, a logo 316B, a logo 316C, and a logo 316D.

[0221] The light assembly 316A may include a full-on control and a full-off control. In the case where there are multiple lights in the living room, the full-on control can be used to turn on all the lights in the living room, and the full-off control can be used to turn off all the lights in the living room. It can be seen that when there are multiple smart home devices that can provide a function in a space, the electronic device 100 can provide a control to control these multiple smart home devices with one button. For example, multiple lights of the same or different types in the living room can all provide lighting functions. Fig. 6A The full-on control and full-off control in the illustrated light fixture 316A can facilitate the user to control (eg, turn on or off) all lights in the living room that can provide lighting functions with one click.

[0222] The mark 316B may be used to indicate the location of the recommended device (eg, "living room") and the category to which the recommended device belongs (eg, "lighting"). From the mark 316B, it can be seen that the currently recommended device is a lighting device in the living room.

[0223] The mark 316C can be used to indicate that the recommended device is in an on state (eg, “on”) and the number of recommended devices in the on state (eg, “12”). As can be seen from the mark 316C, the number of recommended devices currently in the on state is 12.

[0224] The mark 316D can be used to indicate that the recommended device is in a closed state (eg, "closed") and the number of recommended devices in the closed state (eg, "6"). It can be seen from the mark 316D that the number of recommended devices currently in the closed state is 6.

[0225] In some embodiments, the card 316 may further include an option 316E, which may be used to refresh and display information of other types of devices in the same space, or information of a certain type of devices in different spaces. For example, taking the electronic device 100 refreshing and displaying information of other types of devices in the same space as an example, the electronic device 100 may detect a user operation (such as a click operation) on the option 316E, and in response to the operation, refer to Figure 6B The electronic device 100 can display information of a certain type of equipment (such as audio-visual entertainment equipment) in the living room except lighting equipment.

[0226] In some embodiments, the user can also trigger the electronic device 100 to refresh and display information of other categories of devices in the same space, or information of a certain category of devices in different spaces, by sliding left and right on the card 316 .

[0227] In some embodiments, card 316 may also include data monitored by smart home devices in the living room. The data monitored by the smart home devices in the living room may include air quality (e.g., "excellent"), temperature (e.g., "28°C"), and humidity (e.g., "48%"). The data monitored by the smart home devices in the living room may reflect the environment of the living room. In this way, the user can quickly view the air quality, temperature, and humidity of the living room through card 316. Not limited to the above-mentioned air quality, temperature, and humidity, more or less data monitored by smart home devices may be presented in card 316. Among them, the type of data monitored by the smart home devices presented in card 316 may be determined by the type of smart home devices included in the space. For example, the living room includes an air quality monitor, a temperature monitor, and a humidity monitor, then the three types of data, air quality, temperature, and humidity, may be presented in card 316.

[0228] In some embodiments, the electronic device 100 may also display a control for controlling a certain device separately in the card 316, so that when the user does not want to control all devices with one click, the electronic device 100 may also support the user to control a certain device separately. Figure 6B , the card 316 may include components corresponding to one or more audio-visual entertainment devices in the living room, such as a speaker component 316G and a TV component 316H. Among them, the speaker component 316G may include a speaker control on or off, and the name of the device (such as "speaker"). The speaker control on or off can be used to turn the speaker on or off. The TV component 316H may include a TV control on or off, and the name of the device (such as "TV"). The TV control on or off can be used to turn the TV on or off. In this way, the user can independently control a single audio-visual entertainment device in the living room through the card 316, which is convenient and quick.

[0229] In some embodiments, for example, Figure 6B In the case of the control shown for controlling a certain device individually, the recommended devices displayed by the electronic device 100 may be all or part of the devices in a certain category of devices in a certain space.

[0230] In some embodiments, the electronic device 100 may also support the user to manually select which type of device information in which space in the home is displayed in the card 316. Fig. 6A The card 316 may further include an option 316F. The electronic device 100 may detect a user operation (eg, a click operation) on the option 316F, and in response to the operation, refer to Figure 6C, the electronic device 100 can display a window 610, which can include one or more options corresponding to the space (such as the "living room" option, the "kitchen" option, the "master bedroom" option, etc.) and options corresponding to the device category included in the space (such as the "all devices" option, the "lighting" option, the "shading" option, the "audio-visual entertainment" option, etc. corresponding to the device category included in the living room), wherein the options corresponding to the space can be used for the user to select the space where the recommended device is located, and the options corresponding to the device category can be used for the user to select the category to which the recommended device belongs. It can be seen from the window 610 that the device currently recommended by the electronic device 100 is the lighting device in the living room. It is easy to understand that if the user wants to view the information of other types of devices in the living room (such as status information, control information, etc.) and / or control other types of devices in the living room, such as shading devices, then the user can click the "shading" option, thereby triggering the electronic device 100 to display the information of the shading devices in the living room through the card 316, so that the user can view the information of the shading devices in the living room through the card 316 and can control the shading devices in the living room conveniently and quickly. Similarly, the user can also trigger the electronic device 100 to display information of a certain type of device in other spaces except the living room through the card 316 in a similar manner as described above, which will not be repeated here.

[0231] In an embodiment of the present application, there may be multiple ways to trigger the electronic device 100 to recommend devices in the spatial dimension. In one possible implementation, the electronic device 100 can recommend all devices or a certain type of devices in the space currently entered by the user, wherein the certain type of devices can be a certain type of devices recommended by default / randomly, or a certain type of devices recommended based on the usage habits of most users, or a certain type of devices recommended based on the historical operation records of the current user. For example, assuming that the current user has entered the living room, and analyzing the historical operation records of the current user, the current user usually controls the lighting equipment first when entering the living room, or the equipment that the current user often operates in the living room is a lighting equipment, then the electronic device 100 can recommend the lighting equipment in the living room.

[0232] In some embodiments, when it is detected that the user has just entered a certain space, the electronic device 100 can make device recommendations in the spatial dimension so that the user can quickly have a global understanding of the status of all devices in the space or the status of a certain type of device. In other embodiments, after a preset time period (e.g., 2 minutes, 5 minutes, 10 minutes, etc.) after detecting that the user has entered a certain space, the electronic device 100 can switch from making device recommendations in the spatial dimension to making device recommendations in a single device dimension (e.g., recommending the device that the current user is most likely to control) so that the current user can quickly and individually perform control operations on the recommended device. Among them, the device recommended by the electronic device 100 in the single device dimension can be determined, for example, based on the aforementioned preset principles (e.g., time principle, space principle, nearest principle, near field principle, emergency principle).

[0233] 3. Functional dimension

[0234] See also Fig. 7A , Fig. 7A The user interface 310 shown as an example may be the desktop of the electronic device 100 . The user interface 310 may include a card 317 . The card 317 may be used to display content recommended by the device in a functional dimension.

[0235] In the functional dimension, the electronic device 100 can display information about a certain category of equipment recommended for the entire home (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) through the card 317.

[0236] Continue reading Fig. 7A Taking the recommended device as a lighting device for the entire home as an example, card 317 may include a light fixture 317A, a logo 317B, a logo 317C, and a logo 317D.

[0237] The light assembly 317A may include a full-on control and a full-off control. When there are multiple lights in the whole home, the full-on control can be used to turn on all lights in the whole home, and the full-off control can be used to turn off all lights in the whole home. It can be seen that when there are multiple smart home devices that can provide a function in the whole home, the electronic device 100 can provide a control to control these multiple smart home devices with one button. For example, multiple lights of the same or different types in the whole home can provide lighting functions, Fig. 7A The all-on control and all-off control in the illustrated light fixture 317A can facilitate the user to control (eg, turn on or off) all lights that can provide lighting functions throughout the home with one click.

[0238] The mark 317B may be used to indicate the category to which the recommended device belongs (eg, "lighting category"). From the mark 317B, it can be seen that the currently recommended device is a lighting device in the entire home.

[0239] The mark 317C may be used to indicate that the recommended device is in an on state (eg, “on”) and the number of the recommended devices in the on state (eg, “20”). As can be seen from the mark 317C, the number of the recommended devices currently in the on state is 20.

[0240] The mark 317D can be used to indicate that the recommended device is in a closed state (eg, "closed") and the number of recommended devices in the closed state (eg, "10"). It can be seen from the mark 317D that the number of recommended devices currently in the closed state is 10.

[0241] In some embodiments, the card 317 may further include an option 317E, which may be used to refresh and display information of other categories of devices in the entire home (e.g., sunshade, environment monitoring, safety protection, water use, network, audio and video entertainment, etc.). For example, the electronic device 100 may detect a user operation (e.g., a click operation) on option 317E, and in response to the operation, refer to Figure 7B The electronic device 100 can display information of a certain type of equipment (such as audio-visual entertainment equipment) in the entire home except lighting equipment.

[0242] In some embodiments, the user can also trigger the electronic device 100 to refresh and display information of other categories of devices in the entire home (such as sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) by sliding left and right on the card 317.

[0243] In some embodiments, the electronic device 100 may also display a control for controlling a certain device separately in the card 317, so that when the user does not want to control all devices with one click, the electronic device 100 may also support the user to control a certain device separately. Figure 7B, card 317 may include components corresponding to one or more audio-visual entertainment devices in the whole family, such as bedroom speaker component 317G and living room TV component 317H. Among them, bedroom speaker component 317G may include a control for turning on or off the bedroom speaker, the name of the device (such as "speaker") and its location (such as "bedroom"), and turning on or off the bedroom speaker control can be used to turn on or off the bedroom speaker. Living room TV component 317H may include a control for turning on or off the living room TV, the name of the device (such as "TV") and its location (such as "living room"), and turning on or off the living room TV control can be used to turn on or off the living room TV. In this way, users can independently control a single audio-visual entertainment device in the whole family through card 317, which is convenient and quick.

[0244] In some embodiments, for example, Figure 7B In the case of the control for controlling a certain device individually, the recommended devices displayed by the electronic device 100 may be all or part of the devices in a certain category of devices in the entire home.

[0245] In some embodiments, the electronic device 100 may also support the user to manually select which type of device information in the entire home is displayed in the card 317. Fig. 7A The card 317 may further include an option 317F. The electronic device 100 may detect a user operation (eg, a click operation) on the option 317F, and in response to the operation, refer to Figure 7C , the electronic device 100 can display a window 710, which can include options corresponding to the device categories included in the entire home (such as "all devices" option, "lighting" option, "shading" option, "environmental monitoring" option, "safety protection" option, "network" option, "water use" option, "audio and video entertainment" option, etc.), wherein the options corresponding to the device categories can be used by the user to select the category to which the recommended device belongs. It can be seen from window 710 that the device currently recommended by the electronic device 100 is the lighting device in the entire home. It is easy to understand that if the user wants to view the information of other types of devices in the entire home (such as status information, control information, etc.) and / or control other types of devices in the entire home, such as shading devices, then the user can click the "shading" option, thereby triggering the electronic device 100 to display the information of the shading devices in the entire home through the card 317, so that the user can view the information of the shading devices in the entire home through the card 317, and can conveniently and quickly control the shading devices in the entire home.

[0246] In an embodiment of the present application, there may be multiple ways to trigger the electronic device 100 to recommend devices under the functional dimension. In one possible implementation, it is possible to determine which type of device the electronic device 100 is going to recommend based on the type of device that most users are most likely to control in a certain time period. For example, in the time period just entering the evening, the user is most likely to turn on the light to illuminate the room, so the electronic device 100 can recommend lighting equipment; for another example, in the time period when the user is about to fall asleep at night or in the sunny time period during the day, the user is most likely to close the curtains, so the electronic device 100 can recommend sunshade equipment; for another example, in the morning or afternoon leisure and entertainment time period, the user is most likely to turn on audio and video entertainment equipment such as speakers and televisions, so the electronic device 100 can recommend audio and video entertainment equipment; and so on.

[0247] It is easy to understand that recommending devices under the functional dimension can help users quickly have a global understanding of the status of a certain type of device in the entire home. In some embodiments, after the electronic device 100 recommends devices under the functional dimension, it can also switch to recommending devices under the single device dimension (for example, recommending the device that the current user is most likely to control), so that the current user can quickly perform control operations on the recommended device separately. Among them, the devices recommended by the electronic device 100 under the single device dimension can be determined based on the aforementioned preset principles (for example, time principle, space principle, nearest principle, near field principle, emergency principle).

[0248] 4. Scene Dimension

[0249] See also Fig. 8A , Fig. 8A The user interface 310 shown as an example may be the desktop of the electronic device 100 . The user interface 310 may include a card 318 . The card 318 may be used to display content recommended by the device in a scene dimension.

[0250] In the scenario dimension, the electronic device 100 can display information about recommended devices in a triggered scenario (e.g., home scene, leaving home scene, sleeping scene, meeting scene, watching movie scene, etc.) through the card 318. The triggering conditions of the above scenario may include one or more, such as time, location, device status, voice command, etc. The recommended devices may be one or more devices associated with the above scenario recommended by default, or one or more devices set by the user to be controlled when the above scenario is triggered.

[0251] The following is an illustrative introduction using the meeting / movie watching scene, leaving home scene, and returning home scene as examples.

[0252] 1) Meeting / movie-watching scenes

[0253] When the meeting / movie-watching scene is triggered, the electronic device 100 may display information of recommended equipment (such as a lamp, etc.) in the meeting / movie-watching scene through the card 318 .

[0254] For example, see Fig. 8A , the card 318 may include a reception light control 318A and a movie viewing light control 318B of the lamp. The reception light control 318A may be used to turn on or off the reception light mode of the lamp, and the movie viewing light control 318B may be used to turn on or off the movie viewing light mode of the lamp. In this way, when the reception / movie viewing scene is triggered, the user can quickly turn on the reception light / movie viewing light mode of the lamp.

[0255] In some embodiments, card 318 may further include option 318C, and option 318C may be used to refresh and display information of other devices in the same scenario, or information of devices in different scenarios.

[0256] In some embodiments, the user can also trigger the electronic device 100 to refresh and display the information of other devices in the same scene, or the information of devices in different scenes, by sliding left and right on the card 318.

[0257] In some embodiments, the above-mentioned guest reception light control 318A and movie viewing light control 318B may not be displayed simultaneously, but may be displayed separately. For example, when the guest reception scene is triggered, the electronic device 100 may not display the movie viewing light control 318B, and when the movie viewing scene is triggered, the electronic device 100 may not display the guest reception light control 318A.

[0258] In some embodiments, in the meeting / movie watching scene, the electronic device 100 may not only display the information of the light device, but also display the information of other devices associated with the scene. Figure 8B It can be seen that the electronic device 100 not only displays the information of the light device (such as the information of the movie light control of the light), but also displays the information of other devices associated with the movie scene (such as the information of the on or off control of the TV).

[0259] 2) Leaving home scene

[0260] When the away-from-home scenario is triggered, the electronic device 100 may display information about recommended devices (such as lights, curtains, air conditioners, etc.) in the away-from-home scenario through the card 318 .

[0261] For example, see Figure 8C , the card 318 may include a light assembly 318C, a curtain assembly 318D, and an air conditioning assembly 318E.

[0262] The light fixture 318C may include a full-off control, the name of the device (e.g., "light"). In the case where there are multiple lights in the whole home, the full-off control may be used to turn off all lights in the whole home.

[0263] The curtain component 318D may include a full-off control and the name of the device (e.g., "curtain"). In the case where there are multiple curtains in the whole home, the full-off control may be used to close all curtains in the whole home.

[0264] The air conditioning component 318E may include a full-off control, the name of the device (e.g., "air conditioning"). In the case where there are multiple air conditioners in the whole home, the full-off control may be used to turn off all air conditioners in the whole home.

[0265] It can be seen that in the away-from-home scenario, the electronic device 100 provides a one-click shutdown control for multiple smart home devices in the entire home on card 318, which can facilitate the user to shut down multiple smart home devices in the entire home with one click before leaving home. The user does not need to go to each room one by one to shut down the corresponding smart home device or enter the application for managing smart home devices (such as a smart life application) to find and shut down the corresponding smart home device, thereby simplifying user operations, saving time, and improving the efficiency of device control.

[0266] It is easy to understand that the electronic device 100 is not limited to the information of the three devices, namely, the light assembly 318C, the curtain assembly 318D, and the air conditioning assembly 318E. The electronic device 100 can also display more or less information of recommended devices on the card 318.

[0267] In some embodiments, when leaving home, some users may want to turn off multiple smart home devices in the entire home with one click, while some users may only want to turn off multiple smart home devices in a certain space / spaces in the entire home with one click. Therefore, in order to meet the diverse needs of users, the electronic device 100 may also provide, through the card 318, a control for turning off multiple smart home devices in a certain space / spaces (such as a living room, bedroom, etc.) in the entire home with one click (for example, turning off all living room lights, turning off all bedroom lights, etc.), rather than providing a control for turning off multiple smart home devices in the entire home with one click.

[0268] 3) Homecoming scene

[0269] When the home scene is triggered, the electronic device 100 can display information about recommended devices (such as lights, curtains, air conditioners, etc.) in the home scene through the card 318.

[0270] For example, see Fig.8D , the card 318 may include a light assembly 318F, a curtain assembly 318G, and an air conditioning assembly 318H.

[0271] The light fixture 318F may include a full-on control, the name of the device (e.g., "light"). In the case where there are multiple lights in the whole home, the full-on control may be used to turn on all lights in the whole home.

[0272] The curtain component 318G may include a full-open control and the name of the device (e.g., "curtain"). In the case where there are multiple curtains in the whole home, the full-open control may be used to open all the curtains in the whole home.

[0273] The air conditioning component 318H may include a full-on control and the name of the device (eg, "air conditioning"). In the case where there are multiple air conditioners in the whole home, the full-on control may be used to turn on all the air conditioners in the whole home.

[0274] It can be seen that in the home-coming scenario, the electronic device 100 provides a control for starting multiple smart home devices in the entire home with one click on the card 318, so that the user can easily start multiple smart home devices in the entire home with one click when returning home. The user does not need to go to each room one by one to turn on the corresponding smart home device or enter the application for managing smart home devices (such as a smart life application) to find and turn off the corresponding smart home device, thereby simplifying user operations, saving time, and improving the efficiency of device control.

[0275] It is easy to understand that the electronic device 100 is not limited to the information of the three devices, namely, the light assembly 318F, the curtain assembly 318G, and the air conditioning assembly 318H. The electronic device 100 can also display more or less information of recommended devices on the card 318.

[0276] In some embodiments, in the home scenario, some users may want to turn on multiple smart home devices in the entire home with one click, while some users may only want to turn on multiple smart home devices in a certain space / spaces in the entire home with one click. Therefore, in order to meet the diverse needs of users, the electronic device 100 may also provide, through the card 318, controls for turning on multiple smart home devices in a certain space / spaces (such as a living room, bedroom, etc.) in the entire home with one click (for example, turning on all living room lights, turning on all bedroom lights, etc.), rather than providing controls for turning on multiple smart home devices in the entire home with one click.

[0277] It can be seen that by implementing the automatic device recommendation solution in the above-mentioned embodiment 1, the electronic device 100 can present the device recommendation content to the user in the form of desktop cards in the single device dimension, space dimension, function dimension, and scene dimension. In this way, after the user triggers the electronic device 100 to light up the screen and unlock it, the device can be controlled on the card. The user does not need to enter the application for managing smart home devices (such as a smart life application) to find the corresponding device and then perform control operations on the device, which can greatly shorten the time for users to control the device.

[0278] The above is only explained by taking the display of the content recommended by the device in one of the single device dimension, space dimension, function dimension, and scene dimension as an example. In some embodiments, the content recommended by the device can also be displayed in multiple dimensions of the single device dimension, space dimension, function dimension, and scene dimension at the same time. For example, assuming that the content recommended by the device is displayed in the single device dimension and the space dimension in the style of a card at the same time, then the card can simultaneously display the information of a certain category of equipment in a certain space in the recommended home (such as lighting equipment in the living room, etc.) and one or more single devices (such as ceiling lights in the living room, air conditioners in the living room, speakers in the bedroom, etc.).

[0279] The above only takes the example of displaying the device recommended content in a permanent card style on the desktop of the electronic device 100 to illustrate the automatic device recommendation solution in the first embodiment. It is not limited to the permanent card style. The electronic device 100 can also display the device recommended content in other styles (such as non-permanent card style, etc.) on the desktop. Figure 9A-9C The following is an exemplary introduction of how the electronic device 100 displays device-recommended content in a non-resident card style on the desktop.

[0280] For example, see Fig. 9A , Fig. 9A The exemplary user interface 310 may be the desktop of the electronic device 100, and the user interface 310 may include an icon 911. The icon 911 may be used to prompt the user that there is device recommended content to be viewed. In some embodiments, the icon 911 may be displayed only when there is device recommended content that needs to be viewed by the user.

[0281] Continue reading Fig. 9A , the electronic device 100 may detect a user operation (eg, a click operation) on the icon 911, and in response to the operation, refer to Fig. 9B, the electronic device 100 can display a non-resident card 912, which can be used to display the content recommended by the device. It is easy to see from the card 912 that the device currently recommended by the electronic device 100 is the ceiling light in the living room. Figure 3D The relevant introduction about card 312 will not be repeated here.

[0282] In some embodiments, the card 912 may be displayed by the electronic device 100 after enlarging the icon 911 .

[0283] Continue reading Fig. 9B , the card 312 may include a control 912A, and the control 912A may be used to cancel the display of the card 912. The electronic device 100 may detect a user operation (eg, a click operation) on the control 912A, and in response to the operation, the electronic device 100 may cancel the display of the card 912.

[0284] In some embodiments, the electronic device 100 canceling the display of the card 912 may specifically be that the electronic device 100 shrinks the card 912 and displays it as an icon 911 .

[0285] It is easy to see that the above card 912 displays the content recommended by the device in a single device dimension. In some embodiments, the content recommended by the device can also be displayed in other dimensions (such as space dimension, function dimension, scene dimension). Fig. 9C , Fig. 9C The card 913 shown is a card that displays the content recommended by the device in the spatial dimension. For the content recommended by the device displayed in the card 913, please refer to the aforementioned Fig. 6A The relevant introduction about card 316 in the above description will not be repeated here. It is easy to understand that the above card 913 is also a user's Fig. 9A The icon 911 shown is operated (eg, clicked) to trigger the display of the electronic device 100.

[0286] from Figure 9A-9C It can be seen that the electronic device 100 displays the content recommended by the device in a non-resident card style. The content recommended by the device is displayed only when the user wants to view it. This is flexible and convenient and can avoid wasting display space.

[0287] The above only takes the display of the device recommended content on the desktop of the electronic device 100 as an example to illustrate the automatic device recommendation solution in the first embodiment. It is not limited to the desktop. The electronic device 100 can also display the device recommended content on other interfaces (such as the off-screen display interface, the lock screen interface, etc.). Figure 10A-10B , Figures 11A-11DHow the electronic device 100 displays device recommended content on the off-screen display interface and the lock-screen interface is introduced respectively.

[0288] 1) Display device recommended content on the off-screen display interface (AOD interface)

[0289] The electronic device 100 can display device recommended content on the off-screen display interface, wherein the device recommended content may include but is not limited to: status information of the recommended device (for example, normal status information such as on or off, abnormal status information such as gas / water leakage, etc.), data information generated by the recommended device (for example, data information such as air quality, temperature, humidity, etc.), and controls of the recommended device.

[0290] For example, see Fig. 10A , Fig. 10A The user interface 1010 shown can be the off-screen display interface of the electronic device 100. It can be seen that the device recommendation content displayed by the electronic device 100 in the user interface 1010 includes the status information of the recommended device and the data information (such as air quality) generated by the recommended device (such as air quality monitor, temperature monitor, humidity monitor). It can be seen from the status information of the recommended device that the recommended devices are the lights on the balcony and the lights in the basement, and they are both in the on state. From the data information generated by the recommended devices, the recommended devices are the air quality monitor, temperature monitor, humidity monitor, and light in the basement, and the data generated by them are air quality (such as "excellent"), temperature (such as "28°C"), humidity (such as "48%"), and dim light.

[0291] For example, see Fig. 10B The electronic device 100 may also display abnormal status information of the recommended device in the user interface 1010, for example, gas leakage alarm information of the kitchen.

[0292] In addition, the electronic device 100 may also display controls of recommended devices in the user interface 1010. For details, please refer to the aforementioned content related to displaying controls of recommended devices on the desktop, which will not be repeated here.

[0293] In some embodiments, the user can trigger the electronic device 100 to cancel the content recommended by the display device in the off-screen display interface by operating the off-screen display interface (for example, clicking any position in the off-screen display interface).

[0294] 2) Display device recommended content on the lock screen

[0295] The electronic device 100 can display device recommended content by pushing cards on the lock screen interface.

[0296] For example, see Fig.11A , Fig.11A The user interface 1110 shown may be the lock screen interface of the electronic device 100. The user interface 1110 may include a card 1111, and the card 1111 may be used to display the content recommended by the device. Taking the recommended device as the air conditioner in the living room as an example, the card 1111 may include a control 1111A, and the control 1111A may be used to turn the air conditioner in the living room on or off. It can be seen that the control 1111A is currently in the off state, which means that the air conditioner in the living room is currently in the off state. The electronic device 100 can detect the user's operation on the control 1111A (such as a click operation). In response to the operation, the electronic device 100 can indicate that the air conditioner in the living room is turned on, and can switch the state of the control 1111A from the off state to the on state. Fig. 11B The open state is shown as an example.

[0297] Continue reading Fig. 11B Card 1111 may also include controls 1111B and 1111C. Control 1111B may be used to lower the temperature of the air conditioner in the living room, and control 1111C may be used to increase the temperature of the air conditioner in the living room.

[0298] In some embodiments, the user can trigger the electronic device 100 to cancel the display of the card 1111 in the user interface 1110 by performing a corresponding operation (such as a click operation, a slide operation, etc.) in the user interface 1110.

[0299] In some embodiments, card 1111 may also display more or fewer controls for the recommended device.

[0300] It is easy to understand that when more controls are displayed on a card, the size of the card may become larger. However, larger cards will waste display space. Therefore, in this case, the electronic device 100 can support hiding the card and trigger the electronic device 100 to display the card when the user needs to view the card.

[0301] For example, see Fig. 11C , also taking the air conditioner in the living room as an example, it can be seen that the number of controls corresponding to the air conditioner in the living room included in card 1112 (such as on or off controls, mode controls, wind speed controls, temperature adjustment controls, etc.) is significantly larger than the aforementioned Fig.11A and Fig. 11B The number of controls corresponding to the air conditioner in the living room (such as on or off controls, temperature adjustment controls, etc.) included in the card 1111 shown is larger, but the size of the card 1112 is smaller than that of the aforementioned Fig.11A and Fig. 11B The size of the card 1111 shown is also significantly larger. Therefore, the card 1112 can be a card that can be hidden.

[0302] It should be noted that the embodiment of the present application does not limit the method of triggering the electronic device 100 to hide the card 1112. In one possible implementation, the user can trigger the electronic device 100 to hide the card 1112 by sliding down the card 1112 or sliding to the edge of the screen. In another possible implementation, the user can also trigger the electronic device 100 to hide the card 1112 by clicking any position in the display area other than the display area of ​​the card 1112.

[0303] It should be noted that the embodiment of the present application does not limit the method of triggering the electronic device 100 to display the card 1112. In a possible implementation, the user can trigger the electronic device 100 to display the card 1112 by sliding up the user interface 1110 or sliding out from the edge of the screen (for example, sliding from the edge of the screen of the electronic device 100 to the center of the screen).

[0304] It is easy to see that the above Figure 11A-11C This is just an example of displaying the content recommended by the device in a single device dimension. In some embodiments, the content recommended by the device can also be displayed in other dimensions (such as spatial dimension, functional dimension, scene dimension), and the embodiments of the present application are not limited to this.

[0305] In some embodiments, the electronic device 100 may also display device recommended content in 3D format on the lock screen interface.

[0306] For example, see Fig.11D It can be seen that the recommended device is a desk lamp, and the electronic device 100 displays one or more corresponding controls of the desk lamp (eg, brightness adjustment bar 1113, control 1114) in 3D form.

[0307] Among them, the brightness adjustment bar 1113 can be used to adjust the brightness of the desk lamp.

[0308] Among them, control 1114 can be used to turn on or off the desk lamp, and can also be used to indicate the on or off status of the desk lamp. In addition, the display style of control 1114 is the "desk lamp" style, so control 1114 can also be used to indicate that the recommended device is a desk lamp.

[0309] In some embodiments, continue to refer to Fig.11D The electronic device 100 may also display controls 1115 and 1116, wherein both controls 1115 and 1116 may be used to refresh and display information of other recommended devices.

[0310] In some embodiments, the user can Fig.11DThe user interface 1110 shown performs a corresponding operation (such as a click operation, etc.) to trigger the electronic device 100 to cancel the display of the device recommended content in the user interface 1110.

[0311] from Fig.11D It can be seen that the electronic device 100 displays the device recommended content in 3D form, which can facilitate the user to perform three-dimensional control operations on the recommended device, thereby providing the user with a better visual experience and operation experience.

[0312] It should be noted that, not limited to the above lock screen interface, the electronic device 100 can also display the device recommended content in 3D form in other interfaces (such as the desktop, off-screen display interface, etc.).

[0313] Example 2: Customized recommendation

[0314] The following describes in detail the process of users independently setting device recommendation rules when customizing device recommendations in conjunction with a series of exemplary user interfaces.

[0315] See also Fig. 12A , Fig. 12A The user interface 1210 shown in the example may be a user interface for a user to make device recommendation settings. The user interface 1210 may be a user interface provided by an application (such as a smart life application) on the electronic device 100 for managing smart home devices.

[0316] Continue reading Fig. 12A, the user interface 1210 may include option 1211, option 1212, and option 1213, wherein option 1211 may be used for the user to set whether to determine the recommended device based on the automatic recommendation algorithm, option 1212 may be used for the user to set whether to determine the recommended device based on the user-defined device recommendation rule, and option 1213 may be used for the user to set whether to determine the recommended device based on the automatic recommendation algorithm and the user-defined device recommendation rule. It is easy to understand that only one of option 1211, option 1212, and option 1213 can be in a selected state, and the user can set the selected option independently. For example, if the option currently in the selected state is option 1211, it means that the recommended device is currently determined based on the automatic recommendation algorithm, rather than based on the user-defined device recommendation rule or based on the automatic recommendation algorithm and the user-defined device recommendation rule. That is to say, even if the user customizes the device recommendation rule, the device recommendation rule is invalid. Exemplarily, if the user wants to determine the recommended device based on the user-defined device recommendation rules, the user can trigger the electronic device 100 to put option 1212 in a selected state by clicking on option 1212, so that when the device recommendation is made later, the content of the device recommendation is determined only based on the user-defined device recommendation rules. Exemplarily, if the user wants to comprehensively determine the recommended device based on the automatic recommendation algorithm and the user-defined device recommendation rules, the user can trigger the electronic device 100 to put option 1213 in a selected state by clicking on option 1213, so that when the device recommendation is made later, the content of the device recommendation is comprehensively determined based on the automatic recommendation algorithm and the user-defined device recommendation rules.

[0317] Continue reading Fig. 12A The user interface 1210 may also include one or more setting entries for customizing device recommendation rules, such as a time setting entry 1214, a space (place) setting entry 1215, and a scene setting entry 1216, wherein the time setting entry 1214 can be used by the user to set which devices to recommend in which time period, the space (place) setting entry 1215 can be used by the user to set which devices to recommend in which space, and the scene setting entry 1216 can be used by the user to set which devices to recommend in which scene.

[0318] In some embodiments, the above-mentioned custom device recommendation rules such as time, space, and scene can have priorities to avoid conflicts between recommended devices determined based on different device recommendation rules. The priority of each custom device recommendation rule can be pre-set by the electronic device 100 or set by the user. In the embodiment of the present application, the electronic device 100 can support the user to set the priority of each custom device recommendation rule. For example, continue to refer to Fig. 12A The user interface 1210 may also include a device recommendation rule priority ranking setting entry 1217. The electronic device 100 may detect a user operation (such as a click operation) on the device recommendation rule priority ranking setting entry 1217. In response to the operation, the electronic device 100 may display Fig. 12B The user interface 1220 shown as an example can be used by the user to set the priority of the device recommendation rule. The user interface 1220 displays the option boxes of each device recommendation rule (e.g., option box 1221, option box 1222, option box 1223) from top to bottom according to the priority of the device recommendation rule, and the device recommendation rule at the top has a higher priority. The user can trigger the electronic device 100 to move the position of the option box of a device recommendation rule by dragging the option box of the device recommendation rule up or down, thereby modifying the priority of the device recommendation rule. It is easy to understand that the dragging operation up or down is only an exemplary method, and the user can also set the priority of the device recommendation rule in other ways.

[0319] Taking time as an example, the following will provide an exemplary introduction to how a user customizes the device recommendation rule of time (ie, how a user sets which devices to recommend in which time period).

[0320] Continue reading Fig. 12A The electronic device 100 may detect a user operation (eg, a click operation) on the time setting item 1214, and in response to the operation, the electronic device 100 may display Fig.13A User interface 1310 is shown as an example.

[0321] See also Fig.13A , the user interface 1310 may include option 1311. If option 1311 is selected, it means that the time has been added to the device recommendation rule set by the user. If option 1311 is not selected, it means that the time has not been added to the device recommendation rule set by the user. The user can independently set whether to put option 1311 in the selected state. It is easy to understand that when option 1311 is in the selected state, the user needs to set which devices to recommend in which time period before the user-defined time device recommendation rule will take effect, that is, it is possible to determine the recommended device based on the time device recommendation rule in the future.

[0322] Continue reading Fig.13A The user interface 1310 may further include an option 1312, which may be used by the user to add a time period and set the device to be recommended in the time period. The electronic device 100 may detect the user's operation (eg, a click operation) on the option 1312, and in response to the operation, the electronic device 100 may display Fig. 13B User interface 1320 is shown as an example.

[0323] See also Fig. 13B The user interface 1320 may include a time period input box 1321, in which the user may input the start time and end time of the time period. It is easy to understand that the time period may be used as the time period for subsequent customized device recommendations.

[0324] In some embodiments, continue to refer to Fig. 13B , the user interface 1320 may also include date type setting options applied to the above time period, such as option 1322, option 1323, and option 1324, wherein option 1322 may be used by the user to set whether the above time period is applied only to working days, option 1323 may be used by the user to set whether the above time period is applied only to statutory holidays, and option 1324 may be used by the user to set whether the above time period is applied to all date types. It is easy to understand that only one of option 1322, option 1323, and option 1324 can be in a selected state, and the user can set the selected option independently. For example, if the option currently in the selected state is option 1211, it means that the current setting is that the above time period is only applied to working days. In some embodiments, the user interface 1320 may also include a custom setting entry 1325, which may be used by the user to independently set the date type applied to the above time period. For example, the user clicks on the custom setting entry 1325 to trigger the electronic device 100 to display the corresponding user interface for the user to customize the date type applied to the above time period. It is easy to understand that after the user completes customizing the date type applied to the above time period, the above option 1322, option 1323, and option 1324 can all be placed in an unselected state.

[0325] Continue reading Fig. 13BThe user interface 1320 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1326, a space dimension setting entry 1327, and a function dimension setting entry 1328, wherein the single device dimension setting entry 1326 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1327 can be used by the user to select one or more categories (such as lighting, sunshade, audio-visual entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1328 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.

[0326] Continue reading Fig. 13B Taking the single device dimension as an example, the electronic device 100 may detect the user's operation (such as a click operation) for setting the single device dimension entry 1326. In response to the operation, the electronic device 100 may display Fig. 13C User interface 1330 is shown as an example.

[0327] See also Fig. 13C , the user interface 1330 may include setting items (e.g., setting item 1331 for the air conditioner in the living room, setting item for the speaker in the living room, etc.) for one or more devices (e.g., the air conditioner in the living room, etc.), wherein the setting item 1331 for the air conditioner in the living room may be used by the user to select the air conditioner in the living room as the recommended device, and to set the content displayed when the device is recommended (e.g., the controls of the device, etc.). It is easy to understand that the setting items of the devices displayed in the user interface 1330 are all setting items of the devices in the user's home. When there are many devices in the user's home, due to the limited screen size of the electronic device 100, the setting items of all devices cannot be displayed. Therefore, the user can view the setting items of all devices by sliding up and down.

[0328] Continue reading Fig. 13C , assuming that the user wants to select the air conditioner in the living room as the recommended device, then the electronic device 100 can detect the user's operation (such as a click operation) on the setting item 1331 of the air conditioner in the living room, and in response to the operation, the electronic device 100 can display Fig.13D User interface 1340 is shown as an example.

[0329] See also Fig.13D, the user interface 1340 may include options for selecting a device, such as option 1341, wherein option 1341 may be used by the user to set whether to use the air conditioner in the living room as a recommended device, and the user may trigger the electronic device 100 to put option 1341 in a selected state or an unselected state by clicking on option 1341. It is easy to understand that if option 1341 is in a selected state, it means that the user has selected the air conditioner in the living room as a recommended device, and if option 1341 is in an unselected state, it means that the user has not selected the air conditioner in the living room as a recommended device.

[0330] Continue reading Fig.13D , the user interface 1340 may also include options for control selection, such as option 1342, option 1343, option 1344, option 1345, etc., wherein option 1342 may be used by the user to set whether to display the on or off control when the device is recommended, option 1343 may be used by the user to set whether to display the temperature adjustment control when the device is recommended, option 1344 may be used by the user to set whether to display the wind speed adjustment control when the device is recommended, and option 1345 may be used by the user to set whether to display the mode adjustment control when the device is recommended. The user can place the option in a selected state or an unselected state by clicking on the corresponding option. It is easy to understand that if the option is in a selected state, it means that the control corresponding to the option will be displayed when the device is recommended, and if the option is in an unselected state, it means that the control corresponding to the option will not be displayed when the device is recommended.

[0331] For example, see Fig.13E It can be seen that the user has placed option 1341 in the selected state, that is, the user has selected the air conditioner in the living room as the recommended device. In addition, the user has placed options 1342 and 1343 in the selected state, that is, the user has set the on or off controls and temperature adjustment controls for controlling the air conditioner in the living room to be displayed when the device is recommended.

[0332] In some embodiments, in order to facilitate the user to promptly know whether he has selected the recommended device and set the content displayed when the device is recommended (such as the device controls, etc.), the electronic device 100 can also display relevant identification, for example, see Fig.13F , assuming that the user has selected the air conditioner in the living room as a recommended device and set the content to be displayed when making a device recommendation, then the electronic device 100 can display an identifier 1332 on the setting entry 1331 of the air conditioner in the living room shown in the user interface 1330. The identifier 1332 can be used to prompt the user that the air conditioner in the living room has been successfully added as a recommended device and the content to be displayed when making a device recommendation (such as the device's controls, etc.) has been set.

[0333] It is easy to understand that, similar to adding the air conditioner in the living room as a recommended device, the user can also add more devices as recommended devices (for example Fig.13F The speakers in the living room, the curtains in the living room, etc.)

[0334] Continue reading Fig. 13B Taking the spatial dimension as an example, the electronic device 100 may detect the user's operation (such as a click operation) of setting the entry 1327 for the spatial dimension. In response to the operation, the electronic device 100 may display Fig.14A User interface 1410 is shown as an example.

[0335] See also Fig.14A , the user interface 1410 may include setting items for one or more spaces (e.g., living room, bedroom, etc.) (e.g., setting item 1411 for the living room, setting item 1412 for the bedroom, etc.), wherein the setting item 1411 for the living room may be used by the user to select one or more types of devices in the living room as recommended devices, and to set the content displayed when recommending devices (e.g., device controls, etc.). It is easy to understand that the setting items for the spaces displayed in the user interface 1410 are all setting items for the spaces included in the user's home. When there are a large number of spaces in the user's home, the setting items for all spaces cannot be displayed due to the limited screen size of the electronic device 100. Therefore, the user can view the setting items for all spaces by sliding up and down.

[0336] Continue reading Fig.14A , assuming that the user wants to select one or more types of devices in the living room as recommended devices, then the electronic device 100 can detect the user's operation (such as a click operation) on the setting item 1411 of the living room, and in response to the operation, the electronic device 100 can display Fig. 14B User interface 1420 is shown as an example.

[0337] See also Fig. 14B, the user interface 1420 may include options for selecting device categories, such as option 1421, option 1422, option 1423, etc. It is easy to understand that the device categories corresponding to the above options for selecting device categories are all device categories included in the living room. Among them, option 1421 can be used by the user to set whether to use the lighting equipment in the living room as the recommended equipment, option 1422 can be used by the user to set whether to use the sunshade equipment in the living room as the recommended equipment, and option 1423 can be used by the user to set whether to use the audio-visual entertainment equipment in the living room as the recommended equipment. The user can trigger the electronic device 100 to put the option in a selected state or an unselected state by clicking on the corresponding option. Among them, if the option is in a selected state, it means that the user selects a type of device corresponding to the option as the recommended device, and if the option is in an unselected state, it means that the user does not select a type of device corresponding to the option as the recommended device. Among them, the options placed in the selected state can be one or more, that is, the electronic device 100 can support the user to select one or more types of devices in the living room as recommended devices.

[0338] Continue reading Fig. 14B , the user interface 1420 may also include options for selecting controls, such as option 1424, option 1425, option 1426, option 1427, option 1428, etc. It is easy to understand that the controls corresponding to the above options for selecting controls are all controls possessed by the devices included in the living room. For example, if the devices in the living room include audio-visual entertainment devices, the controls corresponding to the above options for selecting controls may include volume adjustment controls. Among them, option 1424 can be used for the user to set whether to display the on or off control when the device is recommended, option 1425 can be used for the user to set whether to display the brightness adjustment control when the device is recommended, option 1426 can be used for the user to set whether to display the color temperature adjustment control when the device is recommended, option 1427 can be used for the user to set whether to display the volume adjustment control when the device is recommended, and option 1428 can be used for the user to set whether to display the playback adjustment control when the device is recommended. The user can set the option to be selected or unselected by clicking on the corresponding option. It is easy to understand that if an option is in a selected state, it means that the control corresponding to the option will be displayed when the device is recommended, and if the option is in an unselected state, it means that the control corresponding to the option will not be displayed when the device is recommended. Among them, the options placed in the selected state can be one or more, that is, the electronic device 100 can support displaying multiple controls selected by the user in the device recommendation.

[0339] It is easy to understand that when there are a large number of options for control selection as mentioned above, due to the limited screen size of the electronic device 100, not all options for control selection can be displayed. Therefore, the user can view all options for control selection by sliding up and down.

[0340] It is easy to understand that after the user completes the device category selection, if the device of the selected category does not have one or some controls, then the options corresponding to this or these controls in the options for control selection can be placed in an unselectable state.

[0341] For example, see Fig. 14C It can be seen that the user has placed option 1421 in a selected state, that is, the user has selected the lighting type in the living room as the recommended device. In addition, the user has placed option 1424 in a selected state, that is, the user has set the on or off control for controlling the lighting type devices in the living room to be displayed when the device is recommended.

[0342] In some embodiments, in order to facilitate the user to promptly know which device or devices in which spaces he / she has selected as the recommended device, the electronic device 100 may also display relevant identifiers, for example, see Fig.14D , assuming that the user has selected one or more types of devices in the living room as recommended devices and set the content to be displayed when making device recommendations, then the electronic device 100 can display an identifier 1412 on the setting entry 1411 of the living room shown in the user interface 1410. The identifier 1412 can be used to prompt the user that the devices in the living room have been successfully added as recommended devices and the content to be displayed when making device recommendations (such as device controls, etc.) has been set.

[0343] It is easy to understand that, similar to adding the living room device as the recommended device, the user can also add more other spaces (such as Fig.14D The equipment shown in the figure (bedroom, kitchen, etc.) is recommended.

[0344] It can be seen that compared with selecting recommended devices in a single device dimension as mentioned above, selecting recommended devices in a space dimension allows users to select a category of devices in a space with one click, rather than a single device, which is convenient and fast and simplifies user operations.

[0345] Continue reading Fig. 13B Taking the function dimension as an example, the electronic device 100 may detect the user's operation (such as a click operation) of setting the item 1328 for the function dimension. In response to the operation, the electronic device 100 may display Fig.15A User interface 1510 is shown as an example.

[0346] See also Fig.15A , the user interface 1510 may include setting items (e.g., setting item 1511 for lighting, setting item 1512 for sunshade, etc.) of one or more device categories (e.g., lighting, sunshade, etc.), wherein the setting item 1511 for lighting may be used by the user to select lighting devices in the entire home as recommended devices, and to set the content displayed when recommending devices (e.g., device controls, etc.). It is easy to understand that the setting items of device categories displayed in the user interface 1510 are all setting items of device categories included in the user's home. When there are a large number of device categories in the user's home, due to the limited screen size of the electronic device 100, the setting items of all device categories cannot be displayed. Therefore, the user can view the setting items of all device categories by sliding up and down.

[0347] Continue reading Fig.15A Assuming that the user wants to select lighting devices in the entire home as recommended devices, the electronic device 100 can detect the user's operation (such as a click operation) on the setting item 1511 of the lighting category, and in response to the operation, the electronic device 100 can display Fig. 15B User interface 1520 is shown as an example.

[0348] See also Fig. 15B The user interface 1520 may include options for selecting a device category, such as option 1521, wherein option 1521 may be used by the user to set whether to use lighting devices as recommended devices. The user may trigger the electronic device 100 to put the option in a selected state or an unselected state by clicking on option 1521. It is easy to understand that if option 1521 is in a selected state, it indicates that the user has selected the lighting device as the recommended device, and if option 1521 is in an unselected state, it indicates that the user has not selected the lighting device as the recommended device.

[0349] Continue reading Fig. 15B, the user interface 1520 may also include options for selecting controls, such as option 1522, option 1523, option 1524, etc. It is easy to understand that the controls corresponding to the above options for selecting controls are all controls possessed by lighting devices. Among them, option 1522 can be used by the user to set whether to display the on or off control when the device is recommended, option 1523 can be used by the user to set whether to display the brightness adjustment control when the device is recommended, and option 1524 can be used by the user to set whether to display the color temperature adjustment control when the device is recommended. The user can put the option in a selected state or an unselected state by clicking on the corresponding option. It is easy to understand that if the option is in a selected state, it means that the control corresponding to the option will be displayed when the device is recommended, and if the option is in an unselected state, it means that the control corresponding to the option will not be displayed when the device is recommended. Among them, the options placed in the selected state can be one or more, that is, the electronic device 100 can support displaying multiple controls selected by the user when the device is recommended.

[0350] It is easy to understand that when there are a large number of options for control selection as mentioned above, due to the limited screen size of the electronic device 100, not all options for control selection can be displayed. Therefore, the user can view all options for control selection by sliding up and down.

[0351] For example, see Fig. 15C It can be seen that the user has placed option 1521 in a selected state, that is, the user has selected lighting as the recommended device. In addition, the user has placed option 1522 in a selected state, that is, the user has set the on or off controls for controlling lighting devices to be displayed when the device is recommended.

[0352] In some embodiments, in order to facilitate the user to promptly know which device or devices in the entire home are selected as recommended devices, the electronic device 100 may also display relevant identifiers, for example, see Fig.15D , assuming that the user has selected the lighting devices in the entire home as recommended devices and set the content to be displayed when making device recommendations, then the electronic device 100 can display an identifier 1512 on the lighting setting item 1511 shown in the user interface 1510. The identifier 1512 can be used to prompt the user that the user has successfully added the lighting devices in the entire home as recommended devices and has completed the setting of the content to be displayed when making device recommendations (such as device controls, etc.).

[0353] It is easy to understand that, similar to adding lighting equipment as recommended equipment, users can also add more other categories (such as Fig.15D The equipment shown (such as sunshade, environmental monitoring, etc.) is recommended.

[0354] It can be seen that compared with selecting recommended devices in a single device dimension or a space dimension, selecting recommended devices in a functional dimension allows users to select a category of devices in the entire home with one click, rather than a single device or a category of devices in a certain space. This is convenient and fast and simplifies user operations.

[0355] Continue reading Fig. 13B After the user completes the time period setting and the recommended device setting, for example, refer to Fig.16A , the electronic device 100 can display the time period set by the user and the information of the recommended devices in the user interface 1320. It can be seen that the time period set by the user is 08:00-08:10, and this time period is only applicable to weekdays. In addition, the user selects the recommended device under the single device dimension.

[0356] Continue reading Fig.16A In some embodiments, in order to facilitate the user to promptly know in which dimension the recommended device is selected, the electronic device 100 may further display a relevant mark. For example, assuming that the user selects a recommended device in a single device dimension, the electronic device 100 may display a mark 1611 on the single device dimension setting entry 1326 shown in the user interface 1320. The mark 1611 may be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device's controls, etc.) is set.

[0357] Continue reading Fig.16A After the user completes the time period setting and the recommended device setting, the electronic device 100 may further display option 1612. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1612. In response to the operation, the electronic device 100 may save the time period and recommended device information that the user has set, and may display Fig. 16B As shown in the user interface 1310, it can be seen that the user interface 1310 displays an entry 1313 corresponding to the time period (e.g., 08:00-08:10) added by the user. It is easy to understand that the user can trigger the electronic device 100 to display the time period by clicking on the entry 1313. Fig.16A The user interface 1320 shown can view or modify the time period set by the user and the information of the recommended equipment.

[0358] Continue reading Fig. 16B The user interface 1310 may further include an option 1314, which may be used to delete a time period that has been added by the user.

[0359] Continue reading Fig.16AWhen setting the recommended device, the user may select the recommended device in only one dimension, or may select the recommended device in multiple dimensions. It is easy to understand that when selecting the recommended device in multiple dimensions, there may be a conflict in the selected recommended devices. For example, the air conditioner for the living room is selected in the single device dimension, and the lighting device for the living room is selected in the space dimension, but the air conditioner does not belong to the lighting device. In this way, the electronic device 100 cannot determine whether to recommend the air conditioner for the living room or the lighting device for the living room, or to recommend the air conditioner for the living room and the lighting device for the living room at the same time. Therefore, in order to solve the above problem, a possible solution is that the electronic device 100 only supports the user to select the recommended device in one dimension. For example, if the user selects the recommended device in the single device dimension, then the user can no longer select the recommended device in the space dimension and the function dimension. For example, after detecting that the user has selected the recommended device in the single device dimension, the electronic device 100 can place the space dimension setting item 1327 and the function dimension setting item 1328 in an unselectable state to prompt the user that the recommended device can no longer be selected in the space dimension and the function dimension. Another possible solution is to Fig. 12A Just as the time, space, scene and other custom device recommendation rules shown in the figure have priorities, the single device dimension, space dimension and function dimension can also have priorities. The electronic device 100 will give priority to recommending devices selected under the dimensions with high priorities. The electronic device 100 can support users to set priorities independently. The priority setting method can be, for example, the same as the above Fig. 12B The advantage of this solution is that, assuming that the user selects recommended devices in multiple dimensions, after a period of time, if the user wants to change the recommended device selected in the current dimension to the recommended device selected in another dimension, then the user only needs to change the priority of different dimensions to change to the recommended device selected in another dimension. There is no need to reselect the recommended device, delete the previously selected recommended device, or change the original time period setting information. It is convenient and fast, and simplifies user operations.

[0360] The following uses space as an example to illustrate how users customize the device recommendation rules of space (i.e., how users set which devices to recommend in which space).

[0361] Continue reading Fig. 12A The electronic device 100 may detect an operation (eg, a click operation) by a user on a space (location) setting entry 1215. In response to the operation, the electronic device 100 may display Fig.17A User interface 1710 is shown as an example.

[0362] See also Fig.17A , the user interface 1710 may include option 1711. If option 1711 is selected, it means that the space has added the device recommendation rule set by the user. If option 1711 is not selected, it means that the space has not added the device recommendation rule set by the user. The user can independently set whether to put option 1711 in the selected state. It is easy to understand that when option 1711 is in the selected state, the user needs to set which devices to recommend in which space before the user-defined space device recommendation rule will take effect, that is, it is possible to determine the recommended devices based on the space device recommendation rule in the future.

[0363] Continue reading Fig.17A The user interface 1710 may further include an option 1712, which may be used by the user to add a space and set the device to be recommended under the space. The electronic device 100 may detect the user's operation (eg, a click operation) on the option 1712, and in response to the operation, the electronic device 100 may display Fig. 17B User interface 1720 is shown as an example.

[0364] See also Fig. 17B The user interface 1720 may include a space input box 1721, in which the user may input the name of the space (eg, living room). It is easy to understand that the name of the space may be used as the name of the space in which the user is located when performing subsequent customized device recommendations.

[0365] It is easy to understand that there are many ways for the electronic device 100 to determine the space where the user is located, and the embodiments of the present application do not limit this. In one possible implementation, the electronic device 100 can determine the space where the user is located through near field communication. For example, the space where the user is located is the living room, and the name of the hotspot in the living room is XXX. Then, when the electronic device 100 is connected to the hotspot named XXX or the electronic device 100 determines that the signal strength of the hotspot named XXX is the highest, the electronic device 100 can determine that the space where the user is located is the living room.

[0366] Continue reading Fig. 17BThe user interface 1720 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1722, a space dimension setting entry 1723, and a function dimension setting entry 1724, wherein the single device dimension setting entry 1722 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1723 can be used by the user to select one or more categories (such as lighting, sunshade, audio-visual entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1724 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.

[0367] The specific process of selecting the recommended device in the single device dimension is similar to the specific process of selecting the recommended device in the single device dimension when customizing the device recommendation principle of "time" mentioned above. Figure 13C-13F The relevant text description will not be repeated here.

[0368] The specific process of selecting the recommended device in the spatial dimension is similar to the specific process of selecting the recommended device in the spatial dimension when customizing the device recommendation principle of "time" mentioned above. Figures 14A-14D The relevant text description will not be repeated here.

[0369] The specific process of selecting the recommended device under the function dimension is similar to the specific process of selecting the recommended device under the function dimension when customizing the device recommendation principle of "time" mentioned above. Figures 15A-15D The relevant text description will not be repeated here.

[0370] Continue reading Fig. 17B After the user completes the space settings and recommended device settings, for example, refer to Fig. 17C , the electronic device 100 can display the space that the user has set up and the information of the recommended devices in the user interface 1720. It can be seen that the space set by the user is the living room, and in addition, the user selects the recommended device in the single device dimension.

[0371] Continue reading Fig. 17CIn some embodiments, in order to facilitate the user to promptly know in which dimension the recommended device is selected, the electronic device 100 may further display a relevant mark. For example, assuming that the user selects a recommended device in a single device dimension, the electronic device 100 may display a mark 1725 on the single device dimension setting entry 1722 shown in the user interface 1720. The mark 1725 may be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device's controls, etc.) is set.

[0372] Continue reading Fig. 17C After the user completes the space setting and the recommended device setting, the electronic device 100 may further display option 1726. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1726. In response to the operation, the electronic device 100 may save the space and recommended device information that the user has set up, and may display Fig.17D As shown in the user interface 1710, it can be seen that the user interface 1710 displays an entry 1713 corresponding to the space (e.g., living room) that the user has added. It is easy to understand that the user can trigger the electronic device 100 to display the space by clicking on the entry 1713. Fig. 17C The user interface 1720 shown can view or modify the space that the user has set up and the information of the recommended equipment.

[0373] Continue reading Fig.17D The user interface 1710 may further include an option 1714, which may be used to delete a space that has been added by the user.

[0374] The following takes scenes as an example to exemplify how users customize the device recommendation rules of scenes (ie, how users set which devices to recommend in which scenes).

[0375] Continue reading Fig. 12A The electronic device 100 may detect a user operation (eg, a click operation) on the scene setting item 1216, and in response to the operation, the electronic device 100 may display Fig.18A User interface 1810 is shown as an example.

[0376] See also Fig.18A, the user interface 1810 may include option 1811. If option 1811 is in a selected state, it means that the scene has added the device recommendation rule set by the user. If option 1811 is not in a selected state, it means that the scene has not added the device recommendation rule set by the user. The user can independently set whether to put option 1811 in a selected state. It is easy to understand that when option 1811 is in a selected state, the user needs to set which devices to recommend in which scene before the user-defined scene device recommendation rule will take effect, that is, it is possible to determine the recommended device based on the scene device recommendation rule in the future.

[0377] Continue reading Fig.18A The user interface 1810 may further include an option 1812, which may be used by the user to add a scene and set the device to be recommended in the scene. The electronic device 100 may detect the user's operation (such as a click operation) on the option 1812, and in response to the operation, the electronic device 100 may display Fig.18B User interface 1820 is shown as an example.

[0378] See also Fig.18B The user interface 1820 may include a scene input box 1821, in which the user may input the name of the scene (eg, a home scene). It is easy to understand that the name of the scene may be used as the name of the scene in which the user is located when making subsequent customized device recommendations.

[0379] In some embodiments, the name of the scene input by the user may be the name of a scene that has been customized by the user in advance, wherein the process of user-customizing the scene may include the name of the user-customized scene, the triggering condition of the customized scene, etc. In this case, optionally, the electronic device 100 may also display the names of one or more scenes that have been customized by the user in advance in the form of a window, for example, and the user only needs to select the name of one of the scenes without manually entering the name of the scene in the scene input box 1821.

[0380] In other embodiments, if the name of the scene input by the user is not the name of a scene that has been customized by the user in advance, the electronic device 100 may prompt the user to set the trigger condition of the scene. After the user completes setting the trigger condition of the scene, it means that the user has completed the setting. Fig.18B The scene setup shown.

[0381] It is easy to understand that the electronic device 100 recommends a customized device in a certain scenario, which means that when the scenario set by the user meets the trigger condition, the electronic device 100 recommends the customized device. For example, the trigger condition of the home scene is the voice command "I'm home", then after detecting the voice command "I'm home" issued by the user, the electronic device 100 can recommend the recommended device selected by the user in the home scene.

[0382] Continue reading Fig.18B The user interface 1820 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1822, a space dimension setting entry 1823, and a function dimension setting entry 1824, wherein the single device dimension setting entry 1822 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1823 can be used by the user to select one or more categories (such as lighting, sunshade, audio-visual entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1824 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.

[0383] The specific process of selecting the recommended device in the single device dimension is similar to the specific process of selecting the recommended device in the single device dimension when customizing the device recommendation principle of "time" mentioned above. Figure 13C-13F The relevant text description will not be repeated here.

[0384] The specific process of selecting the recommended device in the spatial dimension is similar to the specific process of selecting the recommended device in the spatial dimension when customizing the device recommendation principle of "time" mentioned above. Figures 14A-14D The relevant text description will not be repeated here.

[0385] The specific process of selecting the recommended device under the function dimension is similar to the specific process of selecting the recommended device under the function dimension when customizing the device recommendation principle of "time" mentioned above. Figures 15A-15D The relevant text description will not be repeated here.

[0386] Continue reading Fig.18B After the user completes the space settings and recommended device settings, for example, refer to Fig.18C , the electronic device 100 can display the scene that the user has set and the information of the recommended device in the user interface 1820. It can be seen that the scene set by the user is the home scene, and in addition, the user selects the recommended device under the single device dimension.

[0387] Continue reading Fig.18C In some embodiments, in order to facilitate the user to promptly know in which dimension the recommended device is selected, the electronic device 100 may further display a relevant mark. For example, assuming that the user selects a recommended device in a single device dimension, the electronic device 100 may display a mark 1825 on the single device dimension setting entry 1822 shown in the user interface 1820. The mark 1825 may be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device controls, etc.) is set.

[0388] Continue reading Fig.18C After the user completes the scene setting and the recommended device setting, the electronic device 100 may further display option 1826. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1826. In response to the operation, the electronic device 100 may save the scene setting and the recommended device information that the user has completed, and may display Fig.18D As shown in the user interface 1810, it can be seen that the user interface 1810 displays an entry 1813 corresponding to the scene (such as the home scene) added by the user. It is easy to understand that the user can trigger the electronic device 100 to display the scene by clicking on the entry 1813. Fig.18C The user interface 1820 shown can view or modify the scenarios that the user has set up and the information of the recommended devices.

[0389] Continue reading Fig.18D The user interface 1810 may further include an option 1814, which may be used to delete a scene that has been added by the user.

[0390] It is easy to understand that after the user completes the device recommendation settings, the electronic device 100 can save the user's setting information and send the user's setting information to the server 200, so that the server 200 can subsequently recommend the device recommendation content of the user's customized settings based on the user's setting information.

[0391] It is easy to understand that in the case of the above-mentioned customized recommendation, the display method of the content recommended by the device is similar to the aforementioned automatic recommendation. The content recommended by the device can be displayed on the desktop of the electronic device 100, or on other interfaces of the electronic device 100 (such as the off-screen display interface, the lock screen interface, etc.); the display style of the content recommended by the device may include but is not limited to card style and 3D style.

[0392] In an embodiment of the present application, the content of device recommendation may not only include the controls for controlling the recommended device introduced above, but also include controls for triggering the control of the recommended device. For example, for some recommended devices with more complex functions, due to limited display space, it is impossible to display all controls for controlling the recommended device. In this case, a control for triggering the control of the recommended device may be displayed. When the user clicks on the control, the electronic device 100 may display more controls for controlling the recommended device. The user may operate the corresponding controls to realize the control of the recommended device by the electronic device 100. Among them, the above-mentioned "the electronic device 100 displays more controls for controlling the recommended device" may be that the electronic device 100 jumps to the application (such as a smart life application) that manages the recommended device to display more controls for controlling the recommended device, or the electronic device 100 directly displays more controls for controlling the recommended device in the form of windows, cards, etc.; and so on.

[0393] In an embodiment of the present application, the content recommended by the device can be displayed floating above the user interface currently displayed by the electronic device 100, or can be displayed in the user interface currently displayed by the electronic device 100, where the user interface currently displayed by the electronic device 100 can include but is not limited to the desktop, the screen-off display interface, the lock screen interface, the negative one screen interface, and the control center interface.

[0394] In the embodiment of the present application, when automatically recommending a device, the server 200 may determine the content of the device recommendation based on the automatic recommendation algorithm model. There may be multiple automatic recommendation algorithm models used by the server 200, which are not limited in the embodiment of the present application. Two automatic recommendation algorithm models are exemplarily introduced below.

[0395] Automatic recommendation algorithm model 1:

[0396] f(user,t,loc)=Device(t,loc)+Room(t,loc)+Scene(t,loc)

[0397] Among them, f(user, t, loc) can represent the total score of the device recommendation. The value of f(user, t, loc) is the sum of Device(t, loc), Room(t, loc), and Scene(t, loc). Device(t, loc) can represent the score of a single device. Room(t, loc) can represent the score of the space where a single device is located. Scene(t, loc) can represent the score of a single device in the scene where a single device is located. user can represent the current user. t can represent the time point when the device state changes. loc can represent the location of the device when the device state changes.

[0398] It is easy to understand that the larger the value of f(user, t, loc), the greater the probability that the device will be recommended. For example, the value of f(user, t, loc) corresponding to device 1 is greater than the value of f(user, t, loc) corresponding to device 2, that is, the recommendation priority of device 1 is higher than the recommendation priority of device 2, then device 1 will be recommended first. In an embodiment of the present application, the electronic device 100 can support the user to manually switch the currently recommended device, and the switched device can be a device with a lower recommendation priority than the currently recommended device. For example, assuming that the currently recommended device is the above-mentioned device 1, the electronic device 100 detects the user's operation of switching to recommend other devices (for example, clicking the aforementioned Figure 3C After selecting the "Change" option as exemplarily shown, the electronic device 100 can switch the currently recommended device from the above-mentioned device 1 to the above-mentioned device 2.

[0399] Among them, the scores assigned to Device(t, loc), Room(t, loc), and Scene(t, loc) can be determined based on action events, and the above action events may include but are not limited to: user controlling the device through GUI, user controlling the device through VUI, automatic change of device status, and scene triggering device status change.

[0400] In a possible implementation, each action event can be set with its corresponding Device (t, loc) value, Room (t, loc) value, and Scene (t, loc) value based on preset rules. Wherein, the Device (t, loc) value, Room (t, loc) value, and Scene (t, loc) value corresponding to each action event can be the same or different. Exemplarily, Device (t, loc), Room (t, loc), and Scene (t, loc) can all be set with a maximum value and a weight value corresponding to the action event in advance, wherein the Device (t, loc) value, Room (t, loc) value, and Scene (t, loc) value corresponding to each action event can be respectively the product of the maximum value of Device (t, loc) and the weight value of Device (t, loc) corresponding to the action event, the product of the maximum value of Room (t, loc) and the weight value of Room (t, loc) corresponding to the action event, and the product of the maximum value of Scene (t, loc) and the weight value of Scene (t, loc) corresponding to the action event.

[0401] In the embodiment of the present application, the information of each action event can be synchronized to the server 200 so that the server 200 can record the information and further determine the content recommended by the device. For example, when the user controls the device through the GUI or VUI, the server 200 can record the device currently controlled by the user, the way the user controls the device (i.e., whether the user controls the device through the GUI or the VUI), the time and place when the user controls the device, the value of Device (t, loc), the value of Room (t, loc), the value of Scene (t, loc), etc.; for another example, after the device state changes automatically, the server 200 can record the state of the device state after the automatic change, the time and place when the device state changes automatically, the value of Device (t, loc), the value of Room (t, loc), the value of Scene (t, loc), etc.; for another example, when the scene triggers the device state change, the server 200 can record the state of the device state after the scene triggers the change, the time and place when the scene triggers the change, the value of Device (t, loc), the value of Room (t, loc), the value of Scene (t, loc), etc.

[0402] Refer to Table 1, which exemplifies the values ​​of Device(t, loc), Room(t, loc), and Scene(t, loc) corresponding to different action events. It should be understood that the values ​​of Device(t, loc), Room(t, loc), and Scene(t, loc) shown in Table 1 are only exemplary and should not constitute a limitation on the present application.

[0403] In some embodiments, after a preset time period (e.g., 1 day, 2 days, etc.), the value of Device (t, loc), the value of Room (t, loc), and the value of Scene (t, loc) can be decayed according to certain preset rules, and the value after decay is the product of the value before decay and the decay coefficient. Among them, the decay coefficient can be determined based on the length of the preset time period. For example, the shorter the preset time period, the greater the decay coefficient, and the longer the preset time period, the smaller the decay coefficient. Refer to Table 2, which exemplarily shows the decay coefficient of Device (t, loc), the decay coefficient of Room (t, loc), and the decay coefficient of Scene (t, loc) corresponding to different preset time periods. For example, if the preset time period is 1 day (i.e., the value of Device (t, loc), the value of Room (t, loc), and the value of Scene (t, loc) were recorded 1 day ago), then the decay coefficient of Device (t, loc), the decay coefficient of Room (t, loc), and the decay coefficient of Scene (t, loc) can all be 0.8. It can be understood that the attenuation coefficient of Device (t, loc), the attenuation coefficient of Room (t, loc), and the attenuation coefficient of Scene (t, loc) shown in Table 2 are only exemplary and should not constitute a limitation on the present application.

[0404] It can be seen from the exemplary values ​​of the above automatic recommendation model 1, Table 1, and Table 2 that if the user performs control operations on a device within a certain time range and location range every day, then the probability of the device being recommended will increase; if the user controls a new device compared to before (for example, the user controlled a device 2 days ago and controlled the device again 2 days later), then the probability of the device being recommended will increase.

[0405] Action Events The value of Device(t, loc) The value of Room(t, loc) The value of Scene(t, loc) User controls the device via GUI 10 5 0 Automatic changes in device status 1 1 0 Users control devices through VUI 8 8 0 Scene triggers device state changes 2 4 10

[0406] Table 1

[0407]

[0408] Table 2

[0409] In some embodiments, after determining to recommend a device based on the above-mentioned automatic recommendation model, the specific dimension (e.g., single device dimension, spatial dimension, functional dimension, scene dimension) under which the device recommendation is made can be determined based on the value of Device(t, loc), the value of Room(t, loc), and the value of Scene(t, loc). For example, it can be determined which value among the values ​​of Device(t, loc), Room(t, loc), and Scene(t, loc) is the largest. If the value of Device(t, loc) is the largest, the device recommendation can be made under the single device dimension. If the value of Room(t, loc) is the largest, the device recommendation can be made under the spatial dimension or the functional dimension. If Scene(t, loc) is the largest, the device recommendation can be made under the scene dimension.

[0410] Automatic recommendation algorithm model 2:

[0411] f(user,t,loc)=max{Device(t,loc),Room(t,loc),Scene(t,loc)}

[0412] Among them, f(user, t, loc) can represent the score of device recommendation, the value of f(user, t, loc) is the maximum value of Device(t, loc), Room(t, loc), and Scene(t, loc), Device(t, loc) can represent the score of a single device, Room(t, loc) can represent the score of the space where a single device is located, Scene(t, loc) can represent the score of a single device in the scene where a single device is located, user can represent the current user, t can represent the time point when the device state changes, and loc can represent the location of the device when the device state changes.

[0413] It is easy to understand that the larger the value of f(user, t, loc), the greater the probability that the device will be recommended.

[0414] In the above-mentioned automatic recommendation algorithm model 2, the method for determining the value of the above-mentioned Device(t, loc), the value of Room(t, loc), the value of Scene(t, loc), the method for determining the attenuation coefficient of the above-mentioned Device(t, loc), the attenuation coefficient of Room(t, loc), and the attenuation coefficient of Scene(t, loc) are similar to the above-mentioned automatic recommendation algorithm model 1 and will not be repeated here.

[0415] In some embodiments, after determining to make device recommendations based on the above-mentioned automatic recommendation model 2, the specific dimension (e.g., single device dimension, spatial dimension, functional dimension, scene dimension) in which the device recommendation is made can also be determined based on the value of Device(t, loc), the value of Room(t, loc), and the value of Scene(t, loc). For example, if the value of f(user, t, loc) is the same as the value of Device(t, loc), the device recommendation can be made in the single device dimension; if the value of f(user, t, loc) is the same as the value of Room(t, loc), the device recommendation can be made in the spatial dimension or the functional dimension; if the value of f(user, t, loc) is the same as the value of Scene(t, loc), the device recommendation can be made in the scene dimension.

[0416] The following introduces a software structure of an electronic device 100 provided in an embodiment of the present application.

[0417] Fig.19 The software structure of an electronic device 100 provided in an embodiment of the present application is exemplified.

[0418] like Fig.19 As shown, the software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0419] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system library, and the kernel layer.

[0420] The application layer can include a series of application packages.

[0421] like Fig.19 As shown, the application package may include camera, gallery, calendar, call, map, smart life, WLAN, Bluetooth, music, video, short message and other applications.

[0422] Among them, smart life can be an application for managing smart home devices. For example, the smart life application can be used to display home device data such as the operating status and monitoring data of smart home devices; for another example, the smart life application can also be used to display controls for controlling smart home devices, so that users can control smart home devices by operating the controls; for another example, the smart life application can also be used to provide device recommended content (for example, displaying device recommended content through cards, 3D, etc.); etc. For details, please refer to the relevant content in the aforementioned embodiments, which will not be repeated here.

[0423] It should be noted that the name of the smart life application is only a term used in the embodiments of the present application. The meaning represented by it has been recorded in the embodiments of the present application, and the name does not constitute any limitation to the embodiments of the present application.

[0424] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0425] like Fig.19 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0426] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0427] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0428] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0429] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0430] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0431] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0432] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0433] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0434] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0435] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0436] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0437] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0438] A 2D graphics engine is a drawing engine for 2D drawings.

[0439] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, Bluetooth driver, and sensor driver.

[0440] The following is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application.

[0441] Fig. 20 The structure of an electronic device 100 provided in an embodiment of the present application is exemplarily shown.

[0442] like Fig. 20 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0443] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0444] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0445] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0446] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0447] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0448] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0449] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0450] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0451] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0452] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0453] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0454] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other terminal devices, such as AR devices, etc.

[0455] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0456] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device 100 through the power management module 141.

[0457] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0458] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0459] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0460] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0461] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0462] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0463] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0464] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0465] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0466] In the embodiment of the present application, the display screen 194 can be used to display content recommended by the device.

[0467] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0468] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, etc. of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0469] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0470] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0471] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0472] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0473] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0474] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0475] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0476] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0477] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0478] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0479] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0480] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0481] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0482] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0483] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0484] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0485] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0486] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0487] It should be understood that Fig. 20 The electronic device 100 shown is only an example, and the electronic device 100 may have more Fig. 20 More or fewer components may be shown, two or more components may be combined, or there may be a different configuration of components. Fig. 20 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0488] The following introduces the structure of a server 200 provided in an embodiment of the present application.

[0489] Fig.21 The structure of a server 200 provided in an embodiment of the present application is exemplified.

[0490] like Fig.21 As shown, the server 200 may include: one or more processors 2101, a memory 2102, a communication interface 2103, a transmitter 2105, a receiver 2106, a coupler 2107, and an antenna 2108. These components may be connected via a bus 2104 or other means. Fig.21 Take bus connection as an example.

[0491] The communication interface 2103 can be used for the server 200 to communicate with other devices, such as the electronic device 100, etc., for communication. Specifically, the communication interface 2103 can be a 3G communication interface, a 4G communication interface, a 5G communication interface, or a communication interface of a future new air interface. Not limited to a wireless communication interface, the server 200 can also be configured with a wired communication interface 2103, such as a local access network (LAN) interface. The transmitter 2105 can be used to transmit and process the signal output by the processor 2101. The receiver 2106 can be used to receive and process the mobile communication signal received by the antenna 2108.

[0492] In some embodiments of the present application, the transmitter 2105 and the receiver 2106 can be regarded as a wireless modem. In the server 200, the number of the transmitter 2105 and the receiver 2106 can be one or more. The antenna 2108 can be used to convert the electromagnetic energy in the transmission line into electromagnetic waves in the free space, or convert the electromagnetic waves in the free space into electromagnetic energy in the transmission line. The coupler 2107 is used to divide the mobile communication signal received by the antenna 2108 into multiple paths and distribute them to multiple receivers 2106.

[0493] The memory 2102 is coupled to the processor 2101 and is used to store various software programs and / or multiple sets of instructions. Specifically, the memory 2102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state storage devices. The memory 2102 may store a network communication program, which may be used to communicate with one or more additional devices, one or more terminal devices, or one or more network devices.

[0494] In some embodiments of the present application, the memory 2102 may be used to store an implementation program on the server 200 side of the device recommendation method provided by one or more embodiments of the present application.

[0495] The processor 2101 may be used to read and execute computer-readable instructions. Specifically, the processor 2101 may be used to call a program stored in the memory 2102, such as an implementation program of the device recommendation method provided in one or more embodiments of the present application on the server 200 side, and execute instructions contained in the program.

[0496] It should be noted that Fig.21 The server 200 shown is only one implementation of the embodiment of the present application. In actual applications, the server 200 may also include more or fewer components, which is not limited here.

[0497] For more details about the functions and working principles of the server 200, please refer to the relevant contents in the above embodiments, which will not be repeated here.

[0498] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0499] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0500] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A device recommendation method, characterized in that: The method comprises: The electronic device displays a first component, wherein the first component presents at least one control on the electronic device for controlling or triggering control of at least one smart device, wherein the at least one smart device is a smart device determined to be preferentially recommended among smart devices included in an environment where a user is located, and the at least one control includes a first control; The electronic device detects a first operation of the user on the first control; In response to the first operation, the electronic device controls at least one smart device corresponding to the first control.

2. The method according to claim 1, characterized in that: The electronic device displays the first component at a first moment. After the electronic device displays the first component, the method further includes: The electronic device updates and displays the first component at a second moment, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.

3. The method according to claim 1, characterized in that: After the electronic device displays the first component, the method further includes: The electronic device detects that the position of the electronic device switches from the first position to the second position; In response to the switching, the electronic device updates and displays the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.

4. The method according to claim 1, characterized in that After the electronic device displays the first component, the method further includes: The electronic device detects a second operation of the user on the first component; In response to the second operation, the electronic device updates and displays the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.

5. The method according to any one of claims 1 to 4, characterized in that: The first component is displayed in a floating manner on a first user interface of the electronic device; or, The first component is displayed in the first user interface.

6. The method according to claim 5, characterized in that The first user interface is one or more of the following interfaces: desktop, screen-off display interface, lock screen interface, negative one screen interface, and control center interface.

7. The method according to any one of claims 1 to 6, characterized in that: Before the electronic device displays the first component, the method further includes: The electronic device detects a third operation of the user; The electronic device displays a first component, specifically comprising: In response to the third operation, the electronic device displays the first component.

8. The method according to any one of claims 1 to 6, characterized in that: Before the electronic device displays the first component, the method further includes: The electronic device obtains the status information of the at least one smart device; The electronic device displays a first component, specifically comprising: The electronic device displays the first component based on status information of the at least one smart device.

9. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in the style of a permanent card.

10. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in the style of a non-resident card.

11. The method according to claim 7, characterized in that Before the electronic device displays the first component, the electronic device also displays a second control, and the third operation is an operation performed by the user on the second control.

12. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in 3D style.

13. The method according to any one of claims 1 to 12, characterized in that: The first control is used to control one or more smart devices among the priority recommended smart devices.

14. The method according to any one of claims 1 to 13, characterized in that: The first control is a control for controlling the switch of the smart device; The first operation is a start operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device turns on the at least one smart device corresponding to the first control; or, The first operation is a closing operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device turns off the at least one smart device corresponding to the first control.

15. The method according to any one of claims 1 to 13, characterized in that: The first control is a control for adjusting a function parameter of the smart device, and the first operation is an operation of a user adjusting the function parameter.

16. The method according to claim 15, characterized in that The function parameter is brightness, the first operation is a brightness adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the brightness of the at least one smart device corresponding to the first control; or, The functional parameter is temperature, the first operation is a temperature adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the temperature of the at least one smart device corresponding to the first control; or, The function parameter is volume, the first operation is a volume adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the volume of the at least one smart device corresponding to the first control.

17. The method according to any one of claims 1 to 16, characterized in that: The at least one smart device includes a first smart device, the at least one control includes a third control, and the third control is used to trigger and control the first smart device. The method further includes: The electronic device detects a fourth operation of the user on the third control; In response to the fourth operation, the electronic device displays a second component, where at least one control for controlling the first smart device is presented on the second component, and the at least one control includes a fourth control; The method further comprises: The electronic device detects a fifth operation of the user on the fourth control; In response to the fifth operation, the electronic device controls the first smart device.

18. The method according to any one of claims 1 to 17, characterized in that: The at least one smart device meets one or more of the following conditions: being used periodically by the user, being at a distance from the electronic device that is less than a preset distance threshold, being operated by the user within a preset time period, being in the same network as the electronic device, and being in an abnormal state.

19. The method according to any one of claims 1 to 17, characterized in that: The at least one smart device is determined based on a first preset condition, where the first preset condition includes one or more of the following: a first preset time has arrived, the electronic device is in a first preset position, and the user is in a first preset scene.

20. An electronic device, characterized in that: The electronic device includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method described in any one of claims 1-19.

21. A computer storage medium, characterized in that The computer storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 19.

Images