Device recommendation method, related apparatus, and communication system
By displaying the controls of smart home devices on electronic devices, priority recommendation and automatic update of devices are achieved, which solves the problem of low efficiency in searching and controlling devices in a multi-device environment, and improves operational efficiency and user experience.
Patent Information
- Application Number
- PCT/CN2024/120314
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-25
- Filing Date
- 2024-09-23
- Publication Date
- 2025-04-03
AI Technical Summary
In the case of a large number of smart home devices, the process of users finding and controlling specific devices is complicated and cumbersome, and the interaction efficiency is low.
By displaying controls of one or more smart devices on the electronic device, priority recommendation and automatic update of devices can be achieved, and users can directly control the recommended devices through simple operations.
It saves users' time to find equipment, improves the efficiency of users' control equipment, and achieves the purpose of users' quick control of massive equipment.
Smart Images

Figure CN2024120314_03042025_PF_FP_ABST
Abstract
Description
Equipment recommendation method, related device and communication system
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 25, 2023, with application number 202311248461.6 and application name “Equipment Recommendation Method, Related Devices and Communication System”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of terminal technology, and in particular to a device recommendation method, related devices and communication system. Background Art
[0003] With the development of the Internet of Things (IoT) and the popularization of whole-home intelligence, the use of smart home devices is becoming more and more common. Users can control smart home devices through smart home applications (APPs) on electronic devices such as mobile phones and tablets.
[0004] However, when a user owns a large number of smart home devices, if the user wants to control a certain smart home device, the user needs to swipe up or turn the page on the smart home device display page of the above-mentioned smart home application to find the corresponding smart home device and then control it. The whole process is complicated and cumbersome, and the interaction efficiency is low.
[0005] Therefore, when there are a large number of smart home devices, how to enable users to find target devices efficiently and quickly is a problem that needs to be solved urgently.
[0006] Summary of the Invention
[0007] The embodiments of the present application provide a device recommendation method, related devices, and a communication system. The device recommendation method can save users time in searching for devices and improve the efficiency of users in controlling devices.
[0008] In a first aspect, an embodiment of the present application provides a device recommendation method, the method comprising: an electronic device displays a first component, the first component presents at least one control on the electronic device for controlling or triggering control of at least one smart device, the at least one smart device is a priority recommended smart device among the smart devices included in the user's environment, and the at least one control includes a first control; the electronic device detects a first operation of the user on the first control; in response to the first operation, the electronic device controls the at least one smart device corresponding to the first control.
[0009] Among them, the above-mentioned first component can be a component with a display style such as a card, 3D, etc. The electronic device can display information of one or more recommended devices (such as smart devices of the home type, etc.) through the first component (for example, at least one control for controlling or triggering the control of the smart device, etc.), the first control can be a control for controlling at least one recommended device (such as a switch control, etc.), and the first operation can be, for example, a click operation, etc.
[0010] By implementing the method provided in the first aspect, the electronic device can display controls for one or more smart devices in a user interface such as a desktop, without the user having to enter an application for managing the one or more smart devices to search for and control the smart devices. This can solve the problem of low efficiency in users actively searching for devices, and upgrade the process from people looking for devices to devices looking for people. This saves users time in searching for devices, improves the efficiency of users in controlling devices, and enables users to quickly control a large number of devices.
[0011] In one possible implementation, the electronic device displays a first component at a first moment. After the electronic device displays the first component, the method further includes: the electronic device updates and displays the first component at a second moment, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.
[0012] The first moment is different from the second moment, and the first moment is earlier than the second moment. In this way, the electronic device can automatically update and display the first component at different moments, so as to present the user with the information of the one or more smart devices that are currently recommended.
[0013] In one possible implementation, after the electronic device displays the first component, the method further includes: the electronic device detects that the position of the electronic device switches from the first position to the second position; in response to the switch, the electronic device updates the display of the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.
[0014] In this way, when the user is in a different location (for example, switching from a first location to a second location), the electronic device can automatically update the display of the first component based on the user's current location (i.e., the second location) so that information of smart devices that are closer to the user's current location can be presented, making it easier for the user to control the smart device and improving the user experience.
[0015] In one possible implementation, after the electronic device displays the first component, the method further includes: the electronic device detects a second operation of the user on the first component; in response to the second operation, the electronic device updates the display of the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of at least one smart device presented on the first component before the update.
[0016] The second operation may be, for example, a click operation on option 311E as exemplarily shown in FIG3A , or a sliding operation on the first component.
[0017] In this way, the user can trigger the electronic device to update the display of the first component through active operation.
[0018] In a possible implementation, the first component is displayed floating above a first user interface of the electronic device; or, the first component is displayed in the first user interface.
[0019] In other words, the first component can be independent of the first user interface and not part of the first user interface, for example, displayed as a floating window above the first user interface; or it can be part of the first user interface and displayed within the first user interface. This can provide users with different visual experiences.
[0020] In a possible implementation, the first user interface is one or more of the following interfaces: desktop, screen-off display interface, lock screen interface, negative one screen interface, and control center interface.
[0021] That is to say, the above-mentioned first component can be displayed on only one interface or on multiple interfaces at the same time, which can improve the efficiency of users in finding and controlling smart devices.
[0022] In one possible implementation, before the electronic device displays the first component, the method further includes: the electronic device detects a third operation of the user; the electronic device displays the first component, specifically including: in response to the third operation, the electronic device displays the first component.
[0023] Among them, the above-mentioned third operation can be, for example, the operation of the user unlocking the electronic device to enter the desktop, the user sliding up on the desktop, the user's operation on the icon 911 shown in Figure 9A, etc.
[0024] In this way, the user can trigger the electronic device to display the first component through active operation.
[0025] In one possible implementation, before the electronic device displays the first component, the method further includes: the electronic device obtains status information of at least one smart device; the electronic device displays the first component, specifically including: the electronic device displays the first component based on the status information of at least one smart device.
[0026] In this way, the electronic device can automatically make device recommendations based on the status information of the smart device, so that the user can check the current status of the smart device in a timely manner and further control the recommended smart device in a timely manner.
[0027] In a possible implementation, the first component is displayed in a resident card style.
[0028] In this way, users can see the information of recommended devices in a timely manner when using electronic devices without manual operation by users, which is convenient and fast.
[0029] In a possible implementation, the first component is displayed in a non-resident card style.
[0030] In this way, the user can manually trigger the electronic device to display the information of the recommended device. The user can have more initiative to choose whether to display the information of the recommended device. If the information of the recommended device does not need to be displayed, it will not occupy the display space of the electronic device.
[0031] In a possible implementation, before the electronic device displays the first component, the electronic device also displays a second control, and the third operation is an operation performed by the user on the second control.
[0032] The second control may be, for example, the icon 911 shown in FIG. 9A . The user may click the icon 911 to trigger the display of information about the recommended device, so that the user may quickly control the recommended device.
[0033] In a possible implementation manner, the first component is displayed in a 3D style.
[0034] In this way, it is convenient for users to perform three-dimensional control operations on the recommended devices, thereby providing users with better visual and operating experiences.
[0035] In a possible implementation, the first control is used to control one or more smart devices among the prioritized smart devices.
[0036] In this way, the user can control a single smart device by operating the first control, or can control multiple smart devices with one click.
[0037] In one possible implementation, the first control is a control for controlling the switch of a smart device; the first operation is an on operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device turns on at least one smart device corresponding to the first control; or, the first operation is a off operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device turns off at least one smart device corresponding to the first control.
[0038] In this way, when the user performs an opening operation on the first control, the electronic device can turn on at least one smart device, and when the user performs a closing operation on the first control, the electronic device can turn off at least one smart device, which is convenient, fast and efficient.
[0039] In a possible implementation, the first control is a control for adjusting a function parameter of the smart device, and the first operation is an operation of the user adjusting the function parameter.
[0040] Among them, the above-mentioned functional parameters may refer to parameters corresponding to one or more functions provided by the smart device (such as brightness, temperature, volume, wind speed, color temperature, etc.).
[0041] In this way, users can quickly adjust the functional parameters of smart devices and improve the efficiency of user control of devices.
[0042] In one possible implementation, the functional parameter is brightness, the first operation is a brightness adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the brightness of at least one smart device corresponding to the first control; or, the functional parameter is temperature, the first operation is a temperature adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the temperature of at least one smart device corresponding to the first control; or, the functional parameter is volume, the first operation is a volume adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: the electronic device adjusts the volume of at least one smart device corresponding to the first control.
[0043] In this way, users can easily and quickly adjust the brightness, temperature, volume and other functional parameters of smart devices.
[0044] In one possible implementation, at least one smart device includes a first smart device, at least one control includes a third control, and the third control is used to trigger control of the first smart device. The method also includes: the electronic device detects a fourth operation of the user on the third control; in response to the fourth operation, the electronic device displays a second component, and the second component presents at least one control for controlling the first smart device, and the at least one control includes a fourth control; the method also includes: the electronic device detects a fifth operation of the user on the fourth control; in response to the fifth operation, the electronic device controls the first smart device.
[0045] Among them, the above-mentioned first smart device can be a smart device with more complex functions, the third control can be a control for triggering and controlling the smart device, the fourth operation can be, for example, a click operation, the second component can be a component for presenting at least one control of the smart device, the fourth control can be a control for controlling the smart device, and the fifth operation can be an operation on the control (such as a click operation, a sliding operation, etc.).
[0046] In this way, users can also quickly control some smart devices with complex functions.
[0047] In one possible implementation, at least one smart device meets one or more of the following conditions: being periodically used by the user, being at a distance from the electronic device less than a preset distance threshold, being operated by the user within a preset time period, being on the same network as the electronic device, and being in an abnormal state.
[0048] In this way, the electronic device can automatically recommend devices when the smart device meets the above conditions, giving the user an intelligent experience.
[0049] In one possible implementation, at least one smart device is determined based on a first preset condition, where the first preset condition includes one or more of the following: a first preset time has arrived, the electronic device is at a first preset location, and the user is in a first preset scene.
[0050] In this way, the electronic device can make device recommendations when the smart device meets the user's preset conditions, which can achieve the purpose of making device recommendations more accurately and give the user a personalized experience.
[0051] In a second aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method described in any possible implementation method of the first aspect above.
[0052] In a third aspect, an embodiment of the present application provides a computer storage medium storing a computer program, wherein the computer program includes program instructions. When the program instructions are run on an electronic device, the electronic device executes the method described in any possible implementation of the first aspect above.
[0053] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] FIG1A-FIG1F are schematic diagrams of user interfaces for a group of users to search for smart home devices according to an embodiment of the present application;
[0055] FIG2 is a schematic diagram of the architecture of a communication system provided in an embodiment of the present application;
[0056] 3A-3E are schematic diagrams of a set of user interfaces for performing device recommendations in a single device dimension, provided in an embodiment of the present application;
[0057] 4A-4B are another set of user interface diagrams for performing device recommendations in a single device dimension, provided by an embodiment of the present application;
[0058] 5A-5C are another set of user interface diagrams for performing device recommendations in a single device dimension, provided by an embodiment of the present application;
[0059] 6A-6C are schematic diagrams of a set of user interfaces for device recommendation in a spatial dimension, provided by an embodiment of the present application;
[0060] 7A-7C are schematic diagrams of a set of user interfaces for recommending devices based on functional dimensions, provided in an embodiment of the present application;
[0061] 8A-8D are schematic diagrams of a set of user interfaces for device recommendation in a scenario dimension, provided by an embodiment of the present application;
[0062] 9A-9C are schematic diagrams of a user interface for displaying a set of recommended content on a desktop display device according to an embodiment of the present application;
[0063] 10A-10B are schematic diagrams of a user interface for displaying content recommended by a device on an off-screen display interface, provided by an embodiment of the present application;
[0064] 11A-11D are schematic diagrams of a user interface for displaying device-recommended content on a lock screen interface, provided by an embodiment of the present application;
[0065] 12A-12B are schematic diagrams of a user interface for a user to independently set device recommendation rules according to an embodiment of the present application;
[0066] 13A-13F are schematic diagrams of another set of user interfaces for users to independently set device recommendation rules, provided in an embodiment of the present application;
[0067] 14A-14D are schematic diagrams of another set of user interface diagrams for users to independently set device recommendation rules according to an embodiment of the present application;
[0068] 15A-15D are schematic diagrams of another set of user interface diagrams for users to independently set device recommendation rules according to an embodiment of the present application;
[0069] 16A-16B are schematic diagrams of another user interface for users to independently set device recommendation rules according to an embodiment of the present application;
[0070] 17A-17D are schematic diagrams of another set of user interfaces for users to independently set device recommendation rules, provided by an embodiment of the present application;
[0071] 18A-18D are schematic diagrams of another user interface for users to independently set device recommendation rules according to an embodiment of the present application;
[0072] FIG19 is a schematic diagram of a software architecture of an electronic device 100 provided in an embodiment of the present application;
[0073] FIG20 is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application;
[0074] FIG21 is a schematic structural diagram of a server 200 provided in an embodiment of the present application. DETAILED DESCRIPTION
[0075] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0076] It should be understood that the terms "first," "second," and the like in the specification, claims, and drawings of this application are used to distinguish between different objects, rather than to describe a particular order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.
[0077] References to "embodiments" in this application mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0078] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0079] With the development of current Internet of Things technology and the popularization of whole-house intelligence, the use of smart home devices is becoming more and more common, and the number of smart home devices owned by each user is also increasing.
[0080] Despite the emergence of multiple interaction modes, such as voice user interface (VUI) and graphical user interface (GUI), most users are still accustomed to using GUI to control smart home devices. For example, users usually control smart home devices through smart home applications on electronic devices such as mobile phones and tablets.
[0081] The widespread use of smart home devices can make people's lives at home more comfortable, safer and more convenient. However, the increase in the number of smart home devices in the home has also brought some troubles to users.
[0082] For example, if a user owns a large number of smart home devices and wants to control a certain smart home device, the user needs to swipe up or turn the page on the smart home device display page of the above-mentioned smart home application to find the corresponding smart home device and then control it.
[0083] Exemplarily, referring to FIG1A , taking the above-mentioned smart home application as a smart life application as an example, the electronic device 100 can display a user interface 110. The user interface 110 displays a page on which application icons are placed. The page may include icons of multiple applications (such as the icon 111 of the smart life application, etc.). A page indicator may also be displayed below the icons of the above-mentioned multiple applications to indicate the positional relationship between the currently displayed page and other pages. There are multiple tray icons below the page indicator (for example, an icon for a camera application, an icon for a contact application, an icon for a dialing application, an icon for a message application). The tray icon remains displayed when the page is switched. The embodiment of the present application does not limit the content displayed on the user interface 110. In response to the user's operation on the icon or tray icon of the above-mentioned application (such as a click operation), the electronic device 100 can open the application corresponding to the icon of the application or the tray icon.
[0084] The electronic device 100 can detect a user operation (such as a click operation) on the icon 111 of the smart life application. In response to the operation, the electronic device 100 can open the smart life application and display the user interface 120 shown in Figure 1B.
[0085] 1B , the user interface 120 may be a user interface provided by a smart life application. The user interface 120 may include a home name 121, a home management control 122, a number of devices 123, an add control 124, a device option 125, a space option 126, a home option 127, a device card display area 128, and a page option display area 129. Among them:
[0086] The page option display area 129 may include multiple page options. These multiple page options may include home options, mall options, discovery options, scene options, and my options. The above multiple page options can be used to switch the content presented by the user interface in the smart life application. For example, when the home option is in the selected state shown in Figure 1B, the content presented by the user interface in the smart life application may include the control interface of the smart home device that has established a binding relationship with the electronic device 100 and the smart home device data. The embodiment of the present application does not limit the page options included in the page option display area 129.
[0087] That is to say, the user can view the smart home devices in his home and control the smart home devices under the home option in the page option display area 129.
[0088] Home name 121 can be used to indicate the name of a home. A home name can be set by the user. For example, home name 121 can be "Lily's Home." A home can have one or more smart home devices. If home name 121 is "Lily's Home" as shown in Figure 1B, the user interface of the smart life application can present the control interfaces and smart home device data of the smart home devices in the home named "Lily's Home."
[0089] The family management control 122 can be used to manage families in the smart life application. This management can include modifying the family name, switching the family displayed in the smart life application user interface, deleting a family, creating a new family, adding or removing members from a family, and so on. This embodiment of the application does not limit the management method of families in the smart life application.
[0090] The number of devices 123 may be used to indicate the number of smart home devices in a home. For example, a home named "Lily's Home" may have 25 smart home devices.
[0091] Add controls 124 may be used to add smart home devices to a home.
[0092] The device option 125 can be used to trigger the electronic device 100 to display the smart home devices included in a home. As shown in Figure 1B, when the device option 125 is selected, the electronic device 100 can display device cards corresponding to the smart home devices in the device card display area 128. For example, a router card, an air conditioner card, a speaker card, a curtain card, a TV card, a camera card, an air purifier card, a table lamp card, etc. The above-mentioned device cards may include the space where the smart home device is located in the home, the network status of the smart home device, the working status of the smart home device, controls for turning on or off the smart home device, etc. The electronic device 100 can detect the user's operation on a device card (such as a click operation). In response to the operation, the electronic device 100 can display more detailed information (such as power level, operating mode, etc.) and more functional controls (such as temperature adjustment controls, brightness adjustment controls, etc.) of the smart home device indicated by the device card.
[0093] The smart home devices indicated by the device cards in the device card display area 128 may be smart home devices in a home named “Lily’s Home”.
[0094] The space option 126 can be used to trigger the electronic device 100 to display the division of smart home devices contained in a home into spaces, as well as control controls for controlling all smart home devices that can provide a function in a space.
[0095] The above-mentioned spaces can represent different areas in a home. Spaces can include a foyer, living room, kitchen, master bedroom, second bedroom, study, balcony, bathroom, audio-visual room, basement, etc. The embodiments of the present application do not limit the specific division method of different areas in a home. Among them, each smart home device can have a spatial attribute. The spatial attribute can be set by the user for the smart home device when adding the smart home device. The spatial attribute of a smart home device can indicate the location of the smart home device. For example, if the spatial attribute of a smart home device is kitchen, it can indicate that the smart home device is located in the kitchen. Based on the spatial attributes of the smart home devices, the electronic device 100 can support dividing multiple smart home devices into device groups corresponding to each space. For example, a device group can contain multiple smart home devices with the same spatial attributes. The electronic device can provide controls for controlling all smart home devices in a device group with one click. For example, turning on smart home devices such as lights and air conditioners in the living room with one click.
[0096] The My Home option 127 can be used to trigger the electronic device 100 to display the functional classification of the smart home devices contained in a home. That is, the user can view the home device data of the smart home devices that provide a function (such as environmental monitoring function) under the My Home option 127.
[0097] Continuing with FIG1B , it is readily apparent that when device option 125 is selected, electronic device 100 can display a separate device card corresponding to each smart home device in the home. In one possible implementation, electronic device 100 can detect a user swiping up on user interface 120. In response, electronic device 100 can display more cards corresponding to smart home devices, as exemplified in FIG1C . In other words, the user can view the smart home devices in their home under device option 125 and individually control each smart home device.
[0098] It is understood that due to the limited screen size of the electronic device 100, when there are a large number of device cards, the electronic device 100 cannot simultaneously present all of the device cards on the user interface. The electronic device 100 can adjust the device cards displayed in the user interface in response to the user sliding up or down in the user interface. In other words, the user can view different device cards by sliding up or down.
[0099] For example, if a user wants to search for a smart home device (e.g., a table lamp, air conditioner, curtain, etc.) shown in FIG1C , the user needs to confirm that the target device is not included in the smart home devices shown in FIG1B , and then search for the target device by swiping up on the user interface 120 shown in FIG1B . It can be seen that if the user has a large number of smart home devices, searching for the target device is very time-consuming, inefficient, and has a poor user experience.
[0100] In response to the above problem, one solution is that the electronic device 100 can support users to add preset static tags to devices, such as a "frequently used" tag. In this way, the electronic device 100 can display devices with the "frequently used" tag in the front. However, when there are a large number of devices, users still need to search for them one by one, which is very time-consuming.
[0101] Another solution is that the electronic device 100 can group and display the smart home devices in a home according to the spatial attributes of the smart home devices (i.e., the location of the smart home devices). The user can search for the target device in the corresponding spatial group according to the space where the target device is located.
[0102] For example, continuing to refer to FIG. 1B , the electronic device 100 may detect a user operation (eg, a click operation) on the space option 126 . In response to the operation, the electronic device 100 may display the user interface 130 as exemplarily shown in FIG. 1D .
[0103] Referring to Figure 1D , when the space option 126 is selected, the electronic device 100 may display a space card display area 131 in the user interface 130. The space card display area 131 may include space cards corresponding to various spaces in a home. For example, a living room card 132, a master bedroom card, a kitchen card, and so on. In one possible implementation, the electronic device 100 may detect a user swiping up on the user interface 130. In response to this swipe up, the electronic device 100 may display more space cards as shown in the exemplary embodiment of Figure 1E .
[0104] 1E , the space card display area 131 in the user interface 130 may include a kitchen card, a balcony card, a porch card 133 and a basement card.
[0105] It is understood that due to the limited screen size of the electronic device 100, when there are a large number of Space Cards, the electronic device 100 cannot simultaneously display all of the Space Cards on the user interface. The electronic device 100 can adjust the Space Cards displayed in the user interface in response to the user sliding up or down on the user interface. In other words, the user can view different Space Cards by sliding up or down.
[0106] For example, if the user wants to find a smart home device in the space where the porch shown in Figure 1E is located, then the user needs to determine that the space card shown in Figure 1D does not include the porch card, and then search for the porch card by swiping up on the user interface 130 shown in Figure 1D. After finding the porch card, the electronic device 100 can detect the user's operation (such as a click operation) on the porch card 133 shown in Figure 1E. In response to the operation, the electronic device 100 can display the user interface 140 shown in Figure 1F.
[0107] Referring to Figure 1F , user interface 140 may include device cards (e.g., speaker cards, camera cards) corresponding to one or more smart home devices in the space where the entryway is located. This allows the user to find the target device in the space where the entryway is located. It can be seen that finding the target device is still quite time-consuming when there are a large number of space cards.
[0108] Another solution is that the electronic device 100 can group and display the smart home devices in a home according to their functional attributes, and the user can search for the target device in the corresponding functional group based on the function of the target device. Among them, the types of functions may include lighting function, sunshade function, environmental monitoring function, safety protection function, network function, water use function, etc. For example, if the user wants to find the lights in the home, then the user can search in the lighting function group. It is easy to see that, similar to the above two solutions, when there are many functional groups, it is still time-consuming for the user to find the target device.
[0109] Current solutions show that, with a large number of smart home devices, the process of finding a target device remains complex and tedious, resulting in low human-computer interaction efficiency and a poor user experience. Therefore, how to enable users to more efficiently find and quickly locate their target device is an urgent issue to be addressed.
[0110] Based on the above problems, an embodiment of the present application provides a device recommendation method, in which the electronic device can obtain the historical records of the user's manipulation of smart home devices (such as the manipulation method, manipulation time, etc.), the location of the electronic device and other information, and send this information to the server. The server can predict the smart home device that the user is about to control based on this information and the status information of the smart home device itself sent, and send the information of the predicted smart home device (such as control information, status information, etc.) to the electronic device. The electronic device can display the information of the smart home device predicted by the server to recommend it to the user. In this way, the problem of low efficiency of users actively searching for devices can be solved, and the process can be upgraded from people looking for devices to devices looking for people, saving users time in searching for devices, improving users' efficiency in manipulating devices, and achieving the purpose of users quickly controlling massive devices. In addition, in this method, the electronic device can also support users to independently set device recommendation rules, so as to achieve the purpose of more accurate device recommendation and further improve user experience.
[0111] The following describes a communication system provided by an embodiment of the present application.
[0112] FIG2 exemplarily shows a communication system provided in an embodiment of the present application.
[0113] 2 , the communication system may include: an electronic device 100 , one or more smart home devices, and a server 200 .
[0114] The one or more smart home devices may include: a light 201, curtains 202, an air conditioner 203, an electric fan 204, an air purifier 205, a camera 206, and a router 207. The smart home devices are not limited to those shown in FIG2 , and the communication system may further include more or fewer smart home devices.
[0115] The electronic device 100 can be used by the user to control smart home devices, and can also be used by the user to view the operating status and monitoring data of the smart home devices. An application for managing smart home devices (such as a smart life application) can be installed on the electronic device 100. The electronic device 100 can provide a control interface for controlling smart home devices through the smart life application. The control interface can be a control displayed on the electronic device 100 for controlling the smart home devices (such as the light full turn on control, light full turn off control, air conditioning on or off control, humidifier on or off control, etc. shown in the exemplary embodiment of FIG. 1D above).
[0116] The electronic device 100 can also be used to display information about smart home devices recommended by the server 200 (such as control information, status information, etc.) so that users can quickly control smart home devices and achieve the effect of visible and controllable smart home devices. In addition, it is also convenient for users to know the status of smart home devices in a timely manner.
[0117] It is easy to understand that the electronic device 100 can display the information of the smart home devices recommended by the server 200 based on the installed application for managing smart home devices.
[0118] It should be noted that the embodiment of the present application does not limit the display location and display style of the smart home device information recommended by the server 200. The display location may include, but is not limited to, the desktop, lock screen, always on display (AOD) interface, notification bar, negative one screen interface, and control center interface of the electronic device 100; the display style may include, but is not limited to, card style, 3D style, and plain text style.
[0119] In an embodiment of the present application, the electronic device 100 can display information about smart home devices recommended by the server 200 through a component. The display style of the component can include but is not limited to a card style and a 3D style.
[0120] It should be noted that the embodiment of the present application does not limit the timing when the electronic device 100 displays the information of the smart home devices recommended by the server 200. For example, the electronic device 100 can automatically display information about smart home devices automatically recommended by the server 200 or information about smart home devices recommended by the electronic device 100 requested by the server 200 on display locations such as the desktop after the screen is unlocked, the lock screen AOD interface, the lock screen interface after the screen is unlocked, and the notification bar (that is, the electronic device 100 actively requests the server 200 to query information about recommended devices, and displays the information after receiving the recommended device information sent by the server 200); for another example, when the screen is turned on (for example, when the screen is unlocked or unlocked) or when a special event occurs on the smart home device (for example, an alarm event such as a door lock being pried open or a gas leak), the information about smart home devices automatically recommended by the server 200 or information about smart home devices recommended by the electronic device 100 requested by the server 200 is automatically displayed; for another example, based on user-defined conditions (for example, recommending one or some smart home devices within a certain time period and geographic fence), the electronic device 100 is triggered to automatically display information about smart home devices automatically recommended by the server 200 or information about smart home devices recommended by the electronic device 100 requested by the server 200.
[0121] In one possible implementation, all smart home devices other than the electronic device 100 and the router 207 are connected to the router 207. The router 207 can provide network access services for the devices connected to it. The electronic device 100 can send control instructions to the smart home devices through the router 207, thereby controlling the smart home devices. The electronic device 100 can also communicate with the server 200 through the router 207 (for example, sending information such as the user's history of operating the smart home devices and the location of the electronic device 100 to the server 200). The smart home devices can communicate with the server 200 through the router 207 (for example, sending their own status information such as switch status, filter status, and alarm information to the server 200).
[0122] In another possible implementation, a short-range communication connection, such as a Bluetooth connection, a ZigBee communication connection, or a wireless local area network (WLAN) direct connection, may be established between the electronic device 100 and the smart home device. The electronic device 100 may send control instructions to the smart home device via the short-range communication connection, thereby controlling the smart home device.
[0123] The electronic device 100 may be equipped with Or portable electronic devices (or handheld terminal devices) with other operating systems, such as mobile phones, tablet computers, smart watches, smart bracelets, etc., can also be laptop computers with touch-sensitive surfaces or touch panels, desktop computers with touch-sensitive surfaces or touch panels, whole-house central control screens, vehicle-mounted devices, home LCD screens, and other non-portable electronic devices. The embodiments of the present application do not limit the specific type of electronic device 100.
[0124] Smart home devices can refer to home appliances with networking capabilities (e.g., various smart IoT devices). In addition to the smart home devices shown in FIG2 , smart home devices can also include door locks, speakers, robot vacuums, sockets, body fat scales, desk lamps, refrigerators, washing machines, water heaters, microwave ovens, televisions, set-top boxes, humidifiers, dehumidifiers, water purifiers, buzzers, human motion sensors, air quality monitors, gas monitors, flood monitors, smoke alarms, valve monitors, etc. Smart home devices can be connected to the Internet via a network access device (e.g., router 207).
[0125] The smart home device may be manufactured by one or more smart home device manufacturers, and the one or more smart home device manufacturers may include the manufacturer of the electronic device 100 .
[0126] In one possible implementation, the electronic device 100 can establish binding relationships with multiple smart home devices. The binding relationship between the electronic device 100 and the smart home device can be established through an account, i.e., the account logged into the application for managing the smart home device on the electronic device 100 is the same as the account logged into the smart home device. Alternatively, the binding relationship between the electronic device 100 and the smart home device can be established by scanning a QR code, pairing via Bluetooth, or the like. The present embodiment of the application does not specifically limit the method for establishing a binding relationship between the electronic device 100 and the smart home device.
[0127] The server 200 can be used to build a recommendation engine, automatically learn and calculate the historical records (or historical data) of users operating smart home devices, combine the location information of the electronic device 100 and the status information of the smart home devices themselves to predict the smart home devices that the user is about to control, and make device recommendations to the electronic device 100.
[0128] The server 200 can also be used to perform various services related to smart home devices. For example, it can manage the relationship between the electronic device 100 and the smart home devices; obtain the operating status and monitoring data of the smart home devices; obtain the location information of the smart home devices; send the operating status and monitoring data of the smart home devices to the electronic device 100; send control instructions to the smart home devices; and so on.
[0129] The server 200 can also be used to store the binding relationship between the electronic device 100 and the smart home device. In this way, the server 200 can act as an intermediate device to send the control instructions of the electronic device 100 to the smart home device with which the electronic device 100 has established a binding relationship, and send the operating status and monitoring data of the smart home device to the electronic device 100 with which the smart home device has established a binding relationship.
[0130] The server 200 can also be used to store the ways in which smart home devices can be controlled and the functions that smart home devices can provide. In some embodiments, the electronic device 100 can obtain the functions that can be provided by the smart home devices that have established a binding relationship with the electronic device 100 (i.e., the smart home devices in the user's home) from the server 200, thereby providing the user with a control interface that can control multiple smart home devices with one click based on the above functions.
[0131] In some embodiments, the server 200 may be an application server corresponding to an application for managing smart home devices (eg, a smart life application).
[0132] The server 200 may be a traditional server or a cloud server. The embodiment of the present application does not limit the specific type of the server 200.
[0133] The specific functions of the electronic device 100 and the server 200 will be described in detail in subsequent embodiments and will not be expanded here.
[0134] It should be understood that Figure 2 is merely a schematic diagram of the architecture of the communication system and should not constitute a limitation on the present application. The present embodiment of the application does not limit the number of electronic devices 100, the number of servers 200, and the number of smart home devices included in the communication system.
[0135] To facilitate understanding, some concepts involved in the device recommendation method in this application are introduced in detail here.
[0136] 1. Control Intention
[0137] Control intent refers to a user's intent to control a smart home device. Control intent can be determined by the type and capability of the smart home device. For example, a user's control intent for a light might include turning it on and off, adjusting the brightness, and adjusting the color temperature. Another example is a user's control intent for an air conditioner might include turning it on and off, and adjusting the temperature. Another example is a user's control intent for curtains might include opening and closing curtains, and adjusting the degree of curtain opening. Another example is a user's control intent for a speaker might include adjusting the volume and playback, and so on.
[0138] There are various ways for users to control smart home devices. For example, a user can control a smart home device by operating a GUI (e.g., turning a smart home device on or off by clicking a switch control on the electronic device 100); or a user can control a smart home device through a VUI (e.g., turning a smart home device on or off by using a voice command); or a user can set up a scenario in advance for triggering the control of a smart home device (e.g., automatically turning on or off one or more smart home devices when returning home). Once the scenario is triggered, the state of the smart home device (e.g., turning on or off) can be automatically controlled.
[0139] 2. Function (or skill)
[0140] Functions may include a combination of different control intentions, that is, the user's different control intentions for smart home devices can be combined to provide a function, and a function can meet a type of user demand, where the types of functions may include but are not limited to lighting function, shading function, environmental monitoring function, safety protection function, network function, water use function, and audio and video entertainment function.
[0141] Control intents within the lighting function can include turning lights on and off, adjusting brightness, and adjusting color temperature. In other words, smart home devices (such as lights) with brightness and color temperature adjustment capabilities can be used to provide lighting functions. Lighting functions can meet users' lighting needs.
[0142] Control intent for the sunshade function can include opening and closing curtains, adjusting curtain opening and closing, and adjusting curtain opening and closing. In other words, curtains with adjustable curtain opening and closing capabilities can be used to provide sunshade functions. Sunshade functions can meet users' sun protection needs.
[0143] Control intents within the environmental monitoring function can include turning on or off the air quality monitor, turning on or off the air purifier, adjusting the air purification mode, turning on or off the temperature monitor, turning the air conditioner on or off, adjusting the temperature, turning on or off the humidity monitor, turning the humidifier on or off, and turning the dehumidifier on or off. In other words, smart home devices with capabilities such as air quality monitoring, air purification, temperature monitoring, temperature adjustment, humidity monitoring, and humidity adjustment can be used to provide environmental monitoring functionality. Environmental monitoring can meet user needs for air purification, temperature adjustment, and humidity adjustment.
[0144] Control intent within security features can include turning cameras on or off, unlocking doors, turning motion sensors on or off, and activating buzzers. In other words, smart home devices with capabilities such as photo taking, video recording, alarms, and warnings can be used to provide security features. Security features can meet users' needs for monitoring and protecting their homes.
[0145] Control intent within network functions can include turning network access devices on or off, accelerating the network, and managing devices connected to the network. This means that smart home devices (such as routers) with network acceleration and network access device management capabilities can be used to provide network functions. Network functions can satisfy users' internet access needs.
[0146] Control intents for water use functions can include turning a water quality monitor on or off, turning a water heater on or off, adjusting water temperature, and turning a water quantity monitor on or off. In other words, smart home devices with water quality monitoring, water quantity monitoring, and water temperature adjustment capabilities can be used to provide water use functions. These functions can meet user water needs.
[0147] Control intent within the audio and video entertainment function can include turning speakers on or off, turning large-screen devices on or off, adjusting volume, adjusting playback progress, and switching playback content. In other words, smart home devices with music and video playback capabilities can be used to provide audio and video entertainment. Audio and video entertainment functions can meet users' leisure and entertainment needs.
[0148] 3. Space
[0149] Space can refer to a specific location, and space can be divided in different ways. The embodiment of the present application does not limit the way in which space is divided.
[0150] For example, different locations in a home can have different uses. In a home, a space can be a location with a single use. Spaces in a home can include the entrance, living room, kitchen, master bedroom, second bedroom, study, balcony, bathroom, etc.
[0151] For example, a house has different floors. The space in the house can be divided into floors. The space in the house can include the first floor, the second floor, the third floor, etc.
[0152] For another example, a house has different rooms. Each room is separated by physical objects (such as walls). The space in this house can be divided into units of rooms separated by physical objects. The space in this house may include room A, room B, room C, etc.
[0153] For another example, a house can also be considered as an entire space, which can also be called a whole house or a home.
[0154] 4. Scene
[0155] A scenario (or situation) can refer to a combination of factors such as environment, time, place, space, etc. under certain conditions. Only when these conditions are met can the relevant needs be met.
[0156] Scenes can be user-defined. Users can independently set different scenes (such as home scenes, leaving home scenes, sleeping scenes, meeting scenes, watching movies, etc.) in applications for managing smart home devices (such as smart life applications). When setting scenes, users can not only set scene trigger conditions, but also set tasks to be performed when the scene is triggered, such as automatically controlling the status of one or more smart home devices (such as on or off status). Among them, scene trigger conditions can be used to identify scene categories and can trigger electronic devices to perform tasks set under the scene. Scene trigger conditions can include one or more, such as time, location, device status, voice commands, etc.
[0157] By implementing the device recommendation method provided in the embodiment of the present application, the electronic device 100 can not only support recommendation of a single smart home device, but also support recommendation of multiple smart home devices.
[0158] In the embodiment of the present application, device recommendations can be made according to four dimensions: single device dimension, space dimension, function dimension (also called skill dimension), and scenario dimension.
[0159] Among them, in the single-device dimension, the content of the device recommendation made by the electronic device 100 (i.e., the information of the recommended device) may include but is not limited to: the status of a single device (such as on or off status, brightness status, temperature status, alarm status, etc.), the controls of a single device (such as on or off controls, volume adjustment controls, playback adjustment controls, etc.).
[0160] Among them, in the spatial dimension, the content of the device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) of a certain category (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) of equipment in a certain space in the home (such as living room, bedroom, kitchen, balcony, porch, etc.), controls (such as turning controls on or off, etc.), and environmental information in the space (such as temperature information, air humidity information, air quality information, etc.).
[0161] Among them, in the functional dimension, the content of the device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) and controls (such as turning on or off controls, etc.) of a certain category of equipment in the entire family (or whole house) (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.).
[0162] Among them, in the scene dimension, the content of device recommendation made by the electronic device 100 may include but is not limited to: the status (such as on or off status, etc.) and controls (such as turning on or off controls, etc.) of one or more devices associated with a triggered scene (such as going home scene, leaving home scene, sleeping scene, meeting scene, watching a movie scene, etc.).
[0163] By implementing the device recommendation method provided in the embodiments of the present application, the electronic device 100 can not only support automatic device recommendations based on the device recommendation rules preset by the server 200 (i.e., the automatic recommendation algorithm model), but also support customized device recommendations based on device recommendation rules set by the user. These are described below.
[0164] Example 1: Automatic recommendation
[0165] Taking the above-mentioned four dimensions of single device dimension, spatial dimension, functional dimension (also called skill dimension), and scene dimension as examples, the following is a detailed introduction to the device recommendation content that may be displayed by the electronic device 100 when automatically recommending devices, combined with a series of exemplary user interfaces.
[0166] It should be noted that the embodiments of the present application do not limit the display location and display style of the content recommended by the above-mentioned device, and may include multiple display locations and multiple display styles. For example, the above-mentioned display locations may include but are not limited to: the desktop of the electronic device 100, the lock screen interface, the always on display (AOD) interface, the notification bar, the negative one screen interface, and the control center interface; for another example, the above-mentioned display styles may include but are not limited to: card style, 3D style, and ordinary text style.
[0167] The following description will be made by taking the display of device-recommended content in a card format on the desktop of the electronic device 100 as an example.
[0168] The device recommendation content can be displayed as a resident card on the desktop of the electronic device 100. The card can refresh the device recommendation content according to certain rules to automatically recommend different devices to the user. The resident card can refer to a card that is presented along with the presentation of the user interface where the card is located.
[0169] 1. Single device dimension
[0170] 3A , the user interface 310 exemplarily shown in FIG3A may be the desktop of the electronic device 100 . The user interface 310 may include a card 311 . The card 311 may be used to display device-recommended content in a single device dimension.
[0171] Continuing with FIG3A , card 311 may include one or more components corresponding to the recommended devices, such as a speaker component 311A, a main light component 311B, a curtain component 311C, and an air purifier component 311D. It is readily apparent from card 311 that the devices currently recommended by electronic device 100 include a speaker, a main light, curtains, and an air purifier.
[0172] The speaker component 311A may include a speaker control for turning on or off, and the name of the device (e.g., "speaker"). Turning the speaker control on or off can be used to turn the speaker on or off. In some embodiments, there is a speaker in the living room, and turning the speaker control on or off is in the on state as shown in Figure 3A, which may indicate that the speaker in the living room is turned on. When the speaker control on or off is in the on state, the electronic device 100 may detect the user's operation (e.g., a click operation) for turning the speaker control on or off. In response to the operation, the electronic device 100 may instruct the living room speaker to turn off and switch the speaker control on or off to the off state. When the speaker control on or off is in the off state, the electronic device 100 may detect the user's operation (e.g., a click operation) for turning the speaker control on or off. In response to the operation, the electronic device 100 may instruct the living room speaker to turn on and switch the speaker control on or off to the on state.
[0173] The master light assembly 311B may include a master light on / off control and the name of the device (e.g., "Master Light"). The master light on / off control can be used to turn the master light on or off. The method for turning the master light on or off using the master light on / off control can be similar to the method for turning the speaker on or off using the speaker on / off control.
[0174] The curtain component 311C may include a curtain opening / closing control and a device name (e.g., "Curtain"). The curtain opening / closing control may be used to open or close the curtain. The method for opening or closing the curtain using the curtain opening / closing control may be similar to the method for opening or closing the speaker using the speaker opening / closing control.
[0175] The air purifier component 311D may include an air purifier on / off control and the name of the device (e.g., "Air Purifier"). The air purifier on / off control can be used to turn the air purifier on or off. The method for turning the air purifier on or off using the air purifier on / off control can be similar to the method for turning the speaker on or off using the speaker on / off control.
[0176] It is easy to understand that in the embodiment of the present application, the devices recommended by the electronic device 100 can all be devices that the user is likely to control. It can be seen that the electronic device 100 can facilitate users to directly control (for example, turn on or off) the devices by displaying control controls (for example, turn on or off controls) of one or more recommended devices on the card 311. The user no longer needs to enter the application for managing smart home devices (for example, a smart life application) to find the corresponding device and then control the device, thereby simplifying user operations and improving the efficiency of user control of devices and user experience.
[0177] Since the size of a card is limited, the content of the device recommendation displayed on a card (such as the number of recommended devices, etc.) is also limited. Therefore, in some embodiments, the card 311 may also include option 311E, and option 311E may be used to refresh the display of information of one or more other recommended devices. For example, assuming that the user wants to view more other recommended devices, the electronic device 100 may detect the user's operation on option 311E (such as a click operation). In response to the operation, referring to FIG3B , the electronic device 100 may refresh the display of information of one or more other recommended devices (such as cameras, air conditioners, routers, TVs, etc.). Among them, the method for the user to control the recommended devices shown in FIG3B can refer to the aforementioned method of turning on or off the speaker control to turn on or off the speaker.
[0178] In some embodiments, the user can also trigger the electronic device 100 to refresh and display the information of one or more other recommended devices by sliding left or right on the card 311.
[0179] In some embodiments, the electronic device 100 may also automatically refresh and display the information of one or more other devices that are recommended. For example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended at different time points (for example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended after detecting that a certain time point has arrived); for another example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended at different locations (for example, the electronic device 100 may refresh and display the information of one or more other devices that are recommended after detecting that the electronic device 100 has switched from one location to another).
[0180] In some embodiments, the priority of the device shown in FIG3A (i.e., the probability of being recommended) may be higher than the priority of the device shown in FIG3B . In other words, after the user clicks option 311E shown in FIG3A , the electronic device 100 may be triggered to display information about one or more devices with a lower priority than the recommended device.
[0181] Optionally, referring to FIG. 3A , the card 311 may further include a time mark 311F, which may be used to indicate the recommendation time so that the user can know at which time the information of the recommended device displayed in the current card 311 was recommended.
[0182] In some embodiments, after the user clicks option 311E shown in FIG3A , the electronic device 100 may also be triggered to display information about one or more devices that were recommended later than the time point shown in FIG3A . For example, assuming the current time is 8:10 and the time point at which the device shown in FIG3A was recommended is 8:00, after detecting that the user clicks option 311E shown in FIG3A , the electronic device 100 may display information about one or more devices that were recommended later than 8:00 (e.g., 8:10). In this way, the user can be presented with information about the most recently recommended one or more devices.
[0183] As can be seen from Figures 3A and 3B, although a large number of recommended devices are displayed in card 311, the controls for each recommended device displayed in card 311 only include on or off controls. In this way, the user can only control the device to turn it on or off through card 311. If the user wants to perform more other control operations, he still has to find the corresponding device and its more other controls in the application that provides card 311 (such as a smart life application), and then perform more other control operations, which is more cumbersome.
[0184] Therefore, in order to facilitate the user to conveniently and quickly perform more control operations on the recommended device, the electronic device 100 can display more controls of the recommended device when making a device recommendation.
[0185] Referring to FIG3C , card 312 may include an identifier 312A, one or more controls (e.g., an on / off control 312B, a brightness adjustment bar 312C, etc.), and options 312D. Identifier 312A may be used to indicate the name of the recommended device (e.g., "Lighting Main Light"), on / off control 312B may be used to turn the recommended device on or off, brightness adjustment bar 312C may be used to adjust the brightness of the recommended device, and option 312D may be used to refresh the display of information about one or more other recommended devices. As can be seen, since card 312 includes multiple controls corresponding to the recommended devices, it can support users in performing various control operations on the recommended devices quickly and conveniently.
[0186] Continuing with FIG3C , card 312 may also include an identifier 312E and an identifier 312F. Identifier 312E may indicate whether the recommended device is on or off, and identifier 312F may indicate the location of the recommended device. As can be seen, the main light of the recommended device is currently on, and its location is the living room.
[0187] In some embodiments, when the amount of information about the recommended device included in the card 312 remains unchanged, the display style of the card 312 can be simpler and more vivid, thereby providing the user with a better visual experience.
[0188] 3D , which exemplarily shows a card 312 that is more concise and visually appealing than that shown in FIG3C . The card 312 may include a logo 312G and one or more controls (eg, a control 312H, a brightness adjustment bar, etc.).
[0189] Among them, the logo 312G can be used not only to indicate the name of the recommended device (such as "ceiling light"), but also to indicate the location of the recommended device (such as "living room"). In this way, one logo can indicate multiple information in a concise and clear manner.
[0190] Control 312H can not only be used to turn the living room ceiling light on or off, but can also be used to indicate the on or off status of the recommended device. In addition, the display style of control 312H is a "light" style, so control 312H can also be used to indicate that the recommended device type is a light. In this way, a single control can not only support the user's control operation of the recommended device, but also be used to indicate multiple information, which is convenient, concise and intuitive.
[0191] In some embodiments, when the recommended device has many functions, in order to facilitate the user to adjust its various functions quickly and conveniently, the electronic device 100 can display controls corresponding to the various functions of the recommended device. In this way, the number of controls displayed by the electronic device 100 will be very large, which may cause the size of the card to become larger. However, larger cards will waste display space. Therefore, in this case, the electronic device 100 can support the hiding of cards, and the user can trigger the electronic device 100 to display the cards when he needs to view the cards.
[0192] For example, referring to FIG3E , it can be seen that the number of controls corresponding to the recommended devices (e.g., on / off controls, color temperature controls, color controls, brightness adjustment bars, etc.) included in card 313 is significantly greater than the number of controls corresponding to the recommended devices (e.g., on / off controls, brightness adjustment bars, etc.) included in card 312 shown in FIG3C and FIG3D . However, the size of card 313 is also significantly larger than that of card 312 shown in FIG3C and FIG3D . Therefore, card 313 can be a card that can be hidden.
[0193] It should be noted that the embodiment of the present application does not limit the method for triggering the electronic device 100 to hide the card 313. In one possible implementation, the user can trigger the electronic device 100 to hide the card 313 by sliding down the card 313 or sliding toward the edge of the screen. In another possible implementation, the user can also trigger the electronic device 100 to hide the card 313 by clicking anywhere in the display area other than the display area of the card 313.
[0194] It should be noted that the embodiment of the present application does not limit the method for triggering the electronic device 100 to display the card 313. In one possible implementation, the user can trigger the electronic device 100 to display the card 313 by swiping up on the user interface 310 or swiping out from the edge of the screen (for example, swiping from the edge of the screen of the electronic device 100 to the center of the screen).
[0195] It should be noted that the embodiments of the present application do not limit how the electronic device 100 determines which controls or controls to display corresponding to the recommended device. In one possible implementation, the controls corresponding to the recommended device displayed by the electronic device 100 can be determined based on the usage records of most users. For example, the electronic device 100 can display the controls commonly used by most users for the recommended device (such as turning on or off controls, etc.). In another possible implementation, the controls corresponding to the recommended device displayed by the electronic device 100 can be determined based on the usage records of the current user. For example, the electronic device 100 can predict the current user's high-frequency control actions on the recommended device through the current user's historical usage records, and thus can determine the controls to be displayed based on the high-frequency control actions. For example, the electronic device 100 can display the controls corresponding to the recommended device that the current user frequently uses (such as controls that the user uses more than a certain preset frequency, controls that the user has accumulated or continuously used for more than a certain preset time, etc.), controls that the user uses periodically, controls that the user has used in a recent period of time, etc. In this way, different controls can be recommended and displayed for different users, providing users with a personalized experience.
[0196] As can be seen from Figures 3A to 3E, the recommended devices displayed by the electronic device 100 are all devices in a normal state. In the embodiment of the present application, the recommended devices displayed by the electronic device 100 may also be devices in an abnormal state. In this way, the user can be reminded in time that the device is in an abnormal state so that the user can perform control operations on the device in time to avoid safety accidents. Among them, the above-mentioned abnormal state may include but is not limited to: the consumables required by the device are missing (for example, a humidifier is in a water shortage state, etc.), the device is in a fault state (for example, the air conditioner is running too noisy, the router network signal is poor, etc.), and the device is in an emergency safety alarm state (for example, the door lock is pried open, gas leaks, water leaks, etc.). The following is an exemplary introduction in conjunction with Figures 4A to 4B and Figures 5A to 5C.
[0197] 1) The consumables required for the equipment are missing
[0198] For example, referring to FIG4A , card 314 can be used to display information about a recommended device that is in a consumables-deficient state. For example, if the humidifier in the living room is short of water, the recommended device displayed by electronic device 100 may be the humidifier in the living room. Card 314 may include the name of the recommended device (e.g., "Humidifier"), status reminder information of the recommended device (e.g., "Water Shortage Reminder"), and the location of the recommended device (e.g., "Living Room").
[0199] In some embodiments, card 314 may further include an on / off control 314A, which may be used to turn the living room humidifier on or off. Thus, if the living room humidifier is short of water, displaying on / off control 314A on card 314 allows the user to quickly turn off the living room humidifier, thereby preventing damage to the humidifier due to water shortage.
[0200] In some embodiments, the card 314 may further include an option 314B. The option 314B may be used to refresh the information of one or more other recommended devices so that the user can view more other recommended devices.
[0201] 2) The device is in a faulty state
[0202] For example, referring to FIG4B , card 314 can be used to display information about a recommended device in a faulty state. For example, if the air conditioner in the living room is noisy, the recommended device displayed by electronic device 100 may be the air conditioner in the living room. Card 314 may include the name of the recommended device (e.g., "air conditioner"), status reminder information for the recommended device (e.g., "excessive noise reminder"), and the location of the recommended device (e.g., "living room").
[0203] In some embodiments, card 314 may further include an on / off control 314C, which may be used to turn the air conditioner in the living room on or off. Thus, if the air conditioner in the living room is making excessive noise, displaying on / off control 314C on card 314 allows the user to quickly turn off the air conditioner, thereby preventing the noise from disturbing family members.
[0204] 3) The equipment is in emergency safety alarm state
[0205] 5A-5C , the card 315 shown in FIG5A-5C may be used to display information of recommended equipment in an emergency safety alert state.
[0206] For example, referring to FIG5A , taking a door lock as an example, when the door lock is in a prying state, the recommended device displayed by the electronic device 100 may be a door lock, and the card 315 may include the name of the recommended device (e.g., "door lock"), status alert information of the recommended device (e.g., "prying alert"), etc. In this way, the user can be promptly reminded that the door lock has been pried, so that the user can replace the door lock in time to ensure safety.
[0207] For example, referring to FIG5B , taking a kitchen gas stove as an example, when the kitchen gas stove is in a gas leaking state, the recommended device displayed by the electronic device 100 may be the kitchen gas stove. The card 315 may include the name of the recommended device (e.g., "gas stove"), status alarm information of the recommended device (e.g., "gas leak alarm"), the location of the recommended device (e.g., "kitchen"), etc. In this way, the user can be promptly reminded of a gas leak in the gas stove.
[0208] In some embodiments, the card 315 shown in FIG5B may further include an on / off control 315A, which may be used to turn the kitchen gas stove on or off. In this way, when a gas leak occurs in the kitchen gas stove, the user can quickly turn off the kitchen gas stove to avoid causing a fire.
[0209] For example, referring to FIG5C , taking a bathroom water heater as an example, when the bathroom water heater is leaking, the recommended device displayed by the electronic device 100 may be the bathroom water heater. The card 315 may include the name of the recommended device (e.g., "water heater"), status alarm information of the recommended device (e.g., "water leak alarm"), the location of the recommended device (e.g., "bathroom"), etc. In this way, the user can be promptly reminded of a water leak in the water heater.
[0210] In some embodiments, the card 315 shown in FIG5C may further include an on / off control 315B, which may be used to turn the bathroom water heater on or off. This allows the user to quickly turn off the bathroom water heater in the event of a water leak, thereby preventing electric shock from occurring.
[0211] In one possible implementation, the smart home device can actively send its own status information (such as normal status information, abnormal status information) to the server 200, or the server 200 can actively obtain its status information from the smart home device. Furthermore, the server 200 can determine the information of the smart home device to be recommended based on the smart home device's own status information, and can send the information to the electronic device 100, so that the electronic device 100 can display the information of the recommended device.
[0212] In the embodiment of the present application, device recommendations can be made based on preset principles to determine the recommended devices, wherein the preset principles may include but are not limited to: time principle, space principle, proximity principle, near field principle, and urgency principle.
[0213] Among them, the time principle can be to analyze the user's historical operating habits in the time dimension to determine the devices to be recommended. For example, if the user operates a device periodically (for example, every day) or on a fixed date (for example, a weekday, a weekend) at a fixed time point or time period (for example, morning, afternoon, evening), then the probability of the device being recommended at or near the fixed time point / time period will increase. For example, assuming that the user turns on the main light at 8 o'clock every evening, then the main light will most likely be recommended at or around 8 o'clock every evening (for example, 7:59). For example, assuming that the user turns on the speaker every Saturday morning, then the speaker will most likely be recommended every Saturday morning.
[0214] Among them, the spatial principle can be to analyze the spatial location of the user to determine the device to be recommended. For example, if the user's current location is within a preset distance range (for example, overlaps) with the location of the device that the user has historically operated, then the probability of the device being recommended will increase. Among them, the device that the user has historically operated can be a device that the user has operated in the recent period of time (for example, within an hour, within a day, etc.), or it can be a device that the user has operated a long time ago (for example, within a week, within a month, etc.). For example, assuming that the user's current location is the location of the living room speaker, and the user has previously operated the living room speaker, then the living room speaker is likely to be recommended. It is easy to understand that the current location of the electronic device 100 can be used to indicate the current location of the user, and the location of the device that the user has historically operated can be determined in a variety of ways. For example, when the user previously operated the device through the electronic device 100, the location of the electronic device 100 can be used to indicate the location of the device that the user has historically operated; for example, when the user binds the device to the electronic device 100 for an account, the location of the electronic device 100 can be used to indicate the location of the device that the user has historically operated; and so on.
[0215] Among them, the recent principle can be to analyze the status information of the device itself in the time dimension to determine the device to be recommended. For example, if the user changes the state of the device itself (such as on state, off state, etc.) by manipulating a certain device in the recent period of time (such as within one minute, five minutes, etc.), then the probability of the device being recommended in the next period of time will increase. For example, assuming that the user turned on the speaker in the living room to play a song a few minutes ago, then the user is very likely to manipulate the speaker again in the next period of time (such as adjusting the volume, switching to play songs, turning off the speaker, etc.). Therefore, the speaker in the living room will most likely be recommended in the next period of time to facilitate the user to control it.
[0216] Among them, the near-field principle can be to analyze devices (i.e., near-field devices) that are connected to the same short-range network (e.g., Bluetooth connection, WiFi connection, etc.) as the electronic device 100 to determine the devices to be recommended. For example, if the electronic device 100 can detect one or more smart home devices that are connected to the same short-range network, then the probability of these one or more smart home devices being recommended will increase. For example, assuming that the electronic device 100 is connected to a WiFi network named xxx, then one or more smart home devices (e.g., speakers, TVs, etc.) connected to the WiFi network will be highly likely to be recommended.
[0217] The urgency principle can be used to determine which devices to recommend by analyzing the urgency of events that trigger changes in device status. These events can be categorized into three categories based on their urgency: general events, consumable / fault events, and emergency safety alarm events. General events can include changes in status such as switches, brightness, temperature, and volume. Consumable / fault events can include missing consumables (e.g., missing humidifiers) and fault events (e.g., excessive air conditioning noise, insufficient air supply, or poor cooling). Emergency safety alarm events can include home safety-related events such as door lock prying, gas leaks, and water leaks. The probability of a device being recommended can increase in the order of general events, consumable / fault events, and emergency safety alarm events. That is, the probability of a device being recommended is lowest in the event of a general event, and highest in the event of an emergency safety alarm. For example, if a humidifier is short of water, this event is considered a consumables shortage event, and if a gas stove has a gas leak, this event is considered an emergency safety alarm event. Therefore, between humidifiers and gas stoves, the gas stove is the preferred device so that users can detect and stop gas leaks in time to avoid safety accidents.
[0218] It should be noted that the recommended device can be determined based on one of the above-mentioned preset principles, or can be determined based on a combination of multiple principles of the above-mentioned preset principles, and the embodiments of the present application do not limit this.
[0219] 2. Spatial Dimension
[0220] 6A , the user interface 310 exemplarily shown in FIG6A may be a desktop of the electronic device 100 . The user interface 310 may include a card 316 , and the card 316 may be used to display content recommended by the device in a spatial dimension.
[0221] In the spatial dimension, the electronic device 100 can display information about a certain category of equipment (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) in a recommended space in the home (such as living room, bedroom, kitchen, balcony, porch, etc.) through card 316.
[0222] 6A , taking the recommended device as a lighting device in the living room as an example, the card 316 may include a lamp assembly 316A, a logo 316B, a logo 316C, and a logo 316D.
[0223] The light assembly 316A may include a full-on control and a full-off control. In the case where there are multiple lights in the living room, the full-on control can be used to turn on all the lights in the living room, and the full-off control can be used to turn off all the lights in the living room. It can be seen that when there are multiple smart home devices that can provide a function in a space, the electronic device 100 can provide a control for controlling these multiple smart home devices with one click. For example, multiple lights of the same or different types in the living room can all provide lighting functions. The full-on control and the full-off control in the light assembly 316A shown in FIG6A can facilitate the user to control (for example, turn on or off) all lights in the living room that can provide lighting functions with one click.
[0224] The identifier 316B may be used to indicate the location of the recommended device (eg, "living room") and the category to which the recommended device belongs (eg, "lighting"). As can be seen from the identifier 316B, the currently recommended device is a lighting device in the living room.
[0225] The mark 316C can be used to indicate that the recommended device is in the on state (eg, “on”) and the number of recommended devices in the on state (eg, “12”). As can be seen from the mark 316C, the number of recommended devices currently in the on state is 12.
[0226] The mark 316D can be used to indicate that the recommended device is in the off state (eg, “off”) and the number of recommended devices in the off state (eg, “6”). As can be seen from the mark 316D, the number of recommended devices currently in the off state is 6.
[0227] In some embodiments, card 316 may further include option 316E, which may be used to refresh and display information about other types of devices in the same space, or information about a certain type of device in a different space. For example, taking the example of electronic device 100 refreshing and displaying information about other types of devices in the same space, electronic device 100 may detect a user operation (e.g., a click operation) on option 316E. In response to this operation, as shown in FIG6B , electronic device 100 may display information about a certain type of device (e.g., audio and video entertainment) in the living room, in addition to lighting devices.
[0228] In some embodiments, the user can also trigger the electronic device 100 to refresh and display information of other categories of devices in the same space, or information of a certain category of devices in different spaces, by sliding left or right on the card 316 .
[0229] In some embodiments, card 316 may also include data monitored by smart home devices in the living room. The data monitored by the smart home devices in the living room may include air quality (e.g., "excellent"), temperature (e.g., "28°C"), and humidity (e.g., "48%"). The data monitored by the smart home devices in the living room may reflect the environment of the living room. In this way, the user can quickly view the air quality, temperature, and humidity of the living room through card 316. Not limited to the above-mentioned air quality, temperature, and humidity, more or less data monitored by smart home devices may be presented in card 316. Among them, the type of data monitored by the smart home devices presented in card 316 may be determined by the type of smart home devices included in the space. For example, if the living room includes an air quality monitor, a temperature monitor, and a humidity monitor, then card 316 may present three types of data: air quality, temperature, and humidity.
[0230] In some embodiments, the electronic device 100 may also display controls for individually controlling a certain device in the card 316. In this way, when the user does not want to control all devices with one click, the electronic device 100 may also support the user to individually control a certain device. For example, referring to Figure 6B, the card 316 may include components corresponding to one or more audio and video entertainment devices in the living room, such as a speaker component 316G and a TV component 316H. Among them, the speaker component 316G may include a speaker control on or off, the name of the device (such as "speaker"), and the speaker control on or off can be used to turn the speaker on or off. The TV component 316H may include a TV control on or off, the name of the device (such as "TV"), and the TV control on or off can be used to turn the TV on or off. In this way, the user can independently control a single audio and video entertainment device in the living room through the card 316, which is convenient and quick.
[0231] In some embodiments, in the case of displaying a control for controlling a single device, such as shown in FIG6B , the recommended devices displayed by the electronic device 100 may be all or part of the devices in a certain category of devices in a certain space.
[0232] In some embodiments, electronic device 100 may also allow the user to manually select which space in the home and which device category to display in card 316. For example, referring to FIG6A , card 316 may also include option 316F. Electronic device 100 may detect a user action (e.g., a click) on option 316F. In response to this action, referring to FIG6C , electronic device 100 may display window 610. Window 610 may include options corresponding to one or more spaces (e.g., "Living Room," "Kitchen," "Master Bedroom," etc.) and options corresponding to device categories within the space (e.g., "All Devices," "Lighting," "Shading," "Audio / Video Entertainment," etc., corresponding to device categories within the living room). The space-specific options allow the user to select the space where the recommended device is located, while the device category-specific options allow the user to select the category to which the recommended device belongs. As can be seen from window 610, the device currently recommended by electronic device 100 is a lighting device in the living room. It is easy to understand that if the user wants to view information about other types of devices in the living room (such as status information, control information, etc.) and / or control other types of devices in the living room, such as sunshade devices, then the user can click the "Sunshade" option, thereby triggering the electronic device 100 to display information about the sunshade devices in the living room through card 316, so that the user can view information about the sunshade devices in the living room through card 316 and can quickly and easily control the sunshade devices in the living room. Similarly, the user can also trigger the electronic device 100 to display information about a certain type of device in other spaces besides the living room through card 316 in a similar manner, which will not be repeated here.
[0233] In an embodiment of the present application, there may be multiple ways to trigger the electronic device 100 to recommend devices in the spatial dimension. In one possible implementation, the electronic device 100 can recommend all devices or a certain type of devices in the space that the user currently enters, where the certain type of devices can be a certain type of device recommended by default / randomly, or a certain type of device recommended based on the usage habits of most users, or a certain type of device recommended based on the historical operation records of the current user. For example, assuming that the current user has entered the living room, and analyzing the current user's historical operation records, the current user usually controls the lighting device first when entering the living room, or the device that the current user often controls in the living room is a lighting device, then the electronic device 100 can recommend the lighting device in the living room.
[0234] In some embodiments, when it is detected that a user has just entered a certain space, the electronic device 100 can make device recommendations in the spatial dimension so that the user can quickly have a global understanding of the status of all devices in the space or the status of a certain type of device. In other embodiments, after a preset time period (e.g., 2 minutes, 5 minutes, 10 minutes, etc.) after detecting that a user has entered a certain space, the electronic device 100 can switch from making device recommendations in the spatial dimension to making device recommendations in the single device dimension (e.g., recommending the device that the current user is most likely to control) so that the current user can quickly and individually perform control operations on the recommended device. Among them, the devices recommended by the electronic device 100 in the single device dimension can be determined, for example, based on the aforementioned preset principles (e.g., time principle, space principle, nearest principle, near field principle, emergency principle).
[0235] 3. Functional dimension
[0236] 7A , the user interface 310 exemplarily shown in FIG7A may be the desktop of the electronic device 100 . The user interface 310 may include a card 317 . The card 317 may be used to display content recommended by the device in a functional dimension.
[0237] In the functional dimension, the electronic device 100 can display information about a certain category of equipment recommended for the entire home (such as lighting, sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) through card 317.
[0238] 7A , taking the recommended device as a lighting device for the entire home as an example, card 317 may include a light fixture 317A, a logo 317B, a logo 317C, and a logo 317D.
[0239] The light assembly 317A may include a full-on control and a full-off control. In the case where there are multiple lights in the entire home, the full-on control can be used to turn on all the lights in the entire home, and the full-off control can be used to turn off all the lights in the entire home. It can be seen that when there are multiple smart home devices that can provide a function in the entire home, the electronic device 100 can provide a control for controlling these multiple smart home devices with one click. For example, multiple lights of the same or different types in the entire home can provide lighting functions. The full-on control and the full-off control in the light assembly 317A shown in FIG7A can facilitate the user to control (for example, turn on or off) all lights in the entire home that can provide lighting functions with one click.
[0240] The identifier 317B may be used to indicate the category to which the recommended device belongs (eg, "lighting category"). As can be seen from the identifier 317B, the currently recommended device is a lighting device in the entire home.
[0241] The mark 317C can be used to indicate that the recommended device is in the on state (eg, “on”) and the number of recommended devices in the on state (eg, “20”). As can be seen from the mark 317C, the number of recommended devices currently in the on state is 20.
[0242] The mark 317D can be used to indicate that the recommended device is in a closed state (eg, “closed”) and the number of recommended devices in the closed state (eg, “10”). As can be seen from the mark 317D, the number of recommended devices currently in the closed state is 10.
[0243] In some embodiments, card 317 may further include option 317E, which may be used to refresh and display information about devices in other categories throughout the home (e.g., sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.). For example, electronic device 100 may detect a user operation (e.g., a click) on option 317E. In response to this operation, as shown in FIG7B , electronic device 100 may display information about devices in a category other than lighting devices (e.g., audio and video entertainment) throughout the home.
[0244] In some embodiments, the user can also trigger the electronic device 100 to refresh and display information of other categories of devices in the entire home (such as sunshade, environmental monitoring, safety protection, water use, network, audio and video entertainment, etc.) by sliding left and right on the card 317.
[0245] In some embodiments, the electronic device 100 may also display controls for individually controlling a particular device in the card 317. This way, if the user does not want to control all devices with one click, the electronic device 100 can also support the user to individually control a particular device. For example, referring to FIG7B , the card 317 may include components corresponding to one or more audio-visual entertainment devices in the entire home, such as a bedroom speaker component 317G and a living room TV component 317H. The bedroom speaker component 317G may include a control for turning the bedroom speaker on or off, the device name (e.g., “speaker”) and its location (e.g., “bedroom”). The control for turning the bedroom speaker on or off can be used to turn the bedroom speaker on or off. The living room TV component 317H may include a control for turning the living room TV on or off, the device name (e.g., “TV”) and its location (e.g., “living room”). The control for turning the living room TV on or off can be used to turn the living room TV on or off. In this way, the user can independently control individual audio-visual entertainment devices in the entire home through the card 317, which is convenient and quick.
[0246] In some embodiments, in the case of displaying controls for controlling a single device, such as shown in FIG7B , the recommended devices displayed by the electronic device 100 may be all or part of the devices in a certain category of devices in the entire home.
[0247] In some embodiments, electronic device 100 may also allow the user to manually select which category of device information for the entire home is displayed in card 317. For example, referring to FIG7A , card 317 may also include option 317F. Electronic device 100 may detect a user action (e.g., a click) on option 317F. In response to this action, referring to FIG7C , electronic device 100 may display window 710. Window 710 may include options corresponding to device categories for the entire home (e.g., "All Devices," "Lighting," "Shading," "Environmental Monitoring," "Security," "Network," "Water Usage," "Audio and Video Entertainment," etc.). The options corresponding to device categories allow the user to select the category to which the recommended device belongs. As can be seen from window 710, the device currently recommended by electronic device 100 is a lighting device for the entire home. It is easy to understand that if the user wants to view the information of other types of devices in the entire home (such as status information, control information, etc.) and / or control other categories of devices in the entire home, such as sunshade devices, then the user can click on the "Sunshade" option, thereby triggering the electronic device 100 to display the information of the sunshade devices in the entire home through card 317, so that the user can view the information of the sunshade devices in the entire home through card 317, and can quickly and conveniently control the sunshade devices in the entire home.
[0248] In an embodiment of the present application, there may be multiple ways to trigger the electronic device 100 to recommend devices in the functional dimension. In one possible implementation, the electronic device 100 may determine which type of device to recommend based on the device category that most users are most likely to control in a certain time period. For example, in the early evening, the user is most likely to turn on the light to illuminate the room, so the electronic device 100 can recommend lighting devices; for another example, in the evening when the user is about to fall asleep or in the daytime when there is plenty of sunshine, the user is most likely to close the curtains, so the electronic device 100 can recommend sunshade devices; for another example, in the morning or afternoon leisure and entertainment time period, the user is most likely to turn on audio and video entertainment devices such as speakers and TVs, so the electronic device 100 can recommend audio and video entertainment devices; and so on.
[0249] It is easy to understand that recommending devices under the functional dimension can help users quickly have a global understanding of the status of a certain type of device in the entire home. In some embodiments, after the electronic device 100 recommends devices under the functional dimension, it can also switch to recommending devices under the single device dimension (for example, recommending the device that the current user is most likely to control) so that the current user can quickly and individually perform control operations on the recommended devices. Among them, the devices recommended by the electronic device 100 under the single device dimension can be determined based on the aforementioned preset principles (for example, the time principle, the space principle, the nearest principle, the near field principle, and the emergency principle).
[0250] 4. Scenario Dimension
[0251] 8A , the user interface 310 exemplarily shown in FIG8A may be the desktop of the electronic device 100 . The user interface 310 may include a card 318 , and the card 318 may be used to display content recommended by the device in a scene dimension.
[0252] In the scenario dimension, the electronic device 100 can display information about recommended devices for a triggered scenario (e.g., returning home, leaving home, sleeping, meeting guests, watching a movie, etc.) through a card 318. The triggering conditions for the above scenario may include one or more conditions, such as time, location, device status, voice commands, etc. The recommended devices may be one or more devices recommended by default and associated with the above scenario, or one or more devices set by the user to be controlled when the above scenario is triggered.
[0253] The following is an illustrative introduction using the meeting / movie watching scene, leaving home scene, and returning home scene as examples.
[0254] 1) Meeting / movie viewing scenes
[0255] When the meeting / movie-watching scene is triggered, the electronic device 100 may display information about recommended devices (such as lamps, etc.) in the meeting / movie-watching scene through the card 318 .
[0256] For example, referring to Figure 8A , card 318 may include a reception light control 318A and a movie viewing light control 318B. Reception light control 318A can be used to turn the light's reception light mode on or off, while movie viewing light control 318B can be used to turn the light's movie viewing light mode on or off. This allows users to quickly and easily turn on the reception light or movie viewing light mode when a reception / movie viewing scene is triggered.
[0257] In some embodiments, card 318 may further include option 318C. Option 318C may be used to refresh and display information of other devices in the same scenario, or information of devices in different scenarios.
[0258] In some embodiments, the user can also trigger the electronic device 100 to refresh and display information of other devices in the same scene, or information of devices in different scenes, by sliding left and right on the card 318.
[0259] In some embodiments, the above-mentioned meeting light control 318A and movie viewing light control 318B may not be displayed simultaneously, but may be displayed separately. For example, when the meeting scene is triggered, the electronic device 100 may not display the movie viewing light control 318B, and when the movie viewing scene is triggered, the electronic device 100 may not display the meeting light control 318A.
[0260] In some embodiments, in a meeting / movie viewing scenario, the electronic device 100 may display not only information about the light device, but also information about other devices associated with the scenario. For example, in a movie viewing scenario, referring to FIG8B , it can be seen that the electronic device 100 displays not only information about the light device (e.g., information about the light's movie viewing light control), but also information about other devices associated with the movie viewing scenario (e.g., information about the TV's on / off control).
[0261] 2) Leaving home scene
[0262] When the leaving home scenario is triggered, the electronic device 100 can display information about recommended devices (such as lights, curtains, air conditioners, etc.) in the leaving home scenario through the card 318.
[0263] For example, referring to FIG. 8C , the card 318 may include a lamp component 318C, a curtain component 318D, and an air conditioner component 318E.
[0264] The light fixture 318C may include a full-off control and the name of the device (e.g., "light"). In the case where there are multiple lights in the entire home, the full-off control may be used to turn off all lights in the entire home.
[0265] The curtain component 318D may include a full-off control and the name of the device (e.g., "curtain"). In the event that there are multiple curtains throughout the home, the full-off control may be used to close all curtains throughout the home.
[0266] The air conditioning component 318E may include a full-off control and the name of the device (e.g., "air conditioning"). In the case where there are multiple air conditioners in the entire home, the full-off control may be used to turn off all air conditioners in the entire home.
[0267] It can be seen that in the away-from-home scenario, the electronic device 100 provides a one-click shutdown control for multiple smart home devices in the entire home on card 318, which makes it convenient for users to shut down multiple smart home devices in the entire home with one click before leaving home. The user does not need to go to each room one by one to turn off the corresponding smart home device or enter the application for managing smart home devices (such as the smart life application) to find and turn off the corresponding smart home device, which simplifies user operations, saves time, and improves the efficiency of device control.
[0268] It is easy to understand that the electronic device 100 is not limited to the information of the three devices mentioned above, namely the light assembly 318C, the curtain assembly 318D, and the air conditioning assembly 318E. The electronic device 100 can also display information of more or less recommended devices on the card 318.
[0269] In some embodiments, when leaving home, some users may want to turn off multiple smart home devices in the entire home with one click, while some users may only want to turn off multiple smart home devices in a certain space / spaces in the entire home with one click. Therefore, in order to meet the diverse needs of users, the electronic device 100 may also provide a control for turning off multiple smart home devices in a certain space / spaces (such as a living room, bedroom, etc.) in the entire home with one click through the card 318 (for example, turning off all living room lights, turning off all bedroom lights, etc.), rather than providing a control for turning off multiple smart home devices in the entire home with one click.
[0270] 3) Homecoming scene
[0271] When the home scene is triggered, the electronic device 100 can display information about recommended devices (such as lights, curtains, air conditioners, etc.) in the home scene through the card 318.
[0272] For example, referring to FIG. 8D , the card 318 may include a lamp component 318F, a curtain component 318G, and an air conditioner component 318H.
[0273] The light fixture 318F may include a full on control, the name of the device (e.g., "light"). In the case where there are multiple lights in the entire home, the full on control may be used to turn on all lights in the entire home.
[0274] The curtain component 318G may include a full-open control and the name of the device (e.g., "curtain"). In the event that there are multiple curtains throughout the home, the full-open control may be used to open all curtains throughout the home.
[0275] The air conditioning component 318H may include a full-on control and the name of the device (e.g., "air conditioning"). If there are multiple air conditioners in the entire home, the full-on control may be used to turn on all air conditioners in the entire home.
[0276] It can be seen that in the home-going scenario, the electronic device 100 provides a control for turning on multiple smart home devices in the entire home with one click on the card 318, which makes it convenient for the user to turn on multiple smart home devices in the entire home with one click when returning home. The user does not need to go to each room one by one to turn on the corresponding smart home device or enter the application for managing smart home devices (such as the smart life application) to find and turn off the corresponding smart home device, which simplifies user operations, saves time, and improves the efficiency of device control.
[0277] It is easy to understand that the electronic device 100 is not limited to the information of the three devices mentioned above, namely the light component 318F, the curtain component 318G, and the air conditioning component 318H. The electronic device 100 can also display information of more or less recommended devices on the card 318.
[0278] In some embodiments, in a home scenario, some users may want to turn on multiple smart home devices in the entire home with one click, while some users may only want to turn on multiple smart home devices in a certain space / spaces in the entire home with one click. Therefore, in order to meet the diverse needs of users, the electronic device 100 may also provide controls for turning on multiple smart home devices in a certain space / spaces (such as a living room, bedroom, etc.) in the entire home with one click (for example, turning on all living room lights, turning on all bedroom lights, etc.), rather than providing controls for turning on multiple smart home devices in the entire home with one click, through card 318.
[0279] It can be seen that by implementing the automatic device recommendation solution in the above-mentioned embodiment 1, the electronic device 100 can present the device recommendation content to the user in the form of desktop cards in the single device dimension, space dimension, function dimension, and scene dimension. In this way, after the user triggers the electronic device 100 to light up the screen and unlock it, the device can be controlled on the card. The user does not need to enter the application for managing smart home devices (such as the smart life application) to find the corresponding device and then perform control operations on the device, which can greatly shorten the time for users to control the device.
[0280] The above description is based on the example of displaying device recommended content in one of the single device dimension, spatial dimension, functional dimension, and scene dimension. In some embodiments, device recommended content can also be displayed simultaneously in multiple dimensions of the single device dimension, spatial dimension, functional dimension, and scene dimension. For example, assuming that the device recommended content is displayed in both the single device dimension and the spatial dimension in the form of a card, the card can simultaneously display information about a certain category of devices in a certain space in the home (e.g., lighting devices in the living room, etc.) and information about one or more single devices (e.g., a ceiling light in the living room, an air conditioner in the living room, a speaker in the bedroom, etc.).
[0281] The above example illustrates the automatic device recommendation solution in Embodiment 1 by displaying device-recommended content in a resident card format on the desktop of the electronic device 100. The solution is not limited to resident card formats; the electronic device 100 can also display device-recommended content in other formats (e.g., non-resident card formats) on the desktop. The following describes, with reference to Figures 9A-9C , how the electronic device 100 displays device-recommended content in a non-resident card format on the desktop.
[0282] For example, referring to FIG9A , the user interface 310 shown in FIG9A may be the desktop of the electronic device 100, and the user interface 310 may include an icon 911. The icon 911 may be used to prompt the user that there is device-recommended content to be viewed. In some embodiments, the icon 911 may be displayed only when there is device-recommended content that the user needs to view.
[0283] Continuing with FIG9A , the electronic device 100 can detect a user operation (e.g., a click operation) on icon 911. In response to this operation, referring to FIG9B , the electronic device 100 can display a non-resident card 912, which can be used to display device recommendations. It is easy to see from card 912 that the device currently recommended by the electronic device 100 is the ceiling light in the living room. For details about the device recommendations displayed in card 912, please refer to the description of card 312 in FIG3D , which will not be repeated here.
[0284] In some embodiments, the card 912 may be displayed by the electronic device 100 after enlarging the icon 911 .
[0285] 9B , card 312 may include a control 912A, which may be used to cancel display of card 912. Electronic device 100 may detect a user operation (eg, a click operation) on control 912A, and in response to the operation, may cancel display of card 912.
[0286] In some embodiments, the electronic device 100 canceling the display of the card 912 may specifically be that the electronic device 100 shrinks the card 912 and displays it as an icon 911 .
[0287] It is easy to see that the above-mentioned card 912 displays the content recommended by the device in a single device dimension. In some embodiments, the content recommended by the device can also be displayed in other dimensions (such as spatial dimension, functional dimension, and scene dimension). For example, referring to Figure 9C, the card 913 shown in Figure 9C is a card that displays the content recommended by the device in the spatial dimension. For the content recommended by the device displayed in card 913, please refer to the relevant introduction about card 316 in Figure 6A, which will not be repeated here. It is easy to understand that the above-mentioned card 913 is also triggered by the user operating the icon 911 shown in Figure 9A (such as clicking) to display it on the electronic device 100.
[0288] As can be seen from Figures 9A to 9C, the electronic device 100 displays the device-recommended content in a non-resident card style. It will only be displayed when the user wants to view the device-recommended content. This is flexible and convenient and can avoid wasting display space.
[0289] The above only uses the display of device recommended content on the desktop of the electronic device 100 as an example to illustrate the automatic device recommendation solution in the first embodiment. However, the solution is not limited to the desktop. The electronic device 100 can also display device recommended content on other interfaces (such as the off-screen display interface, the lock screen interface, etc.). The following describes how the electronic device 100 displays device recommended content on the off-screen display interface and the lock screen interface, respectively, with reference to Figures 10A-10B and 11A-11D.
[0290] 1) Display device recommended content on the off-screen display interface (AOD interface)
[0291] The electronic device 100 can display device recommended content on the off-screen display interface, where the device recommended content may include but is not limited to: status information of the recommended device (such as normal status information such as on or off, abnormal status information such as gas / water leakage), data information generated by the recommended device (such as air quality, temperature, humidity and other data information), and controls of the recommended device.
[0292] Exemplarily, referring to FIG10A , the user interface 1010 shown in FIG10A may be the off-screen display interface of the electronic device 100 . It can be seen that the device recommendation content displayed in the user interface 1010 of the electronic device 100 includes the status information of the recommended device and the data information (such as air quality) generated by the recommended device (such as an air quality monitor, a temperature monitor, and a humidity monitor). It can be seen from the status information of the recommended device that the recommended devices are the lights on the balcony and the lights in the basement, and both are in the on state. From the data information generated by the recommended devices, the recommended devices are the air quality monitor, temperature monitor, humidity monitor, and light in the basement, and the data generated by them are air quality (such as “excellent”), temperature (such as “28°C”), humidity (such as “48%”), and dim light.
[0293] For example, referring to FIG. 10B , the electronic device 100 may also display abnormal status information of the recommended device in the user interface 1010 , for example, gas leakage alarm information of the kitchen.
[0294] In addition, the electronic device 100 may also display controls of recommended devices in the user interface 1010. For details, please refer to the aforementioned content on displaying controls of recommended devices on the desktop, which will not be repeated here.
[0295] In some embodiments, the user can trigger the electronic device 100 to cancel the content recommended by the display device in the off-screen display interface by operating the off-screen display interface (for example, clicking any position in the off-screen display interface).
[0296] 2) Display device recommended content on the lock screen
[0297] The electronic device 100 can display device-recommended content by pushing cards on the lock screen interface.
[0298] For example, referring to FIG11A , the user interface 1110 shown in FIG11A may be the lock screen interface of the electronic device 100 , and the user interface 1110 may include a card 1111 , which may be used to display content recommended by the device. Taking the recommended device as the air conditioner in the living room as an example, the card 1111 may include a control 1111A, which may be used to turn the air conditioner in the living room on or off. It can be seen that the control 1111A is currently in the off state, which indicates that the air conditioner in the living room is currently in the off state. The electronic device 100 may detect a user operation on the control 1111A (e.g., a click operation). In response to the operation, the electronic device 100 may instruct the air conditioner in the living room to turn on, and may switch the state of the control 1111A from the off state to the on state shown in FIG11B .
[0299] Continuing to refer to FIG. 11B , card 1111 may further include controls 1111B and 1111C. Control 1111B may be used to lower the temperature of the air conditioner in the living room, and control 1111C may be used to increase the temperature of the air conditioner in the living room.
[0300] In some embodiments, the user can trigger the electronic device 100 to cancel the display of the card 1111 in the user interface 1110 by performing a corresponding operation (such as a click operation, a slide operation, etc.) on the user interface 1110.
[0301] In some embodiments, card 1111 may also display more or fewer controls for the recommended device.
[0302] It is easy to understand that when more controls are displayed on a card, the size of the card may become larger. However, larger cards will waste display space. Therefore, in this case, the electronic device 100 can support the card to be hidden, and the electronic device 100 can be triggered to display the card when the user needs to view the card.
[0303] For example, referring to FIG11C , taking the air conditioner in the living room as an example, it can be seen that the number of controls corresponding to the air conditioner in the living room (e.g., on / off control, mode control, wind speed control, temperature adjustment control, etc.) included in card 1112 is significantly greater than the number of controls corresponding to the air conditioner in the living room (e.g., on / off control, temperature adjustment control, etc.) included in card 1111 shown in FIG11A and FIG11B . However, the size of card 1112 is also significantly larger than that of card 1111 shown in FIG11A and FIG11B . Therefore, card 1112 can be a card that can be hidden.
[0304] It should be noted that the embodiment of the present application does not limit the method for triggering the electronic device 100 to hide the card 1112. In one possible implementation, the user can trigger the electronic device 100 to hide the card 1112 by sliding down the card 1112 or sliding toward the edge of the screen. In another possible implementation, the user can also trigger the electronic device 100 to hide the card 1112 by clicking anywhere in the display area other than the display area of the card 1112.
[0305] It should be noted that the embodiment of the present application does not limit the method for triggering the electronic device 100 to display the card 1112. In one possible implementation, the user can trigger the electronic device 100 to display the card 1112 by swiping up on the user interface 1110 or swiping out from the edge of the screen (for example, swiping from the edge of the screen of the electronic device 100 to the center of the screen).
[0306] It is easy to see that the above Figures 11A-11C only take the example of displaying the content recommended by the device in a single device dimension. In some embodiments, the content recommended by the device can also be displayed in other dimensions (such as spatial dimension, functional dimension, and scene dimension). The embodiments of the present application do not limit this.
[0307] In some embodiments, the electronic device 100 may also display device-recommended content in 3D on the lock screen interface.
[0308] For example, referring to FIG. 11D , it can be seen that the recommended device is a desk lamp, and the electronic device 100 displays one or more corresponding controls of the desk lamp (eg, a brightness adjustment bar 1113 and a control 1114 ) in 3D form.
[0309] The brightness adjustment bar 1113 can be used to adjust the brightness of the desk lamp.
[0310] Among them, control 1114 can be used to turn on or off the desk lamp, and can also be used to indicate the on or off status of the desk lamp. In addition, the display style of control 1114 is the "desk lamp" style, so control 1114 can also be used to indicate that the recommended device is a desk lamp.
[0311] In some embodiments, referring to FIG. 11D , the electronic device 100 may further display controls 1115 and 1116 , wherein both controls 1115 and 1116 may be used to refresh and display information of other recommended devices.
[0312] In some embodiments, the user can trigger the electronic device 100 to cancel the display of device-recommended content in the user interface 1110 by performing a corresponding operation (such as a click operation, etc.) on the user interface 1110 shown in FIG. 11D .
[0313] As can be seen from FIG11D , the electronic device 100 displays the device recommended content in 3D, which makes it easier for the user to perform three-dimensional control operations on the recommended device, thereby providing the user with a better visual and operational experience.
[0314] It should be noted that the electronic device 100 is not limited to the above-mentioned lock screen interface, and can also display the device recommended content in 3D form on other interfaces (such as the desktop, off-screen display interface, etc.).
[0315] Example 2: Customized Recommendations
[0316] The following describes in detail the process of users independently setting device recommendation rules when making customized device recommendations, using a series of exemplary user interfaces.
[0317] Referring to Figure 12A, the user interface 1210 exemplarily shown in Figure 12A can be a user interface for the user to perform device recommendation settings. The user interface 1210 can be a user interface provided by an application (such as a smart life application) on the electronic device 100 for managing smart home devices.
[0318] Continuing with FIG12A , user interface 1210 may include options 1211, 1212, and 1213. Option 1211 may be used by the user to set whether the recommended device is determined based on an automatic recommendation algorithm, option 1212 may be used by the user to set whether the recommended device is determined based on user-defined device recommendation rules, and option 1213 may be used by the user to set whether the recommended device is determined based on a combination of the automatic recommendation algorithm and the user-defined device recommendation rules. It is easy to understand that only one of options 1211, 1212, and 1213 can be selected, and the user can independently set the selected option. For example, if option 1211 is currently selected, it means that the recommended device is currently determined based on the automatic recommendation algorithm, rather than based on user-defined device recommendation rules or based on a combination of the automatic recommendation algorithm and user-defined device recommendation rules. In other words, even if the user customizes the device recommendation rule, the device recommendation rule is invalid. For example, if the user wants to determine the recommended device based on the user-defined device recommendation rules, the user can click on option 1212 to trigger the electronic device 100 to place option 1212 in a selected state. In this way, when a device recommendation is made subsequently, the content of the device recommendation is determined solely based on the user-defined device recommendation rules. For example, if the user wants to comprehensively determine the recommended device based on the automatic recommendation algorithm and the user-defined device recommendation rules, the user can click on option 1213 to trigger the electronic device 100 to place option 1213 in a selected state. In this way, when a device recommendation is made subsequently, the content of the device recommendation is comprehensively determined based on the automatic recommendation algorithm and the user-defined device recommendation rules.
[0319] Continuing to refer to Figure 12A, the user interface 1210 may also include one or more setting entries for custom device recommendation rules, such as a time setting entry 1214, a space (place) setting entry 1215, and a scene setting entry 1216. Among them, the time setting entry 1214 can be used by the user to set which devices to recommend in which time period, the space (place) setting entry 1215 can be used by the user to set which devices to recommend in which space, and the scene setting entry 1216 can be used by the user to set which devices to recommend in which scene.
[0320] In some embodiments, the above-mentioned custom device recommendation rules such as time, space, and scene can have priorities to avoid conflicts between recommended devices determined based on different device recommendation rules. The priority of each custom device recommendation rule can be pre-set by the electronic device 100 or set by the user. In an embodiment of the present application, the electronic device 100 can support users to independently set the priority of each custom device recommendation rule. For example, referring to Figure 12A, the user interface 1210 can also include a device recommendation rule priority ranking setting entry 1217. The electronic device 100 can detect the user's operation (such as a click operation) on the device recommendation rule priority ranking setting entry 1217. In response to the operation, the electronic device 100 can display the user interface 1220 shown in Figure 12B. The user interface 1220 can be used for the user to set the priority of the device recommendation rule. The user interface 1220 displays the option boxes of each device recommendation rule (such as option box 1221, option box 1222, option box 1223) from top to bottom according to the priority of the device recommendation rule. The device recommendation rule at the top has a higher priority. The user can trigger the electronic device 100 to move the position of the device recommendation rule's option box by dragging the option box of the device recommendation rule upward or downward, thereby modifying the priority of the device recommendation rule. It is easy to understand that the dragging operation upward or downward is only an exemplary method, and the user can also set the priority of the device recommendation rule in other ways.
[0321] The following takes time as an example to exemplify how a user customizes the device recommendation rule of time (ie, how a user sets which devices to recommend in which time period).
[0322] 12A , the electronic device 100 may detect a user operation (eg, a click operation) on the time setting entry 1214 . In response to the operation, the electronic device 100 may display a user interface 1310 as exemplarily shown in FIG. 13A .
[0323] Referring to FIG. 13A , user interface 1310 may include option 1311. If option 1311 is selected, it indicates that the time is included in the device recommendation rule set by the user. If option 1311 is not selected, it indicates that the time is not included in the device recommendation rule set by the user. The user can independently set whether to set option 1311 to be selected. It is easy to understand that when option 1311 is selected, the user must set the time period for which devices to be recommended before the user-defined time device recommendation rule will take effect. That is, it is possible to subsequently determine the recommended devices based on the time device recommendation rule.
[0324] Continuing with FIG13A , user interface 1310 may further include option 1312, which allows the user to add a time period and set the devices to be recommended during that time period. Electronic device 100 may detect a user operation (e.g., a click operation) on option 1312, and in response to the operation, may display user interface 1320 as exemplified in FIG13B .
[0325] 13B , the user interface 1320 may include a time period input box 1321 , in which the user may input the start time and end time of the time period. It is easy to understand that the time period may be used as the time period for subsequent customized device recommendations.
[0326] In some embodiments, referring again to FIG. 13B , user interface 1320 may further include options for setting the date type to which the time period applies, such as options 1322, 1323, and 1324. Option 1322 allows the user to set whether the time period applies only to weekdays, option 1323 allows the user to set whether the time period applies only to statutory holidays, and option 1324 allows the user to set whether the time period applies to all date types. It will be readily understood that only one of options 1322, 1323, or 1324 can be selected, and the user can independently set the selected option. For example, if option 1211 is currently selected, the time period is currently set to apply only to weekdays. In some embodiments, user interface 1320 may further include a custom settings entry 1325, which allows the user to independently set the date type to which the time period applies. For example, clicking on custom settings entry 1325 may trigger electronic device 100 to display a corresponding user interface for the user to customize the date type to which the time period applies. It is easy to understand that after the user completes customizing the date type applied to the above time period, the above options 1322, 1323, and 1324 can all be placed in an unselected state.
[0327] Continuing to refer to Figure 13B, the user interface 1320 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1326, a space dimension setting entry 1327, and a function dimension setting entry 1328. Among them, the single device dimension setting entry 1326 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1327 can be used by the user to select one or more categories (such as lighting, sunshade, audio and video entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1328 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.
[0328] Continuing to refer to Figure 13B, taking the single device dimension as an example, the electronic device 100 can detect the user's operation (such as a click operation) for setting the entry 1326 for the single device dimension. In response to this operation, the electronic device 100 can display the user interface 1330 shown in Figure 13C.
[0329] Referring to FIG13C , user interface 1330 may include setting items (e.g., setting item 1331 for the living room air conditioner, setting item 1332 for the living room speaker, etc.) for one or more devices (e.g., the living room air conditioner, the living room speaker, etc.). Setting item 1331 for the living room air conditioner may be used by the user to select the living room air conditioner as a recommended device and to set the content displayed when the device is recommended (e.g., the device's controls, etc.). It is easy to understand that the setting items for the devices displayed in user interface 1330 are all setting items for devices in the user's home. If the user's home has a large number of devices, the screen size of electronic device 100 is limited and it is not possible to display the setting items for all devices. Therefore, the user can view the setting items for all devices by swiping up and down.
[0330] Continuing to refer to Figure 13C, assuming that the user wants to select the air conditioner in the living room as the recommended device, the electronic device 100 can detect the user's operation (such as a click operation) on the setting item 1331 for the air conditioner in the living room. In response to this operation, the electronic device 100 can display the user interface 1340 shown in Figure 13D.
[0331] Referring to FIG13D , user interface 1340 may include options for selecting a device, such as option 1341. Option 1341 may be used by the user to set whether the air conditioner in the living room is recommended. The user may click on option 1341 to trigger electronic device 100 to select or deselect option 1341. It is easy to understand that if option 1341 is selected, it indicates that the user has selected the air conditioner in the living room as a recommended device, and if option 1341 is deselected, it indicates that the user has not selected the air conditioner in the living room as a recommended device.
[0332] Continuing to refer to FIG13D , the user interface 1340 may further include options for selecting controls, such as option 1342, option 1343, option 1344, option 1345, etc., wherein option 1342 may be used by the user to set whether to display an on or off control when recommending a device, option 1343 may be used by the user to set whether to display a temperature adjustment control when recommending a device, option 1344 may be used by the user to set whether to display a wind speed adjustment control when recommending a device, and option 1345 may be used by the user to set whether to display a mode adjustment control when recommending a device. The user can place the option in a selected or unselected state by clicking on the corresponding option. It is easy to understand that if an option is in a selected state, it means that the control corresponding to the option will be displayed when the device is recommended, and if the option is in an unselected state, it means that the control corresponding to the option will not be displayed when the device is recommended.
[0333] For example, referring to Figure 13E, it can be seen that the user has placed option 1341 in the selected state, that is, the user has selected the air conditioner in the living room as the recommended device. In addition, the user has placed options 1342 and 1343 in the selected state, that is, the user has set the on or off controls and temperature adjustment controls for controlling the air conditioner in the living room to be displayed when the device is recommended.
[0334] In some embodiments, in order to facilitate the user to promptly know whether he has completed the selection of the recommended device and set the content displayed when the device is recommended (such as the device's controls, etc.), the electronic device 100 can also display relevant identification. For example, referring to Figure 13F, assuming that the user has selected the air conditioner in the living room as the recommended device and set the content displayed when the device is recommended, then the electronic device 100 can display identification 1332 on the setting entry 1331 of the air conditioner in the living room shown in the user interface 1330. Identification 1332 can be used to prompt the user that the air conditioner in the living room has been successfully added as a recommended device and the content displayed when the device is recommended (such as the device's controls, etc.) has been set.
[0335] It is easy to understand that, similar to adding the air conditioner in the living room as a recommended device, the user can also add more devices as recommended devices (such as the speakers in the living room, curtains in the living room, etc. as shown in Figure 13F).
[0336] Continuing to refer to FIG13B , taking the spatial dimension as an example, the electronic device 100 can detect the user's operation (such as a click operation) of setting the entry 1327 for the spatial dimension. In response to the operation, the electronic device 100 can display the user interface 1410 as exemplarily shown in FIG14A .
[0337] 14A , user interface 1410 may include setting items for one or more spaces (e.g., a living room, a bedroom, etc.) (e.g., setting item 1411 for the living room, setting item 1411 for the bedroom, etc.). Living room setting item 1411 may be used by the user to select one or more types of devices in the living room as recommended devices and to set the content displayed when making device recommendations (e.g., device controls, etc.). It is easy to understand that the setting items for the spaces displayed in user interface 1410 are all setting items for the spaces included in the user's home. If the user's home has a large number of spaces, the screen size of electronic device 100 is limited, and the setting items for all spaces cannot be displayed. Therefore, the user can view the setting items for all spaces by swiping up and down.
[0338] Continuing to refer to Figure 14A, assuming that the user wants to select one or more categories of devices in the living room as recommended devices, the electronic device 100 can detect the user's operation (such as a click operation) on the setting item 1411 for the living room. In response to this operation, the electronic device 100 can display the user interface 1420 shown in Figure 14B.
[0339] Referring to Figure 14B, user interface 1420 may include options for selecting device categories, such as option 1421, option 1422, and option 1423. It will be readily understood that the device categories corresponding to the aforementioned device category selection options are all device categories included in the living room. Option 1421 allows the user to select whether lighting devices in the living room are recommended, option 1422 allows the user to select whether sunshade devices in the living room are recommended, and option 1423 allows the user to select whether audio-visual entertainment devices in the living room are recommended. The user can trigger electronic device 100 to select or deselect an option by clicking on the corresponding option. A selected option indicates that the user has selected the corresponding device category as a recommended device, while an unselected option indicates that the user has not selected the corresponding device category as a recommended device. The selected option may be one or more, meaning that electronic device 100 allows the user to select one or more device categories in the living room as recommended devices.
[0340] Continuing with FIG14B , user interface 1420 may also include options for selecting controls, such as option 1424, option 1425, option 1426, option 1427, and option 1428. It will be readily understood that the controls corresponding to the aforementioned control selection options are controls available for devices in the living room. For example, if the devices in the living room include audio and video entertainment devices, the controls corresponding to the aforementioned control selection options may include a volume control. Option 1424 allows the user to set whether to display an on / off control when recommending a device, option 1425 allows the user to set whether to display a brightness control when recommending a device, option 1426 allows the user to set whether to display a color temperature control when recommending a device, option 1427 allows the user to set whether to display a volume control when recommending a device, and option 1428 allows the user to set whether to display a playback control when recommending a device. The user can select or deselect an option by clicking on it. It is easy to understand that when an option is in a selected state, it means that the control corresponding to the option will be displayed when the device is recommended, and when an option is in an unselected state, it means that the control corresponding to the option will not be displayed when the device is recommended. Among them, the options in the selected state can be one or more, that is, the electronic device 100 can support displaying multiple controls selected by the user in the device recommendation.
[0341] It is easy to understand that when there are a large number of options for control selection as mentioned above, due to the limited screen size of the electronic device 100, not all options for control selection can be displayed. Therefore, the user can view all options for control selection by sliding up and down.
[0342] It is easy to understand that after the user completes the device category selection, if the device of the selected category does not have one or some controls, then the options corresponding to this or these controls can be placed in an unselectable state in the options for control selection.
[0343] For example, referring to Figure 14C, it can be seen that the user has placed option 1421 in a selected state, that is, the user has selected the lighting type in the living room as the recommended device. In addition, the user has placed option 1424 in a selected state, that is, the user has set the on or off control for controlling the lighting type device in the living room to be displayed when the device is recommended.
[0344] In some embodiments, in order to facilitate the user to promptly know which device or devices in which spaces they have selected as recommended devices, the electronic device 100 can also display relevant identification. For example, referring to Figure 14D, assuming that the user has selected one or more types of devices in the living room as recommended devices and set the content to be displayed when recommending devices, then the electronic device 100 can display identification 1412 on the setting entry 1411 of the living room shown in the user interface 1410. Identification 1412 can be used to prompt the user that the device in the living room has been successfully added as a recommended device and the content displayed when the device recommendation is completed (such as the device controls, etc.) has been set.
[0345] It is easy to understand that, similar to the above-mentioned addition of the device in the living room as a recommended device, the user can also add more devices in other spaces (such as the bedroom and kitchen shown in FIG14D ) as recommended devices.
[0346] It can be seen that compared with selecting recommended devices in a single device dimension, selecting recommended devices in a space dimension allows users to select a category of devices in a space with one click, rather than a single device, which is convenient and fast and simplifies user operations.
[0347] Continuing to refer to FIG13B , taking the functional dimension as an example, the electronic device 100 can detect the user's operation (such as a click operation) of setting an entry 1328 for the functional dimension. In response to this operation, the electronic device 100 can display the user interface 1510 shown in FIG15A .
[0348] 15A , user interface 1510 may include one or more setting items (e.g., lighting, sunshade, etc.) for device categories (e.g., lighting setting item 1511, sunshade setting item, etc.). Lighting setting item 1511 may be used by the user to select lighting devices throughout the home as recommended devices and to set the content displayed when recommending devices (e.g., device controls, etc.). It is easy to understand that the setting items for the device categories displayed in user interface 1510 are all setting items for the device categories included in the user's home. If the user's home has a large number of device categories, the screen size of electronic device 100 is limited and it is not possible to display all the setting items for the device categories. Therefore, the user can view the setting items for all the device categories by swiping up and down.
[0349] Continuing to refer to Figure 15A, assuming that the user wants to select lighting devices in the entire home as recommended devices, the electronic device 100 can detect the user's operation on the setting item 1511 of the lighting category (for example, a click operation). In response to this operation, the electronic device 100 can display the user interface 1520 shown in Figure 15B.
[0350] Referring to Figure 15B, the user interface 1520 may include options for selecting device categories, such as option 1521, wherein option 1521 can be used for the user to set whether to use lighting devices as recommended devices. The user can trigger the electronic device 100 to put the option in a selected state or an unselected state by clicking on option 1521. It is easy to understand that if option 1521 is in a selected state, it means that the user has selected the lighting device as the recommended device, and if option 1521 is in an unselected state, it means that the user has not selected the lighting device as the recommended device.
[0351] Continuing with Figure 15B , user interface 1520 may also include options for selecting controls, such as option 1522, option 1523, and option 1524. It will be readily understood that the controls corresponding to these control selection options are all controls available for lighting devices. Option 1522 allows the user to set whether to display an on / off control during device recommendations, option 1523 allows the user to set whether to display a brightness adjustment control during device recommendations, and option 1524 allows the user to set whether to display a color temperature adjustment control during device recommendations. The user can select or deselect an option by clicking on it. As will be readily understood, a selected option indicates that the corresponding control will be displayed during device recommendations, while an unselected option indicates that the corresponding control will not be displayed during device recommendations. The selected options may be one or more, meaning that electronic device 100 can support displaying multiple user-selected controls during device recommendations.
[0352] It is easy to understand that when there are a large number of options for control selection as mentioned above, due to the limited screen size of the electronic device 100, not all options for control selection can be displayed. Therefore, the user can view all options for control selection by sliding up and down.
[0353] For example, referring to Figure 15C, it can be seen that the user has placed option 1521 in a selected state, that is, the user has selected the lighting category as the recommended device. In addition, the user has placed option 1522 in a selected state, that is, the user has set the on or off control for controlling the lighting category device to be displayed when the device is recommended.
[0354] In some embodiments, in order to facilitate the user to promptly know which category or categories of devices in the entire home they have selected as recommended devices, the electronic device 100 can also display relevant identification. For example, referring to Figure 15D, assuming that the user has selected lighting devices in the entire home as recommended devices and set the content to be displayed when recommending devices, then the electronic device 100 can display identification 1512 on the setting entry 1511 of the lighting category shown in the user interface 1510. Identification 1512 can be used to prompt the user that the lighting devices in the entire home have been successfully added as recommended devices, and the content displayed when the device recommendation is completed (such as device controls, etc.) has been set.
[0355] It is easy to understand that, similar to the above-mentioned addition of lighting equipment as recommended equipment, the user can also add more equipment of other categories (such as sunshade equipment, environmental monitoring equipment, etc. as shown in Figure 15D) as recommended equipment.
[0356] It can be seen that compared with selecting recommended devices in a single device dimension or space dimension, selecting recommended devices in a functional dimension allows users to select a category of devices in the entire home with one click, rather than a single device or a category of devices in a certain space. This is convenient and fast and simplifies user operations.
[0357] Continuing with FIG13B , after the user completes setting the time period and recommended devices, illustratively referring to FIG16A , electronic device 100 may display the time period and recommended device information that the user has set in user interface 1320. It can be seen that the time period set by the user is 08:00-08:10, and this time period applies only to weekdays. Furthermore, the user has selected a recommended device in the single device dimension.
[0358] Continuing to refer to Figure 16A, in some embodiments, in order to facilitate the user to promptly know in which dimension they have selected the recommended device, the electronic device 100 can also display a relevant logo. For example, assuming that the user selects the recommended device in the single device dimension, the electronic device 100 can display a logo 1611 on the single device dimension setting entry 1326 shown in the user interface 1320. The logo 1611 can be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device controls, etc.) is set.
[0359] Continuing to refer to FIG16A, after the user completes the time period setting and the recommended device setting, the electronic device 100 may further display option 1612. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1612. In response to this operation, the electronic device 100 may save the time period and recommended device information that the user has set, and may display the user interface 1310 shown in FIG16B. It can be seen that the user interface 1310 displays an entry 1313 corresponding to the time period (e.g., 08:00-08:10) that the user has added. It is easy to understand that the user can trigger the electronic device 100 to display the user interface 1320 shown in FIG16A by clicking on the entry 1313, thereby allowing the user to view or modify the time period and recommended device information that the user has set.
[0360] Continuing to refer to FIG. 16B , the user interface 1310 may further include an option 1314 , which may be used to delete a time period added by the user.
[0361] Continuing to refer to Figure 16A, when setting the recommended device, the user may select the recommended device in only one dimension, or may select the recommended device in multiple dimensions. It is easy to understand that when selecting the recommended device in multiple dimensions, there may be a conflict in the selected recommended devices. For example, the air conditioner for the living room is selected in the single device dimension, and the lighting equipment for the living room is selected in the space dimension, but the air conditioner does not belong to the lighting equipment. In this way, the electronic device 100 cannot determine whether to recommend the air conditioner for the living room or the lighting equipment for the living room, or to recommend both the air conditioner for the living room and the lighting equipment for the living room. Therefore, in order to solve the above problem, one possible solution is that the electronic device 100 only supports the user to select the recommended device under one dimension. For example, if the user selects the recommended device under the single device dimension, then the user can no longer select the recommended device under the spatial dimension and the functional dimension. For example, after detecting that the user has selected the recommended device under the single device dimension, the electronic device 100 can place the spatial dimension setting entry 1327 and the functional dimension setting entry 1328 in an unselectable state to prompt the user that the recommended device can no longer be selected under the spatial dimension and the functional dimension. Another possible solution is that, just as the custom device recommendation rules such as time, space, and scene shown in Figure 12A have priorities, the above-mentioned single device dimension, spatial dimension, and functional dimension can also have priorities, and the electronic device 100 will give priority to recommending devices selected under the dimension with a high priority. The electronic device 100 can support users to set priorities independently, and its priority setting method can be, for example, as shown in Figure 12B, which will not be repeated here. The advantage of this solution is that, assuming the user has selected recommended devices in multiple dimensions, after a period of time, if the user wants to change the recommended device selected in the current dimension to the recommended device selected in another dimension, the user only needs to change the priority of different dimensions to change to the recommended device selected in another dimension. There is no need to reselect the recommended device, delete the previously selected recommended device, or change the original time period setting information. It is convenient and fast, and simplifies user operations.
[0362] The following uses space as an example to illustrate how users customize the device recommendation rules for space (i.e., how users set which devices to recommend in which space).
[0363] Continuing to refer to FIG. 12A , the electronic device 100 may detect a user operation (eg, a click operation) on the space (place) setting entry 1215 . In response to the operation, the electronic device 100 may display the user interface 1710 exemplarily shown in FIG. 17A .
[0364] Referring to FIG. 17A , user interface 1710 may include option 1711. If option 1711 is selected, it indicates that the space has incorporated the device recommendation rules set by the user. If option 1711 is not selected, it indicates that the space has not incorporated the device recommendation rules set by the user. The user can independently set whether to place option 1711 in the selected state. It is easy to understand that when option 1711 is selected, the user must also set which devices to recommend in which space before the user-defined device recommendation rules for the space will take effect. That is, it is possible to subsequently determine the recommended devices based on the device recommendation rules for the space.
[0365] Continuing with FIG17A , user interface 1710 may further include option 1712, which allows the user to add a space and set recommended devices for the space. Electronic device 100 may detect a user operation (e.g., a click operation) on option 1712, and in response to the operation, may display user interface 1720 as exemplified in FIG17B .
[0366] Referring to Figure 17B, the user interface 1720 may include a space input box 1721. The user can enter the name of the space (such as the living room) in the space input box 1721. It is easy to understand that the name of the space can be used as the name of the space where the user is located when customizing device recommendations are made later.
[0367] It is easy to understand that there are many ways for the electronic device 100 to determine the space where the user is located, and the embodiments of the present application are not limited to this. In one possible implementation, the electronic device 100 can determine the space where the user is located through near-field communication. For example, the space where the user is located is the living room, and the name of the hotspot in the living room is XXX. Then, when the electronic device 100 is connected to the hotspot named XXX or the electronic device 100 determines that the signal strength of the hotspot named XXX is the highest, the electronic device 100 can determine that the space where the user is located is the living room.
[0368] Continuing to refer to Figure 17B, the user interface 1720 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1722, a space dimension setting entry 1723, and a function dimension setting entry 1724. Among them, the single device dimension setting entry 1722 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1723 can be used by the user to select one or more categories (such as lighting, sunshade, audio and video entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1724 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.
[0369] Among them, the specific process of selecting the recommended device under a single device dimension is similar to the specific process of selecting the recommended device under a single device dimension when customizing the device recommendation principle of "time" mentioned above. Please refer to the relevant text descriptions of Figures 13C-13F mentioned above, and will not be repeated here.
[0370] Among them, the specific process of selecting the recommended device under the spatial dimension is similar to the specific process of selecting the recommended device under the spatial dimension when the aforementioned "time" device recommendation principle is customized. Please refer to the relevant text descriptions of Figures 14A-14D above, and will not be repeated here.
[0371] Among them, the specific process of selecting the recommended device under the functional dimension is similar to the specific process of selecting the recommended device under the functional dimension when customizing the device recommendation principle of "time" mentioned above. You can refer to the relevant text descriptions of Figures 15A-15D mentioned above, and will not repeat them here.
[0372] Continuing with FIG17B , after the user completes setting up the space and recommended devices, illustratively referring to FIG17C , electronic device 100 may display the user's completed space and recommended device information in user interface 1720. As can be seen, the user has set up the living room as their space and has selected a recommended device in the single device dimension.
[0373] Continuing to refer to Figure 17C, in some embodiments, in order to facilitate the user to promptly know in which dimension they have selected the recommended device, the electronic device 100 can also display a relevant logo. For example, assuming that the user selects the recommended device in the single device dimension, the electronic device 100 can display a logo 1725 on the single device dimension setting entry 1722 shown in the user interface 1720. The logo 1725 can be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device controls, etc.) is set.
[0374] Continuing to refer to FIG17C , after the user completes the space settings and recommended device settings, the electronic device 100 may further display option 1726. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1726. In response to this operation, the electronic device 100 may save the information about the space and recommended devices that the user has set up, and may display the user interface 1710 shown in FIG17D . It can be seen that the user interface 1710 displays an entry 1713 corresponding to the space (e.g., the living room) that the user has added. It is easy to understand that the user can trigger the electronic device 100 to display the user interface 1720 shown in FIG17C by clicking on the entry 1713, thereby allowing the user to view or modify the information about the space and recommended devices that the user has set up.
[0375] Continuing to refer to FIG. 17D , the user interface 1710 may further include an option 1714 , which may be used to delete a space that has been added by the user.
[0376] The following takes scenes as an example to exemplify how users customize the device recommendation rules of scenes (ie, how users set which devices to recommend in which scenes).
[0377] Continuing to refer to FIG. 12A , the electronic device 100 may detect a user operation (eg, a click operation) on the scene setting entry 1216 . In response to the operation, the electronic device 100 may display the user interface 1810 exemplarily shown in FIG. 18A .
[0378] Referring to FIG. 18A , user interface 1810 may include option 1811. If option 1811 is selected, it indicates that the scene incorporates the user-defined device recommendation rules. If option 1811 is not selected, it indicates that the scene does not incorporate the user-defined device recommendation rules. The user can independently select whether to select option 1811. It is easy to understand that even if option 1811 is selected, the user must specify which devices to recommend in which scene before the user-defined device recommendation rules for the scene take effect. This means that only then can the recommended devices be determined based on the scene device recommendation rules.
[0379] Continuing with FIG18A , user interface 1810 may further include option 1812, which may be used by the user to add a scenario and set the device to be recommended in the scenario. Electronic device 100 may detect a user operation (e.g., a click operation) on option 1812, and in response to the operation, electronic device 100 may display user interface 1820 as exemplified in FIG18B .
[0380] Referring to Figure 18B, the user interface 1820 may include a scene input box 1821. The user can enter the name of the scene (such as the home scene) in the scene input box 1821. It is easy to understand that the name of the scene can be used as the name of the scene in which the user is in when making subsequent customized device recommendations.
[0381] In some embodiments, the name of the scene input by the user may be the name of a scene that has been customized by the user in advance, wherein the process of user-customizing the scene may include the name of the user-customized scene, the triggering conditions of the customized scene, etc. In this case, the electronic device 100 may also optionally display the names of one or more scenes that have been customized by the user in advance in the form of a window, for example, and the user can simply select the name of one of the scenes without having to manually enter the name of the scene in the scene input box 1821.
[0382] In other embodiments, if the name of the scene input by the user is not the name of a scene that has been customized by the user in advance, then the electronic device 100 may prompt the user to set the trigger conditions of the scene. After the user completes setting the trigger conditions of the scene, it means that the user has completed the scene setting shown in Figure 18B.
[0383] It is easy to understand that the electronic device 100 recommends customized devices in a certain scenario when the scenario set by the user meets the trigger condition. For example, the trigger condition for the home scene is the voice command "I'm home". Then, after detecting the user's voice command "I'm home", the electronic device 100 can recommend the recommended device selected by the user in the home scene.
[0384] Continuing to refer to Figure 18B, the user interface 1820 may also include one or more recommended device setting entries, such as a single device dimension setting entry 1822, a space dimension setting entry 1823, and a function dimension setting entry 1824. Among them, the single device dimension setting entry 1822 can be used by the user to select one or more devices (regardless of the space to which the device belongs or the functional category to which the device belongs) as recommended devices, the space dimension setting entry 1823 can be used by the user to select one or more categories (such as lighting, sunshade, audio and video entertainment, etc.) of devices in one or more spaces (such as living rooms, bedrooms, etc.) in the entire home as recommended devices, and the function dimension setting entry 1824 can be used by the user to set and select one or more categories of devices in the entire home as recommended devices.
[0385] Among them, the specific process of selecting the recommended device under a single device dimension is similar to the specific process of selecting the recommended device under a single device dimension when customizing the device recommendation principle of "time" mentioned above. Please refer to the relevant text descriptions of Figures 13C-13F mentioned above, and will not be repeated here.
[0386] Among them, the specific process of selecting the recommended device under the spatial dimension is similar to the specific process of selecting the recommended device under the spatial dimension when the aforementioned "time" device recommendation principle is customized. Please refer to the relevant text descriptions of Figures 14A-14D above, and will not be repeated here.
[0387] Among them, the specific process of selecting the recommended device under the functional dimension is similar to the specific process of selecting the recommended device under the functional dimension when customizing the device recommendation principle of "time" mentioned above. You can refer to the relevant text descriptions of Figures 15A-15D mentioned above, and will not repeat them here.
[0388] Continuing with FIG18B , after the user completes setting the space and recommended devices, illustratively referring to FIG18C , electronic device 100 may display the scene and recommended device information that the user has set up in user interface 1820. It can be seen that the scene set by the user is the home scene, and the user has also selected a recommended device in the single device dimension.
[0389] Continuing to refer to Figure 18C, in some embodiments, in order to facilitate the user to promptly know in which dimension they have selected the recommended device, the electronic device 100 can also display a relevant logo. For example, assuming that the user selects the recommended device in the single device dimension, then the electronic device 100 can display a logo 1825 on the single device dimension setting entry 1822 shown in the user interface 1820. The logo 1825 can be used to prompt the user that the recommended device has been successfully selected in the single device dimension and the content displayed when the device recommendation is completed (such as the device controls, etc.) is set.
[0390] Continuing to refer to FIG18C , after the user completes the scene settings and the recommended device settings, the electronic device 100 may further display option 1826. The electronic device 100 may detect the user's operation (e.g., a click operation) on option 1826. In response to this operation, the electronic device 100 may save the scene settings and recommended device information that the user has completed, and may display the user interface 1810 shown in FIG18D . It can be seen that the user interface 1810 displays an entry 1813 corresponding to the scene added by the user (e.g., the home scene). It is easy to understand that the user can trigger the electronic device 100 to display the user interface 1820 shown in FIG18C by clicking on the entry 1813, thereby allowing the user to view or modify the scene settings and recommended device information that the user has completed.
[0391] Continuing to refer to FIG. 18D , the user interface 1810 may further include an option 1814 , which may be used to delete a scene that has been added by the user.
[0392] It is easy to understand that after the user completes the device recommendation settings, the electronic device 100 can save the user's setting information and send the user's setting information to the server 200, so that the server 200 can subsequently recommend the user's customized device recommendation content based on the user's setting information.
[0393] It is easy to understand that in the case of the above-mentioned customized recommendation, the display method of the content recommended by the device is similar to the aforementioned automatic recommendation. The content recommended by the device can be displayed on the desktop of the electronic device 100, or on other interfaces of the electronic device 100 (such as the off-screen display interface, the lock screen interface, etc.); the display style of the content recommended by the device may include but is not limited to card style and 3D style.
[0394] In an embodiment of the present application, the content of the device recommendation may include not only the controls for controlling the recommended device introduced above, but also controls for triggering the control of the recommended device. For example, for some recommended devices with more complex functions, due to limited display space, it is impossible to display all controls for controlling the recommended device. In this case, a control for triggering the control of the recommended device may be displayed. When the user clicks on the control, the electronic device 100 may display more controls for controlling the recommended device. The user may operate the corresponding controls to enable the electronic device 100 to control the recommended device. The above-mentioned "electronic device 100 displays more controls for controlling the recommended device" may be the electronic device 100 jumping to the application (such as a smart life application) that manages the recommended device to display more controls for controlling the recommended device, or the electronic device 100 directly displays more controls for controlling the recommended device in the form of windows, cards, etc.; and so on.
[0395] In an embodiment of the present application, the content recommended by the device can be displayed floating above the user interface currently displayed by the electronic device 100, or it can be displayed in the user interface currently displayed by the electronic device 100, where the user interface currently displayed by the electronic device 100 can include but is not limited to the desktop, the off-screen display interface, the lock screen interface, the negative one screen interface, and the control center interface.
[0396] In the embodiment of the present application, when automatically recommending devices, server 200 may determine the recommended device content based on an automatic recommendation algorithm model. The automatic recommendation algorithm model used by server 200 may be a variety of models, which are not limited in the embodiment of the present application. Two automatic recommendation algorithm models are exemplarily described below.
[0397] Automatic recommendation algorithm model 1: f(user, t, loc) = Device(t, loc) + Room(t, loc) + Scene(t, loc)
[0398] Among them, f(user, t, loc) can represent the total score of the device recommendation. The value of f(user, t, loc) is the sum of Device(t, loc), Room(t, loc), and Scene(t, loc). Device(t, loc) can represent the score of a single device, Room(t, loc) can represent the score of the space where a single device is located, and Scene(t, loc) can represent the score of a single device in the scene where a single device is located. User can represent the current user, t can represent the time point when the device status changes, and loc can represent the location of the device when the device status changes.
[0399] It is easy to understand that the larger the value of f(user, t, loc), the greater the probability that the device will be recommended. For example, the value of f(user, t, loc) corresponding to device 1 is greater than the value of f(user, t, loc) corresponding to device 2, that is, the recommendation priority of device 1 is higher than the recommendation priority of device 2, then device 1 will be recommended first. In an embodiment of the present application, the electronic device 100 can support the user to manually switch the currently recommended device, and the switched device can be a device with a lower recommendation priority than the currently recommended device. For example, assuming that the currently recommended device is the above-mentioned device 1, after the electronic device 100 detects the user's operation of switching to recommend other devices (for example, clicking the "Change" option shown in the aforementioned Figure 3C), the electronic device 100 can switch the currently recommended device from the above-mentioned device 1 to the above-mentioned device 2.
[0400] Among them, the scores assigned to Device(t, loc), Room(t, loc), and Scene(t, loc) can be determined based on action events, and the above-mentioned action events may include but are not limited to: user controlling the device through the GUI, user controlling the device through the VUI, automatic change of device status, and scene-triggered device status change.
[0401] In a possible implementation, each action event can be set with its corresponding Device (t, loc) value, Room (t, loc) value, and Scene (t, loc) value based on preset rules. The Device (t, loc) value, Room (t, loc) value, and Scene (t, loc) value corresponding to each action event can be the same or different. For example, Device (t, loc), Room (t, loc), and Scene (t, loc) can all be set in advance with a maximum value and a weight value corresponding to the action event, wherein the Device (t, loc) value, Room (t, loc), and Scene (t, loc) value corresponding to each action event can be respectively the product of the maximum value of Device (t, loc) and the weight value of Device (t, loc) corresponding to the action event, the product of the maximum value of Room (t, loc) and the weight value of Room (t, loc) corresponding to the action event, and the product of the maximum value of Scene (t, loc) and the weight value of Scene (t, loc) corresponding to the action event.
[0402] In an embodiment of the present application, the information of each action event can be synchronized to the server 200 so that the server 200 can record the information and further determine the content recommended by the device. For example, when a user controls a device through a GUI or VUI, the server 200 can record the device currently controlled by the user, the method in which the user controls the device (i.e., whether the user controls the device through a GUI or a VUI), the time and location of the user controlling the device, the value of Device(t, loc), the value of Room(t, loc), the value of Scene(t, loc), etc.; for another example, after the device state changes automatically, the server 200 can record the state of the device after the automatic change, the time and location when the device state changes automatically, the value of Device(t, loc), the value of Room(t, loc), the value of Scene(t, loc), etc.; for another example, when a scene triggers a change in the device state, the server 200 can record the state of the device after the scene triggers the change, the time and location when the scene triggers the change in the device state, the value of Device(t, loc), the value of Room(t, loc), the value of Scene(t, loc), etc.
[0403] Refer to Table 1, which illustrates the Device(t, loc) values, Room(t, loc) values, and Scene(t, loc) values corresponding to different action events. It should be understood that the Device(t, loc) values, Room(t, loc) values, and Scene(t, loc) values shown in Table 1 are merely exemplary and should not be construed as limiting this application.
[0404] In some embodiments, after a preset time period (e.g., 1 day, 2 days, etc.), the values of Device(t, loc), Room(t, loc), and Scene(t, loc) may decay according to certain preset rules, with the decayed values being the product of the pre-decay values and the decay coefficient. The decay coefficient may be determined based on the length of the preset time period. For example, the shorter the preset time period, the greater the decay coefficient, and the longer the preset time period, the smaller the decay coefficient. Table 2 illustrates the decay coefficients of Device(t, loc), Room(t, loc), and Scene(t, loc) corresponding to different preset time periods. For example, if the preset time period is 1 day (i.e., the values of Device(t, loc), Room(t, loc), and Scene(t, loc) were recorded 1 day ago), the decay coefficients of Device(t, loc), Room(t, loc), and Scene(t, loc) may all be 0.8. It is understandable that the attenuation coefficients of Device (t, loc), Room (t, loc), and Scene (t, loc) shown in Table 2 are merely exemplary and should not constitute a limitation to the present application.
[0405] From the exemplary values of the above automatic recommendation model 1, Table 1, and Table 2, it can be seen that if the user performs control operations on a device within a certain time range and location range every day, then the probability of the device being recommended will increase; if the user controls a new device compared to before (for example, the user controlled a device 2 days ago and controlled the device again 2 days later), then the probability of the device being recommended will increase.
[0406] Table 1
[0407] Table 2
[0408] In some embodiments, after determining to recommend a device based on the above-mentioned automatic recommendation model, the specific dimension (e.g., single device dimension, spatial dimension, functional dimension, scene dimension) under which the device recommendation is made can be determined based on the value of Device(t, loc), the value of Room(t, loc), and the value of Scene(t, loc). For example, it can be determined which value among the values of Device(t, loc), Room(t, loc), and Scene(t, loc) is the largest. If the value of Device(t, loc) is the largest, the device recommendation can be made under the single device dimension. If the value of Room(t, loc) is the largest, the device recommendation can be made under the spatial dimension or the functional dimension. If the value of Scene(t, loc) is the largest, the device recommendation can be made under the scene dimension.
[0409] Automatic recommendation algorithm model 2: f(user, t, loc) = max{Device(t, loc), Room(t, loc), Scene(t, loc)}
[0410] Among them, f(user, t, loc) can represent the score of device recommendation. The value of f(user, t, loc) is the maximum value among Device(t, loc), Room(t, loc), and Scene(t, loc). Device(t, loc) can represent the score of a single device, Room(t, loc) can represent the score of the space where a single device is located, and Scene(t, loc) can represent the score of a single device in the scene where a single device is located. User can represent the current user, t can represent the time point when the device status changes, and loc can represent the location of the device when the device status changes.
[0411] It is easy to understand that the larger the value of f(user, t, loc), the greater the probability that the device will be recommended.
[0412] In the above-mentioned automatic recommendation algorithm model 2, the method for determining the value of the above-mentioned Device(t, loc), the value of Room(t, loc), and the value of Scene(t, loc), and the method for determining the attenuation coefficient of the above-mentioned Device(t, loc), the attenuation coefficient of Room(t, loc), and the attenuation coefficient of Scene(t, loc) are similar to those in the above-mentioned automatic recommendation algorithm model 1 and will not be repeated here.
[0413] In some embodiments, after determining to make device recommendations based on the above-mentioned automatic recommendation model 2, the specific dimension (e.g., single device dimension, spatial dimension, functional dimension, scene dimension) in which the device recommendation is made can also be determined based on the value of Device(t, loc), the value of Room(t, loc), and the value of Scene(t, loc). For example, if the value of f(user, t, loc) is the same as the value of Device(t, loc), the device recommendation can be made in the single device dimension; if the value of f(user, t, loc) is the same as the value of Room(t, loc), the device recommendation can be made in the spatial dimension or functional dimension; if the value of f(user, t, loc) is the same as the value of Scene(t, loc), the device recommendation can be made in the scene dimension.
[0414] The following describes a software structure of an electronic device 100 provided in an embodiment of the present application.
[0415] FIG19 exemplarily shows a software structure of an electronic device 100 provided in an embodiment of the present application.
[0416] As shown in Figure 19, the software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.
[0417] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: application layer, application framework layer, system library layer, and kernel layer, from top to bottom.
[0418] The application layer can include a series of application packages.
[0419] As shown in FIG19 , the application package may include applications such as camera, gallery, calendar, call, map, smart life, WLAN, Bluetooth, music, video, and short message.
[0420] Among them, Smart Life can be an application for managing smart home devices. For example, the Smart Life application can be used to display home device data such as the operating status and monitoring data of smart home devices; for another example, the Smart Life application can also be used to display controls for controlling smart home devices, so that users can control smart home devices by operating the controls; for another example, the Smart Life application can also be used to provide device recommended content (for example, through cards, 3D, etc.); etc. For details, please refer to the relevant content in the aforementioned embodiments and will not be repeated here.
[0421] It should be noted that the name of the smart life application is only a term used in the embodiments of this application. The meaning it represents has been recorded in the embodiments of this application, and its name does not constitute any limitation to the embodiments of this application.
[0422] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0423] As shown in FIG19 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
[0424] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.
[0425] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0426] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0427] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).
[0428] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0429] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0430] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0431] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0432] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0433] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0434] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0435] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0436] A 2D graphics engine is a drawing engine for 2D drawings.
[0437] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, Bluetooth driver, and sensor driver.
[0438] The following is a schematic structural diagram of an electronic device 100 provided in an embodiment of the present application.
[0439] FIG20 exemplarily shows the structure of an electronic device 100 provided in an embodiment of the present application.
[0440] As shown in Figure 20, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0441] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0442] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0443] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0444] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0445] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0446] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the electronic device 100.
[0447] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0448] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0449] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0450] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0451] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0452] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100 and to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other terminal devices, such as AR devices.
[0453] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0454] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device 100 via the power management module 141.
[0455] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0456] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0457] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0458] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0459] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0460] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0461] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0462] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0463] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0464] In an embodiment of the present application, the display screen 194 can be used to display content recommended by the device.
[0465] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0466] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and other factors. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0467] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0468] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0469] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0470] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0471] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0472] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0473] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0474] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0475] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0476] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0477] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.
[0478] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0479] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.
[0480] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.
[0481] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0482] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0483] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.
[0484] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0485] It should be understood that the electronic device 100 shown in FIG20 is merely an example, and the electronic device 100 may have more or fewer components than shown in FIG20, may combine two or more components, or may have a different component configuration. The various components shown in FIG20 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0486] The following describes the structure of a server 200 provided in an embodiment of the present application.
[0487] FIG21 exemplarily shows the structure of a server 200 provided in an embodiment of the present application.
[0488] As shown in Figure 21, the server 200 may include: one or more processors 2101, memory 2102, communication interface 2103, transmitter 2105, receiver 2106, coupler 2107, and antenna 2108. These components may be connected via a bus 2104 or other means, with Figure 21 using a bus as an example.
[0489] The communication interface 2103 can be used for the server 200 to communicate with other devices, such as the electronic device 100, for communication. Specifically, the communication interface 2103 can be a 3G communication interface, a 4G communication interface, a 5G communication interface, or a communication interface of a future new air interface. Not limited to a wireless communication interface, the server 200 can also be configured with a wired communication interface 2103, such as a local access network (LAN) interface. The transmitter 2105 can be used to transmit and process the signal output by the processor 2101. The receiver 2106 can be used to receive and process the mobile communication signal received by the antenna 2108.
[0490] In some embodiments of the present application, transmitter 2105 and receiver 2106 can be considered a wireless modem. In server 200, the number of transmitters 2105 and receivers 2106 can be one or more. Antenna 2108 can be used to convert electromagnetic energy in a transmission line into electromagnetic waves in free space, or vice versa. Coupler 2107 is used to split the mobile communication signal received by antenna 2108 into multiple paths and distribute them to multiple receivers 2106.
[0491] Memory 2102 is coupled to processor 2101 and is used to store various software programs and / or multiple sets of instructions. Specifically, memory 2102 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 2102 may store a network communication program that can be used to communicate with one or more additional devices, one or more terminal devices, or one or more network devices.
[0492] In some embodiments of the present application, the memory 2102 may be used to store an implementation program on the server 200 side of the device recommendation method provided by one or more embodiments of the present application.
[0493] The processor 2101 may be configured to read and execute computer-readable instructions. Specifically, the processor 2101 may be configured to call a program stored in the memory 2102, such as a program for implementing the device recommendation method provided in one or more embodiments of the present application on the server 200 side, and execute the instructions contained in the program.
[0494] It should be noted that the server 200 shown in FIG. 21 is merely one implementation of an embodiment of the present application. In actual applications, the server 200 may also include more or fewer components, which is not limited here.
[0495] For more details about the functions and working principles of the server 200, please refer to the relevant content in the above embodiments, which will not be repeated here.
[0496] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0497] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0498] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A device recommendation method, characterized in that: The method comprises: The electronic device displays a first component, wherein the first component presents at least one control on the electronic device for controlling or triggering control of at least one smart device, wherein the at least one smart device is a smart device determined to be preferentially recommended among smart devices included in an environment where a user is located, and the at least one control includes a first control; The electronic device detects a first operation of the user on the first control; In response to the first operation, the electronic device controls at least one smart device corresponding to the first control.
2. The method according to claim 1, characterized in that: The electronic device displays the first component at a first moment. After the electronic device displays the first component, the method further includes: The electronic device updates and displays the first component at a second moment, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.
3. The method according to claim 1, characterized in that After the electronic device displays the first component, the method further includes: The electronic device detects that the position of the electronic device switches from the first position to the second position; In response to the switching, the electronic device updates and displays the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.
4. The method according to claim 1, characterized in that After the electronic device displays the first component, the method further includes: The electronic device detects a second operation of the user on the first component; In response to the second operation, the electronic device updates and displays the first component, and at least one control of at least one smart device presented on the updated first component is partially or completely different from at least one control of the at least one smart device presented on the first component before the update.
5. The method according to any one of claims 1 to 4, characterized in that: The first component is displayed in a floating manner on a first user interface of the electronic device; or, The first component is displayed in the first user interface.
6. The method according to claim 5, characterized in that The first user interface is one or more of the following interfaces: desktop, screen-off display interface, lock screen interface, negative one screen interface, and control center interface.
7. The method according to any one of claims 1 to 6, characterized in that: Before the electronic device displays the first component, the method further includes: The electronic device detects a third operation of the user; The electronic device displays a first component, specifically comprising: In response to the third operation, the electronic device displays the first component.
8. The method according to any one of claims 1 to 6, characterized in that: Before the electronic device displays the first component, the method further includes: The electronic device obtains the status information of the at least one smart device; The electronic device displays a first component, specifically comprising: The electronic device displays the first component based on status information of the at least one smart device.
9. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in the style of a permanent card.
10. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in the style of a non-resident card.
11. The method according to claim 7, characterized in that Before the electronic device displays the first component, the electronic device also displays a second control, and the third operation is an operation performed by the user on the second control.
12. The method according to any one of claims 1 to 8, characterized in that: The first component is displayed in 3D style.
13. The method according to any one of claims 1 to 12, characterized in that: The first control is used to control one or more smart devices among the priority recommended smart devices.
14. The method according to any one of claims 1 to 13, characterized in that: The first control is a control for controlling the switch of the smart device; The first operation is a start operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device turns on the at least one smart device corresponding to the first control; or, The first operation is a closing operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device turns off the at least one smart device corresponding to the first control.
15. The method according to any one of claims 1 to 13, characterized in that: The first control is a control for adjusting a function parameter of the smart device, and the first operation is an operation of a user adjusting the function parameter.
16. The method according to claim 15, characterized in that The function parameter is brightness, the first operation is a brightness adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the brightness of the at least one smart device corresponding to the first control; or, The functional parameter is temperature, the first operation is a temperature adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the temperature of the at least one smart device corresponding to the first control; or, The function parameter is volume, the first operation is a volume adjustment operation, and the electronic device controls at least one smart device corresponding to the first control, specifically including: The electronic device adjusts the volume of the at least one smart device corresponding to the first control.
17. The method according to any one of claims 1 to 16, characterized in that: The at least one smart device includes a first smart device, the at least one control includes a third control, and the third control is used to trigger and control the first smart device. The method further includes: The electronic device detects a fourth operation of the user on the third control; In response to the fourth operation, the electronic device displays a second component, where at least one control for controlling the first smart device is presented on the second component, and the at least one control includes a fourth control; The method further comprises: The electronic device detects a fifth operation of the user on the fourth control; In response to the fifth operation, the electronic device controls the first smart device.
18. The method according to any one of claims 1 to 17, characterized in that: The at least one smart device meets one or more of the following conditions: being used periodically by the user, being at a distance from the electronic device that is less than a preset distance threshold, being operated by the user within a preset time period, being in the same network as the electronic device, and being in an abnormal state.
19. The method according to any one of claims 1 to 17, characterized in that: The at least one smart device is determined based on a first preset condition, where the first preset condition includes one or more of the following: a first preset time has arrived, the electronic device is in a first preset position, and the user is in a first preset scene.
20. An electronic device, characterized in that: The electronic device includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method described in any one of claims 1-19.
21. A computer storage medium, characterized in that The computer storage medium stores a computer program, wherein the computer program includes program instructions. When the program instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 19.
Citation Information
Patent Citations
Smart home device control method and device
CN105204354A
Interface display method and apparatus of intelligent home control application
CN106909396A
User behavior-based smart home service recommendation system and method
CN110471301A
Information display method and electronic device
CN111142396A
Device for controlling indoor temperature in advance by predicting the indoor temperature change according to outdoor temperature change with artifcial intelligence, method thereof, and temperature controll system including the same
KR102745023B1