Smart home card display method and electronic equipment

Abstract

The invention provides a smart home card display method and electronic equipment. In the method, in response to a first operation of a user, the electronic device displays a plurality of cards in a stacked manner, and the plurality of cards are in one-to-one association with a plurality of intelligent devices, or the plurality of cards are in one-to-one association with a plurality of intelligent home spaces; the electronic equipment displays a first card on the top layer of the multiple cards which are displayed in a stacked mode, the first card comprises a first control, and the first control is used for controlling the intelligent equipment associated with the first card. According to the scheme, the electronic equipment responds to the first operation, and a plurality of smart home cards can be stacked and displayed on the desktop, so that the display space of the electronic equipment is saved, a user can conveniently search and operate the smart home cards, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of terminal technologies, and in particular, to a smart home card display method and an electronic device. Background Art

[0002] With the development and popularization of whole-house intelligence, the space with smart devices and the number of smart devices in the home environment are increasing. Users' demand for the convenience of the smart device control entry is increasing day by day.

[0003] To solve the above problems, a solution is provided to add cards corresponding to smart devices or cards corresponding to smart home spaces to the desktop. In this solution, cards corresponding to smart devices can be added to the desktop, and the cards can include controls corresponding to the smart devices. Users can directly click on the controls displayed on the cards to control the smart devices without running the smart home application in the foreground, simplifying the user operation.

[0004] However, when a user has many smart devices or smart home spaces, if cards corresponding to each smart device and cards corresponding to smart home spaces are all added to the desktop, it will seriously occupy the desktop space, and at the same time, it will be difficult for the user to quickly find the card corresponding to the smart device they want to operate, affecting the user experience. Summary of the Invention

[0005] This application provides a smart home card display method and an electronic device to provide a convenient smart home card display solution.

[0006] In a first aspect, this application provides a smart home card display method, which can be executed by an electronic device. The method includes: in response to a first operation of a user, stacking and displaying a plurality of cards, where the plurality of cards are associated with a plurality of smart devices one by one, or the plurality of cards are associated with a plurality of smart home spaces one by one; displaying a first card on the top layer of the stacked plurality of cards, where the first card includes a first control for controlling the smart device associated with the first card.

[0007] In the above method, the user can trigger the first operation, and the electronic device, in response to the first operation, can stack and display a plurality of smart home cards on the desktop, thereby saving the display space of the electronic device and facilitating the user to find and operate the smart home cards, improving the user experience. The electronic device displays the first card on the top layer of the stacked plurality of cards, facilitating the user to directly control the smart device associated with the first card.

[0008] In a possible design, the first control is used to control all the smart devices corresponding to the plurality of cards.

[0009] With this design, the first card may include a master control switch for synchronously controlling all smart devices corresponding to multiple cards, so that the user can control multiple smart devices with one key, facilitating the user to perform scenario control on multiple smart devices in the smart home system and enhancing the user experience.

[0010] Optionally, the first control may also be used to control at least one of the multiple smart devices corresponding to the multiple cards. For example, the first control may be used to synchronously control some of the multiple smart devices to meet the user's requirement of operating multiple smart devices simultaneously. Among them, the multiple smart devices corresponding to the multiple cards may be multiple smart devices associated with the multiple cards, or multiple smart devices in multiple smart home spaces associated with the multiple cards.

[0011] In a possible design, the first control is used to control any one of the multiple smart devices corresponding to the multiple cards.

[0012] In a possible design, the first control satisfies at least one of the following conditions: the usage frequency of the first control is greater than or equal to a first preset threshold; the smart device corresponding to the first control is in an operating state; the service corresponding to the first control is in an operating state; the distance between the smart device corresponding to the first control and the electronic device is less than or equal to a second preset threshold; the first control is a user-defined control.

[0013] With this design, the electronic device can display the control corresponding to the smart device with a higher usage frequency or in an operating state in the first card, or the electronic device can display the control of the smart device near the electronic device, or the user can customize the control displayed in the first card, so as to meet the user's need to control smart devices in different usage scenarios.

[0014] In a possible design, the first card is any one of the multiple cards. The first card is associated with a first smart device, and the first card includes the control corresponding to the first smart device; or the first card is associated with a first smart home space, and the first card includes the controls corresponding to at least one smart device in the first smart home space.

[0015] With this design, the electronic device can display the card associated with any smart device or smart home space on the top layer of the multiple stacked cards, facilitating the user to operate the smart device or smart home space.

[0016] In a possible design, the first card is a newly created card, and the first card includes summary information, where the summary information is used to represent information associated with multiple smart devices corresponding to the multiple cards, or the summary information is used to represent information associated with multiple smart home spaces corresponding to the multiple cards.

[0017] With this design, the electronic device can create a first card and display the first card at the top layer of the multiple stacked cards, and the first card can include information associated with multiple smart devices corresponding to the multiple cards. For example, the summary information can include information such as the number, name, and location of the multiple smart devices or multiple smart home spaces stacked and displayed, so that the user can view the information of the multiple smart devices corresponding to the multiple stacked cards in the first card, facilitating the user to find the card corresponding to the smart device they want to control.

[0018] In a possible design, the stacking and displaying of the multiple cards includes: converting the multiple cards from a first style to a second style and stacking and displaying the converted multiple cards.

[0019] With this design, when the electronic device stacks and displays multiple cards, it can adjust the style of the multiple stacked cards.

[0020] In a possible design, the card size corresponding to the second style is larger than the card size corresponding to the first style.

[0021] With this design, when the electronic device stacks and displays multiple cards, it can expand the multiple cards into a larger-sized style, so that more information or controls can be displayed on the cards.

[0022] In a possible design, after displaying the first card at the top layer of the multiple stacked cards, the method further includes: in response to a second operation triggered by the user on the first card, converting the style of the multiple stacked cards from the first style to the second style.

[0023] Optionally, the second operation can be, for example, a horizontal sliding operation.

[0024] With this design, when the electronic device stacks and displays multiple cards, it can adjust the style of the multiple stacked cards according to the user operation, thereby flexibly applying the desktop space of the electronic device.

[0025] In a possible design, after displaying the first card at the top layer of the multiple stacked cards, the method further includes: in response to a third operation triggered by the user on the first card, displaying a device control interface, where the device control interface includes all or part of the controls of the smart devices corresponding to the multiple cards.

[0026] Optionally, an expansion control may be included in the first card, and the third operation may be, for example, a click operation triggered by the user on the expansion control.

[0027] With this design, the electronic device can display a device control interface according to the user's operation. The device control interface may include all or part of the space of the smart devices corresponding to multiple cards, so that the user can quickly find the controls of the smart device to be controlled in the device space interface.

[0028] In a possible design, after the first card is displayed on the top layer of the multiple stacked cards, the method further includes: in response to a fourth operation triggered by the user on the first card, switching the display of the second card on the top layer of the multiple stacked cards, where the second card is the card located below the first card before the user triggers the fourth operation.

[0029] With this design, after the electronic device stacks and displays multiple cards, the user can operate to switch the card displayed on the top layer, facilitating the user to quickly find the card corresponding to the smart device to be controlled.

[0030] In a possible design, the method further includes: in response to a voice command of the user, switching the display of the third card on the top layer of the multiple stacked cards, where the third card is the card indicated to be displayed by the voice command.

[0031] With this design, the user can control the electronic device to switch the card displayed on the top layer through a voice command.

[0032] In a possible design, before the third card is displayed on the top layer of the multiple stacked cards, the method further includes: performing voiceprint recognition according to the voice command of the user to determine the identity information of the user, and determining that the user has voice control authority according to the identity information of the user.

[0033] With this design, voiceprint recognition can be performed on the user's voice command before responding to the user's voice command, which can improve the security of voice control.

[0034] In a possible design, the method further includes: determining a second smart device from the smart devices corresponding to the multiple cards according to the device status of the smart devices corresponding to the multiple cards, and switching the display of the card corresponding to the second smart device on the top layer of the multiple stacked cards.

[0035] In a possible design, the method further includes: determining that the electronic device moves to near a third smart device, and switching the display of the card corresponding to the third smart device on the top layer of the multiple stacked cards.

[0036] In a possible design, the method further includes: switching to display the card corresponding to the fourth smart device on the top layer of the multiple cards in the stacked display, where the fourth smart device is the smart device located in the pointing direction of the electronic device.

[0037] With the above design, the electronic device can switch the card displayed on the top layer according to the device state, device location, or user pointing direction, so that the card associated with the smart device that the user may need to control can be displayed on the top layer, saving the user's operation of manually searching for the card and improving the user experience.

[0038] In a possible design, the first operation is the operation of the user selecting the multiple smart devices or the multiple smart home spaces in the card editing interface; before the multiple cards are stacked and displayed in response to the user's first operation, the method further includes: determining the multiple smart devices corresponding to the first operation or the multiple smart home spaces corresponding to the first operation.

[0039] With this design, when the user selects a smart device or a smart home space associated with a smart home card, the user selects multiple smart devices or multiple smart home spaces, thereby triggering the stacked display of multiple cards, saving the display space of the electronic device.

[0040] In a possible design, the first operation is a tick operation or a drag operation.

[0041] Among them, the tick operation can be that the user clicks on the selection control corresponding to the smart device or the smart home space, and the drag operation can be that the user drags the identifier corresponding to the smart device or the smart home space to the transfer control.

[0042] In a possible design, the first operation is the operation of the user selecting a target smart device in the card editing interface; the stacked display of multiple cards in response to the user's first operation includes: determining that there is already a card corresponding to a second smart device in the electronic device, where the second smart device has the same device type as the target smart device, or the second smart device belongs to the same smart home space as the target smart device; stacking and displaying the card corresponding to the target smart device and the card corresponding to the second smart device.

[0043] In a possible design, the first operation is the operation of the user selecting a target smart home space in the card editing interface; the stacked display of multiple cards in response to the user's first operation includes: determining that there is already a card corresponding to a second smart home space in the electronic device, where the second smart home space has the same type as the target smart home space; stacking and displaying the card corresponding to the target smart home space and the card corresponding to the second smart home space.

[0044] With the above design, when a user selects a single smart device or a single smart home space when choosing a smart device or a smart home space associated with a smart home card, if the electronic device already has cards of the same type, the electronic device can stack and display the card associated with the smart device or smart home space selected by the user with the cards of the same type, saving the display space of the electronic device.

[0045] In a possible design, the multiple cards for stacked display include a fourth card; in response to a fifth operation triggered by the user for creating a fifth card, it is determined that the fifth card is related to the fourth card, and a control corresponding to the fifth smart device or a control corresponding to the fifth smart home space is added to the fourth card; wherein, the fifth card is associated with a fifth smart device or a fifth smart home space, and the fifth card being related to the fourth card includes at least one of the following: the fourth card includes a control corresponding to a smart device of the same device type as the fifth smart device; or the fourth card includes a control corresponding to a smart device in the same smart home space as the fifth smart device; or the fourth card includes a control corresponding to a smart home space of the same type as the fifth smart home space.

[0046] With this design, when the user triggers the creation of a fifth card associated with a fifth smart device or a fifth smart home space, if the multiple cards stacked and displayed by the electronic device include a fourth card related to the fifth card, the electronic device can add a control corresponding to the fifth smart device or a control corresponding to the fifth smart home space to the fourth card, thereby preventing redundancy due to similar cards among the multiple cards for stacked display.

[0047] In a possible design, before stacking and displaying the multiple cards, the method further includes: displaying a control editing interface, where the control editing interface includes controls corresponding to the multiple smart devices, or the control editing interface includes controls corresponding to smart devices in the multiple smart home spaces; in response to the fifth operation of the user, determining the controls included in the multiple cards after stacked display.

[0048] In a possible design, after displaying a first card at the top layer of the multiple cards for stacked display, the method further includes: in response to a sixth operation of the user, displaying a control editing interface; in response to a seventh operation of the user, determining the controls included in the multiple cards after stacked display.

[0049] With the above design, after the user triggers the stacked display of multiple cards or the electronic device has stacked and displayed multiple cards, the user can select the controls to be displayed in the cards in the control editing interface, thereby meeting the personalized needs of the user.

[0050] In a possible design, before stacking and displaying multiple cards, the method further includes: displaying a reminder message for asking the user whether to stack and display the multiple cards.

[0051] In a second aspect, the present application provides an electronic device, which includes a plurality of functional modules; the plurality of functional modules interact with each other to implement the methods executed by the electronic device in the first aspect and its various embodiments. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementations.

[0052] In a third aspect, the present application provides an electronic device, including at least one processor and at least one memory, where computer program instructions are stored in the at least one memory. When the electronic device runs, the at least one processor executes the methods executed by the electronic device in the first aspect and its various embodiments.

[0053] In a fourth aspect, the present application further provides a computer program product containing instructions. When the computer program product runs on a computer, the computer is enabled to execute the methods executed by the electronic device in the first aspect and its various embodiments.

[0054] In a fifth aspect, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer is enabled to execute the methods executed by the electronic device in the first aspect and its various embodiments.

[0055] In a sixth aspect, the present application further provides a chip, which is used to read the computer program stored in a memory and execute the methods executed by the electronic device in any of the above aspects and their various embodiments.

[0056] In a seventh aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement the methods executed by the electronic device in any of the above aspects and their various embodiments. In a possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. The chip system can be composed of chips or can include chips and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 It is a schematic diagram of the architecture of a smart home system provided by an embodiment of the present application;

[0058] Figure 2 It is a display interface diagram of a smart home application provided by an embodiment of the present application;

[0059] Figure 3A desktop schematic diagram of an electronic device provided by an embodiment of the present application;

[0060] Figure 4 A desktop schematic diagram of an electronic device;

[0061] Figure 5 A structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0062] Figure 6 A software structure block diagram of an electronic device provided by an embodiment of the present application;

[0063] Figure 7 A schematic diagram of a smart home card in a smart home application provided by an embodiment of the present application;

[0064] Figure 8 A schematic diagram of a user-triggered stacked display card provided by an embodiment of the present application;

[0065] Figure 9 A schematic diagram of creating a smart home card provided by an embodiment of the present application;

[0066] Figure 10 A schematic diagram of a desktop provided by an embodiment of the present application;

[0067] Figure 11 A schematic diagram of the first stacked display style provided by an embodiment of the present application;

[0068] Figure 12 A schematic diagram of the second stacked display style provided by an embodiment of the present application;

[0069] Figure 13 A schematic diagram of the third stacked display style provided by an embodiment of the present application;

[0070] Figure 14 A schematic diagram of the fourth stacked display style provided by an embodiment of the present application;

[0071] Figure 15 A schematic diagram of an editing card style provided by an embodiment of the present application;

[0072] Figure 16 A schematic diagram of multiple stacked display cards provided by an embodiment of the present application;

[0073] Figure 17 A schematic diagram of creating a smart home card provided by an embodiment of the present application;

[0074] Figure 18 A schematic diagram of a control editing method provided by an embodiment of the present application;

[0075] Figure 19Schematic diagram of a stacked display smart home card provided by an embodiment of the present application;

[0076] Figure 20 Schematic diagram of a voice-switching smart home card provided by an embodiment of the present application;

[0077] Figure 21 Schematic diagram of card switching based on UWB technology provided by an embodiment of the present application;

[0078] Figure 22 Schematic diagram of a smart home card provided by an embodiment of the present application;

[0079] Figure 23 Flowchart of a smart home card display method provided by an embodiment of the present application. Detailed implementation manners

[0080] In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. Among them, in the description of the embodiments of the present application, hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features.

[0081] It should be understood that in the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B may be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one (item) of the following" or its similar expression refers to any combination of these items, including any combination of single (item) or plural items. For example, at least one (item) of a, b, or c may represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be single or multiple.

[0082] With the development and popularization of whole-house intelligence, the space with intelligent devices and the number of intelligent devices in the home environment are increasing, and the user's demand for the convenience of the intelligent device control entrance is increasing day by day. For example, Figure 1 Schematic architecture diagram of a smart home system provided by an embodiment of the present application. Refer to Figure 1 , the smart home space in the home environment may include the living room, the master bedroom, the secondary bedroom, etc. Multiple intelligent devices of the user may be distributed in different smart home spaces, such as Figure 1The middle living room includes a central device, a router, Smart Screen 1, Smart Speaker 1, and Smart Light 1. The master bedroom includes Smart Screen 2, Smart Speaker 2, and Smart Light 2. The secondary bedroom includes Smart Light 3 and a smart aromatherapy machine. It should be noted that Figure 1 only as an example of the architecture of a smart home system, Figure 1 the types and quantities of the smart devices shown, as well as the quantity and partitioning method of the smart home spaces, are only examples rather than limitations. In specific implementations, the smart home system may include more or fewer smart devices. The smart home system can also be applied to a home environment with more or fewer spaces. Figure 1 The smart home spaces shown are partitioned according to the rooms in the home environment. In implementations, the smart home spaces may also have other partitioning methods, which are not limited in the embodiments of this application. In the embodiments of this application, the smart devices can be IoT devices such as smart TVs, smart speakers, and smart washing machines. The embodiments of this application do not limit the types of smart devices.

[0083] Users can control each smart device in the smart home system through their electronic devices. A smart home application can be installed in the electronic device. Information and controls corresponding to each smart device can be displayed in the smart home application. Users can click on the control corresponding to the smart device to control the smart device. For example, Figure 2 is a display interface diagram of a smart home application provided by an embodiment of this application. Refer to Figure 2 , the smart home application can use a card display method to display the information of the smart devices associated with the user account and the controls corresponding to the smart devices, as well as display the devices included in different smart home spaces. Users can click on the control corresponding to the smart device to control the smart device.

[0084] To facilitate users to operate each device in the smart home system, cards corresponding to the smart devices or cards corresponding to the smart home spaces can be added to the desktop. Users can directly control the smart devices through the cards corresponding to the smart devices displayed on the desktop. For example, Figure 3 is a desktop schematic diagram of an electronic device provided by an embodiment of this application. Refer to Figure 3 in (a), cards corresponding to the smart devices can be displayed on the desktop of the electronic device. Information such as the identifier, status, and location of the smart device can be displayed in the cards. Refer to Figure 3 in (b), cards corresponding to the smart home spaces can also be displayed on the desktop of the electronic device. For example, information such as the environmental information of the living room and the quantity of smart devices located in the living room can be displayed in the card corresponding to the living room. Refer to Figure 3In (c) above, the electronic device can also display a card containing controls corresponding to the smart devices. The electronic device can display the controls corresponding to the recommended smart devices in this card, and the user can click the "Change to Another Batch" control to switch the controls displayed in this card.

[0085] However, when the user has a large number of smart devices or smart home spaces, if the cards corresponding to each smart device and the cards corresponding to the smart home spaces are all added to the desktop, such as Figure 4 the desktop of the electronic device shown, too many cards will seriously occupy the desktop space, and at the same time, it will be difficult for the user to quickly find the card corresponding to the smart device they want to operate, affecting the user experience.

[0086] Based on the above problems, the embodiments of the present application provide a smart home card display method to provide a convenient display solution for the smart home control interface. In the smart home card display method provided by the embodiments of the present application, in response to the user's first operation, multiple cards are stacked and displayed; the multiple cards are associated with multiple smart devices one by one, or the multiple cards are associated with multiple smart home spaces one by one. A first card is displayed on the top layer of the multiple cards after the stacked display, and the first card is any one of the multiple cards, or the first card includes a master control control and / or the controls of the smart devices corresponding to the multiple cards, where the controls of the smart devices corresponding to the multiple cards can be the controls of the multiple smart devices associated with the multiple cards, or the controls of the smart devices in the multiple smart home spaces associated with the multiple cards. Through the smart home card display method provided by the embodiments of the present application, the electronic device can stack and display multiple cards, thereby saving desktop space resources, and the embodiments of the present application can provide a first card that facilitates the user to operate multiple smart devices, improving the convenience of smart home control, and further improving the user experience.

[0087] The following introduces the electronic device and the embodiments for using such an electronic device. The electronic device in the embodiments of the present application can be a tablet computer, a mobile phone, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a wearable device, etc. The embodiments of the present application do not impose any restrictions on the specific type of the electronic device.

[0088] In some embodiments of the present application, the electronic device can also be a portable terminal device that further includes other functions such as a personal digital assistant and / or a music player function. Exemplary embodiments of the portable terminal device include, but are not limited to, those equipped with Or a portable terminal device of other operating systems.

[0089] Figure 5 It is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application. As Figure 5 shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0090] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching instructions and executing instructions. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0091] The USB interface 130 is an interface that complies with the USB standard specification. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives inputs from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, the wireless communication module 160, etc.

[0092] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc. The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: The antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0093] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering and amplifying the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves through the antenna 1 and radiate it out. In some embodiments, at least some function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least some function modules of the mobile communication module 150 and at least some modules of the processor 110 can be disposed in the same device.

[0094] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), and so on. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0095] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, such that electronic device 100 can communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0096] The display screen 194 is used to display the display interface of an application, such as the display page of an application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0097] The camera 193 is used to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB, YUV, etc. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0098] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system and the software code of at least one application program, etc. The data storage area can store the data generated during the use of the electronic device 100 (such as the captured images, recorded videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0099] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as pictures and videos are saved in the external memory card.

[0100] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. For example, music playback, recording, etc.

[0101] Among them, the sensor module 180 can include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.

[0102] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194.

[0103] The touch sensor 180C, also known as the "touch panel". The touch sensor 180C can be disposed on the display screen 194. The touch sensor 180C and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor 180C is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180C can also be disposed on the surface of the electronic device 100, at a different position from the display screen 194.

[0104] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys or touch keys. The electronic device 100 can receive key inputs and generate key signal inputs related to the user settings and function controls of the electronic device 100. The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change in battery level, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the electronic device 100.

[0105] It can be understood that Figure 5The components shown do not specifically define the electronic device 100. The electronic device may also include more or fewer components than shown, or combine certain components, or split certain components, or have different component arrangements. In addition, Figure 5 The combination / connection relationships between the components in

[0106] Figure 6 This is a software structure block diagram of an electronic device provided by an embodiment of the present application. As Figure 6 shown, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, namely the application layer, the application framework layer (framework, FWK), the runtime, the system libraries, and the kernel layer.

[0107] The application layer may include a series of application packages. As Figure 6 shown, the application layer may include a camera, settings, a skin module, a user interface (UI), third-party applications, etc. Among them, the third-party applications may include a gallery, a calendar, a call, a map, a navigation, WLAN, Bluetooth, music, video, short messages, etc. In the embodiment of the present application, the application layer may include a target installation package of a target application downloaded by the electronic device from a server, and the function files and layout files in the target installation package are adapted to the electronic device.

[0108] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer may include some predefined functions. As Figure 6 shown, the application framework layer may include a window manager, a content provider, a view system, a telephone manager, a resource manager, and a notification manager.

[0109] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, etc.

[0110] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.

[0111] The telephone manager is used to provide the communication function of the electronic device. For example, the management of call status (including answering, hanging up, etc.).

[0112] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, and so on.

[0113] The notification manager enables applications to display notification information in the status bar. It can be used to convey informative messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background-running application, or a notification that appears in the form of a dialogue window on the screen. For example, prompting text information in the status bar, emitting a prompt tone, vibrating the electronic device, flashing the indicator light, etc.

[0114] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0115] The core library contains two parts: one part is the functional functions that the Java language needs to call, and the other part is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.

[0116] The system library can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing library (e.g.: OpenGL ES), 2D graphics engine (e.g.: SGL), image processing library, etc.

[0117] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0118] The media library supports the playback and recording of a variety of common audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0119] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0120] The 2D graphics engine is a drawing engine for 2D drawing.

[0121] The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.

[0122] The hardware layer may include various sensors, such as an acceleration sensor, a gyroscope sensor, a touch sensor, etc.

[0123] It should be noted that Figure 5 and Figure 6 the structure shown is only an example of the electronic device provided in the embodiments of the present application, and cannot limit the electronic device provided in the embodiments of the present application. In specific implementation, the electronic device may have more or fewer devices or modules than Figure 5 or Figure 6 the structure shown.

[0124] Next, the smart home card display method provided in the embodiments of the present application will be introduced.

[0125] I. The user triggers the stacked display of multiple cards

[0126] In the embodiments of the present application, the cards that the electronic device can display can be associated with smart devices or with a smart home space. For example, Figure 7 is a schematic diagram of a smart home card in a smart home application provided in the embodiments of the present application. Referring to Figure 7 , in the embodiments of the present application, the electronic device can provide various styles of cards. For example, Figure 7 shows card a with a size of 2*2 and card b with a size of 2*4 as examples. Card a is a card associated with a smart speaker. The identification, working status, location, and playback control of the smart speaker can be displayed on card a. The user can click the playback control on card a to control the smart speaker to play audio. Card b is a card associated with the living room. The number of smart devices located in the living room is displayed on card b. For example, Figure 7 shows that there are 5 devices in the living room on card b. The environmental information of the living room, such as air quality, temperature, humidity, etc., can also be displayed on card b. Controls for simultaneously controlling multiple smart devices in the living room can also be displayed on card b. For example, Figure 5 card b in

[0127] In some embodiments of the present application, the user can trigger a first operation, and the electronic device can, in response to the first operation, stack and display multiple cards.

[0128] In an alternative embodiment, the first operation may be an operation in which the user selects multiple cards in the smart home application interface and adds them to the desktop in batches. In response to the first operation, the electronic device may stack and display the multiple cards selected by the user on the desktop.

[0129] For example, Figure 8 FIG. is a schematic diagram of a user triggering stacked display of cards provided by an embodiment of the present application. Refer to Figure 8 In (a), when the electronic device displays the interface of the smart home application, the user can trigger the edit state on any card. For example, the user can long-press any card to trigger the edit state. When in the edit state, the user can select multiple cards. For example, the user triggers a click operation on multiple cards, and then the user can trigger a drag operation on any of the selected cards and drag the multiple cards to the desktop of the electronic device. After the user raises the hand, the electronic device can stack and display the multiple cards on the desktop.

[0130] Again, for example, refer to Figure 8 In (b), the user can trigger the edit state on any card. For example, the user can long-press any card to trigger the edit state. When in the edit state, the electronic device can display a transfer control in the smart home application interface. The user can drag any card to the transfer control. After the user adds multiple cards to the transfer control, the user clicks the "Add to Desktop" control, and the electronic device can stack and display the multiple cards selected by the user on the desktop.

[0131] In another alternative embodiment, the first operation may be an operation in which the user selects multiple smart devices or multiple smart home spaces when creating a smart home card. For example, Figure 9 FIG. is a schematic diagram of creating a smart home card provided by an embodiment of the present application. Refer to Figure 9 , the user can add a blank card to be edited in a display area such as the desktop or the negative first screen of the electronic device. After the user clicks the blank card, the electronic device can jump to display a card editing interface. The card editing interface can display the smart devices or smart home spaces that the user can select. After the user selects multiple smart devices or multiple smart home spaces, the user clicks the confirmation control to trigger the first operation. Refer to Figure 9 In (a), if the user selects multiple smart devices, the electronic device, in response to the first operation, stacks and displays multiple cards associated with the multiple smart devices; refer to Figure 9 In (b), if the user selects multiple smart home spaces, the electronic device stacks and displays multiple cards associated with the multiple smart home spaces.

[0132] In some embodiments, when the user is in Figure 9When selecting a target smart device or a target smart home space in the shown card editing interface, if the electronic device detects that there is already a card of the same type on the desktop, the electronic device displays a reminder message for asking the user whether to merge and stack the display. After the user confirms, the newly created smart home card can be stacked with the existing smart home cards of the same type on the desktop. Among them, the cards of the same type can be one or more of the same card style, the same device type, and the same affiliated space.

[0133] Optionally, in the embodiment of the present application, when the user triggers the creation of a fifth card corresponding to a fifth smart device or a fifth smart home space, if there are multiple cards stacked on the desktop of the electronic device and a fourth card among the multiple cards is related to the fifth card, the electronic device can also add the control corresponding to the fifth smart device or the control corresponding to the fifth smart home space to the fourth card. The fourth card being related to the fifth card can mean that the fourth card and the fifth card are cards of the same type. For example, the fourth card being related to the fifth card can include at least one of the following: the fourth card includes a control corresponding to a smart device with the same device type as the target smart device; or the fourth card includes a control corresponding to a smart device in the same smart home space as the target smart device; or the fourth card includes a control corresponding to a smart home space of the same type as the target smart home space.

[0134] In another alternative implementation, the first operation can also be an operation where the user drags one card onto another card. For example, Figure 10 is a schematic diagram of a desktop provided for an embodiment of the present application. Refer to Figure 10 , on the desktop, there are a card a associated with a smart device a, a card b associated with a smart device b, and a card c associated with a smart device c. The user can long-press the card a and drag the card a to the position of the card b. After the user raises the hand, the electronic device can stack and display the card a and the card b; similarly, the user can long-press the card c and drag the card c to the area where the stacked card a and card b are located. After the user raises the hand, the electronic device can stack and display the card a, the card b, and the card c. In addition, the way that the user drags a card to trigger the stacked display can also be applicable to multiple cards associated with a smart home space, and the repeated parts will not be elaborated.

[0135] Through the smart home card display method provided by the above embodiments, the user can trigger the electronic device to stack and display multiple smart home cards on the desktop, thereby saving the display space of the electronic device, facilitating the user to find and operate the smart home cards, and improving the user experience.

[0136] It should be noted that the above Figures 8 - 10In the illustrated embodiment, the styles of multiple smart home cards after stacked display are only used as an example rather than a limitation. After the user triggers the operation of stacking and displaying multiple cards, there can be various implementation manners for the styles of the stacked multiple cards. Hereinafter, various stacked display styles provided in the embodiments of the present application will be further introduced.

[0137] II. Styles of Multiple Smart Home Cards after Stacked Display

[0138] In an alternative embodiment, when the electronic device stacks and displays multiple smart home cards, the multiple smart home cards can be directly stacked, and the styles of the stacked multiple smart home cards will not change. The electronic device can display any one of the multiple smart home cards on the top layer. For example, Figure 11 is a schematic diagram of the first stacked display style provided in the embodiment of the present application. Referring to Figure 11 (a) therein, after the electronic device stacks and displays the cards associated with multiple smart devices, the top layer of the stacked multiple cards is the card associated with any one smart device, and the original style of the card remains unchanged. Similarly, referring to Figure 11 (b) therein, after the electronic device stacks and displays the cards associated with multiple smart home spaces, the top layer of the stacked multiple cards is the card associated with any one smart home space. In this embodiment, the order of the stacked multiple cards from the top layer to the bottom layer can be the order of clicking and selecting the multiple cards when the user creates the stacked display of the multiple cards, or the order of the stacked multiple cards from the top layer to the bottom layer can also be the order sorted according to the frequency of the user using the smart device. The card associated with the smart device that the user uses most frequently can be located on the top layer. Of course, in specific implementation, the order of the multiple cards can also be arranged in other ways, and the embodiments of the present application do not limit this.

[0139] In another alternative embodiment, after the electronic device stacks and displays multiple smart home cards, the smart home cards can be expanded into a larger size style, so that more information or controls can be displayed on one card. For example, Figure 12 is a schematic diagram of the second stacked display style provided in the embodiment of the present application. Referring to Figure 12 , after the electronic device stacks and displays the cards associated with multiple smart devices, the size of the stacked cards changes from the original 2*2 to 2*4. Referring to Figure 12 , the electronic device can keep the content displayed on the left side of the expanded card consistent with that of the device card before stacking. On the right side of the expanded card, there can be newly added total control controls, and the total control controls can be used to uniformly control the multiple smart devices associated with the stacked multiple cards, such as Figure 12The master control control "one - key all - on" on the right side of the expanded card in the middle can be used to simultaneously start multiple smart devices associated with multiple stacked cards, and the master control control "one - key all - off" can be used to simultaneously turn off multiple smart devices associated with multiple stacked cards.

[0140] In addition, after the electronic device stacks and displays multiple cards, it can create a first card and display the first card on the top layer of the multiple cards displayed in the stack. The first card can include summary information. The summary information is used to represent information associated with multiple smart devices corresponding to multiple cards. For example, the summary information includes the number of multiple smart devices corresponding to the multiple cards displayed in the stack, the space to which they belong, etc.; or the summary information is used to represent information associated with multiple smart home spaces corresponding to multiple cards. For example, the summary information includes the number of multiple smart home spaces corresponding to the multiple cards displayed in the stack. The first card can also display newly added master control controls for synchronously controlling multiple smart devices. For example, Figure 13 This is a schematic diagram of the third stacked display style provided by the embodiment of the present application. Refer to Figure 13 , the electronic device can also display the first card on the top layer of the multiple cards displayed in the stack. On the left side of the first card is the number of smart devices associated with the multiple cards displayed in the stack. For example, Figure 13 if there are 3 cards associated with smart devices stacked and displayed as in Figure 13 , then "3 devices" is displayed on the left side of the first card. On the right side of the first card, master control controls can be displayed. For example, Figure 13 the master control controls "one - key all - on" and "one - key all - off" are displayed on the right side of the first card as in Figure 13 . Optionally, controls corresponding to smart devices can also be displayed on the right side of the first card. For example,

[0141] the "switch" control corresponding to the living room smart light can also be displayed on the right side of the first card as in Figure 14 This is a schematic diagram of the fourth stacked display style provided by the embodiment of the present application. Refer to Figure 14 , after the electronic device stacks and displays cards associated with multiple smart devices, it can expand the cards from 2 * 2 to 2 * 4 and display more information or controls of the smart devices on the cards.

[0142] In the embodiments of the present application, after the electronic device stacks and displays multiple cards, the user can adjust the styles of the stacked cards. For example, the user can trigger the multiple cards stacked on the desktop to enter the editing state, and the user can drag the cards in the editing state to adjust the card styles. For example, Figure 15 is a schematic diagram of editing card styles provided by an embodiment of the present application. Refer to Figure 15 in (a). The user can click on the editing control on the card in the editing state. When the user triggers a drag operation, the stacked cards can be expanded from 2×2 to 2×4. Optionally, the user can also set the styles of the cards after stacking in the settings interface of the electronic device. Refer to Figure 15 in (b). The user can select the styles of the multiple stacked cards in the settings interface.

[0143] Optionally, the styles of the multiple cards stacked on the desktop of the electronic device can also be dynamically adjusted according to user operations. In implementation, after the electronic device displays the first card on the top layer of the multiple stacked cards, the user can trigger a second operation on the first card. The second operation can be, for example, a horizontal sliding operation. The electronic device can switch the styles of the multiple stacked cards from the first style to the second style. For example, Figure 16 is a schematic diagram of multiple stacked cards provided by an embodiment of the present application. Refer to Figure 16 , the size of the multiple cards stacked by the electronic device is 2×2. When the user triggers a horizontal sliding operation on the card displayed on the top layer, the size of the multiple stacked cards can be expanded to 2×4, and more information or controls of smart devices can be displayed on the cards.

[0144] In addition, refer to Figures 11 - 16 the styles of the multiple smart home cards after stacking shown. Due to the limited display space of the cards, when there are more controls corresponding to the smart devices, the electronic device can directly display the controls with higher user usage frequency on the cards, or when the user creates a smart home card, the user can select the controls to be directly displayed on the cards. For example, Figure 17 is a schematic diagram of creating a smart home card provided by an embodiment of the present application. Refer to Figure 17, after the user selects the "Smart Light" and "Smart Speaker" in the living room on the card editing interface, the electronic device can jump to display the control editing interface. The control editing interface includes the controls corresponding to the "Smart Light" and the controls corresponding to the "Smart Speaker". The user can select the controls to be directly displayed on the card. For example, if the user selects the "Switch" control and the "Color Temperature" control corresponding to the "Smart Light", and the user selects the "Switch" control, the "Next Song" control, and the "Timer" control corresponding to the "Smart Speaker", then the electronic device displays the "Switch" control and the "Color Temperature" control in the card corresponding to the "Smart Light" after stacked display, and the electronic device displays the "Switch" control, the "Next Song" control, and the "Timer" control in the card corresponding to the "Smart Speaker" after stacked display. When the user clicks the "Expand" control in the card, the electronic device can display all the controls corresponding to the "Smart Light" and all the controls corresponding to the "Smart Speaker", and the user can re-edit the controls that can be directly displayed on the card. Such as Figure 18 FIG. Figure 18 is a schematic diagram of a control editing method provided by an embodiment of the present application. After the user clicks the "Expand" control in the smart home card, the electronic device displays the controls corresponding to multiple smart devices associated with multiple stacked cards. The user can long-press any control to trigger the card editing state, and the user can choose to add the control to the card, or the user can also choose to delete the controls displayed in the card.

[0145] III. Switching method of the top card of multiple cards after stacked display

[0146] In the smart home card display method provided by the embodiment of the present application, after the electronic device stacks and displays multiple cards, the electronic device displays the first card on the top layer of the multiple stacked cards. The user can trigger a fourth operation on the first card, and the electronic device switches and displays the second card on the top layer of the multiple stacked cards. Optionally, the user can trigger the electronic device to switch different cards to the top layer display through different gestures. For example, when the user triggers a single-finger swipe operation on the first card, the second card can be the card located on the next layer below the first card; when the user triggers a multi-finger swipe operation on the first card, the second card can be the card located at the bottom layer among the multiple stacked cards. For example, Figure 19 FIG. Figure 19 is a schematic diagram of a smart home card after stacked display provided by an embodiment of the present application. Refer to Figure 19 , after the electronic device stacks and displays the cards associated with multiple smart devices, the user triggers a swipe operation, and the electronic device switches and displays the card located on the top layer.

[0147] In some embodiments, the electronic device supports the user to switch smart home cards through voice control. For example, Figure 20 FIG. Figure 20 is a schematic diagram of voice switching of smart home cards provided by an embodiment of the present application. Refer to Figure 20When the user wishes to switch to the top card among multiple cards displayed in a stack, the user can utter a voice command for controlling the switch. The smart device near the user can collect the user's audio and send the collected audio to the server. The server can perform intent analysis on the audio collected by the smart device, determine the control command corresponding to the audio, and send the control command to the electronic device. The electronic device can switch the smart home card according to the control command. For example, the user can say: Display the smart screen card. The smart device with the audio collection function and near the user can collect the user's audio and send the user's audio to the server. After the server performs intent analysis on the audio, it sends the control command for instructing to switch and display the smart screen card to the electronic device. The electronic device can search for the multiple cards displayed in a stack that include the card associated with the smart screen and switch the card associated with the smart screen to the top of the multiple cards displayed in a stack.

[0148] Optionally, the above voice control solution can also add a step of performing voiceprint recognition on the user to enhance the security of voice control. In a specific implementation, the user can wake up the smart device capable of collecting audio by using a wake-up word and then utter the voice control command. After the smart device collects the user's audio and sends it to the server, the server can perform voiceprint recognition on the user's audio to determine the user's identity. After the server determines that the user is a user with voice control permission, it then sends the control command obtained from the intent analysis to the electronic device.

[0149] It can be understood that the voice control method provided in the embodiments of the present application can also be used to create smart home cards. For example, the user can trigger a voice command for adding a card associated with a smart device or a smart home space. For example, the user can say: "Create a card for the master bedroom", "Create a card for the smart speaker in the master bedroom", etc.; or the user can trigger a voice command for replacing an existing card with a card associated with a certain smart device or a smart home space. For example, the user can say: "Replace the smart speaker card in the master bedroom with the table lamp card in the master bedroom", etc.

[0150] In some embodiments, the electronic device can switch the top card after stacked display according to the device state and / or the location information of the electronic device. Among them, the device state can include, for example, at least one of the device operating state and the working mode. Optionally, the electronic device can switch the card associated with the smart device with the device state of "working" to the top of the multiple cards displayed in a stack, so as to facilitate the user to quickly operate the smart device. For example, when the multiple cards displayed in a stack include a card associated with a smart washing machine and the smart washing machine is working, the electronic device can switch the card associated with the smart washing machine to the top of the multiple cards displayed in a stack, so that the user can control the smart washing machine in a timely manner.

[0151] Optionally, the electronic device can also obtain the location information of the electronic device through indoor positioning technology, or obtain the relative position information between the electronic device and the smart device, so as to determine the smart device closest to the electronic device or the smart home space where the electronic device is located. After the electronic device is turned on, the electronic device can switch the card associated with the smart device closest to the electronic device or the smart home space associated card to the top layer of the multiple cards displayed in a stacked manner.

[0152] In an optional implementation, the electronic device can obtain the identifier of the smart device through ultra-wideband (UWB) technology, and switch the display of the card associated with the smart device according to the identifier of the smart device. For example, Figure 21 FIG. is a schematic diagram of card switching based on UWB technology provided by an embodiment of the present application. Refer to Figure 21 , when the user hopes to switch the display of the smart speaker card, the electronic device can point to the smart speaker and maintain it for a period of time. The electronic device can perform information interaction with the smart speaker based on UWB technology, and the electronic device obtains the identifier of the smart speaker. The electronic device searches for multiple cards displayed in a stacked manner including the card associated with the smart speaker according to the identifier of the smart speaker, and switches the card corresponding to the smart speaker to the top layer of the multiple cards after stacked display.

[0153] In addition, in the embodiment of the present application, the electronic device can also switch the controls and / or the order of the controls displayed in the card according to the device state and / or the location information of the electronic device. Optionally, the electronic device can move the "off" control corresponding to the smart device with the device state of "working" to a position in the area for displaying controls in the card that is closer to the front. Optionally, the electronic device can also determine the smart device closest to the electronic device according to the location information of the electronic device, and move the control corresponding to the smart device to a position in the area for displaying controls in the card that is closer to the front. For example, Figure 22 FIG. is a schematic diagram of a smart home card provided by an embodiment of the present application. Assume Figure 22 the multiple cards displayed in a stacked manner in the shown interface include the card associated with the smart living room light, the card associated with the smart living room speaker, and the card associated with the smart washing machine. Refer to Figure 22 In (a) of, the number of smart devices is displayed on the left side of the top card of the multiple cards after stacked display, and the total control control of "one-key full open", the "switch" control corresponding to the smart living room light, and the "switch" control corresponding to the smart speaker are displayed on the right side. Refer to Figure 22 In (b) of, when the smart washing machine is in a working state, the electronic device can display the "pause" control corresponding to the smart washing machine on the right side of the top card. Refer to Figure 22In (c) below, when the user moves the electronic device near the smart speaker, the electronic device can move the "switch" control corresponding to the smart speaker to a more prominent position for easier user operation.

[0154] Based on the same concept, an embodiment of this application also provides a smart home card display method, which can be executed by an electronic device. Figure 23 It is a flowchart of a smart home card display method provided by an embodiment of this application. Refer to Figure 23 This method includes the following steps:

[0155] S2301: In response to the user's first operation, the electronic device stacks and displays multiple cards.

[0156] Among them, the multiple cards are associated with multiple smart devices one by one, or the multiple cards are associated with multiple smart home spaces one by one.

[0157] S2302: The electronic device displays a first card on the top layer of the multiple stacked cards. The first card includes a first control, and the first control is used to control the smart device associated with the first card.

[0158] It should be noted that for the smart home card display method shown in this application Figure 23 in specific implementation, reference can be made to the above embodiments of this application, and repeated parts will not be elaborated.

[0159] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions executed by the electronic device in each method described in the embodiments of this application. Such as executing Figure 23 the steps executed by the electronic device in the shown embodiment. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementation.

[0160] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory. Computer program instructions are stored in the at least one memory. When the electronic device runs, the at least one processor executes the functions executed by the electronic device in each method described in the embodiments of this application. Such as executing Figure 23 the steps executed by the electronic device in the shown embodiment.

[0161] Based on the above embodiments, this application also provides a computer program product containing instructions. When the computer program product runs on a computer, it causes the computer to execute each method described in the embodiments of this application.

[0162] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer is caused to execute the various methods described in the embodiments of the present application.

[0163] Based on the above embodiments, the present application further provides a chip, which is used to read the computer program stored in a memory and implement the various methods described in the embodiments of the present application.

[0164] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the various methods described in the embodiments of the present application. In a possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. The chip system can be composed of chips or can include chips and other discrete devices.

[0165] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0166] The present application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one or more flows and / or Figure 1 blocks or multiple blocks.

[0167] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means for implementing the functions specified in Figure 1 one or more flows and / or Figure 1 blocks or multiple blocks.

[0168] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are performed on the computer or other programmable apparatus to produce a computer-implemented process, thereby providing instructions for implementing the steps of the process Figure 1 in one process or multiple processes and / or blocks Figure 1 in one block or multiple blocks, the functions specified in the claims.

[0169] Obviously, those skilled in the art can make various changes and modifications to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to cover these modifications and variations.

Claims

1. A method for card display, characterized in that, applied to an electronic device, the method includes: In response to a first operation of the user, stacking and displaying a plurality of cards, where the plurality of cards are associated with a plurality of smart devices one by one, or the plurality of cards are associated with a plurality of smart home spaces one by one; Displaying a first card on the top layer of the plurality of stacked cards, where the first card includes a first control for controlling the smart device associated with the first card.

2. The method according to claim 1, characterized in that, the first control is used to control all the smart devices corresponding to the plurality of cards.

3. The method according to claim 1, characterized in that, the first control is used to control any one of the plurality of smart devices corresponding to the plurality of cards.

4. The method according to claim 3, characterized in that, the first control satisfies at least one of the following conditions: The usage frequency of the first control is greater than or equal to a first preset threshold; The smart device corresponding to the first control is in an operating state; The service corresponding to the first control is in an operating state; The distance between the smart device corresponding to the first control and the electronic device is less than or equal to a second preset threshold; The first control is a user-defined control.

5. The method according to any one of claims 1-4, characterized in that, the first card is any one of the plurality of cards, the first card is associated with a first smart device, and the first card includes a control corresponding to the first smart device; or the first card is associated with a first smart home space, and the first card includes controls corresponding to at least one smart device in the first smart home space.

6. The method according to any one of claims 1-5, characterized in that, the first card is a newly created card, and the first card includes summary information for representing information associated with the plurality of smart devices corresponding to the plurality of cards, or the summary information is used to represent information associated with the plurality of smart home spaces corresponding to the plurality of cards.

7. The method according to any one of claims 1-6, characterized in that, stacking and displaying a plurality of cards includes: Converting the plurality of cards from a first style to a second style, and stacking and displaying the converted plurality of cards.

8. The method according to claim 7, characterized in that, the card size corresponding to the second style is larger than the card size corresponding to the first style.

9. The method according to any one of claims 1-6, characterized in that, after displaying the first card on the top layer of the plurality of stacked cards, the method further includes: In response to a second operation triggered by the user on the first card, converting the style of the plurality of stacked cards from a first style to a second style.

10. The method according to any one of claims 1-9, characterized in that, after displaying the first card on the top layer of the plurality of stacked cards, the method further includes: In response to a third operation triggered by a user on the first card, a device control interface is displayed, and the device control interface includes all or part of the controls of the smart devices corresponding to the multiple cards.

11. The method according to any one of claims 1-10, characterized in that, after the first card is displayed on the top layer of the multiple cards displayed in a stack, the method further includes: in response to a fourth operation triggered by the user on the first card, a second card is switched and displayed on the top layer of the multiple cards displayed in a stack, and the second card is the card located below the first card before the user triggers the fourth operation.

12. The method according to any one of claims 1-11, characterized in that, the method further includes: in response to a voice command of the user, a third card is switched and displayed on the top layer of the multiple cards displayed in a stack, and the third card is the card indicated by the voice command to be displayed.

13. The method according to any one of claims 1-12, characterized in that, the method further includes: a second smart device is determined from the smart devices corresponding to the multiple cards according to the device states of the smart devices corresponding to the multiple cards, and the card corresponding to the second smart device is switched and displayed on the top layer of the multiple cards displayed in a stack.

14. The method according to any one of claims 1-13, characterized in that, the method further includes: it is determined that the electronic device moves to the vicinity of a third smart device, and the card corresponding to the third smart device is switched and displayed on the top layer of the multiple cards displayed in a stack.

15. The method according to any one of claims 1-14, characterized in that, the method further includes: the card corresponding to a fourth smart device is switched and displayed on the top layer of the multiple cards displayed in a stack, and the fourth smart device is the smart device located in the pointing direction of the electronic device.

16. The method according to any one of claims 1-15, characterized in that, the first operation is an operation in which the user selects the multiple smart devices or the multiple smart home spaces in a card editing interface; before the multiple cards are displayed in a stack in response to the first operation of the user, the method further includes: determining the multiple smart devices corresponding to the first operation or the multiple smart home spaces corresponding to the first operation.

17. The method according to claim 16, characterized in that, the first operation is a tick operation or a drag operation.

18. The method according to any one of claims 1-15, characterized in that, the first operation is an operation in which the user selects a target smart device in the card editing interface; the step of displaying the multiple cards in a stack in response to the first operation of the user includes: determining that there is already a card corresponding to a second smart device in the electronic device, and the device type of the second smart device is the same as that of the target smart device, or the smart home space to which the second smart device belongs is the same as that of the target smart device; displaying the card corresponding to the target smart device and the card corresponding to the second smart device in a stack.

19. The method according to any one of claims 1-15, characterized in that, The first operation is an operation in which the user selects a target smart home space on the card editing interface; In response to the user's first operation, a plurality of cards are stacked and displayed, including: Determine that there is a card corresponding to a second smart home space in the electronic device, and the type of the second smart home space is the same as that of the target smart home space; Stack and display the card corresponding to the target smart home space and the card corresponding to the second smart home space.

20. The method according to any one of claims 1-19, wherein, The plurality of stacked and displayed cards include a fourth card; In response to a fifth operation triggered by the user for creating a fifth card, determine that the fifth card is related to the fourth card, and add a control corresponding to the fifth smart device or a control corresponding to the fifth smart home space to the fourth card; wherein, the fifth card is associated with a fifth smart device or a fifth smart home space, and the fifth card being related to the fourth card includes at least one of the following: the fourth card includes a control corresponding to a smart device having the same device type as the fifth smart device; or the fourth card includes a control corresponding to a smart device in the same smart home space as the fifth smart device; or the fourth card includes a control corresponding to a smart home space having the same type as the fifth smart home space.

21. The method according to any one of claims 1-20, wherein, Before the plurality of cards are stacked and displayed, the method further includes: Display a control editing interface, where the control editing interface includes controls corresponding to the plurality of smart devices, or the control editing interface includes controls corresponding to smart devices in the plurality of smart home spaces; In response to the user's fifth operation, determine the controls included in the plurality of cards after stacking and displaying.

22. The method according to any one of claims 1-21, wherein, After a first card is displayed on the top layer of the plurality of stacked and displayed cards, the method further includes: In response to the user's sixth operation, display a control editing interface; In response to the user's seventh operation, determine the controls included in the plurality of cards after stacking and displaying.

23. An electronic device, wherein, It includes at least one processor, the at least one processor is coupled with at least one memory, and the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1-22.

24. A computer-readable storage medium, wherein, Instructions are stored in the computer-readable storage medium, and when it runs on a computer, it causes the computer to execute the method according to any one of claims 1-22.

Images