Card display method and electronic device
By stacking display of smart home cards, the problem of desktop space occupation and search caused by excessive smart devices and space is solved, achieving the effect of saving space and improving user experience.
Patent Information
- Application Number
- PCT/CN2024/126862
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-27
- Filing Date
- 2024-10-23
- Publication Date
- 2025-06-05
AI Technical Summary
When the user has a lot of smart devices or smart home space, if the card corresponding to each smart device and the card corresponding to the smart home space are added to the desktop, it will seriously occupy the desktop space, making it difficult for users to quickly find the cards corresponding to the smart device they want to operate, affecting the user experience.
A card display method is provided, in response to a first operation of the user, a plurality of cards are displayed stacked and displayed, the plurality of cards are associated with or with a plurality of smart devices one by one, and the first card is displayed on the top level, and the first card includes controls for controlling the associated smart devices.
It saves the display space of electronic devices, facilitates users to find and operate smart home cards, improves user experience, and provides convenient ways for users to control multiple smart devices with one click.
Smart Images

Figure CN2024126862_05062025_PF_FP_ABST
Abstract
Description
Card display method and electronic device
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of the People's Republic of China on November 27, 2023, with application number 202311597887.2 and application name "A Smart Home Card Display Method and Electronic Device", the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of terminal technology, and in particular to a card display method and electronic device. Background Art
[0004] With the development and popularization of whole-house intelligence, the space for smart devices and the number of smart devices in the home environment are increasing, and users' demand for convenient control entrances for smart devices is increasing.
[0005] In order to solve the above problems, a solution is provided for adding cards corresponding to smart devices or smart home spaces to the desktop. In this solution, cards corresponding to smart devices can be added to the desktop, and the cards can include controls corresponding to the smart devices. Users can directly click on the controls displayed on the cards to control the smart devices without running smart home applications in the foreground, thereby simplifying user operations.
[0006] However, when a user has a large number of smart devices or smart home spaces, if the cards corresponding to each smart device and smart home space are added to the desktop, it will seriously occupy the desktop space and make it difficult for the user to quickly find the card corresponding to the smart device they want to operate, affecting the user experience.
[0007] Summary of the Invention
[0008] The present application provides a card display method and an electronic device, which are used to provide a convenient display solution for smart home cards.
[0009] In a first aspect, the present application provides a card display method that can be performed by an electronic device. The method includes: in response to a first user operation, stacking and displaying multiple cards, wherein the multiple cards are associated one-to-one with multiple smart devices, or the multiple cards are associated one-to-one with multiple smart home spaces; and displaying a first card on the top layer of the stacked multiple cards, wherein the first card includes a first control, and the first control is used to control the smart device associated with the first card.
[0010] In the above method, a user can trigger a first operation. In response to the first operation, the electronic device can stack and display multiple smart home cards on the desktop, thereby saving display space on the electronic device and making it easier for the user to find and operate smart home cards, thereby improving the user experience. The electronic device displays the first card on the top layer of the stacked multiple cards, allowing the user to directly control the smart device associated with the first card.
[0011] In one possible design, the first control is used to control all smart devices corresponding to the multiple cards.
[0012] Through this design, the first card can include a master control switch for synchronously controlling all smart devices corresponding to multiple cards, so that users can control multiple smart devices with one click, making it easier for users to perform scenario-based control of multiple smart devices in the smart home system and improving user experience.
[0013] Optionally, the first control can also be used to control at least one of the multiple smart devices corresponding to the multiple cards. For example, the first control can be used to synchronously control some of the multiple smart devices to meet the user's need to operate multiple smart devices simultaneously. The multiple smart devices corresponding to the multiple cards can be multiple smart devices associated with multiple cards, or multiple smart devices in multiple smart home spaces associated with multiple cards.
[0014] In one possible design, the first control is used to control any one of the multiple smart devices corresponding to the multiple cards.
[0015] In one possible design, the first control satisfies at least one of the following conditions: the usage frequency of the first control is greater than or equal to a first preset threshold; the smart device corresponding to the first control is in running state; the service corresponding to the first control is in running state; the distance between the smart device corresponding to the first control and the electronic device is less than or equal to a second preset threshold; the first control is a user-defined control.
[0016] Through this design, the electronic device can display controls corresponding to smart devices that the user uses frequently or is in operation in the first card, or the electronic device can display controls for smart devices near the electronic device, or the user can customize the controls displayed in the first card, thereby meeting the user's needs to control smart devices in different usage scenarios.
[0017] In one possible design, the first card is any one of the multiple cards, the first card is associated with a first smart device, and the first card includes controls corresponding to the first smart device; or the first card is associated with a first smart home space, and the first card includes controls corresponding to at least one smart device in the first smart home space.
[0018] Through this design, the electronic device can display the card associated with any smart device or smart home space on the top layer of multiple stacked cards, making it easier for users to operate the smart device or smart home space.
[0019] In one possible design, the first card is a newly created card, and the first card includes summary information, where the summary information is used to represent information associated with multiple smart devices corresponding to the multiple cards, or the summary information is used to represent information associated with multiple smart home spaces corresponding to the multiple cards.
[0020] Through this design, the electronic device can create a new first card and display the first card on the top layer of multiple stacked cards. The first card can include information associated with multiple smart devices corresponding to the multiple cards. For example, the summary information can include the number, name, location and other information of the multiple stacked smart devices or multiple smart home spaces. In this way, the user can view the information of the multiple smart devices corresponding to the multiple stacked cards in the first card, which is convenient for the user to find the card corresponding to the smart device he wants to control.
[0021] In one possible design, stacking and displaying multiple cards includes: converting the multiple cards from a first style to a second style, and stacking and displaying the converted multiple cards.
[0022] With this design, when the electronic device displays multiple cards in a stack, it can adjust the styles of the stacked cards.
[0023] In a possible design, the card size corresponding to the second style is larger than the card size corresponding to the first style.
[0024] With this design, an electronic device can expand multiple cards into a larger size when displaying multiple cards in a stack, thereby displaying more information or controls in the cards.
[0025] In one possible design, after the first card is displayed on the top layer of the stacked multiple cards, the method further includes: in response to a second operation triggered by the user on the first card, converting the style of the stacked multiple cards from the first style to the second style.
[0026] Optionally, the second operation may be, for example, a horizontal sliding operation.
[0027] With this design, when the electronic device displays multiple cards in a stack, the styles of the stacked cards can be adjusted according to user operations, thereby flexibly utilizing the desktop space of the electronic device.
[0028] In one possible design, after the first card is displayed on the top layer of the multiple stacked cards, the method further includes: in response to a third operation triggered by the user on the first card, displaying a device control interface, wherein the device control interface includes all or part of the controls of the smart devices corresponding to the multiple cards.
[0029] Optionally, the first card may include an expansion control, and the third operation may be, for example, a click operation triggered by the user on the expansion control.
[0030] Through this design, the electronic device can display the device control interface according to the user operation. The device control interface may include all or part of the space of the smart devices corresponding to multiple cards, so that the user can quickly find the controls of the smart device they want to control in the device space interface.
[0031] In one possible design, after the first card is displayed on the top layer of the stacked multiple cards, the method further includes: in response to a fourth operation triggered by the user on the first card, switching to display a second card on the top layer of the stacked multiple cards, where the second card is the card located below the first card before the user triggers the fourth operation.
[0032] With this design, after an electronic device displays multiple cards in a stack, the user can switch the card displayed on the top layer, making it easier for the user to quickly find the card corresponding to the smart device they want to control.
[0033] In one possible design, the method further includes: in response to a user's voice command, switching to display a third card on the top layer of the multiple stacked cards, wherein the third card is the card indicated to be displayed by the voice command.
[0034] Through this design, users can control electronic devices to switch the cards displayed on the top layer through voice commands.
[0035] In one possible design, before displaying the third card on the top layer of the stacked multiple cards, the method further includes: performing voiceprint recognition based on the user's voice instructions to determine the user's identity information, and determining that the user has voice control authority based on the user's identity information.
[0036] Through this design, the user's voice command can be recognized by voiceprint before responding to the user's voice command, which can improve the security of voice control.
[0037] In one possible design, the method further includes: determining a second smart device from the smart devices corresponding to the multiple cards based on the device status of the smart devices corresponding to the multiple cards, and switching to display the card corresponding to the second smart device on the top layer of the multiple cards displayed in the stack.
[0038] In one possible design, the method further includes: determining that the electronic device has moved near a third smart device, and switching to display a card corresponding to the third smart device on the top layer of the multiple cards displayed in the stack.
[0039] In one possible design, the method further includes: switching to display a card corresponding to the fourth smart device on the top layer of the multiple stacked cards, where the fourth smart device is a smart device located in the pointing direction of the electronic device.
[0040] Through the above design, the electronic device can switch the cards displayed on the top layer according to the device status, device location or the direction the user is pointing, so that the cards associated with the smart devices that the user may need to control can be displayed on the top layer, eliminating the need for the user to manually search for cards and improving the user experience.
[0041] In one possible design, the first operation is the operation of the user selecting the multiple smart devices or the multiple smart home spaces in the card editing interface; before the stack displays multiple cards in response to the user's first operation, the method also includes: determining the multiple smart devices corresponding to the first operation or the multiple smart home spaces corresponding to the first operation.
[0042] Through this design, when the user selects a smart device or smart home space associated with a smart home card, he or she can select multiple smart devices or multiple smart home spaces, thereby triggering the stacking display of multiple cards, saving display space on the electronic device.
[0043] In one possible design, the first operation is a check operation or a drag operation.
[0044] Among them, the check operation can be that the user clicks the selection control corresponding to the smart device or smart home space, and the drag operation can be that the user drags the icon corresponding to the smart device or smart home space to the transfer control.
[0045] In one possible design, the first operation is the operation of the user selecting a target smart device in the card editing interface; in response to the user's first operation, multiple cards are stacked and displayed, including: determining that a card corresponding to a second smart device already exists in the electronic device, the second smart device is of the same device type as the target smart device, or the second smart device belongs to the same smart home space as the target smart device; and stacking and displaying the card corresponding to the target smart device and the card corresponding to the second smart device.
[0046] In one possible design, the first operation is the operation of the user selecting the target smart home space in the card editing interface; in response to the user's first operation, multiple cards are stacked and displayed, including: determining that a card corresponding to a second smart home space already exists in the electronic device, and the second smart home space is of the same type as the target smart home space; and stacking and displaying the card corresponding to the target smart home space and the card corresponding to the second smart home space.
[0047] Through the above design, when the user selects a smart device or smart home space associated with a smart home card, if a single smart device or a single smart home space is selected, if the electronic device already has a card of the same type, the electronic device can stack and display the card associated with the smart device or smart home space selected by the user with the card of the same type, saving display space of the electronic device.
[0048] In one possible design, the multiple stacked cards include a fourth card; in response to a fifth operation triggered by the user to create a fifth card, it is determined that the fifth card is related to the fourth card, and the controls corresponding to the fifth smart device or the controls corresponding to the fifth smart home space are added to the fourth card; wherein, the fifth card is associated with the fifth smart device or the fifth smart home space, and the fifth card is related to the fourth card, including at least one of the following: the fourth card includes controls corresponding to a smart device of the same device type as the fifth smart device; or the fourth card includes controls corresponding to a smart device in the same smart home space as the fifth smart device; or the fourth card includes controls corresponding to a smart home space of the same type as the fifth smart home space.
[0049] Through this design, when the user triggers the creation of a fifth card associated with a fifth smart device or a fifth smart home space, if the multiple cards stacked and displayed by the electronic device include a fourth card related to the fifth card, the electronic device can add the controls corresponding to the fifth smart device or the controls corresponding to the fifth smart home space to the fourth card, thereby preventing the existence of similar cards in the multiple cards stacked and displayed and causing redundancy.
[0050] In one possible design, before the stacked display of multiple cards, the method further includes: displaying a control editing interface, the control editing interface including controls corresponding to the multiple smart devices, or the control editing interface including controls corresponding to the smart devices in the multiple smart home spaces; and determining, in response to the user's fifth operation, the controls included in the multiple cards after the stacked display.
[0051] In one possible design, after the first card is displayed on the top layer of the stacked multiple cards, the method further includes: displaying a control editing interface in response to a sixth operation of the user; and determining the controls included in the stacked multiple cards in response to a seventh operation of the user.
[0052] Through the above design, after the user triggers the stacking and display of multiple cards or the electronic device has stacked and displayed multiple cards, the user can select the controls displayed in the card in the control editing interface to meet the user's personalized needs.
[0053] In one possible design, before stacking and displaying the multiple cards, the method further includes: displaying a reminder message, wherein the reminder message is used to ask the user whether to stack and display the multiple cards.
[0054] In a second aspect, the present application provides an electronic device comprising multiple functional modules; the multiple functional modules interact with each other to implement the method performed by the electronic device in the first aspect and its respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.
[0055] In a third aspect, the present application provides an electronic device comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the method executed by the electronic device in the above-mentioned first aspect and its various embodiments.
[0056] In a fourth aspect, the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method executed by the electronic device in the above-mentioned first aspect and its various embodiments.
[0057] In a fifth aspect, the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the method executed by the electronic device in the above-mentioned first aspect and its various embodiments.
[0058] In a sixth aspect, the present application further provides a chip, which is used to read a computer program stored in a memory and execute the method executed by the electronic device in any of the above aspects and its various embodiments.
[0059] In a seventh aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement any of the above aspects and the method executed by an electronic device in each embodiment thereof. In one possible design, the chip system also includes a memory for storing the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] FIG1 is a schematic diagram of the architecture of a smart home system provided by an embodiment of the present application;
[0061] FIG2 is a display interface diagram of a smart home application provided in an embodiment of the present application;
[0062] FIG3 is a schematic diagram of a desktop of an electronic device provided in an embodiment of the present application;
[0063] FIG4 is a schematic diagram of a desktop of an electronic device;
[0064] FIG5 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
[0065] FIG6 is a software structure block diagram of an electronic device provided in an embodiment of the present application;
[0066] FIG7 is a schematic diagram of a smart home card in a smart home application provided by an embodiment of the present application;
[0067] FIG8 is a schematic diagram of a user-triggered stacked display of cards provided in an embodiment of the present application;
[0068] FIG9 is a schematic diagram of creating a smart home card according to an embodiment of the present application;
[0069] FIG10 is a schematic diagram of a desktop provided in an embodiment of the present application;
[0070] FIG11 is a schematic diagram of a first stacking display mode provided in an embodiment of the present application;
[0071] FIG12 is a schematic diagram of a second stacking display mode provided in an embodiment of the present application;
[0072] FIG13 is a schematic diagram of a third stacking display style provided in an embodiment of the present application;
[0073] FIG14 is a schematic diagram of a fourth stacking display mode provided in an embodiment of the present application;
[0074] FIG15 is a schematic diagram of editing a card style provided in an embodiment of the present application;
[0075] FIG16 is a schematic diagram of a plurality of cards displayed in a stacked manner according to an embodiment of the present application;
[0076] FIG17 is a schematic diagram of creating a smart home card according to an embodiment of the present application;
[0077] FIG18 is a schematic diagram of a control editing method provided in an embodiment of the present application;
[0078] FIG19 is a schematic diagram of a stacked display of smart home cards provided in an embodiment of the present application;
[0079] FIG20 is a schematic diagram of a voice-switching smart home card provided in an embodiment of the present application;
[0080] FIG21 is a schematic diagram of card switching based on UWB technology provided in an embodiment of the present application;
[0081] FIG22 is a schematic diagram of a smart home card provided in an embodiment of the present application;
[0082] Figure 23 is a flowchart of a smart home card display method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0083] In order to make the purpose, technical solutions and advantages of the embodiments of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features.
[0084] It should be understood that in the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.
[0085] With the development and popularization of whole-house intelligence, the space for smart devices and the number of smart devices in the home environment are increasing, and users have an increasing demand for convenient access to smart device control entrances. For example, Figure 1 is a schematic diagram of the architecture of a smart home system provided in an embodiment of the present application. Referring to Figure 1, the smart home space in a home environment may include a living room, a master bedroom, a second bedroom, etc. A user's multiple smart devices can be distributed in different smart home spaces. For example, in Figure 1, the living room includes a hub device, a router, a smart screen 1, a smart speaker 1, and a smart light 1. The master bedroom includes a smart screen 2, a smart speaker 2, and a smart light 2. The second bedroom includes a smart light 3 and a smart aromatherapy machine. It should be noted that Figure 1 is only an example of the architecture of a smart home system. The types and numbers of smart devices shown in Figure 1 and the number and division method of smart home spaces are only used as an example and not as a limitation. In a specific implementation, the smart home system may include more or fewer smart devices. The smart home system can also be applied to a home environment with more space or less space. The smart home space shown in Figure 1 is divided according to the rooms in the home environment. In implementation, the smart home space may also have other division methods, which are not limited in this embodiment of the present application. In the embodiments of the present application, the smart device may be an IoT device such as a smart TV, a smart speaker, a smart washing machine, etc. The embodiments of the present application do not limit the type of the smart device.
[0086] The user can control each smart device in the smart home system through the user's electronic device. The electronic device may be installed with a smart home application. The smart home application may display information and controls corresponding to each smart device. The user can click on the controls corresponding to the smart device to control the smart device. For example, Figure 2 is a display interface diagram of a smart home application provided in an embodiment of the present application. Referring to Figure 2, the smart home application can use a card display method to display information about smart devices associated with the user account and controls corresponding to the smart devices, as well as display devices included in different smart home spaces. The user can click on the controls corresponding to the smart devices to control the smart devices.
[0087] In order to facilitate the user to operate each device in the smart home system, cards corresponding to smart devices or cards corresponding to smart home spaces can be added to the desktop, and users can directly control smart devices through the cards corresponding to smart devices displayed on the desktop. For example, Figure 3 is a desktop schematic diagram of an electronic device provided in an embodiment of the present application. Referring to (a) in Figure 3, cards corresponding to smart devices can be displayed on the desktop of the electronic device, and the cards can display information such as the identification, status, and location of the smart devices. Referring to (b) in Figure 3, cards corresponding to smart home spaces can also be displayed on the desktop of the electronic device, such as the card corresponding to the living room can display information such as the environmental information of the living room and the number of smart devices located in the living room. Referring to (c) in Figure 3, the electronic device can also display a card containing controls corresponding to smart devices. The electronic device can display recommended controls corresponding to smart devices in the card, and the user can click "Change a batch" controls to switch the controls displayed in the card.
[0088] However, when a user has a large number of smart devices or smart home spaces, if the cards corresponding to each smart device and the cards corresponding to the smart home space are added to the desktop, as shown in the desktop of the electronic device in Figure 4, too many cards will seriously occupy the desktop space, and at the same time make it difficult for the user to quickly find the card corresponding to the smart device they want to operate, affecting the user experience.
[0089] Based on the above problems, an embodiment of the present application provides a smart home card display method to provide a convenient display solution for a smart home control interface. In the smart home card display method provided in the embodiment of the present application, in response to a first operation of the user, multiple cards are stacked and displayed; the multiple cards are associated one-to-one with multiple smart devices, or the multiple cards are associated one-to-one with multiple smart home spaces. A first card is displayed on the top layer of the multiple cards after the stacked display, and the first card is any card among the multiple cards, or the first card includes a master control control and / or controls for smart devices corresponding to multiple cards, wherein the controls for smart devices corresponding to multiple cards can be controls for multiple smart devices associated with multiple cards, or controls for smart devices in multiple smart home spaces associated with multiple cards. Through the smart home card display method provided in the embodiment of the present application, an electronic device can stack and display multiple cards, thereby saving desktop space resources, and the embodiment of the present application can provide a first card that is convenient for users to operate multiple smart devices, improve the convenience of smart home control, and thus improve user experience.
[0090] The following describes electronic devices and embodiments for using such electronic devices. The electronic devices of the embodiments of the present application may be tablet computers, mobile phones, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), wearable devices, etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.
[0091] In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions such as a personal digital assistant and / or a music player. Or portable terminal devices with other operating systems.
[0092] FIG5 is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application. As shown in FIG5 , the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.
[0093] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device 100. The controller may generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. The processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. This memory may store instructions or data that have just been used or are being recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces the processor 110's waiting time, and thus improves system efficiency.
[0094] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160.
[0095] The wireless communication functionality of electronic device 100 can be implemented using antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0096] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0097] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0098] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0099] The display screen 194 is used to display the display interface of the application, such as displaying the display page of the application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0100] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0101] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, and the software code of at least one application, etc. The data storage area can store data generated during the use of the electronic device 100 (such as captured images, recorded videos, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0102] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as pictures and videos can be stored on the external memory card.
[0103] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0104] Among them, the sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.
[0105] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .
[0106] Touch sensor 180C, also known as a "touch panel," can be disposed on display screen 194. The touch sensor 180C and display screen 194 form a touch screen, also known as a "touch screen." Touch sensor 180C is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via display screen 194. In other embodiments, touch sensor 180C can also be disposed on the surface of electronic device 100, at a location different from that of display screen 194.
[0107] The buttons 190 include a power button, a volume button, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive button input and generate key signal input related to the user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
[0108] It is understood that the components shown in FIG5 do not constitute a specific limitation on the electronic device 100. The electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. In addition, the combination / connection relationship between the components in FIG5 may also be adjusted and modified.
[0109] Figure 6 is a block diagram of the software structure of an electronic device provided in an embodiment of the present application. As shown in Figure 6, the software structure of the electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer (framework, FWK), the runtime (runtime) and system library, and the kernel layer.
[0110] The application layer may include a series of application packages. As shown in Figure 6, the application layer may include a camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. In an embodiment of the present application, the application layer may include a target installation package of a target application that the electronic device requests to download from a server, and the function files and layout files in the target installation package are adapted to the electronic device.
[0111] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer may include some predefined functions. As shown in Figure 6, the application framework layer may include a window manager, content provider, view system, telephony manager, resource manager, and notification manager.
[0112] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.
[0113] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.
[0114] The phone manager is used to provide communication functions for electronic devices, such as call status management (including answering, hanging up, etc.).
[0115] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0116] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.
[0117] The runtime includes the core library and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0118] The core library consists of two parts: one containing the Java language's callable functions and the other containing the operating system's core libraries. The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0119] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and an image processing library.
[0120] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0121] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0122] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0123] A 2D graphics engine is a drawing engine for 2D drawings.
[0124] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0125] The hardware layer can include various sensors, such as accelerometers, gyroscopes, touch sensors, etc.
[0126] It should be noted that the structures shown in Figures 5 and 6 are merely examples of electronic devices provided in the embodiments of the present application and do not limit the electronic devices provided in the embodiments of the present application. In specific implementations, the electronic device may have more or fewer devices or modules than those in the structures shown in Figures 5 or 6.
[0127] The following is an introduction to the smart home card display method provided in the embodiment of the present application.
[0128] 1. User triggers stacking to display multiple cards
[0129] In embodiments of the present application, the cards displayed by electronic devices can be associated with smart devices or smart home spaces. For example, Figure 7 illustrates a schematic diagram of a smart home card in a smart home application provided by an embodiment of the present application. Referring to Figure 7, electronic devices in embodiments of the present application can provide a variety of card styles. For example, Figure 7 illustrates a 2x2 card a and a 2x4 card b. Card a is a card associated with a smart speaker. Card a displays the smart speaker's logo, operating status, location, and playback controls. Users can click the playback controls on card a to control audio playback on the smart speaker. Card b is a card associated with the living room. Card b displays the number of smart devices located in the living room. For example, in Figure 7, card b shows that there are five devices in the living room. Card b can also display environmental information for the living room, such as air quality, temperature, and humidity. Card b can also display controls for simultaneously controlling multiple smart devices in the living room. For example, in Figure 5, card b includes controls for "Temperature Control Fully On," "Temperature Control Fully Off," "Lighting Fully On," and "Lighting Fully Off."
[0130] In some implementations of the present application, a user may trigger a first operation, and the electronic device may stack and display multiple cards in response to the first operation.
[0131] In an optional implementation, the first operation may be an operation in which the user selects multiple cards in the smart home application interface and adds them to the desktop in batches. In response to the first operation, the electronic device may stack and display the multiple cards selected by the user on the desktop.
[0132] For example, Figure 8 is a schematic diagram of a user-triggered stacked display of cards provided in an embodiment of the present application. Referring to (a) in Figure 8, when an electronic device displays the interface of a smart home application, the user can trigger the edit state on any card, such as long pressing any card to trigger the edit state. When in the edit state, the user can select multiple cards, such as triggering a single-click operation on multiple cards, and then the user can trigger a drag operation on any selected card and drag multiple cards to the desktop of the electronic device. After the user raises his hand, the electronic device can stack and display multiple cards on the desktop.
[0133] For another example, referring to (b) in FIG8 , a user can trigger an edit state on any card, such as by long-pressing any card. When in the edit state, the electronic device can display a transfer control in the interface of the smart home application. The user can drag any card to the transfer control. After the user adds multiple cards to the transfer control and clicks the "Add to Desktop" control, the electronic device can stack and display the multiple cards selected by the user on the desktop.
[0134] In another optional embodiment, the first operation may be an operation in which the user selects multiple smart devices or multiple smart home spaces when creating a smart home card. For example, FIG9 is a schematic diagram of creating a smart home card provided in an embodiment of the present application. Referring to FIG9 , the user can add a blank card to be edited in a display area such as the desktop or negative one screen of the electronic device. After the user clicks the blank card, the electronic device can jump to display the card editing interface. The card editing interface can display the smart devices or smart home spaces that the user can select. The user can select multiple smart devices or multiple smart home spaces and click the confirmation control to trigger the first operation. Referring to (a) in FIG9 , if the user selects multiple smart devices, the electronic device responds to the first operation and stacks and displays multiple cards associated with the multiple smart devices; referring to (b) in FIG9 , if the user selects multiple smart home spaces, the electronic device stacks and displays multiple cards associated with the multiple smart home spaces.
[0135] In some embodiments, when a user selects a target smart device or target smart home space in the card editing interface shown in FIG9 , if the electronic device detects that a card of the same type already exists on the desktop, the electronic device displays a prompt message asking the user whether to merge and stack the cards. After the user confirms, the newly created smart home card can be stacked and displayed with the existing smart home cards of the same type on the desktop. Cards of the same type can include one or more of the following: the same card style, the same device type, or the same space.
[0136] Optionally, in an embodiment of the present application, when the user triggers the creation of a fifth card corresponding to a fifth smart device or a fifth smart home space, if the desktop of the electronic device has stacked and displayed multiple cards, and a fourth card among the multiple cards is related to the fifth card, the electronic device may also add controls corresponding to the fifth smart device or controls corresponding to the fifth smart home space to the fourth card. The fourth card being related to the fifth card may be that the fourth card and the fifth card are cards of the same type. For example, the fourth card being related to the fifth card may include at least one of the following: the fourth card includes controls corresponding to a smart device of the same device type as the target smart device; or the fourth card includes controls corresponding to a smart device in the same smart home space as the target smart device; or the fourth card includes controls corresponding to a smart home space of the same type as the target smart home space.
[0137] In another optional implementation, the first operation can also be an operation in which the user drags a card onto another card. For example, Figure 10 is a schematic diagram of a desktop provided in an embodiment of the present application. Referring to Figure 10, the desktop includes card a associated with smart device a, card b associated with smart device b, and card c associated with smart device c. The user can long press card a and drag card a to the position of card b. After the user raises his hand, the electronic device can stack and display card a and card b; similarly, the user can long press card c and drag card c to the area where cards a and card b are stacked. After the user raises his hand, the electronic device can stack and display card a, card b, and card c. In addition, the method in which the user drags the card to trigger the stacked display can also be applied to multiple cards associated with the smart home space, and the repetitions will not be repeated.
[0138] Through the smart home card display method provided in the above embodiment, the user can trigger the electronic device to stack and display multiple smart home cards on the desktop, thereby saving the display space of the electronic device, and making it easier for the user to find and operate the smart home cards, thereby improving the user experience.
[0139] It should be noted that the styles of the multiple smart home cards after stacking and displaying in the embodiments shown in Figures 8 to 10 above are only an example and not a limitation. After the user triggers the operation of stacking and displaying multiple cards, the styles of the multiple cards displayed in the stack can be implemented in many ways. The following further introduces the various stacking display styles provided in the embodiments of the present application.
[0140] 2. The style of multiple smart home cards after stacking
[0141] In an optional embodiment, when an electronic device stacks and displays multiple smart home cards, it can directly stack the multiple smart home cards. The styles of the stacked multiple smart home cards will not change, and the electronic device can display any of the multiple smart home cards on the top layer. For example, Figure 11 is a schematic diagram of the first stacking display style provided in an embodiment of the present application. Referring to (a) in Figure 11, after the electronic device stacks and displays multiple smart device-associated cards, the top layer of the stacked multiple cards is a card associated with any smart device, and the original style of the card is not changed. Similarly, referring to (b) in Figure 11, after the electronic device stacks and displays multiple smart home space-associated cards, the top layer of the stacked multiple cards is a card associated with any smart home space. In this embodiment, the order of the stacked multiple cards from top to bottom can be the order in which the user clicks to select multiple cards when creating the stacked display, or the order of the stacked multiple cards from top to bottom can also be the order in which the user uses the smart devices most frequently, and the card associated with the smart device that the user uses most frequently can be at the top layer. Of course, in the specific implementation, the order of the multiple cards can also be arranged in other ways, and the embodiment of the present application is not limited to this.
[0142] In another optional embodiment, after the electronic device stacks and displays multiple smart home cards, the smart home cards can be expanded to a larger size, so that more information or controls can be displayed in one card. For example, Figure 12 is a schematic diagram of the second stacked display style provided in an embodiment of the present application. Referring to Figure 12, after the electronic device stacks and displays multiple cards associated with smart devices, the size of the stacked displayed cards changes from the original 2*2 to 2*4. Referring to Figure 12, the electronic device can display the same content on the left side of the expanded card as the device card before stacking, and the right side of the expanded card can be a newly added master control control. The master control control can be used to uniformly control multiple smart devices associated with the stacked displayed multiple cards, such as the master control "One-key full open" on the right side of the expanded card in Figure 12, which can be used to simultaneously start multiple smart devices associated with the stacked multiple cards, and the master control "One-key full close" can be used to simultaneously close multiple smart devices associated with the stacked multiple cards.
[0143] In addition, after stacking and displaying multiple cards, the electronic device may create a new first card and display the first card on top of the stacked cards. The first card may include summary information indicating information associated with multiple smart devices corresponding to the multiple cards, such as the number of smart devices corresponding to the stacked cards and the spaces to which they belong; or summary information indicating information associated with multiple smart home spaces corresponding to the multiple cards, such as the number of smart home spaces corresponding to the stacked cards. The first card may also display a newly added master control for synchronously controlling multiple smart devices. Figure 13 is a schematic diagram of a third stacked display style provided in an embodiment of the present application. Referring to Figure 13, the electronic device may also display the first card on top of the stacked cards. The left side of the first card displays the number of smart devices associated with the stacked cards. For example, if cards associated with three smart devices are stacked and displayed as shown in Figure 13, the left side of the first card displays "3 devices". The right side of the first card may display master controls, such as the master controls for "One-touch all on" and "One-touch all off" displayed on the right side of the first card as shown in Figure 13. Optionally, controls corresponding to smart devices can also be displayed on the right side of the first card. For example, the right side of the first card in Figure 13 can also display a "switch" control corresponding to the living room smart light, so that controls corresponding to smart devices selected by the user or frequently used by the user can be displayed in a location that is convenient for the user to operate. Furthermore, referring to the stacked display style provided in Figure 13, the card can also include an "expand" control, and the user can trigger a third operation. The third operation can be the user clicking to expand the control. The electronic device can display a device control interface, which includes all or part of the controls of the smart devices corresponding to multiple cards. The user can select the control corresponding to the smart device they want to control.
[0144] In some embodiments, after the electronic device stacks and displays multiple smart home cards, it can expand the smart home cards to a larger size and display the controls corresponding to the smart devices without adding a new master control. Figure 14 is a schematic diagram of the fourth stacked display style provided in an embodiment of the present application. Referring to Figure 14, after the electronic device stacks and displays multiple smart device-associated cards, it can expand the cards from 2*2 to 2*4 and display more smart device information or controls on the cards.
[0145] In an embodiment of the present application, after the electronic device displays multiple cards in a stack, the user can adjust the style of the stacked cards. For example, the user can trigger multiple cards displayed in a stack on the desktop to enter an editing state, and the user can drag the card in the editing state to adjust the card style. For example, Figure 15 is a schematic diagram of an editing card style provided in an embodiment of the present application. Referring to (a) in Figure 15, the user can click on the edit control on the card in the editing state. When the user triggers the drag operation, the stacked displayed cards can be expanded from 2*2 to 2*4. Optionally, the user can also set the style of the stacked displayed cards in the settings interface of the electronic device. Referring to (b) in Figure 15, the user can select the style of the multiple stacked displayed cards in the settings interface.
[0146] Optionally, the styles of multiple cards stacked and displayed by the electronic device on the desktop can also be dynamically adjusted according to user operations. During implementation, after the electronic device displays the first card on the top layer of the stacked multiple cards, the user can trigger a second operation on the first card. The second operation can be, for example, a horizontal sliding operation, and the electronic device can switch the style of the stacked multiple cards from the first style to the second style. For example, Figure 16 is a schematic diagram of a stacked display of multiple cards provided in an embodiment of the present application. Referring to Figure 16, the size of the multiple cards stacked and displayed by the electronic device is 2*2. The user triggers a horizontal sliding operation on the card displayed on the top layer. The size of the stacked multiple cards can be expanded to 2*4, and more information or controls of smart devices can be displayed on the cards.
[0147] In addition, referring to the styles of multiple smart home cards after stacking and displaying as shown in Figures 11-16, due to the limited display space of the cards, when there are many controls corresponding to smart devices, the electronic device can directly display the controls that the user uses more frequently on the card, or the user can select the controls that are directly displayed on the card when creating a smart home card. For example, Figure 17 is a schematic diagram of creating a smart home card provided by an embodiment of the present application. Referring to Figure 17, after the user selects "smart lights" and "smart speakers" in the living room in the card editing interface, the electronic device can jump to the control editing interface. The control editing interface includes controls corresponding to "smart lights" and controls corresponding to "smart speakers". The user can select controls that are directly displayed on the card. For example, if the user selects the "switch" control and "color temperature control" corresponding to "smart lights", and the user selects the "switch" control, "next song" control, and "timer" control corresponding to "smart speakers", the electronic device will display the "switch" control and "color temperature" control in the card corresponding to "smart lights" after the stacking display, and the electronic device will display the "switch" control, "next song" control, and "timer" control in the card corresponding to "smart speakers" after the stacking display. When a user clicks the "Expand" control in a card, the electronic device can display all controls corresponding to the "smart light" and all controls corresponding to the "smart speaker." The user can re-edit the controls that can be directly displayed on the card. As shown in Figure 18, a schematic diagram of a control editing method provided in an embodiment of the present application shows that after the user clicks the "Expand" control in a smart home card, the electronic device displays controls corresponding to multiple smart devices associated with multiple stacked cards. The user can long-press any control to trigger the card editing state. The user can choose to add controls to the card, or the user can choose to delete controls displayed in the card.
[0148] 3. How to switch the top card of multiple cards after stacking
[0149] In the smart home card display method provided in an embodiment of the present application, after the electronic device stacks and displays multiple cards, the electronic device displays the first card on the top layer of the stacked display multiple cards. The user can trigger the fourth operation on the first card, and the electronic device switches to display the second card on the top layer of the stacked display multiple cards. Optionally, the user can trigger the electronic device to switch different cards to the top layer display through different gestures. For example, when the user triggers a single-finger sliding operation on the first card, the second card may be a card located under the first card; when the user triggers a multi-finger sliding operation on the first card, the second card may be a card located at the bottom layer of the stacked display multiple cards. For example, Figure 19 is a schematic diagram of a stacked display smart home card provided in an embodiment of the present application. Referring to Figure 19, after the electronic device stacks and displays multiple smart device-associated cards, the user triggers a sliding operation, and the electronic device switches to display the card at the top layer.
[0150] In some embodiments, the electronic device supports users to switch smart home cards through voice control. For example, Figure 20 is a schematic diagram of a voice-switched smart home card provided in an embodiment of the present application. Referring to Figure 20, when the user wants to switch the top card of multiple cards displayed in a stack, the user can say a voice command to control the switch. The smart device located near the user can collect the user's audio and send the collected audio to the server. The server can perform intent analysis on the audio collected by the smart device, determine the control instruction corresponding to the audio, and send the control instruction to the electronic device. The electronic device can switch the smart home card according to the control instruction. For example, the user can say: Show smart screen card. The smart device with audio collection function and located near the user can collect the user's audio and send the user's audio to the server. After the server performs intent analysis on the audio, it sends the control instruction for indicating the switch display of the smart screen card to the electronic device. The electronic device can search for multiple cards displayed in a stack including the card associated with the smart screen, and switch the card associated with the smart screen to the top layer of the multiple cards displayed in the stack.
[0151] Optionally, the above voice control solution can also include a voiceprint recognition step to enhance the security of voice control. In a specific implementation, a user can wake up a smart device capable of collecting audio using a wake-up word and then speak a voice control command. The smart device collects the user's audio and sends it to a server. The server can then perform voiceprint recognition on the user's audio to determine the user's identity. After confirming that the user has voice control permission, the server then sends the control command obtained from the intent analysis to the electronic device.
[0152] It is understandable that the voice control method provided in the embodiments of the present application can also be used to create smart home cards. For example, the user can trigger a voice command to add a card associated with a smart device or smart home space, such as the user can say: "Create a card for the master bedroom", "Create a card for the smart speaker in the master bedroom", etc.; or the user can trigger a voice command to replace an existing card with a card associated with a smart device or smart home space, such as the user can say: "Replace the smart speaker card in the master bedroom with the desk lamp card in the master bedroom", etc.
[0153] In some embodiments, the electronic device can switch the top card of the stacked display based on the device status and / or the location information of the electronic device, wherein the device status can include, for example, at least one of the device operating status and the working mode. Optionally, the electronic device can switch the card associated with the smart device with the device status of "working" to the top layer of the stacked display of multiple cards, so as to facilitate the user to quickly operate the smart device. For example, when the multiple cards displayed in the stack include a card associated with a smart washing machine, and the smart washing machine is working, the electronic device can switch the card associated with the smart washing machine to the top layer of the stacked display of multiple cards, so that the user can control the smart washing machine in time.
[0154] Optionally, the electronic device may also obtain its location information through indoor positioning technology, or obtain relative position information between the electronic device and a smart device, thereby determining the smart device closest to the electronic device or the smart home space in which the electronic device is located. After the screen turns on, the electronic device may switch the card associated with the smart device closest to the electronic device or the card associated with the smart home space in which the electronic device is located to the top of the stacked display of multiple cards.
[0155] In an optional implementation, the electronic device can obtain the identification of the smart device through ultra wideband (UWB) technology, and switch the display of the card associated with the smart device according to the identification of the smart device. For example, Figure 21 is a schematic diagram of card switching based on UWB technology provided in an embodiment of the present application. Referring to Figure 21, when the user wants to switch to display the card of the smart speaker, the user can point the electronic device at the smart speaker and maintain it for a period of time. The electronic device can interact with the smart speaker based on UWB technology for information, and the electronic device obtains the identification of the smart speaker. The electronic device searches for multiple stacked cards including cards associated with the smart speaker based on the identification of the smart speaker, and switches the card corresponding to the smart speaker to the top layer of the multiple cards after the stacked display.
[0156] In addition, in an embodiment of the present application, the electronic device may also switch the controls and / or the order of controls displayed in the card based on the device status and / or the location information of the electronic device. Optionally, the electronic device may move the "off" control corresponding to the smart device with the device status "working" to the front of the area for displaying controls in the card. Optionally, the electronic device may also determine the smart device closest to the electronic device based on the location information of the electronic device, and move the control corresponding to the smart device to the front of the area for displaying controls in the card. For example, FIG22 is a schematic diagram of a smart home card provided in an embodiment of the present application. Assume that the multiple cards stacked and displayed in the interface shown in FIG22 include cards associated with the living room smart light, cards associated with the living room smart speaker, and cards associated with the smart washing machine. Referring to FIG22 (a), the left side of the top card of the stacked multiple cards displays the number of smart devices, and the right side displays the "one-button full on" master control, the "switch" control corresponding to the smart living room smart light, and the "switch" control corresponding to the smart speaker. Referring to FIG22 (b), when the smart washing machine is in working state, the electronic device may display the "pause" control corresponding to the smart washing machine on the right side of the top card. Referring to (c) in Figure 22, when a user moves an electronic device near a smart speaker, the electronic device can move the "switch" control corresponding to the smart speaker to a front position for easier user operation.
[0157] Based on the same concept, the embodiment of the present application also provides a smart home card display method, which can be executed by an electronic device. Figure 23 is a flow chart of a smart home card display method provided by an embodiment of the present application. Referring to Figure 23, the method includes the following steps:
[0158] S2301: In response to a first operation by the user, the electronic device stacks and displays multiple cards.
[0159] Among them, multiple cards are associated one-to-one with multiple smart devices, or multiple cards are associated one-to-one with multiple smart home spaces.
[0160] S2302: The electronic device displays a first card on a top layer of a plurality of stacked cards. The first card includes a first control, and the first control is used to control a smart device associated with the first card.
[0161] It should be noted that when implementing the smart home card display method shown in Figure 23 of the present application, reference can be made to the above embodiments of the present application, and the repeated parts will not be repeated.
[0162] Based on the above embodiments, the present application further provides an electronic device, comprising multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of the present application. For example, the steps performed by the electronic device in the embodiment shown in FIG23 are executed. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.
[0163] Based on the above embodiments, the present application further provides an electronic device, comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor performs the functions performed by the electronic device in each method described in the embodiments of the present application. For example, the steps performed by the electronic device in the embodiment shown in FIG. 23 are performed.
[0164] Based on the above embodiments, the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the methods described in the embodiments of the present application.
[0165] Based on the above embodiments, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer executes the methods described in the embodiments of the present application.
[0166] Based on the above embodiments, the present application further provides a chip, which is used to read a computer program stored in a memory to implement the various methods described in the embodiments of the present application.
[0167] Based on the above embodiments, the present application provides a chip system, which includes a processor for supporting a computer device to implement the various methods described in the embodiments of the present application. In one possible design, the chip system also includes a memory for storing the necessary programs and data for the computer device. The chip system can be composed of a chip or can include a chip and other discrete devices.
[0168] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0169] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or box in the flow chart and / or block diagram, as well as the combination of the flow chart and / or box in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flow charts and / or one or more boxes in the block diagram.
[0170] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0171] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0172] Obviously, those skilled in the art may make various modifications and variations to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.
Claims
1. A card display method, characterized in that: Applied to electronic equipment, the method comprises: In response to a first operation of the user, a plurality of cards are stacked and displayed, wherein the plurality of cards are associated one by one with a plurality of smart devices, or the plurality of cards are associated one by one with a plurality of smart home spaces; A first card is displayed on the top layer of the plurality of cards displayed in the stack, wherein the first card includes a first control, and the first control is used to control a smart device associated with the first card.
2. The method according to claim 1, characterized in that The first control is used to control all smart devices corresponding to the multiple cards.
3. The method according to claim 1, characterized in that The first control is used to control any one of the multiple smart devices corresponding to the multiple cards.
4. The method according to claim 3, characterized in that The first control satisfies at least one of the following conditions: The usage frequency of the first control is greater than or equal to a first preset threshold; The smart device corresponding to the first control is in running state; The service corresponding to the first control is in running state; The distance between the smart device corresponding to the first control and the electronic device is less than or equal to a second preset threshold; The first control is a user-defined control.
5. The method according to any one of claims 1 to 4, characterized in that: The first card is any card among the multiple cards, the first card is associated with a first smart device, and the first card includes a control corresponding to the first smart device; or the first card is associated with a first smart home space, and the first card includes a control corresponding to at least one smart device in the first smart home space.
6. The method according to any one of claims 1 to 5, characterized in that: The first card is a newly created card, and the first card includes summary information, where the summary information is used to represent information associated with multiple smart devices corresponding to the multiple cards, or the summary information is used to represent information associated with multiple smart home spaces corresponding to the multiple cards.
7. The method according to any one of claims 1 to 6, characterized in that: The stack displays a plurality of cards, including: The multiple cards are converted from a first style to a second style, and the converted multiple cards are stacked and displayed.
8. The method according to claim 7, characterized in that The card size corresponding to the second style is larger than the card size corresponding to the first style.
9. The method according to any one of claims 1 to 6, characterized in that: After displaying the first card on the top layer of the plurality of cards displayed in a stack, the method further includes: In response to a second operation triggered by the user on the first card, the styles of the plurality of cards displayed in a stack are converted from a first style to a second style.
10. The method according to any one of claims 1 to 9, characterized in that: After displaying the first card on the top layer of the plurality of cards displayed in a stack, the method further includes: In response to a third operation triggered by the user on the first card, a device control interface is displayed, where the device control interface includes all or part of the controls of the smart devices corresponding to the multiple cards.
11. The method according to any one of claims 1 to 10, characterized in that: After displaying the first card on the top layer of the plurality of cards displayed in a stack, the method further includes: In response to a fourth operation triggered by the user on the first card, a second card is switched to be displayed on the top layer of the multiple cards displayed in the stack, and the second card is the card located under the first card before the user triggers the fourth operation.
12. The method according to any one of claims 1 to 11, characterized in that: The method further comprises: In response to a user's voice command, a third card is switched to be displayed on the top layer of the plurality of cards displayed in the stack, and the third card is the card indicated to be displayed by the voice command.
13. The method according to any one of claims 1 to 12, characterized in that: The method further comprises: A second smart device is determined from the smart devices corresponding to the multiple cards according to the device states of the smart devices corresponding to the multiple cards, and a card corresponding to the second smart device is switched to be displayed on the top layer of the multiple cards displayed in the stack.
14. The method according to any one of claims 1 to 13, characterized in that: The method further comprises: It is determined that the electronic device has moved to the vicinity of a third smart device, and a card corresponding to the third smart device is switched to be displayed on the top layer of the plurality of cards displayed in the stack.
15. The method according to any one of claims 1 to 14, characterized in that: The method further comprises: The card corresponding to the fourth smart device is switched to be displayed on the top layer of the plurality of cards displayed in stack form, and the fourth smart device is a smart device located in the pointing direction of the electronic device.
16. The method according to any one of claims 1 to 15, characterized in that: The first operation is an operation of the user selecting the multiple smart devices or the multiple smart home spaces in the card editing interface; Before the stack displays the plurality of cards in response to a first operation of the user, the method further includes: Determine a plurality of smart devices corresponding to the first operation or a plurality of smart home spaces corresponding to the first operation.
17. The method according to claim 16, characterized in that The first operation is a check operation or a drag operation.
18. The method according to any one of claims 1 to 15, characterized in that: The first operation is an operation in which the user selects a target smart device in the card editing interface; In response to a first operation of the user, stacking and displaying a plurality of cards comprises: Determining that a card corresponding to a second smart device already exists in the electronic device, the second smart device and the target smart device have the same device type, or the second smart device and the target smart device belong to the same smart home space; The card corresponding to the target smart device and the card corresponding to the second smart device are displayed in a stacked manner.
19. The method according to any one of claims 1 to 15, characterized in that: The first operation is an operation in which the user selects a target smart home space in the card editing interface; In response to a first operation of the user, stacking and displaying a plurality of cards comprises: Determining that a card corresponding to a second smart home space already exists in the electronic device, and the second smart home space is of the same type as the target smart home space; The card corresponding to the target smart home space and the card corresponding to the second smart home space are stacked and displayed.
20. The method according to any one of claims 1 to 19, characterized in that The plurality of cards displayed in a stacked manner include a fourth card; In response to a fifth operation triggered by the user for creating a fifth card, determining that the fifth card is related to the fourth card, and adding a control corresponding to the fifth smart device or a control corresponding to the fifth smart home space to the fourth card; Among them, the fifth card is associated with the fifth smart device or the fifth smart home space, and the fifth card is related to the fourth card and includes at least one of the following: the fourth card includes controls corresponding to a smart device of the same device type as the fifth smart device; or the fourth card includes controls corresponding to a smart device in the same smart home space as the fifth smart device; or the fourth card includes controls corresponding to a smart home space of the same type as the fifth smart home space.
21. The method according to any one of claims 1 to 20, characterized in that Before stacking and displaying a plurality of cards, the method further includes: Displaying a control editing interface, wherein the control editing interface includes controls corresponding to the multiple smart devices, or the control editing interface includes controls corresponding to the smart devices in the multiple smart home spaces; In response to a fifth operation of the user, controls included in the plurality of cards displayed in a stack are determined.
22. The method according to any one of claims 1 to 21, characterized in that After displaying the first card on the top layer of the plurality of cards displayed in a stack, the method further includes: In response to a sixth operation by the user, displaying a control editing interface; In response to a seventh operation of the user, controls included in the plurality of cards after being stacked and displayed are determined.
23. An electronic device, characterized in that: The system comprises at least one processor, wherein the at least one processor is coupled to at least one memory, and the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 22.
24. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the method according to any one of claims 1 to 22.
Citation Information
Patent Citations
Card management method and terminal equipment
CN115016867A
Device control method, related device and communication system
CN115509139A
Card information display method, electronic equipment and graphical user interface
CN115988125A
Interface display method and device, electronic equipment and computer readable storage medium
CN116954432A
Cited By
Management method and device of AI desktop smart card based on user event, terminal and storage medium
CN121658124A