Launching a hierarchical mobile application

The hierarchical mobile application launch method optimizes user interaction by analyzing smart home devices and presenting tailored interfaces, enhancing efficiency and reducing frustration.

JP7770554B2Active Publication Date: 2025-11-14GOOGLE LLC
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024518507
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-09-24
Publication Date
2025-11-14
Estimated Expiration
2041-09-24

AI Technical Summary

Technical Problem

Mobile applications for smart home devices often present users with numerous options that are not relevant, complicating user interaction and reducing efficiency, while removing these options would diminish functionality for other users.

Method used

A hierarchical mobile application launch method that analyzes the user's installed smart home devices and presents an initial launch interface tailored to the specific configuration, including status cards for different categories or types of devices, allowing efficient access to desired features.

Benefits of technology

The method accelerates user access to application features and reduces frustration by eliminating unnecessary navigation through interfaces, adapting to varying user setups.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007770554000001
    Figure 0007770554000001
  • Figure 0007770554000002
    Figure 0007770554000002
  • Figure 0007770554000003
    Figure 0007770554000003
Patent Text Reader

Abstract

Various arrangements are presented for performing hierarchical application launch of an application. A request to register one or more smart home devices in association with a user account can be received. The smart home devices can be mapped to the user account based on receiving the request. An application mapped to the user account may be launched, and the application can analyze the one or more smart home devices registered to the user account and the user interface hierarchy. Based on analyzing the one or more smart home devices registered to the user account and the user interface hierarchy, an initial launch interface can be selected and output for presentation.
Need to check novelty before this filing date? Find Prior Art

Description

[Background technology]

[0001] background Mobile applications, such as those used to control smart home devices, tend to be designed to handle the many types of configurations that a user may have. Thus, many options in a mobile application may not be useful to a particular user. From the user's perspective, the presence of these options may complicate and reduce the user's efficiency when interacting with the mobile application. However, from the provider's perspective, removing these options would reduce the functionality of the mobile application for other users. Summary of the Invention

[0002] overview Various embodiments are described in connection with a method for performing launch of a hierarchical mobile application. In some embodiments, a method for performing launch of a hierarchical mobile application is described. The method can include receiving one or more requests to register one or more smart home devices in association with a user account. The method can include mapping the one or more smart home devices to the user account based on the one or more received requests. The method can include receiving a request to launch by an application executed by the mobile device. The application executed by the mobile device can be mapped to the user account. The method can include analyzing one or more smart home devices registered to the user account and a user interface hierarchy. The method can include selecting, from a plurality of initial launch interfaces, an initial launch interface to be presented by the application in response to receiving the request to launch based on the analysis of the one or more smart home devices registered to the user account and the user interface hierarchy. The method can include outputting the selected initial launch interface by the application executed by the mobile device.

[0003] Embodiments of such a method may include one or more of the following features: the one or more smart home devices may comprise at least two smart home devices; the at least two smart home devices may comprise smart home devices of different categories; the initial launch interface selected from the plurality of initial launch interfaces may be based on the at least two smart home devices comprising smart home devices of different categories based on a user interface hierarchy; a status card element may be presented as part of the initial launch interface for each category of smart home devices of different categories; for each status card element, a current status of the smart home device of the corresponding category may be presented; the at least two smart home devices may comprise smart home devices of the same category; the initial launch interface selected from the plurality of initial launch interfaces may be a middle-tier initial launch interface based on the at least two smart home devices all comprising smart home devices of the same category; the at least two smart home devices may comprise smart home devices of different types but comprising smart home devices of the same category. The initial launch interface selected from the multiple initial launch interfaces may be a mid-tier initial launch interface based on at least two smart home devices being of the same category but different types; one or more smart home devices may comprise only a single smart home device; the initial launch interface selected from the multiple initial launch interfaces may be a lowest-tier initial launch interface based on the single smart home device and user interface hierarchy; the single smart home device may be a video camera, and the selected launch interface may be a device-level video feed that may be captured using the video camera.The one or more smart home devices may be a smart home device selected from the group consisting of a video camera, a smart thermostat, a wireless network router, a smart doorbell, a smart hazard detector, a smart home assistant device, a smart speaker, a smart display, and a smart air purifier. The one or more smart home devices may be one or more smart home devices installed in a single structure.

[0004] In some embodiments, a mobile electronic device is described. The device may include an electronic display. The device may include a wireless network interface. The device may include one or more processors. The device may include memory communicatively coupled to the electronic display, the wireless network interface, and the one or more processors. The memory is readable by the one or more processors and has processor-readable instructions stored therein that, when executed by the one or more processors, can cause the one or more processors to receive one or more requests to register one or more smart home devices in association with a user account. The one or more processors can map the one or more smart home devices to the user account based on receiving the one or more requests. The one or more processors can receive a request to launch an application that can be mapped to the user account. The one or more processors can analyze one or more smart home devices registered to the user account and a user interface hierarchy. The one or more processors can select an initial launch interface from a plurality of initial launch interfaces to be presented by the application in response to receiving the request to launch based on analyzing the one or more smart home devices registered to the user account and the user interface hierarchy. The one or more processors may output the selected initial start-up interface to an electronic display.

[0005] Embodiments of such a device may include one or more of the following features: the processor-readable instructions are loaded into the memory of the mobile electronic device as an application downloaded from an application store via a wireless network interface; the one or more smart home devices may comprise at least two smart home devices; the at least two smart home devices may consist of smart home devices of different categories; the initial startup interface selected from the plurality of initial startup interfaces may be based on the at least two smart home devices consisting of smart home devices of different categories based on a user interface hierarchy; a status card element may be presented as part of the initial startup interface for each category of smart home devices of different categories; for each status card element, a current status of the smart home devices of the corresponding category may be presented; the at least two smart home devices may consist of smart home devices of the same category; the initial startup interface selected from the plurality of initial startup interfaces may be an intermediate-hierarchy initial startup interface based on the at least two smart home devices all consisting of smart home devices of the same category; the at least two smart home devices may consist of smart home devices of different types but of the same category. The initial startup interface selected from the multiple initial startup interfaces may be an intermediate-level initial startup interface based on at least two smart home devices being of the same category but different types. The one or more smart home devices may comprise a single smart home device. The initial startup interface selected from the multiple initial startup interfaces may be a lowest-level initial startup interface based on the single smart home device and the user interface hierarchy. The single smart home device may be a video camera, and the selected startup interface may be a device-level video feed that may be captured using the video camera.

[0006] In some embodiments, a non-transitory processor-readable medium is described. The medium may include processor-readable instructions configured to cause one or more processors to receive one or more requests to register one or more smart home devices in association with a user account. The one or more processors may map the one or more smart home devices to the user account based on receiving the one or more requests. The one or more processors may receive a request to launch an application that may be mapped to the user account. The one or more processors may analyze, by the application, the one or more smart home devices registered to the user account and a user interface hierarchy. The one or more processors may select, by the application, an initial launch interface from a plurality of initial launch interfaces to be presented by the application in response to receiving the request to launch based on analyzing the one or more smart home devices registered to the user account and the user interface hierarchy. The one or more processors may output, by the application, the selected initial launch interface for display.

[0007] A further understanding of the nature and advantages of various embodiments may be realized with reference to the following figures. In the accompanying figures, similar components or features may have the same reference label. Furthermore, various components of the same type may be distinguished by following the reference label with a dash and a second label that distinguishes between the similar components. When only a first reference label is used herein, this description is applicable to any one of the similar components having the same first reference label regardless of the second reference label. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an embodiment of a smart home environment in which various smart home devices are present. [Figure 2A]FIG. 1 illustrates an embodiment of a hierarchy of smart home device interfaces. [Figure 2B] FIG. 1 illustrates another embodiment of a hierarchy of smart home device interfaces. [Figure 3] FIG. 1 illustrates an embodiment of a system for performing hierarchical mobile application launch. [Figure 4A] FIG. 1 illustrates an embodiment of a device-specific interface. [Figure 4B] FIG. 1 illustrates an embodiment of a category-specific interface. [Figure 4C] FIG. 1 illustrates an embodiment of a home level interface. [Figure 4D] FIG. 10 illustrates another home level interface embodiment. [Figure 5] FIG. 1 illustrates an embodiment of a method for performing hierarchical mobile application launch. DETAILED DESCRIPTION OF THE INVENTION

[0009] Detailed Description Users of smart home devices can vary greatly in the number and types of devices they install in their homes. A user may purchase a single smart home device, install it in their home, and use it for a while before installing one or more additional smart home devices. A significant number of users may install only a single smart home device, such as a security camera. However, other users may install a significant number of smart home devices, sometimes of the same type (e.g., multiple security cameras) or sometimes of different types (e.g., a security camera and a smart thermostat). For example, a “power” user of smart home devices may install one or more smart thermostats, smart hazard detectors, video doorbells, video cameras, smart outlets, and home assistants in their home. Thus, when a large number of smart home devices are installed, these devices may be from the same category or different categories.

[0010] An entity selling various types of smart home devices may desire a single, unified application that allows users to interact with any smart home device, including those sold directly by the entity and potentially compatible third-party devices. The unified application can adapt to different situations based on the specific arrangement a user has installed in their home, as described in detail herein. Specifically, when the application is launched, the initial launch interface presented to the user can be based on the specific number or type of smart home devices installed in the user's home. For example, a user with many smart home devices will receive a different launch interface than a user with only two security smart home devices installed in their home, who will also receive a different launch interface than a user with a single smart home device in their home. The embodiments described in detail herein disclose methods and systems for implementing hierarchical mobile application launch. Such an arrangement can, for example, significantly accelerate a user's access to application features desired by the user and reduce user frustration by eliminating the need to navigate through unnecessary interfaces.

[0011] While the description herein focuses on smart home devices, it should be understood that the same principles can be applied to other forms of computerized devices that are not necessarily smart home devices. For example, other forms of Internet of Things (IoT) devices, such as distributed sensors, can be managed in a similar manner by applications. Similarly, fleets of autonomous devices (e.g., land vehicles, unmanned aerial vehicles) can be managed in a similar manner.

[0012] 1 illustrates an embodiment of a smart home environment 100 in which various smart home devices reside. The smart home environment 100 includes a building 150 (e.g., a house, a daycare, an office building, an apartment, a condominium, a garage, or a mobile home) having various integrated devices. It will be understood that devices may also be integrated into the smart home environment 100 that does not include an entire building 150, such as an apartment or condominium. Furthermore, the smart home environment 100 may control and / or be coupled to devices outside of the actual building 150. In fact, some devices in the smart home environment 100 need not be physically present within the building 150.

[0013] It should be understood that a "smart home environment" can refer to a smart environment in a home, such as a single-family home, but the scope of the present teachings is not so limited. The present teachings are also applicable, without limitation, to duplexes, townhomes, apartment complexes, hotels, retail stores, office buildings, industrial buildings, and more generally, any living or working space.

[0014] It should also be understood that, while terms such as user, customer, installer, homeowner, occupant, guest, tenant, landlord, and repair person may be used to refer to one or more persons acting in the context of certain situations described herein, these references do not limit the scope of the present teachings with respect to the person or persons performing such actions. Thus, for example, the terms user, customer, purchaser, installer, subscriber, and homeowner often refer to the same person in the case of a single-family home, because the householder is often the person who makes the purchasing decision, purchases the unit, installs and configures the unit, and is also one of the users of the unit. However, in other scenarios, such as a landlord-tenant environment, the customer may be the landlord with respect to purchasing the unit, the installer may be the local apartment manager, the first user may be the tenant, and the second user may again be the landlord with respect to the remote control functions. Importantly, while the identity of the person performing the action may be germane to the particular benefits provided by one or more of the implementations, such identity should not be construed in the following description as necessarily limiting the scope of the present teachings to those particular individuals having those particular identities.

[0015] The illustrated building 150 includes multiple rooms 152 that are at least partially separated from one another by walls 154. The walls 154 may include interior or exterior walls. Each room may further include a floor 156 and a ceiling 158. Equipment may be mounted on, integrated with, and / or supported by the walls 154, floor 156, or ceiling 158.

[0016] In some implementations, the integrated devices of the smart home environment 100 include intelligent, multi-sensing, network-connected devices that seamlessly integrate with each other and / or with a central server or cloud computing system within a smart home network to provide a variety of useful smart home functions. The smart home environment 100 can include one or more intelligent, multi-sensing, network-connected thermostats 102 (hereinafter referred to as “smart thermostats 102”), one or more intelligent, multi-sensing, network-connected hazard detection units 104 (hereinafter referred to as “smart hazard detectors 104”), one or more intelligent, multi-sensing, network-connected aisle interface devices 106 and 120, and one or more intelligent, multi-sensing, smart alarm systems 122 (hereinafter referred to as “smart alarm systems 122”). In some implementations, one or more smart thermostats 102 detect ambient climate characteristics (e.g., temperature and / or humidity) and control the HVAC system 103 accordingly. For example, each smart thermostat 102 includes an ambient temperature sensor.

[0017] The smart hazard detectors can detect smoke, carbon monoxide, and / or other hazards present in the environment. One or more smart hazard detectors 104 can include a thermal radiation sensor aimed at a respective heat source (e.g., stove, oven, other appliance, fireplace, etc.). For example, the smart hazard detectors 104 in the kitchen 153 include a thermal radiation sensor aimed at the network-connected appliances 112. The thermal radiation sensor can determine the temperature of each heat source (or a portion of each heat source), and the thermal radiation sensor can be aimed at this heat source and provide corresponding blackbody radiation data as an output.

[0018] The smart doorbell 106 and / or smart door lock 120 detect the approach or exit of a person to or from a location (e.g., an exterior door), control the doorbell / door locking function (e.g., receive user input from the portable electronic device 166 to activate the bolt of the smart door lock 120), provide audio or visual notification of the approach or exit of a person, and / or control settings on a security system (e.g., activate or deactivate the security system when an occupant enters or leaves). In some implementations, the smart doorbell 106 includes some or all of the components or features of the camera 118-1. In some implementations, the smart doorbell 106 includes the camera 118-1 and is therefore also referred to in this document as the "doorbell camera 106." The camera 118-1 and / or the camera 118-2 can function as a streaming video camera and a streaming audio device, as described in detail in connection with various embodiments herein. Camera 118 may be mounted on a wall in a location such as indoors, or may be movable and rest on a surface such as shown with camera 118-2. Various embodiments of camera 118 may be installed indoors or outdoors.

[0019] The smart alarm system 122 can detect the presence of an individual within close proximity (e.g., using a built-in IR sensor), sound an alarm (e.g., via a built-in speaker or by sending a command to one or more external speakers), and send notifications to entities or users inside / outside the smart home environment 100. In some implementations, the smart alarm system 122 includes one or more input devices or sensors (e.g., keypad, biometric scanner, NFC transceiver, microphone) to verify the identity of the user and one or more output devices (e.g., display, speaker). In some implementations, the smart alarm system 122 may be set to an armed mode to sound an alarm upon detecting a triggering condition or event unless a disarming action is taken.

[0020] In some implementations, the smart home environment 100 includes one or more intelligent, multi-sensing, network-connected wall switches 108 (hereinafter referred to as "smart wall switches 108") along with one or more intelligent, multi-sensing, network-connected smart wall outlets 110. The smart wall switches 108 can detect ambient lighting conditions, detect room occupancy, and control the power state and / or dim state of one or more lights. In some examples, the smart wall switches 108 can also control the power state or speed of a fan, such as a ceiling fan. The smart wall outlets 110 can detect room or enclosure occupancy and control the supply of power to one or more wall outlets (e.g., so that no power is supplied to the outlets when no one is in the home).

[0021] In some implementations, the smart home environment 100 of FIG. 1 includes a plurality of intelligent, multi-sensing, network-connected appliances 112 (hereinafter referred to as “smart appliances 112”), such as a refrigerator, stove, oven, television, washer, dryer, lights, stereo, intercom system, wall clock, garage door opener, floor fan, ceiling fan, wall air conditioner, pool heater, irrigation system, security system, space heater, window AC unit, and electric duct vent. In some implementations, when an appliance is plugged in, it can identify itself to the smart home network, for example, by indicating what type of appliance it is, and the appliance can automatically integrate with the smart home's controls. Such communication by the appliance to the smart home can be facilitated by either a wired or wireless communication protocol. The smart home can also include a variety of non-communicating legacy appliances 140, such as older, conventional washers / dryers and refrigerators, that can be controlled by the smart wall outlet 110. The smart home environment 100 may further include various partially communicating legacy appliances 142, such as infrared (“IR”) controlled wall air conditioners or other IR-controlled devices, that may be controlled by IR signals provided by the smart hazard detectors 104 or smart wall switches 108.

[0022] In some implementations, the smart home environment 100 includes one or more network-connected cameras 118 configured to provide video surveillance and security within the smart home environment 100. The cameras 118 may be used to determine the occupancy of the building 150 and / or particular rooms 152 within the building 150 and thus can act as occupancy sensors. For example, video captured by the cameras 118 can be processed to identify the presence of occupants within the building 150 (e.g., in particular rooms 152). Particular individuals can be identified based on, for example, their appearance (e.g., height, face) and / or behavior (e.g., their gait / walking style). The cameras 118 can further include one or more sensors (e.g., IR sensors, motion detectors), input devices (e.g., microphones for capturing audio), and output devices (e.g., speakers for outputting audio). In some implementations, the cameras 118 are each configured to operate in a daytime mode and a low-light mode (e.g., a nighttime mode). In some implementations, the cameras 118 each include one or more IR illuminators to provide illumination while the camera is operating in low light mode. In some implementations, the cameras 118 include one or more outdoor cameras. In some implementations, the outdoor cameras include additional features and / or components, such as weather resistance and / or sun compensation.

[0023] The smart home environment 100 may additionally or alternatively include one or more other occupancy sensors (e.g., smart doorbell 106, smart door lock 120, touchscreen, IR sensor, microphone, ambient light sensor, motion detector, smart night light 170, etc.). In some implementations, the smart home environment 100 includes a radio frequency identification (RFID) reader (e.g., within each room 152 or within a portion of each room 152) that determines occupancy based on an RFID tag placed on or embedded in the occupant. For example, the RFID reader may be integrated with the smart hazard detector 104.

[0024] The smart home assistant 119 may have one or more microphones that, when turned on, continuously listen to the surrounding environment. The smart home assistant 119 may be able to respond to user-posed verbal queries, possibly preceded by a triggering phrase. The smart home assistant 119 may output an audio stream, can stream video to the server system 164 if a camera is integrated as part of the device, and / or can output video if a display is incorporated as part of the device.

[0025] Thanks to network connectivity, one or more of the smart home devices of FIG. 1 may further enable a user to interact with the device even when the user is not near the device. For example, a user may communicate with the device using a computer (e.g., a desktop computer, laptop computer, or tablet) or other portable computerized electronic device 166 (e.g., a mobile phone such as a smartphone, a gaming device). A web page or application may be configured to receive communication from the user, control the device based on this communication, and / or present information to the user regarding the operation of the device. For example, a user may view the current setpoint temperature of a device (e.g., smart thermostat 102) and adjust the temperature using a computer. The user may be inside or outside the building during this remote communication.

[0026] As discussed above, users can control smart devices within the smart home environment 100 using networked computers or portable electronic devices 166. In some examples, some or all of the occupants (e.g., individuals living in the home) can register their portable electronic devices 166 with user accounts maintained by the server system 164. Such registration can occur in the server system 164 to authenticate the occupant and / or device as associated with the home and to grant the occupant permission to use the device to control smart devices in the home that are also registered to the user account. An occupant can remotely control smart devices in the home using their registered portable electronic device 166, for example, when the occupant is at work or on vacation. An occupant can also use their registered device to control smart devices when the occupant is physically located in the home, for example, when the occupant is sitting on a couch in the home. It should be appreciated that instead of or in addition to registering the portable electronic devices 166, the smart home environment 100 can make inferences regarding which individuals reside in the home, and therefore are occupants, and which portable electronic devices 166 are associated with those individuals. Thus, the smart home environment can learn who the occupants are and enable the portable electronic devices 166 associated with those individuals to control the smart devices of the home.

[0027] In some implementations, in addition to including processing and sensing capabilities, the smart thermostat 102, smart hazard detector 104, smart doorbell 106, smart wall switch 108, smart wall outlet 110, network-connected appliances 112, camera 118, smart home assistant 119, smart door lock 120, and / or smart alarm system 122 (collectively referred to as "smart home devices") can communicate data and share information with other smart devices, a central server or cloud computing system, and / or other network-connected devices. Data communications may occur using any of a variety of proprietary or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi®, ZigBee®, 6LoWPAN, Thread®, Z-Wave®, Bluetooth® Smart, ISA100.11a, WirelessHART®, MiWi, etc.) and / or any of a variety of proprietary or standard wired protocols (e.g., Ethernet®, HomePlug, etc.), or other suitable communications protocols, including communications protocols not yet developed as of the filing date of this document. At least some smart home devices may communicate with each other using a relatively low power mesh networking protocol.

[0028] In some implementations, some smart devices act as wireless or wired repeaters. Smart home devices with access to line power can act as a bridge between relatively low-power communication protocols (e.g., mesh networking protocols) and relatively high-power communication protocols (e.g., WiFi). Such an arrangement allows battery-powered devices to communicate with a remote server. Some smart devices can communicate with a network interface 160, which enables communication with a network. The network 162 can include the Internet and, possibly, one or more wireless or wired local area networks, such as those within a user's home. Smart devices can communicate with a cloud-based server system 164 via the Internet. The server system 164 can be associated with a manufacturer, support entity, or service provider associated with the smart device. In some implementations, users can contact customer support using the smart device itself, rather than requiring the use of other communication means such as a telephone or an Internet-connected computer. In some implementations, software updates are automatically sent from the server system 164 to the smart device (e.g., when available, when purchased, or at regular intervals).

[0029] In some implementations, network interface 160 includes a conventional network device (e.g., a router), and smart home devices 100 of FIG. 1 include hub device 180 that is communicatively coupled to network 162 directly or via network interface 160. Hub device 180 is further communicatively coupled to one or more of the intelligent, multisensory, network-connected devices described above (e.g., smart devices of smart home environment 100). Each of these smart devices optionally communicates with hub device 180 using at least one or more wireless communication networks available within smart home environment 100 (e.g., ZigBee, Z-Wave, Insteon, Bluetooth, Wi-Fi, and other wireless communication networks). In some implementations, hub device 180 and devices coupled to / with the hub device can be controlled and / or interacted with via applications running on a smartphone, a home controller, a laptop, a tablet computer, a game console, or similar electronic device. In some implementations, a user of such a controller application can view the status of the hub device or coupled smart home devices, configure the hub device to interoperate with new smart devices introduced to the home network, commission new smart devices, and adjust or view settings for connected smart devices, etc. In some implementations, the hub device is configured to boost the performance of less capable smart devices to match the performance of more capable smart devices of the same type, integrate the functionality of multiple different device types (even across different communication protocols), and simplify the addition of new devices and the commissioning of the hub device. In some implementations, the hub device 180 further includes local storage for storing data related to or output by smart devices in the smart home environment 100. In some implementations, the data includes one or more of video data output by a camera device, metadata output by a smart device, configuration information for the smart device, usage logs for the smart device, etc.

[0030] In some implementations, the smart home device 100 includes a local storage device 190 for storing data related to or output by the smart devices of the smart home device 100. In some implementations, the data includes one or more of video data output by a camera device (e.g., the camera 118 or the smart doorbell 106), metadata output by the smart device, configuration information for the smart device, a usage log of the smart device, etc. In some implementations, the local storage device 190 is communicatively coupled to one or more smart devices via a smart home network. In some implementations, the local storage device 190 is selectively coupled to one or more smart devices via a wired and / or wireless communication network. In some implementations, the local storage device 190 is used to store video data when external network conditions are insufficient. For example, the local storage device 190 is used when the encoding bitrate of the camera 118 exceeds the available bandwidth of the external network (e.g., the network 162). In some implementations, the local storage device 190 temporarily stores video data from one or more cameras (e.g., camera 118) before transferring the video data to a cloud-based server system (e.g., server system 164).

[0031] Also included and shown within the exemplary smart home environment 100 of FIG. 1 are service robots 168, each configured to autonomously perform any of a variety of household chores. In some implementations, the service robots 168 can each be configured to sweep floors, wash floors, etc. In some implementations, the service robot can follow a person from room to room and position itself so that it can be monitored while the person is in the room. The service robot can stop at a location within the room where the service robot is likely out of the way but still has a relatively clear view of the room. In some embodiments, a smart air purifier can be present.

[0032] An application installed on a computerized device, such as portable electronic device 166, can be used to interact with one or more smart home devices such as those presented in Figure 1. Such smart home devices may be manufactured or distributed by the same entity or may be part of a larger compatible ecosystem of various third-party entities. Figure 2A shows an embodiment of a hierarchy 200A of smart home device interfaces.

[0033] Hierarchy 200A can be used to determine the launch user interface (UI) presented to a user when an application is launched for the first time. In some embodiments, hierarchy 200A has three levels. "Launch" refers to when a user activates an application for use. For example, on a smartphone, launching typically requires the user to touch a corresponding icon on the smartphone's home screen. Alternatively, the user may speak a command to the electronic device, such as "Launch my smart home application." A "launch user interface" refers to the first UI presented with which the user can interact. For example, a splash screen presented while an application loads is not a launch UI. Rather, a launch UI is the first UI that allows a user to interact with one or more smart home devices.

[0034] In some embodiments, hierarchy 200A may have three levels. The lowest level may be at the device level. As shown, hierarchy 200A includes a device-level UI 203. If only a single smart home device is mapped to a user account, the device-level UI 203 may be presented when an application mapped to the user account is launched. The device-level UI 203 may correspond to a single specific type of device. An example of a device-level UI is shown in FIG. 4A. By way of example, six devices 230 are shown as part of hierarchy 200A. These devices may be any of the types of devices shown in connection with FIG. 1. If a user has only one of the devices 230 mapped to their user account, the user may be presented with the device-level UI 203 corresponding to that device when the application is launched. The device-level UI 203 may differ based on the type of device installed. For example, the device level UI 203 can be a video feed if the user only has a video camera mapped to their user account, or the device level UI 203 can be a media control interface if the user only has a smart home assistant mapped to their user account.

[0035] The category-level UI 202 may be presented as a launch UI when a user has multiple devices mapped to their user account, but all of the devices are of the same category. The hierarchy 200A may include all possible types of smart home devices being divided into various predefined categories. Devices within the same category share at least some aspects in common. By way of example, there may be five device categories. Such device categories may include security / safety, media, climate, connectivity, and lighting. Security / safety may involve any device related to maintaining security or safety, such as video cameras, smart door locks, hazard detectors (e.g., smoke detectors, carbon monoxide detectors), smart doorbells, smart garage openers, smart gate openers, security system components (e.g., window sensors, door sensors, motion sensors, water sensors, pool sensors), smart alarms, etc. Media may involve any device capable of outputting media, such as smart home assistants, smart speakers, smart displays / TVs, and smart home hubs. Climate can involve any device related to controlling or monitoring climate, such as a thermostat, temperature sensor, smart heater, smart air conditioner, smart air quality sensor, smart radiator, smart humidifier, smart fan, smart dehumidifier, and smart air freshener. Connectivity can involve any device related to network connectivity, such as an internet router and network mesh access point. Lighting can include any device related to powering lights on or off, such as a smart bulb, smart light switch, or smart outlet.

[0036] Various other devices may not fit into a category and therefore may be listed under the highest level of the all-devices view. In other embodiments, additional or alternative categories, such as an all-encompassing "other" category, may be created to include some or all of these types of smart devices. Such smart devices may include vehicles, personal mobility devices (e.g., electric scooters, electric bicycles), awnings, bathtubs, beds, blenders, blinds, boilers, device chargers, clocks or clock radios, coffee / tea makers, computers, cooktops, curtains, food dehydrators, dishwashers, doors, dryers, elevators, faucets, water filters, fireplaces, deep fryers, garden controls, grills, exhaust hoods, kettles, locator tags (which may be attached to other devices such as keys or smartphones), mailboxes, microphones, microwaves, mops, lawn mowers, multi-cookers, ovens, pergolas, smartphones, visual displays, pressure cookers, refrigerators, service robots, scene controllers, showers, shutters, slow cookers, sprinkler systems, stylers, toilets, vacuum cleaners, valves, exhaust fans, washing machines, water heaters, and yogurt makers.

[0037] An example of a category level UI 202 is shown in Figure 4B. The category level UI 202 can differ based on the category of device installed. For example, the category level UI 202 can include multiple video feeds if the user only has video devices mapped to their user account, or the category level UI 202 can be a media control interface if the user only has smart home assistants or various other media devices mapped to their user account.

[0038] (Smart outlets can be categorized into a number of categories based on the devices they control. For example, if a smart outlet controls a lamp, the smart output can be categorized as part of a lighting category. Categorization can be done manually by the user, or automatically by server system 164 or application 320 based on names for the smart outlets provided by the user or functions specified by the user. Other types of devices can also be so categorized into device categories 220 of particular device categories.) In other embodiments, there may be fewer or more device categories 220. For example, in some embodiments, a "catch-all" category may exist for smart devices that do not fit into another predefined category. The application or server system may store definitions for each device category or device categories 220, defining which devices fall into a category. Thus, for example, if a user installs a smart home assistant, the application or server may appropriately classify the smart home assistant without user input. In some embodiments, categories may be defined for specific types of devices, such as an air quality / air purifier category, which may include air quality sensors and / or smart air purifiers.

[0039] Home level 210 may represent the highest level of hierarchy 200A. If a user has multiple devices mapped to their user account and the multiple devices fall into different device categories, home level UI 201 may be presented as a launch UI. Home level UI 201 may provide status for each category to which the user has mapped devices. An example of home level UI 201 is shown in FIGS. 4C and 4D. Home level 210 may differ based on the specific device categories to which the user has devices mapped to their user account. For example, if a user has devices 230-1 and 230-3 installed in their home, elements for only device categories 220-1 and 220-2 may be presented, with device category 220-3 excluded from home level UI 201.

[0040] As an example of how hierarchy 200A can function, if a user only has device 230-3 installed in their home and mapped to their user account, device-level UI 203 specific to the type of device 230-3 will be presented as the launch UI. If the user only has devices 230-3 and 230-4 (which may be the same type of device or different types of devices that are part of the same category), category-level UI 202 corresponding to device 220-2 will be presented as the launch UI. If the user only has devices 230-3 and 230-4 (which may be the same type of device or different types of devices that are part of the same category), home-level UI 201 may be presented if the user has devices from multiple categories, such as devices 230-2 and 230-5, mapped to their user account and installed in their home. In this example, home-level UI 201 may include UI elements corresponding to device categories 220-1 and 220-3, but device category 220-2 will be excluded because no smart devices exist in the home that correspond to device category 220-2.

[0041] Hierarchy 200A may be dynamically analyzed, i.e., as smart home devices in the home that are mapped to a user account are added or removed, the launch UI changes based on the smart home device or devices. For example, initially a user may have only device 230-1 mapped to their user account and therefore may receive device-level UI 203 as the launch UI. If the user then maps device 230-6 to their user account, the user may receive home-level UI 201 as their launch UI within the application.

[0042] While hierarchy 200A is shown as having three levels, in other embodiments, there may be fewer (i.e., two) or more (i.e., four or more) levels. FIG. 2B shows another embodiment of hierarchy 200B of a smart home device interface. Hierarchy 200B may include five levels. In addition to the levels detailed in connection with hierarchy 200A, device type 235, multihome level 206, or both may be present. In this embodiment, if a user has multiple homes mapped to their user account and devices installed in those homes, the launch UI may be multihome level UI 204. At this level, the user may select the specific home with which they wish to interact. In some embodiments, even if multihome level 206 is available, the lowest level launch UI may be selected based on where the device is running the application.

[0043] If the user only has multiple devices of the same type installed in their home, the type level UI 205 may be used. For example, if the user only has two security video cameras (e.g., device type 235-1) installed in their home, the launch UI may be the type level UI 205. If the user were to add another device that has video capabilities but is not a dedicated video camera (e.g., a smart doorbell), the category level UI 202 would be presented (assuming the smart doorbell and video camera are part of the same device category). In the example hierarchy 200B, the type level UI 205 may only be available for one or more specific device categories (e.g., how the type level UI 205 is not available for device categories 220-1 and 220-2, etc.). In other embodiments, hierarchies with a subset of the levels detailed in connection with FIGS. 2A and 2B or more levels may be created.

[0044] 3 illustrates an embodiment of a system 300 for performing hierarchical mobile application launch. The system 300 may implement the hierarchies of FIGS. 2A and 2B or variations of these hierarchies. The system 300 may include a mobile device 310, a network 162, and a server system 164.

[0045] The server system 164 may maintain user accounts to which smart home devices and mobile devices 310 may be registered. The application 320 may only be able to manage / present information related to smart home devices that are registered to a user account at the server system 164 to which the application 320 is logged in, such as by a username and password.

[0046] The mobile device 310, which may represent an embodiment of the portable electronic device 166 (e.g., a smartphone, a tablet computer, a gaming device, etc.), may include a network interface 312, a processing system 314, a display 316, and a user interface 318. Other components may be present but are not shown in FIG. 3 for simplicity. The network interface 312 may enable the mobile device 310 to communicate over various wireless networks, such as a cellular network or a Wi-Fi network. The processing system 314 may include one or more processors that enable the execution of software, such as an application 320. The display 316 may be incorporated as part of the mobile device 310 and may enable information to be presented by the mobile device 310. The display 316 may be a touchscreen that functions as both a display and a user interface 318. The user interface 318 may be a keypad incorporated as part of the touchscreen, a voice interface, or other form of interface with which a user can interact to provide input. Other components of the mobile device 310, such as a non-transitory processor-readable medium that may be used to store the application 320, are not shown.

[0047] The application 320 may be installed on the mobile device 310. The application 320 may be downloaded by the mobile device 310 from an application (“app”) store, installed, and executed using the processing system 314. In other embodiments, the application 320 may be pre-installed on the mobile device 310, such as part of an operating system (OS).

[0048] The application 320 includes a mapped device analyzer 322, a UI generation engine 324, a device profile data store 326, and a UI data store 328. Each of these components may be implemented as software as part of the application 320. In other embodiments, some or all of these components may be implemented as part of dedicated hardware on the mobile device 310. Furthermore, some or all of the functionality of the components of the application 320 may be performed remotely by the server system 164, rather than being executed and performed locally by the mobile device 310.

[0049] The mapped device analyzer 322 can analyze specific smart home devices that match the user account currently logged in to the application 320. The mapped device analyzer 322 can access a device profile data store 326 that indicates the make / model and / or category of smart home devices that are mapped to the user account currently logged in to the application 320. The device profile data store 326 can be stored locally as part of the application 320 or maintained remotely by the server system 164. If maintained remotely, the mapped device analyzer 322 can access the server system 164 at startup to obtain a list of devices that are mapped to the user account currently logged in to the application 320. The mapped device analyzer 322 can determine the number of smart home devices and / or whether the smart home devices are mapped to different categories. Based on an analysis of the smart home devices that are mapped to the user account mapped to the application 320, the mapped device analyzer 322 can select a launch UI from a number of available launch UIs according to a hierarchy, such as that described in detail in connection with FIGS. 2A and 2B . A lowest level UI capturing all of the smart home devices for a user account can be used as detailed previously.

[0050] In some embodiments, this analysis is performed by the mapped device analyzer 322 when the application 320 is launched. In other embodiments, this analysis is performed by the mapped device analyzer 322 whenever it is determined that a smart home device is to be added or removed from the user. In other embodiments, the mapped device analyzer 322 and / or the device profile data store 326 may be performed by the server system 164, for example, whenever a smart home device is added or removed. If the analysis is not performed at application launch, the application 320 may store an indication of a particular startup UI that should be presented when the application is launched.

[0051] The UI generation engine 324 can receive an indication of a particular UI to be used and generate a launch UI for presentation by the display 316. The launch UI presented by the display 316 is the first UI that a user can interact with following launch of the application 320. The formatting and graphical elements used to create the launch UI can be retrieved from a UI data store 328.

[0052] 4A-4D show examples of a start-up UI that may be selected based on a hierarchy and a specific smart home device mapped to a user account. The examples of FIGS. 4A-4D are based on hierarchy 200A of FIG. 2A. FIG. 4A shows an embodiment of device-level user interface 400A. Device-level UI 400A would be presented by a mobile device if a user has only a single smart home device linked to the user account to which their mobile device is logged in. For example, according to hierarchy 200A, device category 220-1 may be security and device 230-1 may be a video camera. Furthermore, in the example of FIG. 4A, device 230-1 is a video camera, so device-level UI 400A is a video interface.

[0053] FIG. 4B illustrates an embodiment of a category-level user interface 400B. The category-level UI 400B would be presented as a launch UI by a mobile device if a user has multiple smart home devices linked to the user account to which their mobile device is logged in, and all of the smart home devices are part of the same category. For example, according to hierarchy 200A, device category 220-1 may be security, device 230-1 may be a video camera, and device 230-2 may be a video doorbell. Further, in the example of FIG. 4B, because device category 220-1 is security, the category-level UI 400B may be a video interface providing live streams or video stills from each device 230-1 and 230-2. Because the category-level UI 400B is above the device level, a separate card element may be presented for each device. Card element 410 may be a live stream or video still from device 230-1, and card element 411 may be a live stream or video still from device 230-2. Additional information, such as location, name, charge level, etc., may be presented for each device on its respective card element. Based on the number of devices the user has in the category for which the launch UI is presented, scrolling may be required to view each card element. Selecting a particular card element can navigate to a device-level interface for the smart home device corresponding to the card element. The ordering of card elements in the category-level UI 400B can be manually set by the user.

[0054] FIG. 4C illustrates an embodiment of a home-level interface. Home-level UI 400C will be presented by a mobile device as a launch UI when an application is launched if the user has at least two smart home devices linked to the user account to which their mobile device is logged in, and the smart home devices are part of different categories. For example, according to hierarchy 200A, device category 220-1 may be security, device 230-1 may be a video camera, and device 230-2 may be a video doorbell. Additionally, the user has smart home devices that are part of device category 220-2, which may be the media category. Because home-level UI 400C is above the category level, a separate card element may be presented for each category. Card element 420 may correspond to all devices for the user in the media category (device category 220-2), and card element 421 may correspond to all devices mapped to the user account in the security category (device category 220-1). In home-level UI 400C, because a single card element can correspond to more than one device, not all information for all devices in a category may be presented simultaneously. For example, card element 421 shows a default video still or live feed from a device in device category 220-1. The user can swipe to select other devices (and their associated video stills or live feeds) while remaining in home level UI 400C, as indicated by device selection indicator 422. Additional information related to the category may be presented on each card element. For example, card element 420 for the media category presents media-specific information, including the song title, artist name, and album cover of the currently playing media. Card element 420 for the security category may show the camera's name, camera location, and an indication of whether the camera is live.

[0055] In the example home level UI 400C, there is only a single media device, indicated by card element 420, although similar swipe interfaces may be used for other media devices. Alternatively, the name of the device that is active or outputting media may be indicated, for example, by active device indicator 423.

[0056] When a user selects (e.g., touches) a card element, a corresponding category UI may be output if multiple devices in the category are mapped to a user account in the home. If only a single device exists in the category and a card element is selected on the home-level UI 400C, a device-level UI for the single device may be presented.

[0057] In some embodiments, the category selector 424 allows the user to sort by physical room rather than by category. In some arrangements, a card element for each room in the user's home may be presented rather than a card element for each device category. The ordering of the card elements in the home level UI 400C can be manually set by the user.

[0058] 4D shows an embodiment of a home-level interface 400D. The home-level UI 400D will be presented by the mobile device as the launch UI when the application is launched if the user has three or more smart home devices linked to the user account to which the user's mobile device is logged in, and the smart home devices are part of different categories. For example, according to hierarchy 200A, the user has mapped to the user account smart home devices that are part of device category 220-2, which may be the media category. Additionally, the user has mapped to the user account at least four lighting devices (device category 220-3) and a smart thermostat (a fourth device category not shown in FIG. 2A).

[0059] Because the home-level UI 400C is above the category level, a separate card element may be presented for each category. Card element 420 may correspond to all devices for the user in the media category (device category 220-2), card element 430 may correspond to all devices mapped to the user account in the lighting category, and card element 431 may correspond to all devices mapped to the user account in the climate category. In card element 420, there is an indication that media is being output through two speakers, and therefore at least two media devices are present in the home and mapped to the user account. In the home-level UI 400C, because a single card element can correspond to more than one device, not all information for all devices in a category may be presented simultaneously. For example, card element 430 indicates the number of lighting devices that are on, but not the number of lighting devices, if any, that are off. In this example, the security category is not shown. This may mean that devices in the security category are mapped to the user account in the home, or that the security category is off-screen and scrolling is required to reach the category.

[0060] Additional information related to the category may be presented on each card element. For example, on card element 430 for the lighting category, a written indication of the number of lights turned on and the number of rooms in which those lights are on is shown. Additionally, yellow is used to indicate that the lights are on (as opposed to, for example, gray, being used if all lights are off). On card element 431 for the climate category, the setpoint temperature and current temperature of a smart thermostat may be shown. Additionally, red or orange may indicate that heating is active, blue may indicate that cooling is active, and gray may indicate that the HVAC system is off. As with other categories, if multiple climate devices are present, card element 431 allows for swiping horizontally to view information about other climate category devices.

[0061] The ordering of card elements 420, 430, and 431 may be user selectable, for example, to show the categories the user uses most at the top. Selecting a card element corresponding to a single device may activate a device-specific UI. Selecting a card element corresponding to multiple devices in the same category may activate a category-specific UI, such that if a particular device is selected within the category-specific UI, the device-specific UI will be presented.

[0062] Various methods may be implemented using the smart home arrangement, hierarchy, system, and launch UI of Figures 1-4D. Figure 5 illustrates an embodiment of a method 500 for implementing hierarchical mobile application launch. Method 500 may be implemented using system 300 of Figure 3.

[0063] At block 510, a request to register a smart device to a user account can be received. This request can be received by and registered to the user account through the same mobile application through which the hierarchical mobile application launch occurs at block 560, but on another mobile device or other interface, such as a web-based smart device registration interface, accessed either by the mobile device or via a computerized device. Upon registration, at block 520, the smart device can be mapped to the user account so that data obtained from the smart device can be viewed in association with the user account and / or commands can be sent to the smart device in association with the user account. A remote server system, such as server system 164, maintains a database indicating the smart home devices mapped to the user account. A similar map can be maintained locally on the mobile device that is mapped to the user account. The smart device registered at block 510 can be sold or manufactured by the same entity that published the mobile application, or it can be a supported third-party smart home device (manufactured or sold by another entity). Blocks 510 and 520 may be performed repeatedly on the same mobile device or on different devices mapped to the user account to add each smart home device that the user is installing (or is in the process of installing) in this home.

[0064] At block 530, a request to launch a mobile application may be received by a mobile device where the application and / or the mobile device is mapped to a user account. Block 530 may involve a user touching, issuing a voice command, or otherwise providing input to the mobile device indicating that a mobile application used to interact with the smart home device should be launched. In response to block 530 being executed, the mobile application may begin executing on the mobile device.

[0065] At block 540, the registered smart home devices mapped to the user account are analyzed. The analysis may involve using a stored hierarchy, such as hierarchy 200A or hierarchy 200B, to determine the category into which each registered smart home device falls, as described in detail in connection with FIGS. 2A and 2B. The details of the hierarchy, such as the number of levels in the hierarchy and the definitions of the categories in the hierarchy, may be predefined by the entity that deployed the application and may be updated as part of the application (or at a remote server system, if the analysis is performed at a remote server system). The hierarchy may be used to categorize smart home devices sold or manufactured by the same entity that released the application, as well as supported third-party smart home devices.

[0066] Block 540 may be executed in response to block 530. That is, in response to receiving an application launch request, an application executed by the mobile device may execute block 540, or the application may send a message to a remote server system to execute block 540. Alternatively, blocks 540 and 550 may be executed before block 530, and the results of blocks 540 and 550 may be saved for use in response to block 530 being executed. For example, a mobile application executed by the mobile device may execute blocks 540 and 550 occasionally, periodically, or in response to block 520 being executed, or such blocks may be executed by a remote server system, for example, in response to block 520 being executed. The saved results may be stored remotely by the remote server system or transferred to the mobile device for storage with the application's data. Saving the results on the mobile device may enable faster startup of the application upon launch because less information needs to be retrieved from the server system.

[0067] At block 550, an initial startup UI may be selected from multiple available startup UIs based on the analysis involving the hierarchy of block 540. The selected initial startup UI may be the lowest-level startup UI that captures all of the smart home devices mapped to the user account. Three possible (but non-limiting) examples based on hierarchy 200A include: 1) if only a single smart home device is mapped to the user account, a device-level UI may be used as the startup UI; 2) if multiple smart home devices categorized within the same category are mapped to the user account, a category-level UI may be used as the startup UI; and 3) if multiple smart home devices categorized in multiple categories are mapped to the user account, a home-level UI may be used as the startup UI. Examples of such startup UIs are provided in FIGS. 4A-4C, respectively.

[0068] At block 560, the selected initial launch interface from block 550 may be output for presentation. Block 560 may depend on blocks 530-550 being executed, but not in any particular order, as previously described. The selected initial launch interface may allow the user to view data about all of the smart home devices mapped to the user account and may allow navigation from the initial launch UI to other UIs of the application.

[0069] If a smart home device is added or removed from the user account subsequent to the execution of method 500, the next time method 500 is executed on the mobile device, the initial UI may change based on the modified set of smart home devices now registered to the user account.

[0070] It should be noted that the methods, systems, and devices described above are intended as examples only. It should be emphasized that various embodiments can exclude, substitute, or add various procedures or components as desired. For example, it should be understood that in alternative embodiments, methods may be performed in an order different from that described, and that various steps may be added, excluded, or combined. Also, features described with respect to some embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. It should also be emphasized that technology evolves, and therefore many of the elements are examples and should not be construed as limiting the scope of the invention.

[0071] Specific details are provided herein to provide a thorough understanding of the embodiments. However, it will be understood by those skilled in the art that the embodiments may be practiced without these specific details. For example, well-known processes, structures, and techniques are shown without unnecessary detail to avoid obscuring the embodiments. This description provides example embodiments only and does not limit the scope, applicability, or configuration of the invention. Rather, the foregoing description of the embodiments provides one skilled in the art with an enabling description for implementing embodiments of the invention. Various changes in the function or arrangement of elements may be made without departing from the spirit and scope of the invention.

[0072] Also, it should be noted that the embodiments may be described as a process that is depicted as a flow chart or block diagram. While each embodiment may describe operations as a sequential process, many of the operations may be performed in parallel or simultaneously. Additionally, the order of operations may be rearranged. A process may have additional steps not included in the figures.

[0073] Having described several embodiments, those skilled in the art will recognize that various modifications, alternative configurations, and equivalents may be used without departing from the spirit of the invention. For example, the above elements may simply be components of a larger system, other rules may take precedence over or otherwise modify the application of the invention, and some steps may be undertaken before, during, or after the above elements are considered. Therefore, the above description should not be taken as limiting the scope of the invention.

Claims

1. 1. A method for performing hierarchical mobile application launch, the method comprising: receiving one or more requests to register one or more smart home devices in association with a user account; receiving a request to launch by an application executed by the mobile device; Including, the application executed by the mobile device is associated with the user account; The method comprises: analyzing the one or more smart home devices registered to the user account and a user interface hierarchy; the user interface hierarchy includes a plurality of hierarchies; the plurality of hierarchies including a lower hierarchy corresponding to a device-level user interface for a single smart home device and an upper hierarchy corresponding to a home-level user interface corresponding to multiple categories of smart home devices present in a home; The method comprises: selecting an initial startup interface corresponding to a lowest hierarchical level among the plurality of hierarchical levels that can incorporate all of the one or more registered smart home devices based on analyzing the one or more smart home devices registered to the user account and the user interface hierarchical levels; outputting, by the application executed by the mobile device, the selected initial launch interface in response to the request to launch; The method for performing hierarchical mobile application launch further includes:

2. The method for performing hierarchical mobile application launch of claim 1 , wherein the one or more smart home devices comprises at least two smart home devices.

3. The multiple hierarchies further include an intermediate hierarchy corresponding to category-level user interfaces for multiple smart home devices of the same category; the at least two smart home devices are smart home devices of different categories; The method for performing hierarchical mobile application launch as described in claim 2, wherein the selected initial launch interface is based on the at least two smart home devices being smart home devices of different categories based on the user interface hierarchy.

4. a status card element is presented as part of the initial start-up interface for each of the different categories of smart home devices; The method for performing hierarchical mobile application launch according to claim 3 , wherein for each status card element, a current status of a smart home device of a corresponding category is presented.

5. the at least two smart home devices are smart home devices of the same category; The method for performing the launch of a hierarchical mobile application according to claim 3 , wherein the selected initial launch interface is the initial launch interface of the intermediate hierarchical layer based on the at least two smart home devices all being smart home devices of the same category.

6. the at least two smart home devices are of different types but of the same category; The method for performing the launch of a hierarchical mobile application according to claim 3 , wherein the selected initial launch interface is the initial launch interface of the intermediate hierarchical layer based on the at least two smart home devices being smart home devices of the same category but different types.

7. The method for performing hierarchical mobile application launch of claim 1 , wherein the one or more smart home devices comprises only a single smart home device.

8. 8. The method for performing hierarchical mobile application launch of claim 7, wherein the single smart home device is a video camera and the selected launch interface is a device-level video feed captured using the video camera.

9. the one or more smart home devices; Video camera, smart thermostat, wireless network router, smart doorbell, Smart Hazard Detector, smart home assistant devices, Smart speakers, Smart displays, and Smart Air Purifier 10. The method for performing launch of a hierarchical mobile application of claim 1, wherein the smart home device is selected from the group consisting of:

10. The method for performing hierarchical mobile application launch according to claim 1 , wherein the one or more smart home devices are one or more smart home devices installed in a single structure.

11. An electronic display, a wireless network interface; one or more processors; a memory communicatively coupled to the electronic display, the wireless network interface, and the one or more processors; A mobile electronic device comprising: The memory is readable by the one or more processors and has processor-readable instructions stored therein that, when executed by the one or more processors, cause the one or more processors to: receiving one or more requests to register one or more smart home devices in association with a user account; receiving a request to launch an application associated with the user account; analyzing the one or more smart home devices registered to the user account and a user interface hierarchy; the user interface hierarchy includes a plurality of hierarchies; the plurality of hierarchies including a lower hierarchy corresponding to a device-level user interface for a single smart home device and an upper hierarchy corresponding to a home-level user interface corresponding to multiple categories of smart home devices present in a home; The processor-readable instructions, when executed by the one or more processors, further cause the one or more processors to: selecting an initial startup interface corresponding to a lowest hierarchical level among the plurality of hierarchical levels that can incorporate all of the one or more registered smart home devices based on analyzing the one or more smart home devices registered to the user account and the user interface hierarchical levels; outputting the selected initial startup interface to the electronic display in response to the request to start up; A mobile electronic device.

12. The mobile electronic device of claim 11 , wherein the processor-readable instructions are loaded into the memory of the mobile electronic device as the application downloaded from an application store over the wireless network interface.

13. The plurality of hierarchies further includes an intermediate hierarchy corresponding to a category-level user interface for a plurality of smart home devices of the same category; the one or more smart home devices comprising at least two smart home devices; the at least two smart home devices are smart home devices of different categories; The mobile electronic device of claim 11 , wherein the selected initial startup interface is based on the at least two smart home devices being of the different categories of smart home devices based on the user interface hierarchy.

14. a status card element is presented as part of the initial start-up interface for each of the different categories of smart home devices; The mobile electronic device of claim 13 , wherein for each status card element, a current status of a corresponding category of smart home devices is presented.

15. the at least two smart home devices are smart home devices of the same category; The mobile electronic device of claim 13 , wherein the selected initial startup interface is the intermediate tier initial startup interface based on the at least two smart home devices all being smart home devices of the same category.

16. the at least two smart home devices are of different types but of the same category; 14. The mobile electronic device of claim 13, wherein the selected initial startup interface is the intermediate tier initial startup interface based on the at least two smart home devices being smart home devices of the same category but different types.

17. The one or more smart home devices include only a single smart home device; The mobile electronic device of claim 11 , wherein the single smart home device is a video camera and the selected launch interface is a device-level video feed captured using the video camera.

18. A program for causing one or more processors to carry out the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Information equipment control method and program

    JP2016063531A

  • Device control apparatus, device control method, and device control system

    JP2017151787A

  • Systems and methods for displaying integrated home automation modules

    JP2017508195A

  • Remote alarm disarm with acoustic presence verification

    JP2019500659A

  • Remote control terminal, program, remote control device, and remote control system

    JP2020113973A