Equipment state identification method and device

Abstract

The invention discloses an equipment state identification method and device, relates to the technical field of terminals, and can improve the equipment naming efficiency. The method comprises the following steps: sending a first instruction to a plurality of second devices in a first environment; the first instruction is used for indicating that multiple second devices in the first environment are set to be in different device states; receiving a first operation input by a user; in response to the first operation, acquiring first images of a plurality of second devices contained in the first environment; the multiple second devices correspond to different device states; and naming the plurality of second devices included in the first image according to the device states of the plurality of second devices in the first image.

Description

Technical Field

[0001] The invention relates to the technical field of image recognition, and in particular to a method and a device for identifying a device state. Background Art

[0002] At present, more and more people choose to install smart home devices to build a whole house smart. In the whole house smart, it is necessary to establish a corresponding relationship between devices and device cards so that users can control the corresponding smart home devices through device cards.

[0003] In the related art, after the smart home device is installed, the user or maintenance engineer can manually manipulate the device card to name the device card. For similar scenes such as hotels, manually modifying the device card name to name is difficult and complex to implement. Summary of the invention

[0004] The present application provides a device status identification method and apparatus for improving the efficiency of device naming.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, the technical solution of the present application provides a device status identification method, which can be applied to a first device or a component (such as a chip system) that supports the function of the first device, and the method includes: sending a first instruction to multiple second devices in a first environment; the first instruction is used to instruct the multiple second devices in the first environment to be set to different device states; receiving a first operation input by a user; in response to the first operation, obtaining a first image of the multiple second devices included in the first environment; the multiple second devices have different corresponding device states; and naming the multiple second devices included in the first image according to the device states of the multiple second devices in the first image.

[0007] In this method, the first device can distinguish different second devices according to different states of different second devices in the first image, and automatically name the corresponding second devices accordingly, without the need for the user to manually name the second devices, thereby improving the efficiency of device naming and reducing the user's operating costs. In scenarios where a large number of second devices need to be named in batches, the time-consuming process of manually naming each second device can be further avoided.

[0008] In one possible design, it also includes:

[0009] Sending a second instruction to a plurality of third devices in the second environment; the second instruction is used to instruct the plurality of third devices in the second environment to be set to different device states;

[0010] receiving a second operation input by a user;

[0011] In response to the second operation, a second image of a plurality of third devices included in the second environment is acquired; the plurality of third devices in the second image correspond to different device states;

[0012] The second image is matched with the first image to name a plurality of third devices included in the second image using the naming of a plurality of second devices in the first image.

[0013] In batch installation and maintenance scenarios such as hotels, the decoration layout of each room may be similar, and multiple second devices in a room can be named first. Afterwards, the method of the present application is used to associate and match the first image corresponding to the first room with the second image corresponding to the second room, and refer to the name of the second device in the first room to name the third device in the second room. On the one hand, it can improve the naming efficiency of batch devices in similar environments, and on the other hand, it can avoid problems such as non-standard naming and high naming error rate caused by manual naming.

[0014] In one possible design, it also includes:

[0015] Sending a second instruction to a plurality of third devices in the second environment; the second instruction is used to instruct the plurality of third devices in the second environment to be set to different device states;

[0016] receiving a second operation input by a user;

[0017] In response to the second operation, a second image of a plurality of third devices included in the second environment is acquired; the plurality of third devices in the second image correspond to different device states;

[0018] The second image is matched with the third image to name the multiple third devices included in the second image using the naming of the multiple second devices in the third image; the third image is a pre-stored image, and the multiple second devices in the third image correspond to different device states.

[0019] Optionally, the third image may be an image pre-stored in the mobile phone. For example, an image corresponding to room 1 is pre-stored. Later, when multiple devices in the second environment (such as room 3) need to be named, the mobile phone matches the image of room 1 and the image including multiple devices in room 3, so as to use the image corresponding to room 1 to name multiple devices in room 3.

[0020] In one possible design, it also includes:

[0021] A first interface is displayed, where the first interface includes naming information of the plurality of second devices.

[0022] In this method, the first device displays the automatically generated naming information of the second device in the first interface, so that the user can distinguish different second devices based on the naming information in the first interface, thereby facilitating the user to use the first device to operate the second device they want to control, thereby improving the efficiency of human-computer interaction.

[0023] In one possible design, the method further includes: obtaining identifications of the plurality of second devices that are set to different device states;

[0024] Naming the multiple second devices included in the first image according to the device states of the multiple second devices in the first image includes:

[0025] The multiple second devices included in the first image are named according to the identifiers of the multiple second devices and the device states of the multiple second devices in the first image; the identifier of each second device corresponds to the device state of a second device in the first image.

[0026] Optionally, the device identifier includes but is not limited to a MAC address, a device number, a device model identifier, etc.

[0027] For example, the warm color 1 lamp in image B is lamp 1 marked as aa in room 2, the warm color 2 lamp in image B is lamp 2 marked as bb in room 2, and the cool color lamp in image B is lamp 3 marked as cc in room 2. Then lamp 1 can be named "room 2 warm color 1 lamp", lamp 2 can be named "room 2 warm color 2 lamp", and lamp 3 can be named "room 2 cool color lamp".

[0028] In the method, the first device establishes a connection between the second device in the first image and the device in the actual first environment according to the different device states of the plurality of second devices in the first image, so as to determine the device identification corresponding to the second device in the first image, and names the second device corresponding to the device identification, thereby realizing an automatic and intelligent device naming process and improving the device naming efficiency.

[0029] In one possible design, the method further includes:

[0030] Acquire location information of the plurality of second devices, where the location information includes a space where the first environment is located and / or a location of the second device in the first image;

[0031] Naming the multiple second devices included in the first image according to the device states of the multiple second devices in the first image includes:

[0032] The multiple second devices are named according to the identifiers of the multiple second devices, the device states of the multiple second devices in the first image, and the location information of the multiple second devices.

[0033] For example, the left light in image B is light 1 marked as aa in room 2, the middle light in image B is light 2 marked as bb in room 2, and the right light in image B is light 3 marked as cc in room 2. Then light 1 can be named "left light in room 2", light 2 can be named "middle light in room 2", and light 3 can be named "right light in room 2".

[0034] In this method, the first device can establish a connection between the second device in the first image and the device in the actual first environment according to the different device states of the plurality of second devices in the first image, so as to determine the device identification corresponding to the second device in the first image, and can name the second device corresponding to the device identification according to the location information of the second device in the first image. The user can know the location of the second device according to the name of the second device, so that the user can control the second device accordingly.

[0035] In one possible design, matching the second image with the first image includes:

[0036] It is determined that the environmental background in the first image matches the environmental background in the second image, and that the positions of the plurality of second devices in the first image match the positions of the plurality of third devices in the second image.

[0037] In a possible design, acquiring first images of a plurality of second devices included in the first environment includes:

[0038] Taking photos of the multiple second devices to generate the first image;

[0039] or, receiving the first image from a fourth device;

[0040] Or, obtain the first image stored in advance.

[0041] Enriching the scenarios for obtaining the first image and obtaining the first image in multiple ways can help improve the success rate of device naming.

[0042] In one possible design, the second device includes at least one of the following devices: a fixed-location device and a movable device.

[0043] In one possible design, the fixed-position device includes at least one of the following devices: a lamp, a switch; and the movable device includes a Bluetooth button.

[0044] In one possible design, the device status includes at least one of the following: color temperature, luminous saturation, open or closed state, and temperature.

[0045] In a possible design, the first device may store the device identification of the second device and the corresponding naming information. For example, the first device stores the identification aa of lamp 1 and the naming information corresponding to lamp 1, "Room 1 Left Lamp".

[0046] In one possible design, the second device is a removable device; and the method further includes:

[0047] A change in the position of the removable device is detected, and the naming information of the removable device in the first interface is updated.

[0048] In a possible design, obtaining the space where the multiple second devices are located includes:

[0049] The space where the multiple second devices are located is determined according to the first image and / or the perception information of the sensor.

[0050] The first device may determine the space where the plurality of second devices are located in the first image based on the background in the first image, or determine the space where the second devices are located based on the perception information collected by the sensor. Alternatively, the first device may determine the space where the second devices are located based on the background of the first image and the perception information of the sensor.

[0051] In a second aspect, a device state identification method is provided, which can be applied to a first device or a component (such as a chip system) supporting a function of the first device, and the method includes:

[0052] Sending a second instruction to a plurality of third devices in the second environment; the second instruction is used to instruct the plurality of third devices in the second environment to be set to different device states;

[0053] receiving a second operation input by a user;

[0054] In response to the second operation, a second image of a plurality of third devices included in the second environment is acquired; the plurality of third devices in the second image correspond to different device states;

[0055] The second image is matched with a first image corresponding to a first environment, so that the plurality of third devices included in the second image are named using the names of the plurality of second devices in the first environment; the first image includes the plurality of second devices in the first environment.

[0056] In batch installation and maintenance scenarios such as hotels, the decoration layout of each room may be similar, and multiple second devices in a room can be named first. Afterwards, the method of the present application is used to associate and match the first image corresponding to the first room with the second image corresponding to the second room, and refer to the name of the second device in the first room to name the third device in the second room. On the one hand, it can improve the naming efficiency of batch devices in similar environments.

[0057] Optionally, the naming method of the second device in the first environment may refer to the naming method in the first aspect. Alternatively, the naming method of the second device in the first environment may follow the naming method in the related art, which is not limited in this application.

[0058] In one possible design, it also includes:

[0059] A second interface is displayed, where the second interface includes naming information of the plurality of third devices.

[0060] In one possible design, matching the second image with the first image includes:

[0061] It is determined that the environmental background in the first image matches the environmental background in the second image, and that the positions of the plurality of second devices in the first image match the positions of the plurality of third devices in the second image.

[0062] In one possible design, the second device includes at least one of the following devices: a fixed-location device and a movable device.

[0063] In one possible design, the fixed-position device includes at least one of the following devices: a lamp, a switch; and the movable device includes a Bluetooth button.

[0064] In one possible design, the device status includes at least one of the following: color temperature, luminous saturation, open or closed state, and temperature.

[0065] In a third aspect, the present application provides a device comprising a processor and a memory, the memory being used to store computer program code, the computer program code comprising computer instructions, and when the processor executes the computer instructions, a method in any possible design of any of the above aspects of the present application is executed.

[0066] In a fourth aspect, the technical solution of the present application provides a computer-readable storage medium, including computer instructions. When the computer instructions are executed on a device, the device executes any possible design method in any of the above aspects.

[0067] In a fifth aspect, the technical solution of the present application provides a computer program product, which, when executed on a device, enables the device to execute any possible design method in any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] Figure 1 Interface example diagrams provided for related technologies;

[0069] Figure 2A A schematic diagram of the architecture of the system provided in the embodiment of the present application;

[0070] Figure 2B A schematic diagram of the architecture of a system provided in an embodiment of the present application;

[0071] Figure 3 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0072] Figure 4 A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0073] Figure 5 A schematic diagram of an interface provided in an embodiment of the present application;

[0074] Figure 6 A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0075] Figure 7 , Figure 8 A schematic diagram of an interface provided in an embodiment of the present application;

[0076] Fig. 9 A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0077] Fig. 10A , Fig. 10B A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0078] Fig.11 A schematic diagram of an interface provided in an embodiment of the present application;

[0079] Fig.12 A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0080] Fig.13A , Fig. 13B A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0081] Fig.14 A schematic diagram of a scenario of a device status identification method provided in an embodiment of the present application;

[0082] Fig.15 A schematic diagram of the structure of a device state identification device provided in an embodiment of the present application;

[0083] Fig.16 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0084] Related technology 1 provides a method for naming a device card, such as Figure 1 (a), multiple device cards are displayed in the mobile phone interface 101. Figure 1 In (b), the user manipulates the device card 101a to trigger the mobile phone to control the light corresponding to the device card 101a to turn on. The user determines the light corresponding to the device card 101a by observing the change of the device status in the environment. For example, if the user observes that the kitchen light is turned on, the user determines that the device card 101a corresponds to the kitchen light. Figure 1 In (c), the user renames the device card 101a to "kitchen light". In this way, by naming the device card, the relationship between the device and the device card can be established, so that the user knows the specific device corresponding to the device card.

[0085] In the related art 1, the user needs to manually manipulate the device card to control the light to turn on, and manually name the device card of the light. Therefore, in the scenario where a large number of names are required, the implementation complexity is high and the naming efficiency is low.

[0086] In another related technology, the media access control (MAC) address of the device and the device name are pre-associated through a label template. When the device is networked, the MAC address of the device is obtained, and the device name is associated with the MAC address. The following table 1-1 shows the association between the MAC address and the name.

[0087] Table 1-1

[0088]

[0089] In the related technology 2, the devices to be installed in the environment need to be named in advance according to the template and the MAC addresses of the devices need to be entered, which is a complicated and time-consuming process. When batch naming is performed, a large number of MAC addresses need to be entered, which is not conducive to batch naming.

[0090] It can be seen that in the related art, the efficiency of naming device cards is relatively low.

[0091] In order to solve the above technical problems, an embodiment of the present application provides a device status identification method. In response to a first operation, a first device obtains a first image of an environment including multiple second devices, and displays a first interface according to the first image, wherein the first interface includes the identifiers of the multiple second devices, and the identifiers of the multiple second devices are determined according to the device status corresponding to the multiple second devices in the first image, and the device status corresponding to the multiple second devices are all different. In this method, the first device determines the identifier of each second device in the first interface according to the different statuses of the multiple second devices in the first image, so that the user can distinguish different second devices according to the identifier of the second device, thereby facilitating the user to use the first device to control the second device to be controlled. In this process, the user does not need to manually click on the device card and manually modify the name of the device card, which reduces the complexity of the user's operation and can improve the efficiency of human-computer interaction.

[0092] As follows, the technical solutions in the embodiments of the present application are described below in conjunction with the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to include, for example, "one or more" such expressions, unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two).

[0093] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0094] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0095] The present application embodiment provides a control method for a smart device. For example, Figure 2A Figure 1 is a schematic diagram of a system to which this method is applicable. Figure 2A As shown, the system can manage smart devices as a family unit. Among them, a family can be called a whole house, and the whole house can be divided into different spaces. For example, the whole house includes the entrance corridor, kitchen, dining room, living room, balcony, master bedroom, second bedroom, bathroom, etc.

[0096] The whole-house system may include a device 100, which is used to control a device 200 (such as an Internet of Things (IoT) device). The device 100 includes, but is not limited to, a mobile phone, a PC, a tablet computer, a central control screen, and the like. As a possible implementation, the device 100 may be installed with an application for controlling the device 200. The application may be a system pre-installed application, or a non-pre-installed application (such as an application downloaded from an application market). It should be understood that the system pre-installed application includes a part of the system application (such as a service, component, or plug-in in the system application), or an independent application pre-installed in the device 100, that is, there is an independent application icon. Exemplarily, the application may be an easy-to-maintain application. In an embodiment of the present application, the device 100 may also automatically name the device card of the device 200 through the installed application.

[0097] Alternatively, the device 100 may also control the device 200 through other means (such as a control center).

[0098] In the embodiment of the present application, the device 100 (such as a mobile phone) can send instructions to multiple devices 200 (such as lights) respectively to instruct the multiple devices 200 to adjust their own device states or adjust related control parameters. For example, the mobile phone sends instructions to multiple lights to instruct the multiple lights to adjust to different color temperatures, and the mobile phone can distinguish the multiple lights according to their different color temperatures.

[0099] As a possible implementation manner, the device 100 sends an instruction to the hub device 400 , and the hub device 400 forwards the instruction to the device 200 .

[0100] At least one device 300 is provided in the whole house. Exemplarily, each room or area includes at least one device 300.

[0101] Optionally, device 300 is used to locate device 200 , and / or device 100 , and / or a user, and report location information of device 200 , and / or location information of device 100 , and / or location information of the user to central device 400 .

[0102] In some examples, the device 300 may include a sensor, which is responsible for collecting the user's spatial location information. For another example, the device 300 may be a camera authorized by the user, which collects image information of other devices and / or users and determines the location information of each device and / or user accordingly.

[0103] The whole house is also equipped with devices 200 (for example, IoT devices). Devices 200 can also be called controlled devices, and devices 200 can be controlled by devices 100. For example, the kitchen is equipped with rice cookers or electric pressure cookers, gas equipment, etc.; the living room is equipped with speakers (for example, smart speakers), televisions, routing devices, etc.

[0104] It should be noted that although Figure 2A In the figure, the device 200 only shows a smart TV, but those skilled in the art should know that the device 200 includes but is not limited to a smart TV and a smart speaker. The device 200 may not be a smart home device, but a portable device, such as a personal computer (PC), a tablet computer, a mobile phone, a smart remote control, etc. The specific form of the device 200 is not limited in the embodiment of the present application.

[0105] Optionally, the system may further include a hub device 400. Hub device 400 is also referred to as a hub, a central control system, or a host. In some examples, hub device 400 may be used to receive information (such as positioning information) sent by device 300. Hub device 400 may determine the space where the user and / or device 100 is located, and determine the specific location (such as coordinates) of the user and / or device 100 in the space based on the positioning information and the apartment type information.

[0106] Optionally, device 300 communicates with device 200 via wired or wireless means.

[0107] Optionally, the device 200 and the device 300 may be connected to the central device 400 via a wired (e.g., power line communication (PLC)) and / or wireless (e.g., Wi-Fi, Bluetooth, etc.) method. It is understandable that the methods in which the devices 200 and 300 are connected to the central device 400 may be the same or different. For example, both the device 200 and the device 300 are connected to the central device 400 via a wireless method. Alternatively, the device 200 is connected to the central device 400 via a wireless method, and the device 300 is connected to the central device 400 via a wired method. Alternatively, the smart speakers, televisions and other devices in the device 200 are connected to the central device 400 via a wireless method (e.g., Wi-Fi), and the smart desk lamps, smart clothes hangers and other devices in the device 200 are connected to the central device 400 via a wired method (e.g., PLC).

[0108] Optionally, the central device in each room or area, or the central device of the whole house may exist separately, or may be integrated into one device with the device 300 or the device 100, or may be integrated into one device with the device 300 and the device 100. This application does not limit this.

[0109] The above content is only an example of a system to which the method of the embodiment of the present application is applicable. The system may also include more or fewer devices, or different device layout positions, etc.

[0110] In addition to the whole-house smart scene mentioned above, the technical solution of the above embodiment can also be applied to other scenes. For example, the technical solution of the above embodiment can also be applied to factory and office scenes where the device cards of devices need to be named in batches.

[0111] Figure 2B A structural example of the system 100 is shown, and the system 100 may include an image acquisition module, an image processing module, and an associated naming module. Optionally, the above modules in the system 100 may be integrated into the same device.

[0112] The image acquisition module can be used to acquire an image containing the device to be named. Taking the naming of the device card through the mobile phone as an example, the image acquisition module can be implemented as a camera in the mobile phone. The mobile phone can capture the image containing the device to be named through the camera.

[0113] Optionally, the image processing module may include a state modification module and a state recognition module. The state modification module may be used to instruct multiple devices to be named to adjust the device states to different states. The state recognition module may be used to recognize the device states of the devices to be named in the image. Optionally, only one of the state modification module and the state recognition module may be located in the image processing module, while the other module may be located in other modules.

[0114] Optionally, the system may further include a scene recognition module, which may be used to recognize the scene where the device to be named is located, such as the space where the device to be named is located.

[0115] The association naming module can be used to name the corresponding device cards according to the device status determined by the status recognition module and the environment where the device is located. For example, the devices to be named are three lamps. Since the color temperature of the three lamps has been adjusted according to the instructions, the color temperatures of the three lamps in the image generated by taking pictures of the three lamps are different. Therefore, the device association naming module can associate the three lamps in the image with the lamps in the actual environment according to the different color temperatures of the three lamps, and name the device cards of the three lamps accordingly. For example, the left lamp, the middle lamp, and the right lamp in the image correspond to lamps 1 to lamps 3 in room 1, respectively. Then the device association naming module can name the device card of lamp 1 as "left lamp in room 1", the device card of lamp 2 as "middle lamp in room 1", and the device card of lamp 3 as "right lamp in room 1".

[0116] Optionally, the system may also include an image registration module. The image registration module may be used to align the photographed images of two environments (or scenes) and associate the devices in the two environments. For example, after the three lamps in room 1 are named, in the process of naming the devices in room 2, if the image registration module determines that the background in the photographed image B of room 2 matches the background in the photographed image A of room 1, and the installation positions of the three lamps in room 1 in image A are similar to the installation positions of the three lamps in room 2 in image B, it means that the layouts of room 1 and room 2 are similar, and the three lamps in room 1 and room 2 may be installed in batches. In this case, the device association naming module may name the device cards of the three lamps in room 2 according to the naming rules of the device cards of the three lamps in room 1. For example, the device cards of the three lamps in room 2 from left to right are named "Room 2 Left Lamp", "Room 2 Middle Lamp", and "Room 2 Right Lamp" in order.

[0117] Optionally, the devices 100, 200, 300, etc. in the embodiments of the present application may be implemented by different devices, or some devices may be integrated together. Figure 3 This can be achieved by using the devices in the Figure 3 The hardware structure diagram of the device provided in the embodiment of the present application is shown in FIG. The device includes at least one processor 301 , a memory 303 and at least one communication interface 302 . The memory 303 may also be included in the processor 301 .

[0118] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the device. In other embodiments of the present application, the device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0119] The processor 301 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0120] There may be communication lines between the above components, and the communication lines may include a path to transmit information between the above components.

[0121] Communication interface 302, used to communicate with other devices. In the embodiment of the present application, the communication interface can be a module, a circuit, a bus, an interface, a transceiver or other device capable of implementing a communication function, used to communicate with other devices. Optionally, when the communication interface is a transceiver, the transceiver can be an independently arranged transmitter, which can be used to send information to other devices, and the transceiver can also be an independently arranged receiver, which is used to receive information from other devices. The transceiver can also be a component that integrates the functions of sending and receiving information, and the embodiment of the present application does not limit the specific implementation of the transceiver.

[0122] The memory 303 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication line. The memory may also be integrated with the processor.

[0123] The memory 303 is used to store computer-executable instructions for implementing the solution of the present application, and the execution is controlled by the processor 301. The processor 301 is used to execute the computer-executable instructions stored in the memory 303, thereby implementing the method provided in the following embodiments of the present application.

[0124] Optionally, the computer-executable instructions in the embodiments of the present application may also be referred to as application code, instructions, computer program or other names, which are not specifically limited in the embodiments of the present application.

[0125] In a specific implementation, as an embodiment, the processor 301 may include one or more CPUs, such as Figure 3 CPU0 and CPU1 in.

[0126] In a specific implementation, as an embodiment, the electronic device may include multiple processors, such as Figure 3 301 and processor 304 in FIG. Each of these processors may be a single-CPU processor or a multi-CPU processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0127] In the present application embodiment, Figure 3 The device may also include a display 305 for displaying content, such as a device card of the device.

[0128] Understandably, Figure 3 The illustrated structure does not constitute a specific limitation of the device. In other embodiments of the present application, the device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0129] Figure 3 The device shown can be a general device or a special device, and the embodiment of the present application does not limit the type of device. For example, the device is a smart panel, which is a special device for controlling smart home devices. For another example, the device is a mobile phone, which is a general device that can control smart home devices.

[0130] The technical solution of the embodiment of the present application can be applied to various scenarios for automatically naming device cards. For example, when the installation engineer installs a large number of whole-house IoT devices for each household in the entire building, this method can be used to quickly name the device cards of the installed IoT devices. For another example, during the user's subsequent use of the IoT device, this method can be used to quickly rename the device card. As follows, the automatic naming of device cards through the Yiwei application in the mobile phone is mainly used as an example to illustrate, but this does not constitute a limitation on the scenarios to which the technical solution is applicable.

[0131] Scenario 1: Automatically name the cards of multiple devices in a single space on a mobile phone

[0132] For example, the mobile phone automatically names the cards of multiple lights in the room (such as Light 1, Light 2, Light 3). Figure 4 An example of a process of the method in the embodiment of the present application is shown, and the method may include the following steps:

[0133] S101. The mobile phone receives a card management operation.

[0134] As a possible implementation method, after installing lamps 1 to 3, you can power on lamps 1 to 3 and use your mobile phone to configure the network for lamps 1 to 3, so that lamps 1 to 3 can be connected to the network environment of the whole house. Users can view the device cards of lamps 1 to 3 through the application (APP) installed on their mobile phones. For example, Figure 5 (a), the mobile phone displays the interface 501 of the Yiwei application, and the interface 501 includes the device card 501c of the lamp 1 in the guest room 1, and the device cards of lamps 2 and 3.

[0135] Interface 501 also includes control 501a. In response to the user clicking control 501a, the mobile phone may pop up card 501b, which includes the option of "smart naming for photos". The user clicks the option of "smart naming for photos", and the mobile phone receives the user's card management operation and jumps to the following example. Figure 5 The photo taking interface 502 shown in (b) of FIG. 5 may include a viewfinder 502a. The viewfinder 502a displays an image captured by the mobile phone through the camera, such as Figure 5 The image of the scene including three lights shown in (b) of FIG. 502 can also include a photo control 502b. The user can click the photo control 502b, and the mobile phone can receive the card management operation input by the user.

[0136] Here, we take the example of a user clicking the "Smart Naming" option to trigger the phone to jump to the photo interface. The operation that triggers the phone to jump to the photo interface can also be other operations, which are not limited in the present embodiment. For example, a preset operation gesture is used to trigger the phone to jump to, for example, Figure 5 The photo taking interface shown in (b).

[0137] S102. In response to the card management operation, the mobile phone sends instructions to lamps 1 to 3.

[0138] The instruction is used to instruct to modify the device status. Optionally, when the device whose device card needs to be named is a lamp, the device status may include any one or more of the following statuses: the color temperature, brightness, and saturation of the lamp. This article takes the adjustment of the color temperature of the lamp as an example, but this does not constitute a limitation on the adjustment of the device status of the lamp.

[0139] As a possible implementation, a mobile phone (an example of a first device) sends instructions (an example of a first instruction) for lamps 1-3 (an example of a second device) to a central device, and the central device sends instructions to lamps 1-3 respectively.

[0140] Exemplarily, in response to a user clicking on Figure 5 In the photo taking control 502b shown in (b), the mobile phone sends a command to the lamp 1 with the device identification aaa through the central device, so as to indicate that the lamp 1 adjusts the color temperature to the color temperature B; the mobile phone sends a command to the lamp 2 with the device identification bbb through the central device, so as to indicate that the lamp 2 adjusts the color temperature to the color temperature A; the mobile phone sends a command to the lamp 3 with the device identification ccc through the central device, so as to indicate that the lamp 3 adjusts the color temperature to the color temperature C.

[0141] Exemplarily, the following Table 1-2 shows the correspondence between the device identification of each lamp and the color temperature.

[0142] Table 1-2

[0143] equipment Equipment identification Color Temperature Light 1 aaa B Light 2 bbb A Light 3 ccc C

[0144] According to the technical solution of the embodiment of the present application, a mobile phone can instruct multiple lights to adjust to different device states, without the need for users to manually adjust the device states of the lights, thereby reducing the complexity of user operations.

[0145] The operation used to trigger the mobile phone to send instructions is not limited to the card management operation mentioned above, but can also be other operations. For example, after the mobile phone accepts the card management operation and jumps to the photo taking interface. The "one-click modification of device status" option is displayed in the photo taking interface. In response to the user clicking the "one-click modification of device status" operation, the mobile phone sends instructions to the corresponding multiple devices to instruct the multiple devices to adjust the corresponding device status.

[0146] S103: The mobile phone receives a photo-taking operation from the user.

[0147] For example, the user clicks Figure 5 The photo-taking control 502b (an example of the first operation) shown in (b) can receive the photo-taking operation of the user.

[0148] S104. In response to the photo-taking operation, the mobile phone takes a photo of the scene including lights 1 to 3 to generate an image.

[0149] The image generated by taking the photo is used by the mobile phone to distinguish between lights 1 to 3, thereby automatically naming the device cards of lights 1 to 3.

[0150] Optional, such as Figure 5 (b), the mobile phone may display a prompt box 502c in the photo taking interface 502, for prompting the user to take a photo of the lights in room 1, so as to enhance as much image details of lights 1 to 3 as possible in the taken image.

[0151] Exemplarily, in response to a user clicking on Figure 5 In the photo control 502b shown in (b), the mobile phone calls the camera to take a photo of the scene including lights 1 to 3, and generates the following Figure 6 The image shown is an example of the first image. Figure 6 ,Since the three lights have adjusted their respective color temperatures according to the instructions of the mobile phone, the color temperatures of the three lights in the image are different.

[0152] It should be noted that here, the example of a user clicking a photo control to trigger a mobile phone to acquire an image is taken. In other embodiments, the method of triggering a mobile phone to acquire an image of an environment including home appliances may be other, and the embodiments of the present application do not limit this. For example, when the mobile phone detects that the color temperatures of multiple lights in the viewfinder are different, which means that the multiple lights have adjusted their own color temperatures, the mobile phone triggers the photo taking and generates an image of the environment including the multiple lights.

[0153] S105. The mobile phone names the device cards corresponding to Lights 1 to 3 according to image A.

[0154] As a possible implementation, after the mobile phone generates an image of a scene containing lights 1 to 3, it uses an image recognition algorithm to process the image, detect lights 1 to 3 in the image, and identify the device status of lights 1 to 3. The mobile phone can distinguish each light by its different device status in the image, and associate each light in the image with the lights in the captured scene. The mobile phone can name the device card of each light according to its device status.

[0155] For example, after algorithm processing, Figure 6 The mobile phone determines that the color temperature of the left lamp in the image is color temperature B, and then the mobile phone can know that the left lamp in the image is lamp 1 with device identification aaa in the captured scene. Therefore, the mobile phone can use "the left lamp of guest room 1" as the name of the device card of lamp 1 in guest room 1. For example, the mobile phone will Figure 5The name of the device card 501c of lamp 1 shown in (a) is updated to Figure 7 The name of the device card 701a of the light 1 shown in the interface 701 (example of the first interface) is “left light”.

[0156] akin, Figure 6 The color temperature of the lamp in the middle of the image is color temperature A, so the mobile phone can know that the lamp is lamp 2 with device identification bbb, so the mobile phone can use "middle lamp in guest room 1" as the name of the device card of lamp 2. Figure 6 The color temperature of the right lamp in the image shown is color temperature C, so the mobile phone can know that the lamp is lamp 3 with device identification ccc, so the mobile phone can use "right lamp of guest room 1" as the name of the device card of lamp 3.

[0157] In this way, the mobile phone can distinguish different lights according to the device status of different lights in the image, and automatically name the device cards of the corresponding lights accordingly, without the need for users to manually change the names of device cards, which can improve the naming efficiency of device cards and reduce user operation costs. In particular, in scenarios where the names of device cards need to be modified in batches, the time-consuming manual modification of the name of each device card can be avoided.

[0158] Scenario 2:

[0159] In the above, the example that lamps 1 to 3 are all in the same space and the mobile phone knows that lamps 1 to 3 are all in the same space is taken. In other embodiments, lamps 1 to 3 may be located in different spaces, or lamps 1 to 3 may be located in the same space, but the mobile phone does not know the specific locations of the three. In this case, the mobile phone can identify the space where lamps 1 to 3 are located based on the image of the scene containing lamps 1 to 3. Afterwards, the mobile phone can automatically name the device cards of lamps 1 to 3 based on the space where lamps 1 to 3 are located and the different device states of lamps 1 to 3.

[0160] For example, Figure 8 In (a), the mobile phone displays the interface 801 of the Easy Maintenance application, which includes device cards of multiple lights in the whole house. The user can select the device cards that need to be named and managed, for example, the user long presses the first four device cards on the interface 801.

[0161] Afterwards, if Figure 8 (b), in response to the user clicking on the control 501a, the mobile phone pops up the card 501b. When detecting that the user clicks on the "Photo Smart Naming" option in the card 501b, the mobile phone sends instructions to the four lights corresponding to the four device cards selected by the user to instruct the four lights to adjust to different color temperatures.

[0162] Exemplarily, the device identifiers of the four lights corresponding to the four device cards selected by the user and the color temperatures adjusted to them are shown in Table 2 below.

[0163] Table 2

[0164] equipment Equipment identification Color Temperature Light 4 ddd E Light 5 eee D Light 6 fff G Light 7 ggg F

[0165] And, when it is detected that the user clicks Figure 8 The mobile phone can jump to the operation of the "Photo Smart Naming" option in the card 501b shown in (b). Figure 8 (c) shows the photo taking interface 803. Optionally, the mobile phone may display a prompt box 803a in the photo taking interface 802 to prompt the user to take photos of multiple areas of the whole house, so that the mobile phone can know the device status of multiple lights in the whole house through the photos taken.

[0166] Users can click Figure 8 The photo control 803b of the photo interface 803 shown in (c) triggers the mobile phone to take a photo of the light after the color temperature is adjusted. Fig. 9 The figure shows images A and B obtained by taking photos of multiple areas of the whole house by a mobile phone. For image A of a scene including lights, the mobile phone identifies the color temperature of the two lights in image A. Assuming that the color temperature of the first light from the left is color temperature F, the color temperature of the second light from the left is color temperature G, the color temperature of the third light from the left is color temperature D, and the color temperature of the light on the right is color temperature H, the mobile phone can determine that the first light on the left in image A is light 7 with a device identification of ggg as shown in Table 2, the second light on the left in image A is light 6 with a device identification of fff as shown in Table 2, and the third light on the left in image B is light 5 with a device identification of eee as shown in Table 2. Among them, the mobile phone does not indicate that a certain light is adjusted to color temperature H, which means that the user does not want to name the device card corresponding to the light on the right in image A (color temperature is color temperature H) this time.

[0167] Furthermore, the mobile phone can use an image recognition algorithm to identify the space captured by image A. For example, based on the background of image A, the mobile phone can determine that the space where lamps 5, 6, and 7 are located is guest room 2. Therefore, the mobile phone can use "Guest room 2 left lamp 1" as the name of the device card for lamp 7, "Guest room 2 left lamp 2" as the name of the device card for lamp 6, and "Guest room 2 left lamp 3" as the name of the device card for lamp 5.

[0168] Similarly, for image B including a scene of a lamp, the mobile phone recognizes that the color temperature of the lamp in image B is color temperature E, and the mobile phone can determine that the lamp in image B is lamp 4 with device identification ddd shown in Table 2. Moreover, the mobile phone can determine that the space where lamp 4 is located is a restaurant based on the background of image B. Therefore, the mobile phone can use "restaurant lamp" as the name of the device card of lamp 4.

[0169] Optionally, the naming rules of the device cards corresponding to the devices in different spaces may be different. For example, the device cards of the lights in the living room may be named based on the color temperature of the lights. For example, the device cards of multiple lights may be named warm light 1, warm light 2, and cool light 1. In this way, the user can use the corresponding device cards to control lights with different color temperatures to create light and shadow effects in the living room.

[0170] As another example, the device cards of the lamps in the guest room may be named based on the positions of the lamps. For example, the lamps in the guest room may be named lamp 1, lamp 2, and lamp 3 from left to right.

[0171] Optionally, the naming rules of the device cards can be preset, or set by the user, or the mobile phone can be set according to the user's usage habits of the device (such as a lamp).

[0172] Scenario 3:

[0173] In the above, the device that needs to be named is a lamp as an example. In other scenarios, the device that needs to be named may also be other devices.

[0174] For example, the device to be named is a switch. Figure 8 (b), the interface 802 includes device cards of multiple lights and multiple switches in the whole house. Assuming that the user selects the device cards of three switches and clicks the "Photo Smart Naming" option in card 501b, the mobile phone needs to name the device cards of the three switches.

[0175] Assume that the three switches are switch 1 to switch 3. The device identifier of switch 1 is aa, the device identifier of switch 2 is bb, and the device identifier of switch 3 is cc. In response to the user clicking the "Smart Naming for Photos" option, the mobile phone can send instructions to switches 1 to 3 to indicate that the three switches are set to different open and closed states, such as indicating that switch 1 closes the left button, indicating that switch 2 closes the middle button, and indicating that switch 3 closes the right button. Table 3-1 shows the instructions indicating the open and closed states of the three switches.

[0176] Table 3-1

[0177]

[0178] Furthermore, when the user clicks on the "Smart Naming for Photos" option, the phone can jump to the photo taking interface. The user can click on the photo taking control in the photo taking interface to trigger the phone to take photos of the switch that has been set to the open or closed state. Fig. 10AThe figure shows an image A obtained by taking a photo of multiple switches by a mobile phone. For the image A including multiple switches, the mobile phone identifies the open and closed states of the three switches in the image A. Assuming that the left key of the first switch from the left is closed, the middle key of the second switch from the left is closed, and the right key of the third switch from the left is closed, the mobile phone can determine that the first switch from the left in the image A is switch 1 with a device identification of aa as shown in Table 3-1, the second switch from the left in the image A is switch 2 with a device identification of bb as shown in Table 3-1, and the third switch from the left in the image A is switch 3 with a device identification of cc as shown in Table 3-1.

[0179] Furthermore, the mobile phone can use an image recognition algorithm to identify the space captured by image A. For example, the mobile phone can determine that the space where switches 1-3 are located is guest room 2 based on the background of image A. Therefore, the mobile phone can use "Guest room 2 left 1 switch" as the name of switch 1, "Guest room 2 left 2 switch" as the name of switch 2, and "Guest room 2 left 3 switch" as the name of switch 3.

[0180] In other embodiments, the mobile phone can also distinguish different switches in other ways. As a possible implementation method, the mobile phone can distinguish different switches according to the parameters of the lights controlled by the switches. Exemplarily, in response to the user clicking the "Smart Naming for Photos" option, the mobile phone can send instructions to switch 1-switch 3 to instruct the three switches to adjust their own control parameters. Taking the example that all three switches are switches for controlling lights, Table 3-2 shows the control parameters that the instructions instruct the three switches to adjust. Among them, when the instruction instructs switch 1 to control the light, the control parameter (color temperature of the light) is color temperature A. When the instruction instructs switch 2 to control the light, the color temperature of the light is color temperature B. When the instruction instructs switch 3 to control the light, the color temperature of the light is color temperature C.

[0181] Table 3-2

[0182] equipment Equipment identification Color Temperature Switch 1 aa A Switch 2 bb B Switch 3 cc C

[0183] In response to the user clicking on the "Smart Naming for Photos" option, the phone jumps to the photo taking interface. The user turns on switch 1, which turns on the light, and the color temperature of the light is color temperature A. The user clicks on the photo taking control in the photo taking interface, triggering the phone to take a photo of the scene containing switches 1 to 3. The phone generates a photo taking command based on the following example: Fig. 10B In the image A shown, it is known that the color temperature of the light in the environment is color temperature A, indicating that switch 1 is turned on. According to image A, the left switch in image A is turned on, so the mobile phone can determine that the left switch in image A is switch 1 in the actual environment. The mobile phone can use "left switch" as the name of the device card of switch 1 according to the naming rule.

[0184] Similarly, after taking a photo to generate image A, the user turns on switch 2, which turns on the light, and the color temperature of the light is color temperature B. The user clicks the photo control in the photo taking interface, triggering the phone to take a photo of the scene containing switches 1 to 3, and generates the following image: Fig. 10B The mobile phone can know that the color temperature of the light in the environment is color temperature B according to image B, which means that switch 2 is turned on. And according to image B, the middle switch in image B is turned on, so the mobile phone can determine that the middle switch in image B is switch 2 in the actual environment. According to the naming rules, the mobile phone can use "middle switch" as the name of the device card of switch 2.

[0185] Similarly, after taking a photo to generate image B, the user turns on switch 3, which controls the light to turn on, and the color temperature of the light is color temperature C. The user triggers the mobile phone to take a photo of the scene including switches 1 to 3, and generates the following image: Fig. 10B Image C shown. The mobile phone can automatically name the device card of switch 3 according to the color temperature of the light in the environment of image C and the naming rules.

[0186] Scenario 4:

[0187] In other scenarios, when IoT devices are installed in batches, the mobile phone can refer to the names of certain devices to name the device cards of other devices.

[0188] For example, the mobile phone can name the device cards of the three lamps in room 1 with device identifiers aaa, bbb, and ccc respectively in the above manner. In the process of naming the device cards of the three lamps, an image A is generated by taking a photo of a scene containing the three lamps. Fig.13A shown.

[0189] Alternatively, the mobile phone can name the device cards of the three lamps in room 1 by using the related technology. Then, the mobile phone sends instructions to the three lamps to instruct the three lamps to adjust their respective color temperatures. Then, the mobile phone takes a photo of the scene containing the three lamps and generates a picture such as Fig.12The image A shown. The mobile phone can distinguish different lights according to the different color temperatures of different lights in image A, and match the lights in image A with lights in the actual environment. For example, after distinction, the first light on the left in image A corresponds to light 1 with device identification aaa in the actual environment, the second light on the left corresponds to light 2 with device identification bbb in the actual environment, and the third light on the left corresponds to light 3 with device identification ccc in the actual environment. Exemplarily, the mobile phone can name the lights in the actual room 1 corresponding to each light in image A according to the position of each light in image A, for example, the names of the three lights in room 1 with device identifications aaa, bbb, and ccc are respectively "room 1 left light 1", "room 1 left light 2", and "room 1 right light". For another example, the mobile phone can name the lights in the actual room 1 corresponding to each light in image A according to the color temperature of each light in image A, for example, the names of the three lights in room 1 with device identifications aaa, bbb, and ccc are respectively "room 1 warm light 1", "room 1 warm light 2", and "room 1 cold light 1". As shown below, a mobile phone is mainly used as an example to name the corresponding lights according to the positions of the lights in image A, but this does not constitute a limitation on the naming method of the device.

[0190] Afterwards, the mobile phone names the device cards of the multiple lights in room 2. For example, Fig.11 In (a), in response to the user clicking the "Photo Smart Copy" option in card 501b, the mobile phone determines that the user wants to name the device card to be named according to the naming rules of the existing device cards, and then the mobile phone can send a batch of device cards to multiple devices (such as Fig.11 In (a), three lights other than the first three lights of the named device cards) are sent instructions (an example of the second instruction) to instruct multiple devices to adjust device states or control parameters. Afterwards, the user takes a photo of the devices to be batch named in Room 2 with a mobile phone, and the mobile phone names the device cards to be batch named in Room 2 based on the image generated by the photo.

[0191] For example, the image generated by a mobile phone taking a photo of the devices to be batch named in room 2 (an example of the second environment) is as follows Fig.11 In the image B shown in (b), the mobile phone can determine through the image registration algorithm that the image B is matched and aligned with the background in the image A generated by taking a photo of room 1 (an example of the first environment), and the installation positions of the three lamps (an example of the third device) in image B are similar to the installation positions of the three lamps in image A, which means that the layouts of room 2 and room 1 are similar. In this case, the mobile phone can name the device cards of the three lamps in room 2 according to the naming rules of the three lamps in room 1.

[0192] For example, the color temperature of the left lamp in image B is color temperature A, the color temperature of the middle lamp is color temperature B, and the color temperature of the right lamp is color temperature C. The mobile phone can establish a connection between the three lamps in image B and the three lamps in the actual room 2 according to the color temperatures of the three lamps. For example, the left lamp in image B is lamp 2 in room 2, the middle lamp in image B is lamp 1 in room 2, and the right lamp in image B is lamp 3 in room 2. Therefore, the mobile phone can refer to the naming rules of the three lamps in room 1 and use "Room 2 Left 2 Lamp" as the name of the device card of lamp 1, "Room 2 Left 1 Lamp" as the name of the device card of lamp 2, and "Room 2 Right Lamp" as the name of the device card of lamp 3.

[0193] For another example, in a hotel or other maintenance scenario, the decoration layout of each room is similar, and the device cards of multiple devices in a room can be named first. Afterwards, the name of the device card corresponding to the room can be copied to the device cards of other rooms by taking photos using the method of the embodiment of the present application. On the one hand, it can improve the configuration efficiency of the device card, and on the other hand, it can avoid problems such as irregular naming and high naming error rate caused by manual naming.

[0194] Scene 5:

[0195] The above takes batch naming of device cards of fixed devices in the environment as an example. In other scenarios, device cards of movable devices whose locations in the environment are not fixed can also be batch named.

[0196] Taking the removable device as a Bluetooth button as an example, more than two Bluetooth buttons can be placed in the same area. The mobile phone can use the above method to batch name the Bluetooth buttons. For example, in response to the user clicking the "Smart Naming for Photo" option, the mobile phone sends instructions to multiple Bluetooth buttons to indicate that the multiple Bluetooth buttons are set to different open and closed states, such as indicating that Bluetooth button 1 is closed and indicating that Bluetooth button 2 is not closed. Table 3-1 shows the instructions indicating the open and closed states of the three switch settings.

[0197] Table 3-3 shows the instructions for setting the on and off states of the two Bluetooth buttons.

[0198] Table 3-3

[0199] equipment Equipment identification Open and closed state Bluetooth button 1 aa1 Close button Bluetooth button 2 Bb1 No closing button

[0200] Furthermore, when the user clicks on the "Smart Naming for Photos" option, the phone can jump to the photo taking interface. The user can click on the photo taking control in the photo taking interface to trigger the phone to take photos of the Bluetooth button that has been set to the open or closed state. Fig.13AThe figure shows an image A obtained by taking a photo of multiple Bluetooth buttons by a mobile phone. For the image A including multiple Bluetooth buttons, the mobile phone identifies the open and closed states of two Bluetooth buttons in the image A. Assuming that the button of the first Bluetooth button from the left is closed and the button of the second Bluetooth button from the left is not closed, the mobile phone can determine that the first Bluetooth button from the left in the image A is Bluetooth button 1 with a device identifier of aa1 as shown in Table 3-3, and the second Bluetooth button from the left in the image A is Bluetooth button 2 with a device identifier of bb1 as shown in Table 3-3.

[0201] Furthermore, the mobile phone can determine that the space where Bluetooth button 1-2 is located is guest room 1 according to the background of image A. Therefore, the mobile phone can use "guest room 1-Bluetooth button 1" as the name of Bluetooth button 1 and "guest room 1-Bluetooth button 2" as the name of Bluetooth button 2.

[0202] In some other embodiments, in response to the user clicking the "Photo Smart Naming" option, the mobile phone sends instructions to multiple Bluetooth buttons to instruct the multiple Bluetooth buttons to adjust their respective control parameters, such as adjusting the color temperature of the lights controlled by each of them when they are turned on. The user can use the mobile phone to take a photo of the Bluetooth button in room 1. When the button of Bluetooth button 1301 is pressed, the image A generated by the mobile phone is as follows: Fig. 13B As shown in (a), when the Bluetooth button 1302 is pressed, the image B generated by the mobile phone camera is as follows Fig. 13B As shown in (b). The mobile phone can determine the correspondence between the Bluetooth buttons in image A and image B and the Bluetooth buttons in the actual environment according to the color temperature of the lights in the environment of image A and image B. The mobile phone can also identify the space where the two Bluetooth buttons are located according to the background of image A and image B. The mobile phone can name the device cards corresponding to the Bluetooth buttons in the actual environment according to image A and image B. Exemplarily, the Bluetooth button 1301 on the left side of image A and image B corresponds to the Bluetooth button with device identification aa in the actual room 1, and the Bluetooth button 1302 on the right side corresponds to the Bluetooth button with device identification bb in the actual room 1. For example, the mobile phone names the Bluetooth button with device identification aa as "Button 1 in Room 1" and names the Bluetooth button with device identification bb as "Button 2 in Room 1". For another example, according to the appearance of the Bluetooth buttons in image A and image B, the button of Bluetooth button 1301 is a palm-shaped button, and the button of Bluetooth button 1302 is a round button. If Fig. 13B (c), the mobile phone can use "Room 1 palm-shaped button" as the device card name of the Bluetooth button with device identification aa, and use "Room 1 round button" as the device card name of the Bluetooth button with device identification bb.

[0203] As a possible implementation method, for a removable device, the mobile phone can obtain the location of the removable device. For example, the Bluetooth button periodically reports its location to the mobile phone, or the mobile phone periodically detects or obtains the location of the Bluetooth button from other devices (such as sensors). The mobile phone can automatically update the device card name of the removable device according to the location of the removable device. In this way, the device card of the removable device can be efficiently managed.

[0204] Scene 6:

[0205] In this scenario, the device types of the multiple devices to be named are different. The mobile phone can distinguish the multiple devices according to their device types in the image and name the device cards of the multiple devices. For example, in response to the user naming the device cards of lamp A and switch A, the mobile phone takes a photo of room 3 containing lamp A and switch A, and the generated image is as follows: Fig.14 As shown. The image includes lamp A and switch A. Based on the image recognition and matching algorithm, the mobile phone recognizes that lamp A and switch A in the image are different types of devices, and the mobile phone can distinguish lamp A from switch A. The mobile phone can name the device card of lamp A as "room 3 lamp" and the device card of switch A as "room 3 switch".

[0206] In some embodiments, when there are a large number of devices to be named, for example, for some scenes (such as stations, etc.), dozens of lights need to be installed in a relatively large roof space. In this scenario, when the user takes a photo of multiple lights, a panoramic photo can be taken, and the panoramic photo includes all the lights installed on the roof. The terminal can name the corresponding lights in the actual environment according to the positions of different lights in the panoramic photo.

[0207] Alternatively, in this scenario, when a user takes photos of multiple lights, multiple photos can be taken, and one photo includes some lights. The terminal can determine the user's shooting angle based on the user's shooting posture when taking each photo, and stitch the multiple photos into one image based on the shooting angle, and name the corresponding lights in the actual environment based on the stitched image. The embodiments of the present application are not limited to this, and the terminal can also adopt other methods to process the multiple images taken to determine the names of the corresponding devices in the actual environment.

[0208] In the above, the example of identifying the space where the home appliance is located by image recognition is used. In other embodiments, the mobile phone can also determine the location of the home appliance based on the sensor perception data. For example, the user holds the mobile phone in the bedroom and takes a photo of the environment including the lamp. In this case, the mobile phone can determine that the lamp is located in the bedroom based on the sensor perception data.

[0209] In other embodiments, the mobile phone can determine the space where the home appliance is located based on the image generated by taking a photo and the sensor's perception data. For example, the mobile phone identifies the image background based on the image generated by taking a photo of an environment containing a lamp, and preliminarily determines that the lamp is located in the bedroom based on the image background. Afterwards, the mobile phone further determines that the lamp is located in the bedroom based on the sensor's perception data.

[0210] In the above, taking pictures to obtain images containing household appliances is used as an example. The mobile phone can also use other methods to obtain images containing household appliances. As a possible implementation method, when the user intends to name the device card, the mobile phone can obtain the image of the corresponding area captured by each camera from the cameras throughout the house, and name the device cards of multiple household appliances according to the different states of multiple household appliances in the image. In some examples, the mobile phone may pre-store a reference image (an example of the third image) including multiple household appliances in the first environment. For example, pre-store reference images corresponding to room 1 and room 2. Subsequently, when it is necessary to name multiple household appliances in the second environment, the mobile phone matches the reference image and the image including multiple household appliances in the second environment, so as to use the reference image corresponding to the first environment to name multiple household appliances in the second environment.

[0211] The above takes the device card as an example, and in other embodiments, the device card can also be replaced by a device label, etc. The embodiments of the present application do not limit this.

[0212] It should be noted that the above-mentioned multiple embodiments can be combined and the combined scheme can be implemented. Optionally, some operations in the process of each method embodiment are optionally combined, and / or the order of some operations is optionally changed. In addition, the execution order between the steps of each process is only exemplary and does not constitute a limitation on the execution order between the steps. There can also be other execution orders between the steps. It is not intended to indicate that the execution order is the only order in which these operations can be performed. A person of ordinary skill in the art will think of a variety of ways to reorder the operations described herein. In addition, it should be noted that the process details involved in a certain embodiment of this article are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.

[0213] In addition, some steps in the method embodiment may be equivalently replaced by other possible steps. Alternatively, some steps in the method embodiment may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added in the method embodiment. Alternatively, the execution subject (such as a functional module) of some steps in the method embodiment may be replaced by other execution subjects.

[0214] Furthermore, the above method embodiments may be implemented separately or in combination.

[0215] Some other embodiments of the present application provide a device, which may be the first device mentioned above. The device may include: a display screen, a memory, and one or more processors. The display screen, the memory, and the processor are coupled. The memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the device may perform the various functions or steps performed by the corresponding device in the above method embodiment. The structure of the device may refer to Figure 3 The equipment (device) shown.

[0216] The core structure of the device can be expressed as Fig.15 As shown in the structure, the device includes: a processing module 1301, an input module 1302, a storage module 1303 and a display module 1304.

[0217] The processing module 1301 may include at least one of a central processing unit (CPU), an application processor (AP) or a communication processor (CP). The processing module 1301 may perform operations or data processing related to the control and / or communication of at least one of the other elements of the user device. Specifically, the processing module 1301 may be used to control the content displayed on the main screen according to certain trigger conditions. The processing module 1301 is also used to process the input instructions or data and determine the display style according to the processed data.

[0218] The input module 1302 is used to obtain the instructions or data input by the user and transmit the obtained instructions or data to other modules of the device. Specifically, the input mode of the input module 1302 may include touch, gesture, approaching the screen, etc., or voice input. For example, the input module may be the screen of the device, obtain the user's input operation and generate an input signal according to the obtained input operation, and transmit the input signal to the processing module 1301.

[0219] The storage module 1303 may include a volatile memory and / or a non-volatile memory. The storage module is used to store at least one instruction or data related to other modules of the user device. Specifically, the storage module may record the location of the interface where the device interface element UI is located.

[0220] The display module 1304 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a micro-electromechanical system (MEMS) display, or an electronic paper display, and is used to display content (e.g., text, images, videos, icons, symbols, etc.) that can be viewed by a user.

[0221] Optionally, a communication module 1305 is also included to support personal devices (via a communication network) to communicate with other personal devices. For example, the communication module can be connected to a network via wireless communication or wired communication to communicate with other personal devices or network servers. Wireless communication can use at least one of cellular communication protocols, such as long-term evolution (LTE), advanced long-term evolution (LTE-A), code division multiple access (CDMA), wideband code division multiple access (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro) or global mobile communication system (GSM). Wireless communication may include, for example, short-range communication. Short-range communication may include at least one of wireless fidelity (Wi-Fi), Bluetooth, near field communication (NFC), magnetic stripe transmission (MST) or GNSS.

[0222] It should be noted that each functional module of the device can execute one or more steps in the above method embodiment.

[0223] The present application also provides a chip system, such as Fig.16 As shown, the chip system includes at least one processor 1401 and at least one interface circuit 1402. The processor 1401 and the interface circuit 1402 can be interconnected via lines. For example, the interface circuit 1402 can be used to receive signals from other devices (such as the memory of the device). For another example, the interface circuit 1402 can be used to send signals to other devices (such as the processor 1401). Exemplarily, the interface circuit 1402 can read the instructions stored in the memory and send the instructions to the processor 1401. When the instructions are executed by the processor 1401, the device can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0224] An embodiment of the present application also provides a computer storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned device, the device executes each function or step executed by the mobile phone in the above-mentioned method embodiment.

[0225] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute each function or step executed by the mobile phone in the above method embodiment.

[0226] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0227] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0228] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0229] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0230] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0231] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A device status identification method, characterized in that: Applied to a first device, the method includes: Sending a first instruction to a plurality of second devices in a first environment; the first instruction is used to instruct the plurality of second devices in the first environment to be set to different device states; Receiving a first operation input by a user; In response to the first operation, acquiring first images of a plurality of second devices included in the first environment; the plurality of second devices correspond to different device states; The multiple second devices included in the first image are named according to the device states of the multiple second devices in the first image.

2. The method according to claim 1, characterized in that Also includes: Sending a second instruction to a plurality of third devices in the second environment; the second instruction is used to instruct the plurality of third devices in the second environment to be set to different device states; receiving a second operation input by a user; In response to the second operation, a second image of a plurality of third devices included in the second environment is acquired; the plurality of third devices in the second image correspond to different device states; The second image is matched with the first image to name a plurality of third devices included in the second image using the naming of a plurality of second devices in the first image.

3. The method according to claim 1, characterized in that Also includes: Sending a second instruction to a plurality of third devices in the second environment; the second instruction is used to instruct the plurality of third devices in the second environment to be set to different device states; receiving a second operation input by a user; In response to the second operation, a second image of a plurality of third devices included in the second environment is acquired; the plurality of third devices in the second image correspond to different device states; The second image is matched with the third image to name the multiple third devices included in the second image using the naming of the multiple second devices in the third image; the third image is a pre-stored image, and the multiple second devices in the third image correspond to different device states.

4. The method according to any one of claims 1 to 3, characterized in that: Also includes: A first interface is displayed, where the first interface includes naming information of the plurality of second devices.

5. The method according to any one of claims 1 to 4, characterized in that: The method further includes: obtaining identifications of the plurality of second devices set to different device states; Naming the multiple second devices included in the first image according to the device states of the multiple second devices in the first image includes: The multiple second devices included in the first image are named according to the identifiers of the multiple second devices and the device states of the multiple second devices in the first image; the identifier of each second device corresponds to the device state of a second device in the first image.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire location information of the plurality of second devices, where the location information includes a space where the first environment is located and / or a location of the second device in the first image; Naming the multiple second devices included in the first image according to the device states of the multiple second devices in the first image includes: The multiple second devices are named according to the identifiers of the multiple second devices, the device states of the multiple second devices in the first image, and the location information of the multiple second devices.

7. The method according to claim 3, characterized in that Matching the second image with the first image includes: It is determined that the environmental background in the first image matches the environmental background in the second image, and that the positions of the plurality of second devices in the first image match the positions of the plurality of third devices in the second image.

8. The method according to any one of claims 1 to 7, characterized in that: Acquiring first images of a plurality of second devices included in the first environment includes: Taking photos of the multiple second devices to generate the first image; Or, receiving the first image from a fourth device.

9. The method according to any one of claims 1 to 8, characterized in that: The second device includes at least one of the following devices: a fixed-location device and a movable device.

10. The method according to claim 9, characterized in that The fixed-position device includes at least one of the following devices: a lamp, a switch; and the movable device includes a Bluetooth button.

11. The method according to any one of claims 1 to 10, characterized in that: The device status includes at least one of the following: color temperature, luminous saturation, open or closed state, and temperature.

12. A computer-readable storage medium, characterized in that: The method comprises a program or an instruction. When the program or the instruction is executed, the method according to any one of claims 1 to 11 is implemented.

13. An electronic device, characterized in that: The electronic device comprises a processor and a memory; The memory is used to store computer-executable instructions. When the device is running, the processor executes the computer-executable instructions stored in the memory, so that the device executes the method according to any one of claims 1 to 11.

Images