Equipment monitoring method, device, system, storage medium and electronic device
By obtaining device status query instructions and three-dimensional panoramic models, the operating status of smart home devices is intuitively displayed, which solves the problem of monitoring smart home devices and improves user experience and device management efficiency.
Patent Information
- Application Number
- CN202210868956.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-22
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2042-07-22
AI Technical Summary
Existing smart home equipment monitoring technology is difficult to effectively detect equipment failures and manage power waste, resulting in poor user experience and economic losses.
By obtaining device status query instructions, the operating status and installation location information of the target device are determined, and the device status is displayed in the indoor panoramic view based on the three-dimensional panoramic model, the equipment is realized intuitive monitoring and early warning prompts.
It improves users' monitoring and management capabilities of smart home devices, reduces equipment failures and power waste, and improves user experience.
Smart Images

Figure CN115390465B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart home / smart family technology, and more specifically, to a device monitoring method, device, system, storage medium and electronic device. Background Art
[0002] With the rapid development of science and technology, more and more smart devices are being used in family life to provide users with a comfortable living environment. For example, in family life, a large number of smart switches, smart lamps, smart locks, smart air conditioners, smart washing machines and smart refrigerators may be used.
[0003] Such a large number of smart devices has brought a huge usage burden to users. For example, if some devices malfunction, if not discovered in time, it may cause personal injury and property loss to users; some devices are still in operation after use, causing waste of electricity and causing economic losses to users.
[0004] Therefore, how to monitor various smart devices in the home and improve the user experience of smart homes has become a technical problem that needs to be urgently solved in the industry. Summary of the invention
[0005] The present application provides a device monitoring method, apparatus, system, storage medium and electronic device for solving the technical problem of how to monitor various smart devices in a home and improve the user experience of smart home.
[0006] The present application provides a device monitoring method, comprising:
[0007] Get device status query instructions;
[0008] Based on the device status query instruction, determine the target device corresponding to the device status query instruction, and based on the target device, determine the operating status information and installation location information of the target device;
[0009] Based on the installation location information and the three-dimensional panoramic model of the target building where the target device is located, determine an indoor panoramic view including the target device;
[0010] The operating status information of the target device is displayed in the indoor panoramic view.
[0011] According to the device monitoring method provided by the present application, the step of determining the target device corresponding to the device status query instruction based on the device status query instruction includes:
[0012] Performing keyword extraction on the device status query instruction, and determining a master device corresponding to the device status query instruction based on the keyword extraction result;
[0013] Based on the master device and the master-slave relationship of the devices in the target building, determining the slave device corresponding to the master device;
[0014] Based on the master device and / or the slave device, a target device corresponding to the device status query instruction is determined.
[0015] According to the device monitoring method provided by the present application, determining the operating status information and installation location information of the target device based on the target device includes:
[0016] Comparing the identification information of the target device with the identification information of each device in the building equipment operation status table, and determining the operation status information of the target device based on the identification information comparison result;
[0017] The identification information of the target device is compared with the identification information of each device in the building equipment installation information table, and the installation location information of the target device is determined based on the identification information comparison result.
[0018] According to the equipment monitoring method provided by the present application, the construction equipment operation status table is determined based on the following steps:
[0019] Based on a preset query time interval, sending a status query instruction to each device in the target building;
[0020] Receiving operation status information fed back by each device based on the status query instruction;
[0021] The building equipment operation status table is determined based on the operation status information of each device.
[0022] According to the device monitoring method provided by the present application, the displaying of the operating status information of the target device in the indoor panoramic view includes:
[0023] Determine the warning state of the target device based on each operating indicator in the operating state information of the target device and the warning threshold corresponding to each operating indicator;
[0024] When the warning state of the target device is a fault state, the display state of the target device is adjusted in the indoor panoramic view.
[0025] According to the device monitoring method provided by the present application, the obtaining device status query instruction includes:
[0026] Send query prompt voice;
[0027] receiving a query response voice input by a user based on the query prompt voice;
[0028] The device status query instruction is determined based on the transcribed text of the query response speech.
[0029] The present application provides a device monitoring apparatus, comprising:
[0030] An acquisition unit, used for acquiring a device status query instruction;
[0031] an information determining unit, configured to determine, based on the device status query instruction, a target device corresponding to the device status query instruction, and based on the target device, determine operating status information and installation location information of the target device;
[0032] a map determining unit, configured to determine an indoor panoramic map including the target device based on the installation location information and a three-dimensional panoramic model of a target building where the target device is located;
[0033] A display unit is used to display the operating status information of the target device in the indoor panoramic view.
[0034] The present application provides an equipment monitoring system, including an equipment monitoring device, and a plurality of equipment arranged in a target building;
[0035] Each device is connected to the device monitoring apparatus through at least one of an Internet of Things, a wireless local area network or a cellular network.
[0036] The present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, wherein the device monitoring method is implemented when the program is executed.
[0037] The present application provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to implement a device monitoring method described in the computer program.
[0038] The device monitoring method, device, system, storage medium and electronic device provided in the present application determine the target device corresponding to the device status query instruction based on the acquired device status query instruction, and determine the operating status information and installation location information of the target device based on the target device; determine an indoor panoramic view containing the target device based on the installation location information and a three-dimensional panoramic model of a target building where the target device is located; display the operating status information of the target device in the indoor panoramic view, so that the user can intuitively monitor each device in the target building and view the environmental information and status information of the device at the same time, thereby improving the user's experience of using smart homes. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0040] In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0041] Figure 1 It is one of the flow charts of the device monitoring method provided by this application;
[0042] Figure 2 This is the second flow chart of the device monitoring method provided by this application;
[0043] Figure 3 It is a structural schematic diagram of the equipment monitoring device provided by the present application;
[0044] Figure 4 It is a structural diagram of the equipment monitoring system provided by this application;
[0045] Figure 5 It is a schematic diagram of the hardware environment of the device monitoring method provided by this application;
[0046] Figure 6 It is a schematic diagram of the structure of the electronic device provided in this application.
[0047] Reference numerals:
[0048] 501: terminal device; 502: server. DETAILED DESCRIPTION
[0049] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0050] It should be noted that the terms "first", "second" etc. in the present application are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable in appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, the process, method, system, product or equipment comprising a series of steps or units need not be limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment.
[0051] Figure 1 This is one of the flow charts of the device monitoring method provided by this application, such as Figure 1 As shown, the method includes step 110 , step 120 , step 130 and step 140 .
[0052] Step 110: Obtain device status query instruction.
[0053] Specifically, the execution subject of the device monitoring method provided in the embodiment of the present application is a device monitoring apparatus. The device monitoring apparatus can be embodied in the form of software, such as device monitoring software; it can also be a hardware device for executing the device monitoring method, including a mobile terminal, a tablet computer, a desktop computer, and a server.
[0054] The application scenario of the device monitoring method provided in the embodiment of the present application is a home scenario. Among them, the device is a smart home appliance, that is, various home appliances that have a network communication module, can access the Internet or the Internet of Things, can send their own operating status, receive and execute remote control commands, including smart speakers, smart air conditioners, smart refrigerators, smart TVs, smart bathroom heaters, smart lamps and smart switches.
[0055] The device status query instruction is an instruction to query the status of each device in the home scene. The device monitoring device can provide the user with input devices such as a keyboard, a touch screen or a remote control, and the user can input the device status query instruction by himself; it can also collect the voice signal emitted by the user through a sound sensor and obtain the device status query instruction through a voice recognition method; it can also collect the user's gestures or body movements through an image sensor and obtain the device status query instruction associated with the gestures or body movements.
[0056] For example, the user can set an image of a specific gesture action in the device monitoring device, and associate the specific gesture action with the switch status of the query lamp. When the camera captures the user's image and sends the image to the device monitoring device, the device monitoring device can generate a lamp switch status query instruction when it recognizes the specific gesture action based on the image.
[0057] Step 120: Based on the device status query instruction, determine the target device corresponding to the device status query instruction, and based on the target device, determine the operating status information and installation location information of the target device.
[0058] Specifically, the operation status information refers to each operation status of the device and / or the operation parameters under each operation status. For example, the operation status information may include online status, offline status, fault status, etc., and may also include operation parameters under each status, such as voltage parameters, current parameters, power parameters, etc. under the online status. The operation status information may be defined differently according to different device types.
[0059] The installation location information refers to the installation location of the device in the target building. The target building here is the house corresponding to the home scene, such as a residence, apartment, or hotel. The representation of the installation location can be defined according to actual needs. For example, for a smart air conditioner, its installation location information can be represented in an array, such as [second floor, bedroom, east wall]. It is also possible to establish a three-dimensional coordinate system for the entire target building, with the door position as the coordinate origin, the east-west direction as the X-axis, the north-south direction as the Y-axis, and the vertical direction as the Z-axis. The installation location information of a smart air conditioner is represented in coordinate form as (10, 3, 2), in meters.
[0060] By parsing the device status query instruction, the target device corresponding to the device status query instruction can be determined, and the operating status information and installation location information of the target device can be further determined based on the target device.
[0061] For example, if the device status query command is "the on / off status of all air conditioners", after parsing the command, it can be determined that the target device is the air conditioner in each room in the target building; if the device status query command is "the on / off status of the ceiling light in the master bedroom", after parsing the command, it can be determined that the target device is the ceiling light in the master bedroom in the target building.
[0062] The equipment monitoring device can pre-store the installation location information of each device in the target building. According to the determined target device, the installation location information of the target device can be queried. Since the equipment monitoring device is connected to each device through network communication, the equipment monitoring device can obtain the operating status information of each device in real time. After the target device is determined, the operating status information of the target device can be queried.
[0063] Step 130: Determine an indoor panoramic image including the target device based on the installation location information and the three-dimensional panoramic model of the target building where the target device is located.
[0064] Specifically, a 3D panoramic model is a virtual model of a real scene built based on 3D panoramic technology. The 3D panoramic model of a target building refers to a model obtained by taking 360-degree photos of each room in the target building through a camera, and then stitching them together at the corresponding positions in the target building according to the content of each photo. Through the 3D panoramic model, the equipment in each room of the target building can be viewed interactively in all directions, and the real scene of each equipment can be restored.
[0065] According to the installation location of the target device and the three-dimensional panoramic model of the target building where the target device is located, an indoor panoramic view of the location of the target device can be determined. The indoor panoramic view displays the target device and the surrounding environment where the target device is located in a wide-angle manner.
[0066] Step 140: Display the operating status information of the target device in the indoor panoramic view.
[0067] Specifically, the equipment monitoring device can superimpose the operating status information of the target equipment on the indoor panoramic view for display, so that the user can monitor the target equipment more intuitively and can also directly view the operating status of the target equipment.
[0068] The device monitoring method provided in the embodiment of the present application determines the target device corresponding to the device status query instruction according to the acquired device status query instruction, and determines the operating status information and installation location information of the target device according to the target device; determines an indoor panoramic view including the target device according to the installation location information and a three-dimensional panoramic model of a target building where the target device is located; displays the operating status information of the target device in the indoor panoramic view, so that the user can intuitively monitor each device in the target building and view the environmental information and status information of the device at the same time, thereby improving the user's experience of using smart homes.
[0069] Based on the above embodiment, step 120 includes:
[0070] Extract keywords from the device status query instruction, and determine the main device corresponding to the device status query instruction based on the keyword extraction result;
[0071] Based on the master device and the master-slave relationship of the devices in the target building, determine the slave device corresponding to the master device;
[0072] Based on the master device and / or the slave device, a target device corresponding to the device status query instruction is determined.
[0073] Specifically, keyword extraction can be performed on the device status query instruction input by the user to obtain a keyword extraction result, that is, a keyword for finding the target device. The keyword extraction method can adopt a keyword extraction method based on statistical features, a keyword extraction method based on a word graph model, and a keyword extraction method based on a topic model. For example, if the device status query instruction input by the user is "What is the status of the air conditioner in the living room", after keyword extraction of the instruction, the keywords obtained are "living room" and "air conditioner".
[0074] Since there is a master-slave relationship between the various devices in the home scene, when the user queries the target device, both the master device and the slave devices subordinate to the master device can be used as target devices. For example, in the living room, a central air-conditioning system may be set up, including a master air-conditioner and multiple slave air-conditioners. When the user's device status query instruction is issued, it can be determined that the master device corresponding to the extracted keyword "air-conditioner" is the master air-conditioner. According to the subordinate relationship between the main air-conditioner and the remaining multiple slave air-conditioners in the living room, the main air-conditioner in the living room is used as the master device, and the slave air-conditioners are used as slave devices, both of which are used as the target devices that the user wants to view.
[0075] You can collect statistics on the equipment in each room of the target building and determine the master-slave relationship of the equipment in the target building according to the equipment category or equipment purpose. For example, you can classify multiple wall lamps in a room separately to determine the master and slave equipment; you can also classify all ceiling lamps, wall lamps, table lamps and floor lamps in the room separately, with the ceiling lamp as the master equipment and other lamps as slave equipment.
[0076] Based on any of the above embodiments, step 120 includes:
[0077] Compare the identification information of the target device with the identification information of each device in the building equipment operation status table, and determine the operation status information of the target device based on the identification information comparison result;
[0078] The identification information of the target device is compared with the identification information of each device in the building equipment installation information table, and the installation location information of the target device is determined based on the identification information comparison result.
[0079] Specifically, the identification information of the target device may be a device code, a service set identifier (SSID) or a media access control address (MAC address) of the target device, etc. The identification information is used to uniquely identify all devices in the target building.
[0080] The equipment monitoring device can collect the operating status information of each device in the target building and establish a building equipment operating status table. The time interval can be set to update the building equipment operating status table. The equipment monitoring device compares the identification information of the target device with the identification information of each device in the building equipment operating status table. When the identification information of the target device is the same as the identification information of any device, it can be determined that the device is the same as the target device, and the operating status information of the device in the building equipment operating status table is used as the operating status information of the target device.
[0081] The equipment monitoring device can collect the installation location information of each device in the target building and establish a building equipment installation information table. The time interval can be set to update the building equipment installation information table. The equipment monitoring device compares the identification information of the target device with the identification information of each device in the building equipment installation information table. When the identification information of the target device is the same as the identification information of any device, it can be determined that the device and the target device are the same device, and the installation location information of the device in the building equipment installation information table is used as the installation location information of the target device.
[0082] Based on any of the above embodiments, the construction equipment operation status table is determined based on the following steps:
[0083] Based on a preset query time interval, a status query instruction is sent to each device in the target building;
[0084] Receive the operating status information fed back by each device based on the status query instruction;
[0085] Based on the operating status information of each device, a building equipment operating status table is determined.
[0086] Specifically, the building equipment operation status table can be updated according to a preset query time interval. That is, the equipment monitoring device can send a status query instruction at the current moment to each device in the target building through the communication network at the current moment according to the preset query time interval. After receiving the status query instruction at the current moment, each device organizes its own operation status and operation parameters into the operation status information at the current moment, and sends it to the equipment monitoring device. After receiving the operation status information at the current moment, the equipment monitoring device updates the operation status information of each device in the building equipment operation status table at the previous moment to obtain the latest building equipment operation status table.
[0087] The preset query time interval can be determined according to the purpose of each device. For example, smart home appliances can be divided into kitchen equipment, bathroom equipment, cleaning equipment and air conditioning equipment. For kitchen equipment, such as gas stoves and microwave ovens, if used improperly, it will cause personal injury to the user, so a shorter preset query time interval can be set; for air conditioning equipment, such as air conditioners and heaters, if used improperly, it will only affect the user's experience and will not cause personal injury to the user, so a longer preset query time interval can be set. In addition, users can also customize the preset query time interval for each device in the device monitoring device according to personal preferences or focus.
[0088] By setting different preset query time intervals for devices with different purposes, the personalized needs of users can be met. At the same time, the computing resources of the equipment monitoring device can be effectively utilized to avoid frequent status queries of all devices, which would bring a large communication load to the communication network.
[0089] Based on any of the above embodiments, step 140 includes:
[0090] Determine the warning state of the target device based on each operating indicator in the operating state information of the target device and the warning threshold corresponding to each operating indicator;
[0091] When the warning state of the target device is a fault state, the display state of the target device is adjusted in the indoor panoramic view.
[0092] Specifically, in order to be able to prompt the user more intuitively, multiple operating indicators can be set for each device, and a corresponding warning threshold can be set for each operating indicator. When the operating indicator value in the operating status information of the target device exceeds the warning threshold, the warning state of the target device is set to a fault state. For example, if the target device is an air conditioner, the operating indicator in the operating status information of the air conditioner can be set to the air conditioner cooling temperature, and the warning threshold of the operating indicator can be set to 28 degrees Celsius. If the air conditioner cooling temperature is higher than the warning threshold, the warning state of the air conditioner is determined to be a fault state.
[0093] For the target device, judging the warning status only by a single operating indicator has low accuracy. Different warning weights can be set for each operating indicator, and the degree to which each operating indicator exceeds the warning threshold is weighted and summed, and the warning status of the target device is determined based on the weighted summation result. For example, for an air conditioner, the air conditioner cooling temperature is more accurate than the air conditioner operating power. Therefore, a lower warning weight can be set for the air conditioner cooling temperature, and a higher warning weight can be set for the air conditioner operating power.
[0094] In the indoor panoramic view, the display status of the target device can be reflected in display color, display size, display shape, etc. When the warning status of the target device is a fault status, the target device can be flashed, highlighted, enlarged, or the display color of the target device can be changed to red.
[0095] By associating the display status of the target device with the warning status, the user can intuitively view the operating status information of the target device.
[0096] Based on any of the above embodiments, step 110 includes:
[0097] Send query prompt voice;
[0098] Receiving a query response voice input by a user based on a query prompt voice;
[0099] Based on the transcribed text of the query response voice, the device status query instruction is determined.
[0100] Specifically, the device monitoring device can also query the operating status of the target device through voice control. For example, when the device monitoring device is embodied in the form of an application and runs on the user's mobile phone, the user only needs to input voice to realize remote monitoring of various devices in the home environment.
[0101] The device monitoring device can send a query prompt voice to the user, such as "What device do you want to query?" Through the voice prompt, it is relatively convenient to reduce the user's active input, save the user's time, and reduce the obstacles for the user to use the device monitoring device.
[0102] The user responds to the query prompt voice, such as "I want to check the status of the bedroom air conditioner". After receiving the query response voice, the device monitoring device uses voice transcription technology to process the query response voice into transcribed text. After extracting keywords from the transcribed text, the device status query instruction can be obtained.
[0103] Based on any of the above embodiments, Figure 2 This is the second flow chart of the device monitoring method provided by this application, such as Figure 2 As shown, the method is applied to a home scene, in which a device monitoring device is provided, and the device is connected to each device in the home scene through the Internet of Things. The method includes:
[0104] Step 210: Obtain basic attribute information of the device (device MAC address, application category, floor, room).
[0105] Step 220: Determine the master-slave relationship of the devices (one master device may correspond to multiple slave devices).
[0106] Step 230: Query the online status of the device (this data is real-time data and needs to be re-acquired by calling the interface every 120 seconds).
[0107] Step 240: Obtain device reporting information (including attribute reporting, alarms, online and offline, network reporting, etc.).
[0108] In order to load data quickly, the calls between data are processed using the Remote Dictionary Server (Redis) cache to ensure that data can be loaded quickly, giving users a smooth data display experience.
[0109] In addition, the equipment monitoring device can also analyze the operation of the equipment according to various dimensions. For example, by model, you can see how many air conditioners and lights there are. By room, you can see how many devices there are in each room on each floor. By access type, you can see how many devices of each type are connected. By signal strength, you can see how many good, medium, and poor devices there are.
[0110] Based on any of the above embodiments, Figure 3 It is a structural diagram of the equipment monitoring device provided by this application, such as Figure 3 As shown, the device comprises:
[0111] An acquisition unit 310 is used to acquire a device status query instruction;
[0112] The information determining unit 320 is used to determine the target device corresponding to the device status query instruction based on the device status query instruction, and determine the operating status information and installation location information of the target device based on the target device;
[0113] A map determining unit 330 is used to determine an indoor panoramic map including the target device based on the installation location information and the three-dimensional panoramic model of the target building where the target device is located;
[0114] The display unit 340 is used to display the operating status information of the target device in the indoor panoramic view.
[0115] The device monitoring device provided in the embodiment of the present application determines the target device corresponding to the device status query instruction based on the acquired device status query instruction, and determines the operating status information and installation location information of the target device based on the target device; determines an indoor panoramic view including the target device based on the installation location information and a three-dimensional panoramic model of a target building where the target device is located; and displays the operating status information of the target device in the indoor panoramic view, so that the user can intuitively monitor each device in the target building and view the environmental information and status information of the device at the same time, thereby improving the user's experience of using smart homes.
[0116] Based on any of the above embodiments, the information determination unit is used to:
[0117] Extract keywords from the device status query instruction, and determine the main device corresponding to the device status query instruction based on the keyword extraction result;
[0118] Based on the master device and the master-slave relationship of the devices in the target building, determine the slave device corresponding to the master device;
[0119] Based on the master device and / or the slave device, a target device corresponding to the device status query instruction is determined.
[0120] Based on any of the above embodiments, the information determination unit is used to:
[0121] Compare the identification information of the target device with the identification information of each device in the building equipment operation status table, and determine the operation status information of the target device based on the identification information comparison result;
[0122] The identification information of the target device is compared with the identification information of each device in the building equipment installation information table, and the installation location information of the target device is determined based on the identification information comparison result.
[0123] Based on any of the above embodiments, the device further includes:
[0124] The building equipment operation status table determination unit is used to send a status query instruction to each device in the target building based on a preset query time interval; receive the operation status information fed back by each device based on the status query instruction; and determine the building equipment operation status table based on the operation status information of each device.
[0125] Based on any of the above embodiments, the display unit is used for:
[0126] Determine the warning state of the target device based on each operating indicator in the operating state information of the target device and the warning threshold corresponding to each operating indicator;
[0127] When the warning state of the target device is a fault state, the display state of the target device is adjusted in the indoor panoramic view.
[0128] Based on any of the above embodiments, the acquiring unit is used for:
[0129] Send query prompt voice;
[0130] Receiving a query response voice input by a user based on a query prompt voice;
[0131] Based on the transcribed text of the query response voice, the device status query instruction is determined.
[0132] Based on any of the above embodiments, Figure 4 It is a structural diagram of the equipment monitoring system provided by this application, such as Figure 4 As shown, the system 400 includes the equipment monitoring device 410 in the above embodiment, and a plurality of equipment 420 arranged in the target building; wherein the dotted lines represent communication connections.
[0133] Each device 420 is connected to the device monitoring apparatus 410 through at least one of the Internet of Things, a wireless local area network or a cellular network.
[0134] Specifically, the Internet of Things (IoT) is an extended and expanded network based on the Internet. It combines various information sensing devices with the network to form a huge network, realizing the interconnection of people, machines and objects at any time and any place. The Internet of Things can be established through a cloud platform to connect various devices in a home scene with device monitoring devices to achieve data transmission.
[0135] In addition, the various devices and device monitoring devices can be connected via a wireless LAN or a cellular network.
[0136] Based on any of the above embodiments, the present application also provides a device monitoring method. The device monitoring method is widely used in smart home (Smart Home), smart home, smart home device ecology, smart residential (Intelligence House) ecology and other whole-house intelligent digital control application scenarios. In this embodiment, Figure 5 is a schematic diagram of the hardware environment of the device monitoring method provided by the present application. The above device monitoring method can be applied to Figure 5 In the hardware environment shown, which is composed of a terminal device 501 and a server 502, the server 502 is connected to the terminal device 501 through a network, and can be used to provide services (such as application services, etc.) for the terminal or a client installed on the terminal. A database can be set on the server or independently of the server to provide data storage services for the server 502. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data computing services for the server 502.
[0137] The above network may include but is not limited to at least one of the following: wired network, wireless network. The above wired network may include but is not limited to at least one of the following: wide area network, metropolitan area network, local area network, and the above wireless network may include but is not limited to at least one of the following: WIFI (Wireless Fidelity), Bluetooth. The terminal device 501 may be but is not limited to a PC, a mobile phone, a tablet computer, a smart air conditioner, a smart range hood, a smart refrigerator, a smart oven, a smart stove, a smart washing machine, a smart water heater, a smart washing equipment, a smart dishwasher, a smart projection equipment, a smart TV, a smart clothes drying rack, a smart curtain, a smart audio and video, a smart socket, a smart speaker, a smart speaker, a smart fresh air equipment, a smart kitchen and bathroom equipment, a smart bathroom equipment, a smart sweeping robot, a smart window cleaning robot, a smart mopping robot, a smart air purification equipment, a smart steamer, a smart microwave oven, a smart kitchen treasure, a smart purifier, a smart water dispenser, a smart door lock, etc.
[0138] Based on any of the above embodiments, based on any of the above embodiments, Figure 6 A schematic diagram of the structure of the electronic device provided in this application, such as Figure 6 As shown, the electronic device may include: a processor (Processor) 610, a communication interface (Communications Interface) 620, a memory (Memory) 630 and a communication bus (Communications Bus) 640, wherein the processor 610, the communication interface 620, and the memory 630 communicate with each other through the communication bus 640. The processor 610 may call the logic command in the memory 630 to execute the following method:
[0139] Obtain a device status query instruction; based on the device status query instruction, determine a target device corresponding to the device status query instruction, and based on the target device, determine the operating status information and installation location information of the target device; based on the installation location information and a three-dimensional panoramic model of a target building where the target device is located, determine an indoor panoramic view including the target device; and display the operating status information of the target device in the indoor panoramic view.
[0140] In addition, the logic commands in the above-mentioned memory 630 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on such an understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art, and the computer software product is stored in a storage medium, including several commands to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.
[0141] The processor in the electronic device provided in the embodiment of the present application can call the logic instructions in the memory to implement the above method. Its specific implementation method is consistent with the implementation method of the aforementioned method and can achieve the same beneficial effects, which will not be repeated here.
[0142] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the methods provided in the above embodiments are implemented.
[0143] Its specific implementation is consistent with the aforementioned method implementation and can achieve the same beneficial effects, so it will not be repeated here.
[0144] An embodiment of the present application provides a computer program product, including a computer program, which implements the above method when executed by a processor.
[0145] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0146] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.
[0147] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A device monitoring method, characterized in that: include: Get device status query instructions; Based on the device status query instruction, determine the target device corresponding to the device status query instruction, and based on the target device, determine the operating status information and installation location information of the target device; Based on the installation location information and the three-dimensional panoramic model of the target building where the target device is located, determine an indoor panoramic view including the target device; Displaying the operating status information of the target device in the indoor panoramic view; The determining, based on the device status query instruction, a target device corresponding to the device status query instruction includes: Performing keyword extraction on the device status query instruction, and determining a master device corresponding to the device status query instruction based on the keyword extraction result; Based on the master device and the master-slave relationship of the devices in the target building, determining the slave device corresponding to the master device; Based on the master device and / or the slave device, a target device corresponding to the device status query instruction is determined.
2. The device monitoring method according to claim 1, characterized in that: The determining, based on the target device, the operating status information and the installation location information of the target device includes: Comparing the identification information of the target device with the identification information of each device in the building equipment operation status table, and determining the operation status information of the target device based on the identification information comparison result; The identification information of the target device is compared with the identification information of each device in the building equipment installation information table, and the installation location information of the target device is determined based on the identification information comparison result.
3. The device monitoring method according to claim 2, characterized in that: The construction equipment operation status table is determined based on the following steps: Based on a preset query time interval, sending a status query instruction to each device in the target building; Receiving operation status information fed back by each device based on the status query instruction; The building equipment operation status table is determined based on the operation status information of each device.
4. The device monitoring method according to claim 1, characterized in that: The displaying of the operating status information of the target device in the indoor panoramic view includes: Determine the warning state of the target device based on each operating indicator in the operating state information of the target device and the warning threshold corresponding to each operating indicator; When the warning state of the target device is a fault state, the display state of the target device is adjusted in the indoor panoramic view.
5. The device monitoring method according to any one of claims 1 to 4, characterized in that: The obtaining device status query instruction includes: Send query prompt voice; receiving a query response voice input by a user based on the query prompt voice; The device status query instruction is determined based on the transcribed text of the query response speech.
6. An equipment monitoring device, characterized in that: include: An acquisition unit, used for acquiring a device status query instruction; an information determining unit, configured to determine, based on the device status query instruction, a target device corresponding to the device status query instruction, and based on the target device, determine operating status information and installation location information of the target device; a map determining unit, configured to determine an indoor panoramic map including the target device based on the installation location information and a three-dimensional panoramic model of a target building where the target device is located; A display unit, used for displaying the operating status information of the target device in the indoor panoramic view; The information determination unit is used for: Performing keyword extraction on the device status query instruction, and determining a master device corresponding to the device status query instruction based on the keyword extraction result; Based on the master device and the master-slave relationship of the devices in the target building, determining the slave device corresponding to the master device; Based on the master device and / or the slave device, a target device corresponding to the device status query instruction is determined.
7. A device monitoring system, characterized in that: The device comprises the equipment monitoring device as claimed in claim 6, and a plurality of equipments arranged in a target building; Each device is connected to the device monitoring apparatus through at least one of an Internet of Things, a wireless local area network or a cellular network.
8. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein the device monitoring method according to any one of claims 1 to 5 is executed when the program is executed.
9. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the device monitoring method according to any one of claims 1 to 5 through the computer program.
Citation Information
Patent Citations
Ontology-based smart home semantic query method and ontology-based smart home semantic query device
CN104424310A
Remote intelligent household system based on Internet of Things
CN107193214A
Control method and device for intelligent equipment, storage medium and processor
CN108717270A
State prompting method, device and equipment and storage medium
CN110620707A
State information query method and device
CN111274319A
