Environmental monitoring method, environmental monitoring system, and robot controller
The home robot and the detection equipment are locally networked, directly receiving and confirming abnormal information, generating and sending prompts, which solves the problems of long data transmission links and high false alarm rates in existing technologies, and realizes timely and accurate alarms for environmental monitoring.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- JD DIGITS HAIYI INFORMATION TECHNOLOGY CO LTD
- Filing Date
- 2025-01-23
- Publication Date
- 2026-07-24
AI Technical Summary
Existing environmental monitoring and early warning technologies rely on cloud processing. The data transmission links are long and susceptible to network problems, resulting in a low success rate of alarm messages reaching users, a high false alarm rate, and an inability to convey abnormal information to users in a timely and accurate manner.
By networking the home robot with the detection equipment locally, abnormal information can be directly received and secondary confirmed, and prompts can be generated and sent. Multiple methods are used to ensure the timeliness and accuracy of information transmission, including voice broadcast and video communication.
It shortens the data transmission link, improves data transmission efficiency and success rate, reduces false alarms, ensures that prompts reach users in a timely and accurate manner, and provides comprehensive security and convenient management experience.
Smart Images

Figure CN122449971A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of this disclosure relate to the field of home safety monitoring technology, specifically to environmental monitoring methods, environmental monitoring systems, and robot controllers. Background Technology
[0002] With an aging population, more and more families are facing situations where elderly people live alone or children are left home alone. In such cases, a safe home environment is especially important. Figure 1 As shown, existing environmental monitoring and early warning technologies mainly rely on home security devices combined with mobile apps to achieve basic security, environmental monitoring, and alarm functions for abnormal situations.
[0003] However, the inventors discovered that related detection technologies typically require environmental monitoring equipment to report data to the cloud (i.e., the server), which then processes the data before pushing it to the app user. Not only is the data transmission link long, but if the environmental monitoring equipment loses connection to the cloud, or if the user's app is offline or experiences network anomalies, the success rate of alarm messages reaching the user will be affected.
[0004] The information disclosed in this background section is only intended to enhance the understanding of the background of the inventive concept, and therefore may contain information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0005] The summary portion of this disclosure is intended to provide a brief overview of the concepts, which will be described in detail in the detailed description portion. This summary portion is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions.
[0006] Some embodiments of this disclosure provide environmental monitoring methods, environmental monitoring systems, robot controllers, computer-readable media, and computer program products to address one or more of the technical problems mentioned in the background section above.
[0007] In a first aspect, some embodiments of this disclosure provide an environmental monitoring method, including: in response to a robot receiving detection anomaly information sent by a detection device, determining the location area indicated by the detection anomaly information, wherein the detection device is installed in the robot's working environment, and the robot is provided with a signal connection component for establishing a connection with the detection device; controlling the robot to move to the location area, and confirming the abnormal event indicated by the detection anomaly information; in response to confirming the existence of an abnormal event, controlling the robot to generate a prompt message and sending the prompt message to the corresponding user.
[0008] In some embodiments, sending a prompt message to the corresponding user includes: determining whether there is a network connection between the robot and the application server; and in response to determining that there is a network connection, sending a prompt message to the corresponding monitoring application through the application server, wherein the monitoring application is installed on the user terminal.
[0009] In some embodiments, the method further includes: in response to determining that a network connection has failed, selecting target user information from pre-stored user information, wherein the user information includes user contact information; and sending a prompt message to the target user indicated by the target user information based on the user contact information in the target user information.
[0010] In some embodiments, controlling the robot to generate prompt information and sending the prompt information to the corresponding user further includes: controlling the robot to move in the working environment to find whether a user exists; generating prompt information based on the search result and sending the prompt information to the corresponding user, wherein different search results correspond to different sending methods.
[0011] In some embodiments, generating a prompt message based on the search result and sending the prompt message to the corresponding user includes: in response to finding a user in the work environment, determining whether the found user is only a first preset user; in response to determining that the found user is only the first preset user, generating a prompt message according to a first preset format and broadcasting the prompt message to the first preset user via voice; and selecting target user information from pre-stored user information and making a video contact with the target user indicated by the target user information.
[0012] In some embodiments, the method further includes: in response to determining that the found user has other users, and that the other users are second preset users, generating a prompt message according to a second preset format, and broadcasting the prompt message to the second preset user via voice; and in response to determining that a set time has elapsed since the voice broadcast, broadcasting the message to the second preset user again via voice to determine whether to contact the user indicated by the pre-stored user information; and determining whether to perform a video contact operation based on the response message from the second preset user.
[0013] In some embodiments, the method further includes: in response to not finding a user in the work environment, determining whether there is a room with a closed door that has not been entered; in response to determining that there is a room that has not been entered, controlling the robot to knock on the door; in response to determining that someone opens the door, determining that a user has been found in the work environment; in response to determining that no one opens the door, or determining that there is no room that has not been entered, selecting target user information from pre-stored user information and contacting the target user indicated by the target user information by telephone.
[0014] In some embodiments, confirming the abnormal event indicated by the detected anomaly information includes at least one of the following: using a camera installed on the robot to acquire video images of the location area, and performing identification and analysis on the video images to confirm whether the abnormal event indicated by the detected anomaly information exists; using thermal imaging technology installed on the robot to acquire infrared thermal images of the location area, and performing analysis on the infrared thermal images to confirm whether the abnormal event indicated by the detected anomaly information exists; using a sound receiver installed on the robot to acquire sound from the location area, and performing sound processing and analysis to confirm whether the abnormal event indicated by the detected anomaly information exists.
[0015] Secondly, some embodiments of this disclosure provide an environmental monitoring system, including: a detection device installed in the working environment to be detected, configured to detect the area where it is installed, and to send detection anomaly information to a connected robot in response to determining a detection anomaly; and a robot configured to, in response to receiving the detection anomaly information, process the detection anomaly information using the environmental monitoring method described in any implementation of the first aspect above, and periodically inspect the working environment for monitoring, wherein the robot is provided with a signal connection component for establishing a connection with the detection device.
[0016] Thirdly, some embodiments of this disclosure provide a robot controller, including: one or more processors; and a storage device storing one or more programs thereon, which, when executed by one or more processors, cause the one or more processors to implement the environmental monitoring method described in any of the implementations of the first aspect above.
[0017] Fourthly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the environmental monitoring method described in any of the implementations of the first aspect above.
[0018] Fifthly, some embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the environmental monitoring method described in any of the implementations of the first aspect above.
[0019] The various embodiments disclosed above have the following beneficial effects: The environmental monitoring methods of some embodiments of this disclosure can deliver prompt information (i.e., alarm information) to users in a timely and accurate manner. Combining the intelligent management of home robots and the monitoring functions of smart home security devices, it provides users with comprehensive security and a convenient management experience. Specifically, the robot is connected to the detection device. When the detection device detects an anomaly, it can directly report the anomaly information to the robot. That is, the robot and the detection device are locally networked, which can greatly shorten the data transmission link, thereby improving the efficiency and success rate of data transmission and avoiding network problems affecting the delivery of warnings to users. In addition, after receiving the detected anomaly information, the robot can also perform secondary confirmation of the anomaly event. If an anomaly event is confirmed, a prompt message will be generated and sent to the corresponding user. This can reduce or avoid false alarms from environmental monitoring sensors and improve the accuracy of the prompt information. Attached Figure Description
[0020] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.
[0021] Figure 1 These are flowcharts of some embodiments of relevant environmental monitoring technologies;
[0022] Figure 2 These are flowcharts of some embodiments of the environmental monitoring method disclosed herein;
[0023] Figure 3A These are schematic diagrams illustrating some application scenarios of the environmental monitoring methods disclosed herein;
[0024] Figure 3B yes Figure 3A A detailed processing flow diagram for the application scenario shown;
[0025] Figure 4 These are schematic diagrams illustrating the architecture of some embodiments of the environmental monitoring system disclosed herein;
[0026] Figure 5 This is a schematic diagram of the structure of a robot controller suitable for implementing some embodiments of the present disclosure. Detailed Implementation
[0027] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0028] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.
[0029] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0030] Furthermore, the terms “a” and “a plurality” used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as “one or more”.
[0031] Figure 2 A flow 200 is shown, illustrating some embodiments of an environmental monitoring method according to this disclosure. The method may include the following steps:
[0032] Step 201: In response to the robot receiving the detection anomaly information sent by the detection device, determine the location area indicated by the detection anomaly information.
[0033] In some embodiments, the implementer of the environmental monitoring method of this disclosure (e.g., a robot or robot controller) can communicate with other electronic devices (such as detection equipment, user terminals, etc.) via wired or wireless connections. Here, the detection equipment is generally installed in the robot's working environment. This working environment can be any environment requiring environmental monitoring, such as a home, warehouse, hotel, etc. The detection equipment is typically used for environmental safety monitoring, such as gas leak detection, door and window opening / closing detection, smoke detection, kitchen temperature detection, etc.
[0034] It is understood that the robot in this embodiment can be a home robot. Home robots are typically intelligent robots designed to perform various tasks and provide services in a home environment. These robots usually possess advanced technologies such as artificial intelligence, autonomous navigation, voice recognition, and visual recognition. They can sense and control various smart home devices, interact with family members, and assist users in completing various daily activities. These robots are typically equipped with cameras and motion components to achieve their recognition and mobility capabilities. Additionally, the robot in this embodiment is also equipped with a signal connection component for establishing a connection with the detection device. The connection method of the signal connection component can be configured according to actual needs, such as Bluetooth, wireless network, or other methods that enable signal connection. It should be noted that establishing a direct connection between the robot and the detection device can significantly shorten the transmission distance of the detection data, thereby improving the efficiency and success rate of data transmission. Furthermore, since different detection devices may have different connection methods, the aforementioned signal connection component can employ multiple protocol gateway modules to achieve connection with various detection devices, enhancing the robot's versatility.
[0035] Here, the detection equipment can perform real-time monitoring of the environmental safety at its installation location. If an anomaly is detected, it can send an anomaly information to the robot. Upon receiving the anomaly information, the robot can determine the location area indicated by the anomaly information. For example, the anomaly information may include the identification information of the detection equipment, such as its serial number or name. In this case, the robot can obtain the identification information of the detection equipment from the anomaly information. Based on this identification information, it can then determine the location area indicated by the anomaly information, i.e., the area where the safety anomaly occurred.
[0036] For example, a robot can determine the location of a device from its identification information (such as the device name), which is equivalent to the location area indicated by the detected anomaly information. If the device name is "gas leak detection device," then the robot can determine that the location area is a kitchen gas leak. Alternatively, the robot can look up the location area corresponding to the identification information from a pre-stored relational table. This relational table represents the correspondence between the identification information of the detection device and the location area.
[0037] Step 202: Control the robot to move to the location area and confirm the abnormal event indicated by the detected abnormal information.
[0038] In some embodiments, after determining the location area indicated by the detected anomaly information, the executing entity can control the robot to move to that location area and confirm the anomaly event indicated by the detected anomaly information. Here, the robot can confirm the anomaly event indicated by the detected anomaly information in various ways. For example, a camera installed on the robot can be used to acquire video images of the location area. The video images can then be analyzed to confirm whether the anomaly event indicated by the detected anomaly information exists. Alternatively, the robot can be equipped with thermal imaging technology. In this case, this technology can be used to acquire infrared thermal images of the location area. The presence of the anomaly event indicated by the detected anomaly information can then be confirmed by analyzing the infrared thermal images. Another example is the use of a sound receiver installed on the robot to acquire sound from the location area. The sound can then be processed and analyzed, such as through noise reduction and amplification, to confirm whether the anomaly event indicated by the detected anomaly information exists.
[0039] Understandably, the specific method used for confirmation can be determined based on the circumstances of the unusual event. For example, if someone is unattended in the kitchen for an extended period due to cooking or if the kitchen temperature is excessively high, thermal imaging technology can be used for confirmation, or a combination of thermal imaging technology and video images can be used.
[0040] It should be noted that the robot's secondary verification can reduce false alarms caused by the inherent false alarm rate of the detection equipment, thereby improving the accuracy of monitoring alarms. In some embodiments, if no abnormal event is confirmed, no safety alarm is required. If an abnormal event is confirmed, step 203 can be continued.
[0041] Step 203: In response to the confirmation of an abnormal event, control the robot to generate a prompt message and send the prompt message to the corresponding user.
[0042] In some embodiments, upon confirming the existence of an abnormal event, the robot can generate a notification message and send it to the corresponding user. The notification message can be sent in at least two ways. This multiple sending methods can reduce or avoid the impact of network problems, helping to ensure successful message delivery and thus improving the success rate of alerts reaching users.
[0043] It should be noted that the specific sending method used can be determined based on the actual situation. For example, such as... Figure 3A As shown, under normal network conditions, the robot can report anomalies to the server, which then pushes the alarm information to the user's app. In the event of a network outage, the robot can directly send alarms via telephone.
[0044] Specifically, first, it can be determined whether a network connection exists between the robot and the application server. For example, the robot can send a network test message to the application server. If it receives a network test response from the application server, it can be determined that a network connection exists. If it does not receive a network test response from the application server, it can be determined that there is no network connection (i.e., the network connection has failed). As another example, the robot can test the network connection to the application server. If the test is normal, it indicates that a network connection exists; if the test is abnormal, it indicates that there is no network connection.
[0045] Furthermore, if a network connection is confirmed, a notification message can be sent to the corresponding monitoring application via the application server. This monitoring application can be installed on the user's terminal. If a network connection failure is confirmed, target user information can be selected from pre-stored user information, including user contact information. Then, based on the contact information in the target user information, a notification message can be sent to the target user indicated in the target user information. This contact information can include, but is not limited to, at least one of the following: mobile phone number, landline number, or an account in a chat application. Additionally, the robot can send notification messages to the target user promptly via various methods such as telephone, SMS, voice, and video.
[0046] In some optional implementations, the robot can be controlled to move within the work environment to locate a user. Based on the search results, a prompt message is generated and sent to the corresponding user. The sending method varies depending on the search result. For example... Figure 3A As shown, in a home environment, the robot can also locate people. If it finds someone, it can use voice prompts to alert and reassure the user. If it fails to find someone, it can contact the user by phone.
[0047] Specifically, such as Figure 3B As shown, if a user is found in the work environment, it can be further determined whether the found user is only the first preset user. The first preset user can be set according to actual needs, such as people with weaker behavioral or self-control abilities, like children or elderly people with mobility difficulties. If it is determined that the found user is only the first preset user, a prompt message can be generated according to the first preset format, and the prompt message can be read aloud to the first preset user. For example... Figure 3B The dashed box shows the TTS (Text to Speech) broadcast content. It also shows the ability to select a target user from pre-stored user information and make a video call to the indicated target user, i.e., a video call to an emergency contact.
[0048] Furthermore, if it is determined that there are other users among the found users, and these other users are the second preset users, then a prompt message can be generated according to the second preset format. This prompt message can also be voice-broadcast to the second preset users. The second preset users can also be manually set, such as elderly people with good mobility or minors with a certain degree of self-care ability. Additionally, after a set time interval has elapsed since the voice broadcast, such as a 2-minute delay, the voice broadcast can be repeated to the second preset users to determine whether to contact the user indicated by the pre-stored user information. Furthermore, based on the second preset user's response, it can determine whether to perform a video call. For example, it can confirm with the user whether they need to make a call. Upon receiving confirmation from the user to make a call, the robot can call the video call interface to make a video call.
[0049] Optionally, such as Figure 3B As shown in the flowchart on the right, if the robot cannot find the user in the work environment, it can determine if there is a room that has been locked and not entered. This avoids situations where the user cannot be found because they are resting during the day or sleeping after 10 PM. If an unentered room is confirmed, the robot can knock on the door. If someone opens the door, it confirms that the user has been found in the work environment. In this case, the robot can determine whether only the first preset user exists, and then execute the corresponding prompt message sending process. If no one opens the door, or if it is determined that there is no unentered room, the robot can select the target user information from the pre-stored user information and then contact the target user indicated in the target user information by phone, i.e., call the emergency contact.
[0050] It should be noted that the pre-stored user information (i.e., the contact list) can contain information for at least one user. The robot can contact these users sequentially according to priority. For example, if the first user cannot be contacted, it can contact other users until a user is reached, or contact all users. If no one answers the call in the contact list, 24-hour human customer service can be used to contact the relevant user. This ensures that alarm information is delivered to users quickly and promptly, achieving more accurate and effective environmental safety warnings.
[0051] As described above, the environmental monitoring methods of some embodiments of this disclosure can deliver alert information (i.e., alarm information) to users in a timely and accurate manner. Specifically, most related environmental monitoring technologies are based on data reported by monitoring devices, combined with cloud platform algorithms, to push alarm messages to users' mobile apps. This approach mainly has the following problems: 1. Low reach rate: Existing environmental monitoring devices such as door locks, magnetic door sensors, and video access control systems need to report device data to the cloud, which then processes the data before pushing it to the app user. The link is long and the message delivery function to users is relatively simple, resulting in a low reach rate. In addition, disconnection between the device and the cloud, or network outages or network abnormalities in the user's app, will also affect the success rate of message delivery. 2. High false alarm rate: Security and sensor devices on the market all have a certain false alarm rate, which can easily lead to such false alarm messages misleading users, thus losing the purpose of the security device itself.
[0052] Based on this, some embodiments of the environmental monitoring method disclosed herein combine the intelligent management of home robots with the monitoring functions of smart home security devices, providing users with comprehensive security and convenient management experience. This involves connecting the robot to the detection device. When the detection device detects an anomaly, it can directly report the anomaly information to the robot. In other words, the robot and the detection device are locally networked, which greatly shortens the data transmission link, thereby improving data transmission efficiency and success rate, and avoiding network problems affecting the delivery of warnings to users. Furthermore, after receiving the detected anomaly information, the robot can also perform secondary confirmation of the anomaly. If an anomaly is confirmed, a prompt message will be generated and sent to the corresponding user. This can reduce or avoid false alarms from environmental monitoring sensors and improve the accuracy of the prompt message.
[0053] Some embodiments of this disclosure also propose an environmental monitoring system. Further reference... Figure 4 The environmental monitoring system disclosed herein may include a detection device and a robot. Here, the detection device can be installed in the working environment to be monitored, configured to detect the area where it is installed, and in response to determining a detection anomaly, send detection anomaly information to a connected robot. The robot can be configured to, in response to receiving the detection anomaly information, employ the above-described... Figure 2 The environmental monitoring method described in any of the embodiments processes abnormal detection information and can periodically inspect the working environment for safety monitoring. The robot is equipped with a signal connection component for establishing a connection with the detection equipment.
[0054] It's important to note that safety is paramount in the home environment. Traditional security alert systems often have limitations. Home robots, however, are flexible and intelligent, possessing mobility and sensory capabilities. They can patrol and monitor various areas of the home, and when encountering home security issues, they ensure that alerts are accurately and quickly delivered to users through efficient information transmission, thus better achieving environmental safety warnings.
[0055] Centered on home robots and combined with security sensors and cloud algorithms, this system can promptly detect potential safety hazards within a monitored area. For example, leaving a kitchen unattended for extended periods with open flames could damage appliances or even lead to a fire. The system accurately and quickly identifies existing safety issues in the kitchen, addressing abnormal smoke, excessively high temperatures, gas leaks, and other anomalies. The mobile robot allows for easier access to those in need of protection, providing solutions for the elderly and children. This solution extends beyond just the kitchen, providing real-time safety monitoring and, in conjunction with mobile devices, accurately analyzes scenarios and delivers optimal decisions.
[0056] Understandably, relevant environmental monitoring technologies often lack interactivity. For example, existing environmental monitoring and security devices, such as kitchen smoke alarms, only alert users through push notifications to an app or loud announcements. This method of alerting is unfriendly, and the alarm messages can easily cause panic among the elderly or children. This approach cannot accurately detect indoor occupants and cannot provide timely and appropriate suggestions and solutions to users.
[0057] The disclosed home robot can communicate with humans through technologies such as speech recognition, natural language understanding, and speech synthesis. When the robot detects an anomaly or senses an abnormal state of a security device, it can alert the homeowner through voice announcements, promptly reassuring elderly family members or children. It can also communicate with elderly family members or children, and even video-connect with children or parents to address related issues promptly.
[0058] Environmental safety early warning methods based on home robots provide comprehensive safety protection for families through real-time sensing, data analysis, alarm triggering, and autonomous response. With continuous technological advancements and expanding application scenarios, this early warning method will play an even more important role in the future, bringing greater assurance to home safety.
[0059] The following is for reference. Figure 5 The diagram shows a structural schematic of a robot controller 500 suitable for implementing some embodiments of the present disclosure. Figure 5 The robot controller shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of this disclosure.
[0060] like Figure 5 As shown, the robot controller 500 may include a processing unit 501 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. The RAM 503 also stores various programs and data required for the operation of the robot controller 500. The processing unit 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0061] Typically, the following devices can be connected to I / O interface 505: input devices 506 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a speaker, vibrator, etc.; storage devices 508 including, for example, a memory card; and communication devices 509. Communication device 509 allows robot controller 500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 A robot controller 500 with various devices is shown; however, it should be understood that implementation or possession of all the devices shown is not required. More or fewer devices may be implemented alternatively. Figure 5 Each box shown can represent a device or multiple devices as needed.
[0062] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 509, or installed from storage device 508, or installed from ROM 502. When the computer program is executed by processing device 501, it performs the functions defined in the methods of some embodiments of this disclosure.
[0063] It should be noted that, in some embodiments of this disclosure, the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0064] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.
[0065] The aforementioned computer-readable medium may be included in the robot controller or may exist independently without being assembled into the robot controller. The aforementioned computer-readable medium carries one or more programs that, when executed by the robot controller, cause the robot controller to: determine the location area indicated by the detection anomaly information sent by the detection device, wherein the detection device is installed in the robot's working environment and the robot is equipped with a signal connection component for establishing a connection with the detection device; control the robot to move to the location area and confirm the abnormal event indicated by the detection anomaly information; and, in response to confirming the existence of an abnormal event, control the robot to generate a prompt message and send the prompt message to the corresponding user.
[0066] Furthermore, computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages or a combination thereof. Programming languages include object-oriented programming languages—such as Java, Smalltalk, and C++—and conventional procedural programming languages—such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0067] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0068] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0069] Some embodiments of this disclosure also provide a computer program product, including a computer program that, when executed by a processor, implements any of the above-described environmental monitoring methods.
[0070] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.
Claims
1. An environmental monitoring method, comprising: In response to the robot receiving detection anomaly information sent by the detection device, the location area indicated by the detection anomaly information is determined, wherein the detection device is installed in the working environment of the robot, and the robot is provided with a signal connection component for establishing a connection with the detection device; Control the robot to move to the location area, and confirm the abnormal event indicated by the detected abnormal information; In response to the confirmation of the abnormal event, the robot is controlled to generate a prompt message and send the prompt message to the corresponding user.
2. The environmental monitoring method according to claim 1, wherein, Sending the prompt information to the corresponding user includes: Determine whether the robot has a network connection with the application server; In response to the determination that a network connection exists, the application server sends the notification information to the corresponding monitoring application, wherein the monitoring application is installed on the user terminal.
3. The environmental monitoring method according to claim 2, wherein, The method further includes: In response to determining that the network connection has failed, target user information is selected from pre-stored user information, wherein the user information includes the user's contact information; Based on the user contact information in the target user information, the prompt message is sent to the target user indicated by the target user information.
4. The environmental monitoring method according to claim 1, wherein, The step of controlling the robot to generate prompt information and sending the prompt information to the corresponding user also includes: The robot is controlled to move within the work environment to locate any users. Based on the search results, a prompt message is generated and sent to the corresponding user. The sending method varies depending on the search results.
5. The environmental monitoring method according to claim 4, wherein, The step of generating a prompt message based on the search results and sending the prompt message to the corresponding user includes: In response to finding a user in the work environment, determine whether the found user is only the first preset user; In response to determining that the only user found is a first preset user, a prompt message is generated according to a first preset format, and the prompt message is verbally broadcast to the first preset user; and Select target user information from pre-stored user information and contact the target user indicated by the target user information via video.
6. The environmental monitoring method according to claim 5, wherein, The method further includes: In response to the determination that there are other users besides the found user, and that the other users are second preset users, a prompt message is generated according to a second preset format, and the prompt message is verbally broadcast to the second preset user; and In response to determining that the time interval between the voice broadcast and the set time has been reached, the voice broadcast is performed again to the second preset user to determine whether to contact the user indicated by the pre-stored user information. Based on the response from the second preset user, determine whether to perform a video call.
7. The environmental monitoring method according to claim 4, wherein, The method further includes; In response to the absence of a user in the work environment, determine whether there is a room with a closed door that the user has not entered; In response to the determination that there is an unvisited room, the robot is controlled to make a knocking sound. In response to determining that someone has opened the door, it is determined that a user has been found in the work environment; In response to determining that no one opens the door, or that there is no room that has not been entered, the system selects the target user information from the pre-stored user information and contacts the target user indicated by the target user information by telephone.
8. The environmental monitoring method according to any one of claims 1-7, wherein, The confirmation of the abnormal event indicated by the detected abnormal information includes at least one of the following: Using the camera installed on the robot, video images of the location area are captured, and the video images are identified and analyzed to confirm whether there is an abnormal event indicated by the detected anomaly information; Using the thermal imaging technology installed on the robot, infrared thermal images of the location area are acquired, and the infrared thermal images are analyzed to confirm whether there is an abnormal event indicated by the abnormal detection information. The robot uses a sound receiver installed on it to collect sound from the location area and processes and analyzes the sound to confirm whether there is an abnormal event indicated by the detected anomaly information.
9. An environmental monitoring system, comprising: The detection equipment, installed in the working environment to be inspected, is configured to inspect the area where it is installed, and in response to determining an anomaly, send anomaly information to the connected robot. A robot is configured to, in response to receiving the detected anomaly information, process the detected anomaly information using the environmental monitoring method as described in any one of claims 1-8, and periodically inspect the working environment for monitoring, wherein the robot is provided with a signal connection component for establishing a connection with the detection device.
10. A robot controller, comprising: One or more processors; Storage device, on which one or more programs are stored, When the one or more programs are executed by the one or more processors, the one or more processors implement the environmental monitoring method as described in any one of claims 1-8.
11. A computer-readable medium having a computer program stored thereon, wherein, When the computer program is executed by the processor, it implements the environmental monitoring method as described in any one of claims 1-8.
12. A computer program product comprising a computer program that, when executed by a processor, implements the environmental monitoring method as described in any one of claims 1-8.