A method for handling household accidents
By identifying and recording family members and comprehensive information judgment in the intelligent home monitoring system, combining image feature matching and hierarchical analysis methods, the problems of untimely processing and high misjudgment rates in the existing technology are solved, and more reasonable and Accurate accident handling.
Patent Information
- Application Number
- CN201910334298.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-04-24
- Publication Date
- 2024-12-17
- Estimated Expiration
- 2039-04-24
AI Technical Summary
The existing smart home monitoring technology is not promptly, intelligently and has a high misjudgment rate when handling emergencies, resulting in unreasonable accident handling.
The monitoring center will identify and record family members, continuously judge the accident situation, combine image feature matching and hierarchical analysis methods to make comprehensive judgments. If family members are not online, they will send a request for help to the user and execute feedback instructions to improve processing. Rationality.
Through a comprehensive judgment method of multiple information, the misjudgment rate is reduced, making the monitoring center's handling of family members' status more reasonable, and improving the accuracy and timeliness of accident handling.
Smart Images

Figure CN111860034B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of intelligent monitoring, and in particular to a method for handling household accidents. Background Art
[0002] In the process of popularization and application of IoT and smart home related technologies, accidents and unexpected situations are gradually increasing with the development and popularization of technology, so efficient and intelligent smart home monitoring and supervision are becoming more and more important. How to effectively deal with various emergencies or accidents in the home under the environment of smart IoT has become one of the key research topics, but the existing monitoring methods for dealing with detected emergencies still have problems such as untimely processing, unintelligent processing and high misjudgment rate of accidents. The existing technology is to transmit the accident to the data aggregation center and the monitoring center through WI-FI communication after the accident is discovered for processing and feedback of the results, but the handling of the accident in the comparative document is not reasonable enough.
[0003] With respect to the problem that the monitoring in the prior art is not reasonable enough in handling accidents, no effective solution has been proposed yet. Summary of the invention
[0004] The present invention aims to solve the above technical problems at least to a certain extent.
[0005] The invention provides a method for handling household accidents, so as to solve the problem that the monitoring is not reasonable enough for handling accidents.
[0006] According to one aspect of an embodiment of the present invention, a method for handling household accidents is provided, the method comprising:
[0007] The monitoring center identifies and records each family member;
[0008] The monitoring center continuously determines whether an accident has occurred and, if it is determined that an accident has occurred, identifies people in the monitoring area based on identification records of family members;
[0009] The monitoring center determines whether the family member is online based on the identification results;
[0010] When it is determined that the family member is not online, the monitoring center sends a request for help to the user terminal and executes the instructions fed back by the user terminal.
[0011] Compared with the prior art, the advantages of the technical solution of the present invention are:
[0012] The monitoring center handles the accident according to the status of the family members, making the monitoring center's handling method more reasonable.
[0013] The monitoring center has proposed a judgment method that integrates multiple information. This judgment method can integrate judgment factors, strengthen the connection between judgment factors, and reduce the error rate of judgment. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 The present invention is a flowchart of a method for handling household accidents according to an embodiment of the present invention. DETAILED DESCRIPTION
[0015] The accompanying drawings are only used for illustrative purposes and should not be construed as limiting the present patent.
[0016] The technical solution of the present invention is further described below in conjunction with the accompanying drawings and embodiments.
[0017] Example 1
[0018] like Figure 1 According to one aspect of an embodiment of the present invention, a method for handling household accidents is provided, the method comprising:
[0019] S110: The monitoring center identifies and records each family member;
[0020] S120: The monitoring center continuously determines whether an accident has occurred, and identifies people in the monitoring area based on identification records of family members if an accident has occurred;
[0021] S130: The monitoring center determines whether the family member is online based on the identification result;
[0022] S140: When it is determined that the family member is not online, the monitoring center sends a request for help to the user terminal and executes the instructions fed back by the user terminal.
[0023] By analyzing the status of family members, the monitoring center can handle accidents more reasonably.
[0024] In the specific implementation process, the step of the monitoring center identifying and recording family members includes: when the monitoring method of the monitoring center includes video streaming, the monitoring center records videos or takes images of all family members; the monitoring center extracts features from a single frame of video or a captured image of a single family member, and records the features of all family members and uses the features of each family member as the basis for identifying the family member. By extracting and recording features, family members can be identified more accurately during identification.
[0025] Furthermore, the step of identifying the people in the monitoring area according to the identification records of the family members in the case of judging that an accident has occurred includes that the identification method is image feature matching, and the identity of the people in the monitoring area is confirmed according to the image feature matching result. Feature matching is the main method of image recognition.
[0026] Furthermore, the step of using the characteristics of each family member as the basis for identifying the member includes: the monitoring center requests the user terminal to input the relationship between all family members and generates a family relationship diagram based on the input results; the monitoring center determines whether there is a blood relationship between family members based on the family relationship diagram; the monitoring center summarizes the common characteristics between family members with blood relationship based on the blood relationship; when the monitoring center identifies family members, if it finds that there is an unrecognizable object, it confirms the family member who is most similar to the identified object as a suspected object based on the characteristics of the unrecognizable object; the monitoring center increases the weight of the common characteristics of the suspected object as the basis for re-identification, and re-identifies the unrecognizable object. Due to the hereditary nature of genes, people with blood relationship have more common characteristics in appearance. In the case of recognition failure caused by some interference factors, the common characteristics can be used as a method to reduce recognition errors.
[0027] Specifically, the step of the monitoring center continuously judging whether an accident has occurred includes, when the monitoring method of the monitoring center is a combination of multiple monitoring methods, the monitoring center analyzes the specified items for judging the accident in combination with the hierarchical analysis method, and then judges whether an accident has occurred in the monitoring area based on the analysis results and the monitored information.
[0028] Suppose that the set of values of the designated items corresponding to the accident types detected by the monitoring area at time t0 is A1, and the set of values of the change of the designated items corresponding to the accident types from t0-t to t0 is A2; the set of values of the designated items of the monitoring area under normal conditions at time t0 is B1, and the set of values of the change of the designated items of the monitoring area under normal conditions from t0-t to t0 is B2; the "under normal conditions" means "when no accident occurs"; t0 is a fixed constant.
[0029] The "judgment accident" is only used as an identifier; the corresponding designated items are the main basis items for judging the type of accident, for example: the corresponding designated items for judging a fire accident are temperature, carbon concentration, etc.;
[0030] Assume that the specified items are the first specified item x, the second specified item y, and the third specified item z, and the set A1 and the set B1 are respectively set to A1 = {x1, y1, z1} and the set B1 = {x'1, y'1, z'1};
[0031] The x1 is the value of the first designated item x monitored by the monitoring center in the monitoring area at time t0, the y1 is the value of the second designated item y monitored by the monitoring center in the monitoring area at time t0, the z1 is the value of the third designated item z monitored by the monitoring center in the monitoring area at time t0, the x'1 is the value of the change of the first designated item x in the monitoring area monitored by the monitoring center during the time from t0-t to t0, the y'1 is the value of the change of the second designated item y in the monitoring area monitored by the monitoring center during the time from t0-t to t0, and the z'1 is the value of the change of the third designated item z in the monitoring area monitored by the monitoring center during the time from t0-t to t0;
[0032] The design judgment matrix according to the specified items is:
[0033]
[0034] The a ij (i = x, y, z; j = x, y, z) represents the ratio of the importance of item i to item j in determining the type of accident;
[0035] According to the concept of hierarchical analysis method:
[0036]
[0037] Due to a ij is the ratio of the importance of items i and j in determining the accident type, then The importance in judging the accident type is the influence of the specified item on the judgment of the accident type, which can be obtained according to the numerical value or its change in historical accidents. However, since there are more judgment items in historical accidents, the judgment ratio is incomplete and the judgment result has a large error. Therefore, the hierarchical analysis method is needed to standardize the weights of the specified items.
[0038] Suppose that the maximum characteristic root λ of the judgment matrix is obtained by substituting x1, y1, z1 in set P1 into x, y, z in the judgment matrix max1 The corresponding eigenvector is U1, and the weight vector is obtained by standardizing U1 The weight vector In Represent the weights of x1, y1, and z1 respectively; substitute the set A2 = {x2, y2, z2} into x, y, and z in the judgment matrix to obtain the weight vector The a xy 、a xy 、a xy The value of is not related to the numerical values of x1, y1, and z1, but is related to the meanings of x1, y1, and z1. For example, x1 represents the value of the specified item x at a certain moment. It represents the ratio of the importance of the values of x and y at any time in the judgment; It represents the importance ratio of the numerical changes of items x and y at any time t in the judgment; the specific value of the importance ratio is set by the user or obtained by machine training; the hierarchical analysis method lists the judgment matrix according to each specified item and also uses the consistency index RI to verify the judgment matrix. This method makes appropriate judgments based on effective judgment results;
[0039] Let the proofreading set be Design algorithm i The equation of the term is;
[0040]
[0041] Let the equation calculate the numerical score of the specified term x based on x1, and let the proofreading set
[0042]
[0043] Assume the equation to calculate the total score of a given item:
[0044] Among them, the proofreading set R i r x For x' i 、x i The simple comparison results (i is 1 or 2) are exponentially scaled up and down to make them reasonable. The specific values are based on user settings or machine training; the scores corresponding to the specified items y1 and z1 The calculation method is the same as the score corresponding to the x1 term in formula ② The calculation method of S2 is the same as that of S1, which is to use formula ①. Then the control center obtains S2 according to the set A2, B2, U2 and R2 through formula ①.
[0045] Let the total score be Alarm threshold O;
[0046] If S 总 If it is greater than or equal to 0, it is judged that an accident has occurred;
[0047] If S 总 If it is less than 0, it is judged that no accident has occurred;
[0048] The alarm threshold O is a unique constant corresponding to an accident;
[0049] The monitoring center is based on S 总 The comparison result with O is used to determine whether an accident has occurred and the type of accident.
[0050] The judgment process of the specific example described above is based on the main basis items for judging accidents, namely, the designated items are three items. The number of items of the designated items in the calculation method of the present invention is an arbitrary constant. Considering that the accident type may not be unique, the monitoring center also needs to make the same analysis on the accident type related to the designated items calculated in the judgment process of the determined accident type. Due to its pairwise comparison characteristics and randomness, the traditional hierarchical level analysis method has a strong dependence on RI and a large matrix error result. However, if only one end is compared, the significance and scope of application of the matrix will be greatly reduced. This method uses the proofreading set R to correct the intermediate quantity and avoid subsequent repeated calculations. The proofreading set R and the alarm threshold O are one of the main ways for the user end to regulate the calculation method. The calculation method described makes machine judgment more authoritative and universal, and the application of the method scenario reduces the amount of calculation when using the hierarchical analysis method.
[0051] Specifically, the monitoring center determines whether the family member is online based on the identification result, and the situation where the family member is not online includes that the family member cannot be monitored, the family member is monitored to be in a sleeping state, and the maximum age of the monitored family member is less than or equal to a child.
[0052] Specifically, the step of the monitoring center sending a request for help to the user end and executing the instructions fed back by the user end includes: the monitoring center confirms the geographical location of the monitored family, scores all known processing ends according to the geographical location of the monitored family, selects and sends the identity information and help request of the appropriate processing end to the user end, and then the monitoring center processes the instructions fed back by the user end, and the fed back instructions include ignoring the accident and sending an appointment application to a specific processing end and receiving the appointment confirmation of the specific processing end. The score is determined based on the geographical distance between the processing end and the accident area, the processing qualifications of the processing end, the processing history of the processing end, and whether the identity of the processing end is authenticated. The user end leads the decision-making method to improve the rationality of the processing.
[0053] Specifically, the step of the monitoring center sending a request for help to the user terminal and executing the instruction fed back by the user terminal includes: when the monitoring center sends an appointment application to a specific processing terminal and receives an appointment confirmation from the specific processing terminal, the monitoring center sends an application for a processing request to the user terminal and receives an instruction for the processing request fed back by the user terminal; according to the instruction for the processing request fed back by the user terminal, the monitoring center opens part of the authority to the specific processing terminal. The monitoring center grants part of the authority to the processing terminal to make the accident handling of the processing terminal smoother and more reasonable.
[0054] Furthermore, after the step of opening part of the permissions to the specific processing end, the monitoring center also includes sending a processing confirmation application to the user end and receiving a processing confirmation instruction fed back by the user end. If there is a pre-processing plan or an emergency processing plan, according to the pre-processing plan or the emergency processing plan and the processing confirmation instruction fed back by the user end, after confirming that the specific processing end has completed the processing, the monitoring center reclaims part of the permissions that have been opened to the specific processing end. Reclaiming permissions makes the method more secure.
[0055] While the invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be apparent to those skilled in the art that various modifications may be made without departing from the scope of the invention.
[0056] The scope of the present invention should not be limited to the details described in the detailed description of the specification, but should be defined by the claims. In addition, all changes and modifications derived from the meaning and scope of the claims and their equivalents should be interpreted as being included in the scope of the present invention.
Claims
1. A method for handling household accidents, characterized in that: The method comprises: The monitoring center identifies and records each family member; The monitoring center continuously determines whether an accident has occurred and, if it is determined that an accident has occurred, identifies people in the monitoring area based on the identification records of family members; The monitoring center determines whether the family member is online based on the identification results; If it is determined that the family member is not online, the monitoring center sends a request for help to the user terminal and executes the instructions fed back by the user terminal; The specific steps for the monitoring center to continuously determine whether an accident has occurred include: The monitoring center analyzes the monitored information using the analytic hierarchy process and determines whether an accident has occurred in the monitoring area based on the analysis results; Assume that the specified items are the first specified item x, the second specified item y, and the third specified item z, and the set A1 and the set B1 are respectively set to A1={x1, y1, z1} and the set B1={x'1, y'1, z'1}; The x1 is the value of the first designated item x monitored by the monitoring center in the monitoring area at time t0, the y1 is the value of the second designated item y monitored by the monitoring center in the monitoring area at time t0, the z1 is the value of the third designated item z monitored by the monitoring center in the monitoring area at time t0, the x'1 is the value of the change of the first designated item x in the monitoring area monitored by the monitoring center during the time from t0-t to t0, the y'1 is the value of the change of the second designated item y in the monitoring area monitored by the monitoring center during the time from t0-t to t0, and the z'1 is the value of the change of the third designated item z in the monitoring area monitored by the monitoring center during the time from t0-t to t0; The design judgment matrix according to the specified items is: a ij (i = x, y, z; j = x, y, z) represents the ratio of the importance of item i to item j in determining the type of accident; According to the concept of hierarchical analysis method: Due to a ij is the ratio of the importance of items i and j in determining the accident type, then The importance in determining the accident type is the influence of the specified item on determining the accident type, which can be obtained based on the numerical value or its variation of historical accidents, and the weight of the specified item is standardized using the hierarchical analysis method; Suppose that according to the judgment matrix, the maximum characteristic root λ of the judgment matrix is obtained by substituting x1, y1, z1 in set A1 into x, y, z in the judgment matrix. max1 The corresponding eigenvector is U1, and the weight vector is obtained by standardizing U1 , the weight vector In Represent the weights of x1, y1, and z1 respectively; Substitute the set A2 = {x2, y2, z2} into x, y, and z in the judgment matrix and finally get the weight vector ; The specific value of the importance ratio is set by the user or obtained by machine training; the hierarchical analysis method lists the judgment matrix according to each specified item and then uses the consistency index RI to verify the judgment matrix; Let the proofreading set be Design algorithm i The equation of the term is; Let the equation calculate the numerical score of the specified term x based on x1, and let the proofreading set Suppose the equation calculates the total score of a given item: Among them, the proofreading set R i In For x' i 、x i The simple comparison results are exponentially magnified and reduced to make them reasonable. The specific values are based on user settings or machine training; the scores corresponding to the y1 and z1 items The calculation method is the same as the score corresponding to the x1 term in formula ② The calculation method of S2 is the same as that of S1, which is to use formula ①. Then the control center obtains S2 according to the set A2, B2, U2 and R2 through formula ①. Let the total score be Alarm threshold O; If S 总 If it is greater than or equal to 0, it is judged that an accident has occurred. If S 总 If it is less than 0, it is judged that no accident has occurred; The alarm threshold O is a unique constant corresponding to an accident; The monitoring center is based on S 总 The comparison result with O is used to determine whether an accident has occurred and the type of accident.
2. A method for handling household accidents according to claim 1, characterized in that: The steps of the monitoring center identifying and recording each family member specifically include: When the monitoring method of the monitoring center includes video streaming, the monitoring center records videos or takes images of all family members; The monitoring center extracts features from single-frame videos or captured images of individual family members, records the features of all family members, and uses the features of each family member as the basis for identifying the family member.
3. A method for handling household accidents according to claim 2, characterized in that: The step of identifying people in the monitoring area according to the identification records of family members when an accident occurs specifically includes: The identification method is image feature matching, and the identity of the person in the monitoring area is confirmed based on the image feature matching result.
4. A method for handling household accidents according to claim 2, characterized in that: The step of using the characteristics of each family member as the basis for identifying the member specifically includes: The monitoring center requests the user terminal to input the relationship between all family members and generates a family relationship diagram based on the input results; The monitoring center determines whether there is a blood relationship between family members based on the family relationship diagram; The monitoring center summarizes the common characteristics between blood-related family members based on their blood relationships; When the monitoring center is identifying family members, if it finds an unidentifiable object, it will identify the family member who is most similar to the identified object as a suspected object based on the characteristics of the unidentifiable object; The monitoring center increases the common features of the suspected objects as the weight when re-identifying, and re-identifies the unidentifiable objects.
5. A method for handling household accidents according to claim 1, characterized in that: The specific steps of the monitoring center judging whether the family member is online according to the identification result include: The situation where the family member is not online includes that no family member can be monitored, the family member is monitored to be in a sleeping state, and the maximum age of the monitored family member is less than or equal to a child.
6. A method for handling household accidents according to claim 1, characterized in that: The specific steps of the monitoring center sending a request for help to the user terminal and executing the instructions fed back by the user terminal include: The instructions fed back by the user end include ignoring the accident and sending an appointment application to a specific processing end and receiving an appointment confirmation from the specific processing end.
7. A method for handling household accidents according to claim 6, characterized in that: The specific steps of the monitoring center sending a request for help to the user terminal and executing the instructions fed back by the user terminal include: When the monitoring center sends a reservation application to a specific processing terminal and receives a reservation confirmation from the specific processing terminal, the monitoring center sends a processing request application to the user terminal and receives a processing request instruction fed back by the user terminal; Based on the instructions of the processing request received from the user end, the monitoring center opens some permissions to the specific processing end.
Citation Information
Patent Citations
Apparatus and Method for Unmanned Safety Guard Based on Video Recognition
KR1020150033402A
