An object monitoring method, device, electronic device and storage medium

Abstract

The present invention relates to an object monitoring method, apparatus, electronic device and storage medium, including: obtaining the respective eye behavior information of a plurality of objects; determining the respective object fatigue information of the plurality of objects according to the eye behavior information; determining the respective group fatigue information of a plurality of groups based on the object fatigue information; determining a fatigued group among the plurality of groups according to the group fatigue information, and sending control information to the associated devices of the fatigued group. According to the technical solution of the present invention, by determining the respective object fatigue information of a plurality of objects through the respective eye behavior information of the plurality of objects, determining the group fatigue information of a plurality of groups based on the respective object fatigue information of the plurality of objects, determining a fatigued group according to the group fatigue information, and sending control information to the associated devices of the fatigued group, it is possible to monitor and improve the fatigue level of the fatigued group and improve the work or learning efficiency of the fatigued group.

Description

Technical Field

[0001] The present invention relates to the technical field of fatigue monitoring, and particularly to an object monitoring method, device, electronic device and storage medium. Background Art

[0002] People often experience fatigue during work or study, which can lead to a decrease in learning or work efficiency. Currently, there is no related technology for monitoring their fatigue status in the existing art. Summary of the Invention

[0003] The purpose of the present invention is to provide an object monitoring method, device, electronic device and storage medium. By determining the object fatigue information of multiple objects based on their respective eye behavior information, determining the group fatigue information of multiple groups based on the object fatigue information of multiple objects, determining the fatigued groups according to the group fatigue information, and sending control information to the associated devices of the fatigued groups, it is possible to monitor and improve the fatigue level of the fatigued groups and improve the work or learning efficiency of the fatigued groups.

[0004] To achieve the above purpose, the present invention provides the following solutions:

[0005] An object monitoring method, the method comprising:

[0006] Obtaining the eye behavior information of multiple objects, where the eye behavior information characterizes the blinking degree of the objects;

[0007] Determining the object fatigue information of the multiple objects according to the eye behavior information;

[0008] Based on the object fatigue information, determining the group fatigue information of multiple groups, each group including at least two objects;

[0009] Determining the fatigued groups among the multiple groups according to the group fatigue information, and sending control information to the associated devices of the fatigued groups.

[0010] Optionally, the eye behavior information includes at least two of the blinking frequency, blinking intensity information, and blinking duration; the determining the object fatigue information of the multiple objects according to the eye behavior information includes:

[0011] Obtaining an eye fatigue model;

[0012] Inputting the eye behavior information into the eye fatigue model to obtain the object fatigue information of each object.

[0013] Optionally, the eye behavior information includes the blinking frequency, blinking intensity information, and blinking duration, and the obtaining the eye behavior information of multiple objects includes:

[0014] Obtain the electroencephalogram information of each of multiple objects;

[0015] According to the electroencephalogram information, determine the number of blinks within a preset time period before the current moment, the blink intensity corresponding to each blink within the preset time period, and the blink duration;

[0016] Based on the number of blinks, obtain the blink frequency;

[0017] Based on the blink intensity corresponding to each blink within the preset time period, perform mean processing to obtain the blink intensity information.

[0018] Optionally, the determining the group fatigue information of each of multiple groups based on the object fatigue information includes:

[0019] Obtain the object distribution information;

[0020] Based on the object distribution information, determine the objects corresponding to each of the multiple groups;

[0021] Based on the object fatigue information of the objects of each group, determine the group fatigue information of each group.

[0022] Optionally, before obtaining the eye behavior information of each of multiple objects, it further includes:

[0023] Obtain the current scene mode;

[0024] In the case where the current scene mode belongs to the learning mode, execute the step of obtaining the eye behavior information of each of multiple objects.

[0025] Optionally, the sending control information to the associated device of the fatigued group includes:

[0026] Send control information to the area lighting control device corresponding to the fatigued group;

[0027] Send push information to the electronic device of the push object corresponding to the fatigued group;

[0028] Send a vibration instruction to the head-mounted device of the object corresponding to the fatigued group to make the head-mounted device vibrate.

[0029] Optionally, the sending control information to the area lighting control device corresponding to the fatigued group includes:

[0030] Obtain the lighting adjustment range corresponding to the current scene mode and the current lighting information;

[0031] Determine target light information based on the light adjustment range and current light information, where the target light information is greater than the current light information, and the maximum threshold information corresponding to the light adjustment range is greater than the target light information;

[0032] Send the target light information to the area light control device corresponding to the fatigued group.

[0033] On the other hand, the present invention also provides an object monitoring device, which includes:

[0034] An information acquisition module, configured to acquire the eye behavior information of multiple objects respectively, where the eye behavior information characterizes the blinking degree of the objects;

[0035] A first information determination module, configured to determine the object fatigue information of the multiple objects respectively according to the eye behavior information;

[0036] A second information determination module, configured to determine the group fatigue information of multiple groups respectively based on the object fatigue information, and each group includes at least two objects;

[0037] A control module, configured to use the groups with group fatigue information higher than the preset fatigue information among the multiple groups as the fatigued groups, and send control information to the associated devices of the fatigued groups.

[0038] On the other hand, the present invention also provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the above object monitoring method.

[0039] On the other hand, the present invention also provides a non-volatile computer-readable storage medium, on which computer program instructions are stored, wherein, when the computer program instructions are executed by a processor, the above object monitoring method is implemented.

[0040] An object monitoring method, device, electronic device and storage medium provided by the present invention can determine the object fatigue information of multiple objects respectively through the eye behavior information of the multiple objects, determine the group fatigue information of multiple groups based on the object fatigue information of the multiple objects respectively, determine the fatigued groups according to the group fatigue information, and send control information to the associated devices of the fatigued groups, so as to monitor and improve the fatigue degree of the fatigued groups and improve the work or learning efficiency of the fatigued groups. Description of the Drawings

[0041] To more clearly illustrate the technical solution of the present invention, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0042] Figure 1 It is a flowchart of a method for an object monitoring method provided by an embodiment of the present invention;

[0043] Figure 2 It is a flowchart of a method for determining the object fatigue information of multiple objects respectively according to the eye behavior information provided by an embodiment of the present invention;

[0044] Figure 3 It is a flowchart of a method for obtaining the eye behavior information of multiple objects respectively provided by an embodiment of the present invention;

[0045] Figure 4 It is a flowchart of a method for determining the group fatigue information of multiple groups respectively based on the object fatigue information provided by an embodiment of the present invention;

[0046] Figure 5 It is a flowchart of a method before obtaining the eye behavior information of multiple objects respectively provided by an embodiment of the present invention;

[0047] Figure 6 It is a flowchart of a method for sending control information to the associated devices of the fatigued group provided by an embodiment of the present invention;

[0048] Figure 7 It is a flowchart of a method for sending control information to the area lighting control device corresponding to the fatigued group provided by an embodiment of the present invention;

[0049] Figure 8 It is a block diagram of the structure of an object monitoring device provided by an embodiment of the present invention. Detailed implementation manners

[0050] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of the present invention.

[0051] To make the above objects, features, and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below with reference to the drawings and specific implementation manners.

[0052] It should be noted that the terms "first", "second", etc. in the description, claims and the above drawings of the present invention are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present invention described here can be implemented in an order other than those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0053] The following introduces embodiments of the object monitoring method of the present invention. Figure 1 It is a flowchart of a method for an object monitoring method provided by an embodiment of the present invention. This specification provides method operation steps as described in the embodiments or flowcharts, but based on routine or non-creative labor, it may include more or fewer operation steps. The step order listed in the embodiments is only one way among the execution orders of numerous steps, and does not represent the only execution order. When the actual system product is executed, it can be executed in the order shown in the embodiments or the drawings or in parallel (for example, in an environment of parallel processors or multi-threaded processing). As Figure 1 As shown, this embodiment provides an object monitoring method, and the method includes:

[0054] S101. Obtain the eye behavior information of each of multiple objects, where the eye behavior information characterizes the blinking degree of the object.

[0055] Among them, the multiple objects may refer to objects that need to be subjected to fatigue detection and adjustment; specifically, they may be people. The eye behavior information may refer to the relevant information collected during the blinking process of the object. The eye behavior information can characterize the blinking degree of the object. The eye behavior information may include at least two of the blinking frequency, blinking intensity information, and blinking duration.

[0056] In practical applications, the electroencephalogram signals of each object are collected separately by an electroencephalogram acquisition device. The electroencephalogram acquisition device may be a head-mounted acquisition device. Specifically, the electroencephalogram acquisition device can obtain the electroencephalogram signals of the object through frontal electroencephalogram sensing. By analyzing and processing the electroencephalogram signals of the object, the eye behavior information of each object can be obtained.

[0057] S102. Determine the object fatigue information of each of the multiple objects according to the eye behavior information.

[0058] Among them, the object fatigue information can characterize the fatigue degree of the object. The object fatigue information can be in the form of a numerical value or a level. For example, the object fatigue information can include mild fatigue, moderate fatigue, severe fatigue, etc.

[0059] In practical applications, different interval thresholds can be set for the object fatigue information (such as fatigue level) corresponding to the eye behavior information; the object fatigue information can be obtained corresponding to the interval threshold where the eye behavior information of the object is located.

[0060] S103. Based on the object fatigue information, determine the group fatigue information of each of multiple groups, where each group includes at least two objects.

[0061] Among them, the group fatigue information can characterize the fatigue degree of the group. It can be understood that the higher the fatigue degree of the group characterized by the group fatigue information, the higher the possibility that most objects in the group are in a fatigued state.

[0062] In practical applications, it can be divided into multiple groups evenly according to the distribution of multiple objects. For example, students in a classroom can be divided into multiple groups according to the seat distribution of the students; each group includes at least two objects; each group is a group. The average value of the object fatigue information of all objects in the group can be used as the group fatigue information of the group.

[0063] S104. According to the group fatigue information, determine the fatigued groups among the multiple groups, and send control information to the associated devices of the fatigued groups.

[0064] Among them, the fatigued group can refer to a group composed of multiple objects and with a relatively high overall fatigue degree. The preset fatigue information can be used to define the fatigued groups among the multiple groups. The associated devices of the fatigued groups can include the head-mounted devices of the objects included in the fatigued groups, the regional light control devices corresponding to the fatigued groups, and / or the electronic devices for pushing objects corresponding to the fatigued objects.

[0065] In practical applications, compare the group fatigue information of each group with the preset fatigue information; the groups among the multiple groups with group fatigue information higher than the preset fatigue information can be used as the fatigued groups. The fatigue degree of the fatigued groups can be reduced by adjusting the regional light corresponding to the fatigued groups. Specifically, the color temperature and illuminance of the regional light corresponding to the fatigued groups can be increased. Or it can also be to perform vibration feedback through the head-mounted devices of the objects to reduce the fatigue degree of the fatigued groups.

[0066] It can be understood that the factors affecting the fatigue of a group may be the factor of uneven distribution of ambient light or the factor of the location where the group is located. For example, in the scenario of students having classes in a classroom, daylight may have an impact during the day, resulting in uneven light distribution; for students sitting in the back row, due to the relatively longer distance from their seats to the blackboard compared to the front row, they are more likely to experience visual fatigue. By obtaining the fatigued group, it is possible to combine the factors that may cause fatigue and conduct fatigue monitoring of the object.

[0067] By determining the object fatigue information of multiple objects based on their respective eye behavior information, determining the group fatigue information of multiple groups based on the object fatigue information of multiple objects, determining the fatigued group according to the group fatigue information, and sending control information to the associated devices of the fatigued group, it is possible to monitor and improve the fatigue level of the fatigued group and improve the work or learning efficiency of the fatigued group.

[0068] Figure 2 This is a flowchart of a method for determining the object fatigue information of multiple objects according to eye behavior information provided by an embodiment of the present invention. In a possible implementation manner, as Figure 2 shown, the above step S102 may include:

[0069] S201. Obtain an eye fatigue model.

[0070] Among them, the eye fatigue model can be used to determine object fatigue information.

[0071] In practical applications, the eye fatigue model can be obtained through machine learning. Specifically, the sample eye behavior information of multiple sample objects and the object fatigue information label of each object can be collected multiple times. The above multiple sample eye behavior information is input into a preset machine learning model for fatigue information prediction processing to obtain predicted object fatigue information. According to the predicted object fatigue information and the object fatigue information label, object fatigue loss information is obtained. The preset machine learning model is trained according to the object fatigue loss information to obtain an eye fatigue model.

[0072] The preset machine learning model may include, but is not limited to, one of a neural network model, a regression model, a least squares method model, a support vector machine, a Markov algorithm, etc. Among them, the neural network model includes one or more of a deep neural network, a recurrent neural network, a convolutional neural network, etc. Deep learning is an algorithm for performing representation learning on a large amount of data. Deep learning is to learn the internal laws and representation levels of sample data, and the information obtained during these learning processes is very helpful for the interpretation of data such as text, images, and sounds. Its ultimate goal is to enable the machine to have the ability of analysis and learning like a human, and be able to recognize data such as text, images, and sounds. The feature extraction of deep learning does not rely on humans, but is automatically extracted, has very strong learning ability and adaptability, and is data-driven, with a high upper limit.

[0073] S202. Input the eye behavior information into the eye fatigue model to obtain the object fatigue information of each object.

[0074] In practical applications, the eye behavior information may include at least two of the blink frequency, blink intensity information, and blink duration. By inputting the data in the eye behavior information of each object into the eye fatigue model, the object fatigue information of each object can be obtained.

[0075] Figure 3 It is a flowchart of a method for obtaining the eye behavior information of multiple objects provided by an embodiment of the present invention. In a possible implementation manner, as Figure 3 shown, the above step S101 may include:

[0076] S301. Obtain the electroencephalogram information of multiple objects respectively.

[0077] Among them, the electroencephalogram information can represent the overall reflection of the electrophysiological activities of the object's cranial nerve cells on the cerebral cortex or the scalp surface. The electroencephalogram information may include electroencephalogram signals.

[0078] In practical applications, the electroencephalogram information of a single object can be collected by a head-mounted electroencephalogram signal acquisition device. Specifically, the frontal electroencephalogram can be collected through a single-lead differential electrode, and the bias electrode is fixed on the earlobe of each object by a clip, and the electroencephalogram sampling frequency is 1KHz.

[0079] S302. According to the electroencephalogram information, determine the number of blinks within a preset time period before the current moment, the blink intensity corresponding to each blink within the preset time period, and the blink duration.

[0080] Among them, the preset time period can be one minute or other period of time, which is not limited in this disclosure; in this embodiment, the preset time period is one minute. The blink intensity can represent the relative strength of this blink. The blink duration can refer to the duration of blinking at a higher frequency.

[0081] In practical applications, with a step size of 1 second, it is determined whether the current EEG signal exceeds a preset threshold. If it exceeds, the current state is determined to be a blinking state. Among them, before use, through voice adaptation guidance, "Please close your eyes for 10 seconds", the standard deviation a of the EEG signal during the user's eye-closure process can be obtained. 1 ; "Please blink for 10 seconds", the standard deviation a of the EEG signal during the user's blinking process can be obtained. 2 , and thus the preset threshold can be automatically set to (a 1 + a 2 ) / 2. The number of blinks per minute can be obtained by summation. The standard deviation of the EEG signal corresponding to each blink can be used as the blink intensity; or it can also be evenly divided into 3 levels between (a 1 + a 2 ) / 2 and a 2 , and each blink can respectively correspond to low, medium, and high intensities. The blink duration can be obtained by continuously counting the values exceeding the preset threshold.

[0082] S303. Obtain the blink frequency based on the number of blinks.

[0083] In practical applications, based on the number of blinks per minute, the blink frequency of the object can be obtained.

[0084] S304. Perform mean processing based on the blink intensity corresponding to each blink within a preset time period to obtain blink intensity information.

[0085] In practical applications, taking the standard deviation of the EEG signal corresponding to each blink as the blink intensity, the mean processing can be performed on the blink intensities corresponding to all blinks within a preset time period, and the obtained mean information is used as the blink intensity information.

[0086] Figure 4 This is a flowchart of a method for determining the group fatigue information of multiple groups based on the object fatigue information provided by an embodiment of the present invention. In a possible implementation manner, as Figure 4 shown, the above step S103 may include:

[0087] S401. Obtain object distribution information.

[0088] Among them, the object distribution information can characterize the position distribution of multiple objects. The object distribution information may include the positions of multiple objects within a certain range.

[0089] In practical applications, a location acquisition request can be sent to the head-mounted devices of each object; after receiving the location acquisition request, the head-mounted device of each object obtains location information through the positioning module and sends the location information carrying the head-mounted device identifier to the object monitoring device. After receiving the location information sent by the head-mounted devices of each object, the object monitoring device can obtain object distribution information based on the location information of multiple objects.

[0090] S402. Based on the object distribution information, determine the objects corresponding to each of the multiple groups.

[0091] In practical applications, grouping can be performed according to the distribution of multiple objects, and the objects in each group are used as a group. Specifically, it can be divided into M regions by region or by equal number of people, and all the objects in each region can be used as the objects corresponding to a group.

[0092] S403. Based on the object fatigue information of the objects in each group, determine the group fatigue information of each group.

[0093] In practical applications, the object fatigue degree in each region is x i , then the bag-of-words matrix of the fatigue degree distribution of a randomly selected region (including K objects) is [x 1 , x 2 , x 3 , ……, x k . If the number of objects in a single region < K (i.e., there are vacancies) when dividing by region, one of the methods of taking the average value, maximum value, or minimum value of the object fatigue degree in the region can be used to fill the vacancies. Based on the object fatigue information of the objects in each of the multiple groups, classification can be performed based on the KNN algorithm (K-Nearest Neighbor, proximity algorithm) to obtain the group fatigue type of each group. The group fatigue type can include types such as normal, mild fatigue, moderate fatigue, and severe fatigue. The group fatigue type of each group can be used as the group fatigue information of each group.

[0094] Figure 5 This is a flowchart of a method before obtaining the eye behavior information of multiple objects provided by an embodiment of the present invention. In a possible implementation manner, as Figure 5 shown, before obtaining the eye behavior information of multiple objects, it may include:

[0095] S501. Obtain the current scene mode.

[0096] Among them, the current scene mode may refer to the specific mode of the scene at the current moment. For example, for the classroom learning scene, the current scene mode may be one of multiple modes such as the wake-up mode (which may refer to within the time of the first class in the morning and afternoon), the general teaching mode, the exam mode, the relaxation mode, and the night mode.

[0097] In practical applications, for the classroom learning scene, the mapping relationship between time and the scene mode can be preset; by obtaining the current time and according to the mapping relationship between time and the scene mode, the current scene mode can be obtained.

[0098] S502. When the current scene mode belongs to the learning mode, execute the step of obtaining the eye behavior information of each of the multiple objects.

[0099] Among them, for the classroom learning scene, the learning mode may include the wake-up mode, the general teaching mode, the exam mode, and the night mode.

[0100] It can be understood that when the current scene mode belongs to the learning mode, execute the step of obtaining the eye behavior information of each of the multiple objects; when the current scene mode does not belong to the learning mode, it means that the current scene mode belongs to the relaxation mode, and the step of obtaining the current scene mode can be returned until the current scene mode belongs to the learning mode and the step of obtaining the eye behavior information of each of the multiple objects is executed. The computing cost can be reduced when the current scene mode does not belong to the learning mode.

[0101] Figure 6 This is a flowchart of a method for sending control information to the associated device of the fatigued group provided by an embodiment of the present invention. In a possible implementation manner, as Figure 6 shown, sending control information to the associated device of the fatigued group may include:

[0102] S601. Send control information to the area lighting control device corresponding to the fatigued group.

[0103] In practical applications, the area lighting distribution of the scene where multiple objects are located can be determined according to the position distribution of multiple groups. For example, the distribution of lighting appliances in the current scene can be obtained. The area lighting corresponding to each group can be determined according to the position distribution of multiple groups, the positions of each lighting appliance, and the lighting area. After determining the fatigued group, the area lighting corresponding to it can be determined according to the position where the fatigued group is located, so as to adjust the area lighting. Specifically, the color temperature and brightness of the area lighting can be increased to reduce the fatigue degree of the fatigued group.

[0104] S602. Send push information to the electronic device of the push object corresponding to the fatigued group.

[0105] Among them, the push object can be the parent of the object corresponding to the fatigued group or a teacher. The push information may include the locations of the objects in the fatigued group and the changing trend of the fatigue state of each object in the group.

[0106] In practical applications, a mapping relationship between each object and the electronic device of the push object can be established in advance. After determining the fatigued group, the fatigue information of the day of the object can be sent to the electronic device of the parent of each object in the group, so that the parents of the students can understand the changing trend of the classroom fatigue state of the students; the push information can also be sent to the electronic device of the current teacher in charge, pushing the location of the fatigued group and the changing trend of the fatigue state of each object in the group.

[0107] S603. Send a vibration instruction to the head-mounted device of the object corresponding to the fatigued group to make the head-mounted device vibrate.

[0108] By vibrating the head-mounted device of the object corresponding to the fatigued group, vibration feedback is given to the object in the fatigued group to reduce the fatigue level of the fatigued group.

[0109] Figure 7 This is a flowchart of a method for sending control information to the area lighting control device corresponding to the fatigued group provided by an embodiment of the present invention. In a possible implementation manner, as Figure 7 shown, sending control information to the area lighting control device corresponding to the fatigued group may include:

[0110] S701. Obtain the lighting adjustment range corresponding to the current scene mode and the current lighting information.

[0111] In practical applications, a mapping relationship between the scene mode and the lighting adjustment range can be established in advance. The corresponding lighting adjustment range is determined through the current scene mode. The lighting condition of the area corresponding to the fatigued group can be collected as the current lighting information through the ambient light sensor in the area corresponding to the fatigued group. It can be understood that since the distribution positions of the objects in the scene are relatively fixed within a period of time, the division of the group is also relatively fixed. The group division situation can be obtained in advance according to the object distribution situation, and then the specific lighting area can be determined according to the group division situation, so that the ambient light sensor can be set according to the lighting area for lighting condition collection.

[0112] S702. Based on the lighting adjustment range and the current lighting information, determine the target lighting information, where the target lighting information is greater than the current lighting information, and the maximum threshold information corresponding to the lighting adjustment range is greater than the target lighting information.

[0113] Among them, the target lighting information can be used to indicate the brightness and color temperature that the area corresponding to the fatigued group needs to be adjusted to. The target lighting information may include the lamp color temperature mode and brightness.

[0114] It can be understood that the fatigue level of the fatigued group is reduced by increasing the brightness and color temperature of the corresponding area of the fatigued object. Therefore, the target light illumination information is greater than the current light illumination information, and the maximum threshold information corresponding to the light illumination adjustment range is greater than the target light illumination information.

[0115] S703. Send the target light illumination information to the area light illumination control device corresponding to the fatigued group.

[0116] In practical applications, after receiving the target light illumination information, the area light illumination control device can adjust the brightness and color temperature of the lamps of the area light illumination corresponding to the fatigued group according to the target light illumination information.

[0117] Figure 8 It is a structural block diagram of an object monitoring device provided by an embodiment of the present invention. On the other hand, this embodiment also provides an object monitoring device, as Figure 8 shown, the device includes:

[0118] An information acquisition module 10, configured to acquire the respective eye behavior information of multiple objects, and the eye behavior information characterizes the blinking degree of the objects;

[0119] A first information determination module 20, configured to determine the respective object fatigue information of multiple objects according to the eye behavior information;

[0120] A second information determination module 30, configured to determine the respective group fatigue information of multiple groups based on the object fatigue information, and each group includes at least two objects;

[0121] A control module 40, configured to determine the fatigued groups among multiple groups according to the group fatigue information, and send control information to the associated devices of the fatigued groups.

[0122] On the other hand, an embodiment of the present invention also provides an electronic device, including: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the above object monitoring method.

[0123] On the other hand, an embodiment of the present invention also provides a non-volatile computer-readable storage medium, on which computer program instructions are stored, wherein, when the computer program instructions are executed by a processor, the above object monitoring method is implemented.

[0124] It should be noted that, for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as combinations of two series of actions. However, those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Similarly, each module of the above object monitoring device refers to a computer program or a program segment for performing one or more specific functions. In addition, the distinction of the above modules does not mean that the actual program codes must also be separated. In addition, the above embodiments can be arbitrarily combined to obtain other embodiments.

[0125] In the above embodiments, the descriptions of the embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments. Those skilled in the art can also understand that the various illustrative logical blocks, units, and steps listed in the embodiments of the present invention can be implemented by electronic hardware, computer software, or a combination of both. To clearly show the interchangeability of hardware and software, the above various illustrative components, units, and steps have generally described their functions. Whether such functions are implemented by hardware or software depends on the specific application and the design requirements of the entire system. Those skilled in the art can use various methods to implement the described functions for each specific application, but such implementation should not be understood as exceeding the scope protected by the embodiments of the present invention.

[0126] The above description has fully disclosed the specific embodiments of the present invention. It should be pointed out that any modification made by those skilled in the art to the specific embodiments of the present invention does not depart from the scope of the claims of the present invention. Accordingly, the scope of the claims of the present invention is not limited to the foregoing specific embodiments.

Claims

1. An object monitoring method, characterized in that, the method includes: Obtaining the eye behavior information of each of multiple objects, where the eye behavior information characterizes the blinking degree of the object; the eye behavior information includes blinking frequency, blinking intensity information, and blinking duration; the obtaining the eye behavior information of each of multiple objects includes: obtaining the electroencephalogram information of each of multiple objects; according to the electroencephalogram information, determining the number of blinks within a preset time period before the current moment, the blinking intensity corresponding to each blink within the preset time period, and the blinking duration; based on the number of blinks, obtaining the blinking frequency; based on the blinking intensity corresponding to each blink within the preset time period, performing mean processing to obtain the blinking intensity information; Determining the object fatigue information of each of the multiple objects according to the eye behavior information; Determining the group fatigue information of each of multiple groups based on the object fatigue information, where each group includes at least two objects; the determining the group fatigue information of each of multiple groups based on the object fatigue information includes: obtaining object distribution information; the object distribution information characterizes the position distribution of the multiple objects; the object distribution information is determined based on the position information sent by the head-mounted device of each object; based on the object distribution information, determining the objects corresponding to each of the multiple groups, including: grouping according to the distribution of the multiple objects, and the objects in each group are used as a group; based on the object fatigue information of the objects in each group, determining the group fatigue information of each group; Determining the fatigued groups among the multiple groups according to the group fatigue information, and sending control information to the associated devices of the fatigued groups.

2. The method according to claim 1, characterized in that, the eye behavior information includes at least two of blinking frequency, blinking intensity information, and blinking duration; the determining the object fatigue information of each of the multiple objects according to the eye behavior information includes: Obtaining an eye fatigue model; Inputting the eye behavior information into the eye fatigue model to obtain the object fatigue information of each object.

3. The method according to claim 1, characterized in that, before obtaining the eye behavior information of each of the multiple objects, it further includes: Obtaining the current scene mode; In the case where the current scene mode belongs to the learning mode, performing the step of obtaining the eye behavior information of each of the multiple objects.

4. The method according to claim 1, characterized in that, the sending control information to the associated devices of the fatigued groups includes: Sending control information to the area lighting control device corresponding to the fatigued group; Sending push information to the electronic device that pushes objects corresponding to the fatigued group; Sending a vibration instruction to the head-mounted device of the object corresponding to the fatigued group to make the head-mounted device vibrate.

5. The method according to claim 4, characterized in that, the sending control information to the area lighting control device corresponding to the fatigued group includes: Obtaining the lighting adjustment range corresponding to the current scene mode and the current lighting information; Determine target light information based on the light adjustment range and current light information, where the target light information is greater than the current light information, and the maximum threshold information corresponding to the light adjustment range is greater than the target light information; Send the target light information to the area light control device corresponding to the fatigued group.

6. An object monitoring device, characterized in that, the device includes: An information acquisition module, configured to acquire the respective eye behavior information of multiple objects, where the eye behavior information characterizes the blinking degree of the objects; the eye behavior information includes blinking frequency, blinking intensity information, and blinking duration; the acquisition of the respective eye behavior information of multiple objects includes: acquiring the respective electroencephalogram information of multiple objects; according to the electroencephalogram information, determining the number of blinks within a preset time period before the current moment, the blinking intensity corresponding to each blink within the preset time period, and the blinking duration; based on the number of blinks, obtaining the blinking frequency; based on the blinking intensity corresponding to each blink within the preset time period, performing mean processing to obtain the blinking intensity information; A first information determination module, configured to determine the respective object fatigue information of the multiple objects according to the eye behavior information; A second information determination module, configured to determine the respective group fatigue information of multiple groups based on the object fatigue information, where each group includes at least two objects; the determination of the respective group fatigue information of multiple groups based on the object fatigue information includes: acquiring object distribution information; the object distribution information characterizes the position distribution of the multiple objects; the object distribution information is determined based on the position information sent by the head-mounted device of each object; based on the object distribution information, determining the respective objects corresponding to the multiple groups, including: grouping according to the distribution of the multiple objects, and taking the objects in each group as a group; based on the object fatigue information of the respective objects in each group, determining the group fatigue information of each group; A control module, configured to determine the fatigued groups among the multiple groups according to the group fatigue information, and send control information to the associated devices of the fatigued groups.

7. An electronic device, characterized in that, it includes: a processor; a memory for storing processor-executable instructions; wherein, the processor is configured to execute the executable instructions to implement the object monitoring method according to any one of claims 1 to 5.

8. A non-volatile computer-readable storage medium, on which computer program instructions are stored, characterized in that, when the computer program instructions are executed by a processor, the object monitoring method according to any one of claims 1 to 5 is implemented.

Images