Safety reminding method and device, equipment and storage medium

Abstract

The invention is suitable for the technical field of information processing, and provides a safety reminding method and device, equipment and a storage medium. According to the safety reminding method, whether the user has the potential safety hazard can be quantified from three dimensions of the motion state, the head state and the environment information, the potential safety hazard quantification accuracy is improved, the probability of potential safety hazard information misinformation can be reduced, the safety reminding message is output when the three dimensions meet corresponding conditions at the same time, and the safety reminding efficiency is improved. According to the technical scheme, timely reminding can be performed when the user state has the potential safety hazard, the timeliness of safety reminding is improved, the potential safety hazard information is output through the target equipment, information transmission is more visual and rapid, the effectiveness of safety reminding is improved, and the travel safety of the user is guaranteed.

Description

Technical Field

[0001] This application belongs to the technical field of information processing, and particularly relates to a safety reminder method, device, equipment and storage medium. Background Art

[0002] Nowadays, more and more people start to choose green travel and walk to their destinations. There are potential safety hazards when they lower or raise their heads for a long time during walking (such as looking at mobile devices or materials for a long time with their heads down or looking around for a long time with their heads up). How to give safety reminders timely and effectively has become an urgent problem to be solved currently. Summary of the Invention

[0003] In view of this, the embodiments of this application provide a safety reminder method, device, equipment and storage medium to solve the problem of potential safety hazards when lowering or raising the head for a long time during walking in the prior art.

[0004] The first aspect of the embodiments of this application provides a safety reminder method, which is applied to a target device. The method includes:

[0005] Obtain acceleration data through the inertial sensor of the target device, and determine the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state;

[0006] When the user's motion state is in a walking state and the head state is in a head-down state or a head-up state, obtain real-time environment information;

[0007] If it is determined that the user is in an outdoor environment based on the real-time environment information, output a safety reminder message.

[0008] The first aspect of the embodiments of this application provides a safety reminder method. By obtaining acceleration data through the inertial sensor of the target device and determining the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state; when the user's motion state is in a walking state and the head state is in a head-down state or a head-up state, obtain real-time environment information; if it is determined that the user is in an outdoor environment based on the real-time environment information, output a safety reminder message. It can quantify whether there are potential safety hazards for the user from three dimensions: motion state, head state and environmental information, improve the accuracy of quantifying potential safety hazards, and reduce the probability of false alarms of potential safety hazard information. And when the corresponding conditions are met in all three dimensions, output a safety reminder message, which can remind in time when the user's state actually has potential safety hazards, improve the timeliness of safety reminders, and output potential safety hazard information through the target device, which is more intuitive and rapid in information transmission, thus improving the effectiveness of safety reminders and ensuring the travel safety of users.

[0009] The second aspect of the embodiments of this application provides a safety reminder device, including:

[0010] A first monitoring module, configured to obtain acceleration data through an inertial sensor of a target device, and determine a user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state;

[0011] A second monitoring module, configured to obtain real-time environment information when the user's motion state is in a walking state and the head state is in a bowed state or a raised state;

[0012] A reminder module, configured to output a safety reminder message if it is determined based on the real-time environment information that the user is in an outdoor environment.

[0013] A third aspect of the embodiments of the present application provides a target device, including an inertial sensor, a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the safety reminder method provided in the first aspect of the embodiments of the present application are implemented;

[0014] The inertial sensor is configured to obtain acceleration data.

[0015] A fourth aspect of the embodiments of the present application provides a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the steps of the safety reminder method provided in the first aspect of the embodiments of the present application are implemented.

[0016] It can be understood that the beneficial effects of the above second aspect to the fourth aspect can refer to the relevant descriptions in the above first aspect, and will not be repeated here. Description of the Drawings

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0018] Figure 1 is a schematic structural diagram of a target device provided by an embodiment of the present application;

[0019] Figure 2 is a first flow chart of a safety reminder method provided by an embodiment of the present application;

[0020] Figure 3 is a schematic architecture diagram of the connection between a target device and a terminal device provided by an embodiment of the present application;

[0021] Figure 4It is a communication schematic diagram between the target device and the terminal device provided by an embodiment of the present application;

[0022] Figure 5 It is the second process schematic diagram of the security reminder method provided by an embodiment of the present application;

[0023] Figure 6 It is a structural schematic diagram of the security reminder device provided by an embodiment of the present application. Detailed implementation manners

[0024] In the following description, specific details such as specific system architectures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from interfering with the description of the present application.

[0025] It should be understood that when used in the specification and appended claims of the present application, the term "comprising" indicates the presence of the described features, wholes, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0026] It should also be understood that the term "and / or" used in the specification and appended claims of the present application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0027] As used in the specification and appended claims of the present application, the term "if" can be interpreted as "when" or "once" or "in response to determining" or "in response to detecting" according to the context. Similarly, the phrase "if determined" or "if detecting [the described condition or event]" can be interpreted as meaning "once determined" or "in response to determining" or "once detecting [the described condition or event]" or "in response to detecting [the described condition or event]" according to the context.

[0028] In addition, in the description of the specification and appended claims of the present application, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0029] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in one or more embodiments of this application. Thus, statements such as "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification are not necessarily all referring to the same embodiment, but rather mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized.

[0030] In applications, nowadays more and more people start to choose green travel and walk to their destinations. There are safety hazards when looking down or up for a long time during walking (such as looking down at mobile devices or materials for a long time or looking up at surrounding things for a long time). How to give timely and effective safety reminders has become an urgent problem to be solved currently.

[0031] In view of the above technical problems, the embodiment of this application provides a safety reminder method. Acceleration data is obtained through an inertial sensor of a target device, and the motion state and head state of a user are determined based on the acceleration data; wherein, the target device is in a worn state; when the motion state of the user is in a walking state and the head state is in a looking-down state or a looking-up state, real-time environment information is obtained; if it is determined based on the real-time environment information that the user is in an outdoor environment, a safety reminder message is output. Whether there are safety hazards for the user can be quantified from three dimensions of the motion state, head state, and environment information, improving the accuracy of safety hazard quantification, and reducing the probability of false alarms of safety hazard information. When the corresponding conditions are met simultaneously in the three dimensions, a safety reminder message is output, which can timely remind when the user's state actually has safety hazards, improving the timeliness of safety reminders. Moreover, the safety hazard information is output through the target device, which is more intuitive and rapid in information transmission, thus improving the effectiveness of safety reminders and ensuring the travel safety of users.

[0032] The safety reminder method provided by the embodiment of this application can be applied to a target device. The target device can specifically be a wearable device that can be worn on parts such as ears, eyes, and head and can be used to detect the head state of a user. For example, it can be an earphone, smart glasses, an Augmented Reality (AR) / Virtual Reality (VR) device, etc. Specifically, it can be a True Wireless Stereo (TWS) earphone. The embodiment of this application does not impose any restrictions on the specific type of the target device.

[0033] It should be noted that the target device for executing the security reminder method needs to be equipped with an inertial sensor. The inertial sensor can be an acceleration sensor, an angular velocity sensor (gyroscope), an inertial measurement unit (IMU), a magnetic sensor, an attitude reference system, etc. The specific type of the inertial sensor is not limited in the embodiments of the present application.

[0034] Figure 1 An exemplary structural diagram of the target device 100 is shown. The target device 100 includes an inertial sensor 101, a memory 102, a processor 103, and a computer program 104 stored in the memory 102 and executable on the processor 103. When the processor 103 executes the computer program 104, the above analysis method is implemented.

[0035] In applications, the selection of the inertial sensor 101 can refer to the above relevant descriptions and will not be elaborated here.

[0036] In applications, the processor 103 can be a central processing unit (CPU). The processor can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0037] In applications, the memory 102 can be an internal storage unit of the terminal device in some embodiments, such as the hard disk or memory of the terminal device. The memory 102 can also be an external storage device of the terminal device in other embodiments, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device. Further, the memory 102 can also include both the internal storage unit and the external storage device of the terminal device. The memory 102 is used to store computer programs 104 such as an operating system, application programs, a boot loader (BootLoader), etc. The memory 102 can also be used to temporarily store data that has been output or will be output.

[0038] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the target device 100. In some other embodiments of the present application, the target device 100 may include more or fewer components than those illustrated, or combine certain components, or different components. For example, it may further include a graphics processor, etc. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0039] As Figure 2 shown, the security reminder method 200 provided by the embodiments of the present application is applied to a target device and includes the following steps S201 to S203:

[0040] Step S201: Obtain acceleration data through an inertial sensor of the target device, and determine the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state.

[0041] In an application, the target device can determine whether it is worn by obtaining the surface contact situation, the coverage situation of preset points, or the running situation, etc. Specifically, the surface contact situation can be obtained through a contact sensor, and when the surface contact area is greater than a preset contact area, or when a preset contact point is contacted, it is determined that the target device is worn; it can also detect whether the preset points are covered through an optical sensor or an infrared sensor, and when the preset points are covered, it is determined that the target device is worn; it can also determine the running situation by obtaining the audio and video playback situation, and when the audio and video are played, it is determined that the target device is worn.

[0042] In an application, when the target device is in a worn state, the inertial sensor can be scheduled to obtain acceleration data, and the user's motion state and head state can be determined. Specifically, the judgment order can be to first judge the motion state, and when the motion state is in a walking state, then judge the head state; or the motion state and the head state can be judged simultaneously. The judgment method can be to judge the motion state and the head state through a set of acceleration data; or one set of acceleration data can be used to judge the motion state, and another set of acceleration data can be used to judge the head state.

[0043] It should be noted that the inertial sensor can obtain multiple sets of acceleration data by obtaining accelerations in different directions. For example, the inertial sensor can obtain the acceleration in the vertical direction and the acceleration in the horizontal direction, and can also obtain the acceleration of the x-axis, the acceleration of the y-axis, and the acceleration of the z-axis. The embodiments of the present application do not impose any restrictions on the acceleration direction of the acceleration data.

[0044] In the application, the user's motion state can be determined by the vertical acceleration and / or the horizontal acceleration, and the user's head state can be determined by any one of the accelerations of the x-axis, the y-axis, and the z-axis, or by a combination of any two axes, or by a combination of xyz axes. The embodiments of the present application do not impose any restrictions on the method for determining the motion state and the head state.

[0045] Step S202: When the user's motion state is in a walking state and the head state is in a head-down state or a head-up state, real-time environmental information is obtained.

[0046] In the application, the user's motion state may include but is not limited to stationary state, walking state, running state and cycling state. The user's head state may include but is not limited to head-down state, head-level state and head-up state. When the user's motion state is in walking state and the head state is in head-down state or head-up state, it means that the user has certain safety risks when walking, and real-time environmental information can be obtained to determine whether the user is in an outdoor environment or an indoor environment.

[0047] Step S203: If it is determined based on the real-time environmental information that the user is in an outdoor environment, output safety reminder information.

[0048] In the application, when the user's movement state is in a walking state and the head state is in a head-down state or head-up state, and it is determined based on real-time environmental information that the user is in an outdoor environment, it means that the user is currently in a walking state and there is a high safety hazard, and a safety reminder message can be output to inform the user of the current safety hazard and remind the user to pay attention to safety. The safety reminder message may include voice reminder message and / or vibration reminder message, and the specific output form of the safety reminder message may be determined based on the output form supported by the target device. The embodiment of the present application does not impose any restrictions on the output form of the safety reminder message.

[0049] In one embodiment, the real-time environment information includes real-time location information or real-time environment sound information, and step S203 includes:

[0050] Obtain the duration of the user's outdoor environment based on real-time location information;

[0051] When the user is in a walking state, the head state is in a head-down state or head-up state, and the duration of the user in an outdoor environment is greater than a preset time threshold, a safety reminder message is output;

[0052] Alternatively, when the real-time ambient sound information matches the preset ambient sound information, the duration of the user being in the outdoor environment is obtained based on the real-time ambient sound information;

[0053] When the user's motion state is in the walking state, the head state is in the lowered head state or the raised head state, and the duration of the user in the outdoor environment is greater than the preset time threshold, a safety reminder message is output.

[0054] In the application, the method for obtaining real-time location information and the method for determining whether the user is in the outdoor environment based on the real-time location information can refer to the relevant descriptions in the following embodiments. The following describes the method for obtaining real-time ambient sound information and the method for determining whether the user is in the outdoor environment based on the real-time ambient sound information: The real-time ambient sound information can be collected by the target device. Specifically, when it is detected that the user's motion state is in the walking state and the head state is in the lowered head state or the raised head state, the microphone of the target device is controlled to collect the real-time ambient sound information, and the real-time ambient sound information is compared with the preset ambient sound information. If the real-time ambient sound information matches the preset ambient sound information, it can be determined that the user is in the outdoor environment; if the real-time ambient sound information does not match the preset ambient sound information, it can be determined that the user is in the indoor environment.

[0055] In the application, an ambient sound detection model can be used to determine whether the real-time ambient sound information matches the preset ambient sound information. The ambient sound detection model can be trained with real sound data of various outdoor environments during the training phase. The real sound data can include engine sounds, tire noises, horn sounds, or rustling sounds of leaves, etc., so as to fit the real-time ambient sound information and detect the similarity between the real-time ambient sound information and the preset ambient sound information. If the similarity is greater than the first preset similarity, it is determined that the real-time ambient sound information matches the preset ambient sound information.

[0056] In the application, the preset ambient sound information containing various real sound data can also be compared with the real-time ambient sound information. If the similarity between the real-time ambient sound information and any one of the real sound data is greater than the second preset similarity, it is determined that the real-time ambient sound information matches the preset ambient sound information.

[0057] It should be noted that the embodiments of the present application do not impose any restrictions on the specific matching method between the real-time ambient sound information and the preset ambient sound information, nor on the specific magnitudes of the first preset similarity and the second preset similarity.

[0058] In the application, the duration of the user in the outdoor environment can be recorded based on the real-time location information / real-time ambient sound information. Among them, if the user continuously stays in the outdoor environment, the above-mentioned duration will continue to increase; if the user enters the indoor environment from the outdoor environment, the above-mentioned duration will be cleared, or if the interruption time when the user enters the indoor environment from the outdoor environment is lower than the preset interruption threshold, the duration will continue to be recorded after the user re-enters the outdoor environment. The above-mentioned interruption time represents the duration after the user enters the indoor environment from the outdoor environment. The preset interruption threshold can be 3s, 5s, or 10s, etc.

[0059] In the application, when the user's motion state is in the walking state, the head state is in the lowered head state or the raised head state, and the duration of the user in the outdoor environment is greater than the preset time threshold, a safety reminder message is output, so as to output a safety reminder message when it is determined that the user has been in the outdoor environment for a long time and keeps walking with the head lowered, which can improve the accuracy of the output of the safety reminder message, thereby improving the effectiveness of the output of the safety reminder message and improving the user experience, and avoiding misoutputting the safety reminder message when there is no potential safety hazard for the user (such as briefly lowering the head to look at the watch or briefly raising the head to look at the weather, etc.).

[0060] In the application, a first preset time threshold and a second preset time threshold can also be set. The first preset time threshold is used to monitor the duration of the user's motion state being in the walking state, the head state being in the lowered head state or the raised head state, and the user being in the outdoor environment. The second preset time threshold is used to monitor the duration of the user's motion state being in the walking state, the head state being in the lowered head state or the raised head state, and the user being in the indoor environment. The safety reminder method when the user is in the indoor environment is the same as the safety reminder method when the user is in the outdoor environment. The difference is that the second preset time threshold can be greater than the first preset time threshold, so as to relax the monitoring strictness in the indoor environment compared with the outdoor environment and improve the fit degree of the safety reminder with the environment where the user is located.

[0061] In one embodiment, the target device is connected to the terminal device, and step S203 includes:

[0062] When the user's motion state is in the walking state and the head state is in the lowered head state or the raised head state, send a positioning instruction to the terminal device and receive the real-time environment information returned by the terminal device.

[0063] In the application, the target device can obtain the real-time environment information through its own positioning unit, or can be connected to a terminal device with positioning function (refer to the structure diagram shown in Figure 3 ), and receive the real-time environment information. Specifically, when the target device monitors that the user's motion state is in the walking state and the head state is in the lowered head state or the raised head state, it can actively send a positioning instruction to the terminal device and receive the real-time environment information returned by the terminal device. Among them, the positioning instruction is used to represent that the target device needs to obtain the real-time environment information, and the real-time environment information can be specific location information or a location judgment result of the user being in the outdoor environment or the indoor environment.

[0064] In an application, acceleration data is obtained through an inertial sensor of a target device, and the motion state and head state of a user are determined based on the acceleration data; wherein, the target device is in a worn state; when the motion state of the user is in a walking state and the head state is in a bowed state or a raised state, real-time environmental information is obtained; if it is determined that the user is in an outdoor environment based on the real-time environmental information, a safety reminder message is output. It is possible to quantify whether there are potential safety hazards for the user from three dimensions: motion state, head state, and environmental information, improve the accuracy of quantifying potential safety hazards, reduce the probability of false alarms of potential safety hazard information, and output a safety reminder message when the corresponding conditions are met in all three dimensions. It can timely remind when the user's state actually has potential safety hazards, improve the timeliness of safety reminders, and output potential safety hazard information through the target device, which is more intuitive and rapid in information transmission, thereby improving the effectiveness of safety reminders and ensuring the travel safety of the user.

[0065] It should be noted that by using the target device to detect potential walking safety hazards and output safety reminder information, the target device independently has the ability to provide safety reminders. In scenarios where the user does not carry or use a terminal device (such as walking, brisk walking, or race walking), it can effectively make up for the disadvantages of the terminal device in terms of unintuitive information transmission or insufficient reminders, and can effectively inform the user of potential safety hazards in the first time to avoid safety risks.

[0066] As Figure 3 shown, in one embodiment, the target device 100 further includes a communication unit 105, and the communication unit 105 is used to connect to the terminal device 300;

[0067] The processor 103 is used to control the communication unit 105 to send a positioning instruction to the terminal device 300 and receive the real-time environmental information returned by the terminal device 300 through the communication unit 105 when the motion state of the user is in a walking state and the head state is in a bowed state or a raised state;

[0068] Among them, the wired connection between the inertial sensor and the terminal device 300 represents wired communication, and the wireless connection between the inertial sensor and the terminal device 300 represents wireless communication.

[0069] In an application, the terminal device 300 may be a tablet computer with a positioning function, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. Specifically, it may be a mobile phone or a smart watch. The embodiments of the present application do not impose any restrictions on the specific type of the terminal device 300.

[0070] In an application, the communication unit 105 may include a wired communication unit and / or a wireless communication unit. The communication method of the wired communication unit may include 3.5 mm audio plug connection or USB connection, etc.; the communication methods of the wireless communication unit may include Bluetooth, mobile communications, wireless local area network (WLAN), near field communication (NFC), and ZigBee, etc. The embodiments of the present application do not impose any restrictions on the communication methods supported by the communication unit 105.

[0071] Figure 4 An exemplary communication schematic diagram of the target device and the terminal device is shown, where Figure 4 in the target device is specifically the earphone 401, and the terminal device is specifically the smart watch 402.

[0072] As Figure 5 shown, in one embodiment, based on Figure 2 the corresponding embodiment, a security reminder method 500 is provided, including the following steps S501 to step S504:

[0073] Step S501: Obtain a first acceleration through the inertial sensor of the target device, and determine whether the user's motion state is a walking state according to the change of the first acceleration;

[0074] wherein, the first acceleration includes the acceleration in the vertical direction, and the second acceleration includes the acceleration in the x-axis, y-axis, and z-axis directions; when the user is in a walking state, the first acceleration changes periodically, and at the quasi-stationary moment of the walking state, the first acceleration is equal to 0.

[0075] In an application, the acceleration data may specifically include a first acceleration and a second acceleration. The first acceleration can be obtained through an inertial sensor of the target device, and based on the change of the first acceleration, it can be determined whether the user's motion state is a walking state. The first acceleration may specifically be the acceleration in the vertical direction. When the user is in a walking state, the first acceleration will show periodic changes (the change situation can refer to the waveform of a sine wave). In one step cycle, it can include three stages: support, landing, and stepping. In the support stage, the first acceleration starts to increase from zero, and after increasing for a period of time, it starts to decrease, during which the first acceleration is greater than 0. In the landing stage, the first acceleration continues to decrease and starts to increase after decreasing for a period of time, during which the first acceleration is less than 0. In the stepping stage, the first acceleration is approximately equal to 0. The moment when the first acceleration is equal to 0 in the stepping stage is the quasi-stationary moment, and at this time, both feet are in stable contact with the ground.

[0076] In one embodiment, when the frequency of the periodic change of the first acceleration is less than a preset frequency and the average value of the absolute value of the first acceleration is within a preset acceleration interval, it is determined that the user's motion state is a walking state.

[0077] In an application, the specific method for determining the user's motion state based on the change of the first acceleration is as follows: Obtain the frequency of the periodic change of the first acceleration. If the above frequency is less than the preset frequency, it indicates that the user's motion frequency is consistent with the motion frequency in the walking state. If the above frequency is greater than the preset frequency, it indicates that the user is in a state corresponding to a high motion frequency (such as running or taking a vehicle). And obtain the average value of the absolute value of the first acceleration. If the above average value is within the preset acceleration interval, it indicates that the user's acceleration is consistent with the acceleration in the walking state. If the above average value is less than the preset acceleration interval, it indicates that the user is in a state corresponding to a low acceleration (such as a steadily moving car). If the above average value is greater than the preset acceleration interval, it indicates that the user is in a state corresponding to a high acceleration (such as taking a bus or other vehicle on a bumpy road). When the frequency of the periodic change of the first acceleration is less than the preset frequency and the average value of the absolute value of the first acceleration is within the preset acceleration interval, it can be determined that the user's motion state is a walking state.

[0078] Among them, the preset frequency may specifically be 5Hz. The embodiments of the present application do not impose any restrictions on the specific values of the preset frequency and the preset acceleration interval.

[0079] Step S502: If the user's motion state is a walking state, obtain the second acceleration at the quasi-stationary moment through the inertial sensor of the target device, and obtain the user's head attitude angle based on the second acceleration to determine the user's head state.

[0080] In an application, if it is determined that the user's motion state is a walking state, a stationary moment can be captured by the inertial sensor of the target device. The capture conditions for the quasi-stationary moment include: the first acceleration is equal to 0; the acceleration segment where the quasi-stationary moment is located shows a positive increasing trend. After capturing the quasi-stationary moment, the second acceleration at the quasi-stationary moment can be further obtained through the inertial sensor. The second acceleration includes the x-axis acceleration, y-axis acceleration, and z-axis acceleration, and the head pose angle of the user can be obtained based on the second acceleration. The specific calculation method can refer to the existing conversion method between the three-axis acceleration and the pose angle.

[0081] In an application, when the head pose angle of the user is within the first preset pose angle interval, it is determined that the head state of the user is a bowed head state; when the head pose angle of the user is within the second preset pose angle interval, it is determined that the head state of the user is a raised head state. Among them, the first preset pose angle interval can be greater than -90 degrees and less than -15 degrees, or can be greater than -45 degrees and less than -15 degrees; the second preset pose angle interval can be greater than 15 degrees and less than 90 degrees, or can be greater than 15 degrees and less than 45 degrees. The specific interval ranges of the first preset pose angle interval and the second preset pose angle interval are not limited in any way in the embodiments of the present application.

[0082] Step S503, when the user's motion state is in a walking state and the head state is in a bowed head state or a raised head state, obtain real-time environmental information;

[0083] Step S504, if it is determined that the user is in an outdoor environment based on the real-time environmental information, output a safety reminder message.

[0084] In an application, the safety reminder method provided in step S503 and step S504 can refer to the relevant descriptions in the above step S202 and step S203, and will not be elaborated here.

[0085] In an application, by determining the user's motion state according to the acceleration in the vertical direction, compared with determining the motion state by the acceleration in the horizontal direction, it has a better anti-interference effect and improves the recognition accuracy of the motion state; and obtaining the second acceleration at the quasi-stationary moment to determine the head state can eliminate the acceleration interference caused by walking and improve the judgment accuracy of the head state, thereby improving the accuracy of quantifying potential safety hazards.

[0086] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0087] Such as Figure 6As shown in the figure, an embodiment of the present application further provides a safety reminder device for performing the steps in the embodiment of the safety reminder method applied to the target device. The safety reminder device may be a virtual appliance in the target device, run by the processor of the target device, or the target device itself.

[0088] As Figure 6 shown in the figure, the safety reminder device 600 provided by the embodiment of the present application includes:

[0089] A first monitoring module 601, configured to obtain acceleration data through an inertial sensor of the target device, and determine the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state;

[0090] A second monitoring module 602, configured to obtain real-time environment information when the user's motion state is in a walking state and the head state is in a lowered state or a raised state;

[0091] A reminder module 603, configured to output a safety reminder message if it is determined based on the real-time environment information that the user is in an outdoor environment.

[0092] In one embodiment, the above-mentioned first monitoring module 601 includes:

[0093] A first acceleration monitoring unit, configured to obtain a first acceleration through an inertial sensor of the target device, and determine whether the user's motion state is a walking state according to the change of the first acceleration;

[0094] A second acceleration monitoring unit, if the user's motion state is a walking state, obtains a second acceleration at the quasi-stationary moment through an inertial sensor of the target device, and obtains the user's head attitude angle according to the second acceleration to determine the user's head state;

[0095] Wherein, the first acceleration includes the acceleration in the vertical direction, and the second acceleration includes the x-axis acceleration, the y-axis acceleration, and the z-axis acceleration; when the user is in a walking state, the first acceleration changes periodically, and at the quasi-stationary moment of the walking state, the first acceleration is equal to 0.

[0096] In one embodiment, the above-mentioned second monitoring module 602 includes:

[0097] A real-time environment information acquisition unit, when the user's motion state is in a walking state and the head state is in a lowered state or a raised state, sends a positioning instruction to the terminal device and receives the real-time environment information returned by the terminal device.

[0098] In one embodiment, the above-mentioned reminder module 603 includes:

[0099] A delay unit for obtaining the duration of the user in the outdoor environment based on real-time environmental information;

[0100] An output unit for outputting a safety reminder message when the user's motion state is in a walking state, the head state is in a lowered head state or a raised head state, and the duration of the user in the outdoor environment is greater than a preset time threshold.

[0101] In an application, each module in the safety reminder device 600 can be a software program module, can also be implemented by different logic circuits integrated in a processor, or can also be implemented by multiple distributed processors.

[0102] It should be noted that for the content such as information interaction and execution process between the above modules, since it is based on the same concept as the method embodiment of the present application, for its specific functions and the technical effects brought, reference can be specifically made to the method embodiment part, and details will not be described here.

[0103] Those skilled in the art can clearly understand that for the convenience and conciseness of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. Each functional module in the embodiment can be integrated in a processing module, can also be physically present separately for each module, or two or more modules can be integrated in one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. In addition, the specific names of each functional module are only for the convenience of mutual distinction and do not limit the protection scope of the present application. The specific working process of the modules in the above system can refer to the corresponding process in the above safety reminder method embodiment, and details will not be described here.

[0104] The embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above various safety reminder method embodiments can be implemented.

[0105] When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the above-described embodiment methods of this application, a computer program can be used to instruct relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above-described various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable storage medium can at least include: any entity or device capable of carrying the computer program code to the photographing terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc.

[0106] In the above embodiments, the descriptions of the various embodiments have their own emphases. For parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0107] Those of ordinary skill in the art can realize that the modules and algorithm steps of the various examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0108] In the embodiments provided in this application, it should be understood that the disclosed terminal device and method can be implemented in other ways. For example, the terminal device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there can be other division methods. For example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be in an electrical, mechanical, or other form.

[0109] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included within the protection scope of the present application.

Claims

1. A safety reminder method, characterized in that, applied to a target device, the method includes: obtaining acceleration data through an inertial sensor of the target device, and determining the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state; when the user's motion state is in a walking state and the head state is in a bowed state or a raised state, obtaining real-time environment information; if it is determined that the user is in an outdoor environment based on the real-time environment information, outputting a safety reminder message.

2. The safety reminder method according to claim 1, characterized in that, the obtaining acceleration data through the inertial sensor of the target device and determining the user's motion state and head state according to the acceleration data includes: obtaining a first acceleration through the inertial sensor of the target device, and determining whether the user's motion state is a walking state according to the change of the first acceleration; if the user's motion state is a walking state, obtaining a second acceleration at the quasi-stationary moment through the inertial sensor of the target device, and obtaining the user's head attitude angle according to the second acceleration to determine the user's head state; wherein, the first acceleration includes the acceleration in the vertical direction, and the second acceleration includes the x-axis acceleration, the y-axis acceleration and the z-axis acceleration; when the user is in a walking state, the first acceleration changes periodically, and at the quasi-stationary moment of the walking state, the first acceleration is equal to 0.

3. The safety reminder method according to claim 2, characterized in that, when the frequency of the periodic change of the first acceleration is less than a preset frequency, and the average value of the absolute value of the first acceleration is within a preset acceleration interval, determining that the user's motion state is a walking state.

4. The safety reminder method according to claim 1, characterized in that, the real-time environment information includes real-time position information, and the outputting a safety reminder message if it is determined that the user is in an outdoor environment based on the real-time environment information includes: obtaining the duration of the user being in an outdoor environment based on the real-time position information; when the user's motion state is in a walking state, the head state is in a bowed state or a raised state, and the duration of the user being in an outdoor environment is greater than a preset time threshold, outputting a safety reminder message.

5. The safety reminder method according to claim 4, characterized in that, the target device is connected to a terminal device, and the obtaining real-time environment information when the user's motion state is in a walking state and the head state is in a bowed state or a raised state includes: when the user's motion state is in a walking state and the head state is in a bowed state or a raised state, sending a positioning instruction to the terminal device and receiving the real-time position information returned by the terminal device.

6. The safety reminder method according to claim 1, characterized in that, the real-time environment information includes real-time environmental sound information, and the outputting a safety reminder message if it is determined that the user is in an outdoor environment based on the real-time environment information includes: when the real-time environmental sound information matches the preset environmental sound information, obtaining the duration of the user being in an outdoor environment based on the real-time environmental sound information; When the user's motion state is in a walking state, the head state is in a bowed state or a raised state, and the duration of the user in an outdoor environment is greater than a preset time threshold, a safety reminder message is output.

7. The safety reminder method according to any one of claims 1 to 6, characterized in that the safety reminder message includes a voice reminder message and / or a vibration reminder message.

8. A safety reminder device, characterized in that it includes: A first monitoring module, configured to obtain acceleration data through an inertial sensor of a target device, and determine the user's motion state and head state according to the acceleration data; wherein, the target device is in a worn state; A second monitoring module, configured to obtain real-time position information when the user's motion state is in a walking state and the head state is in a bowed state or a raised state; A reminder module, configured to output a safety reminder message if it is determined based on the real-time position information that the user is in an outdoor environment.

9. A target device, characterized in that it includes an inertial sensor, a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the steps of the safety reminder method according to any one of claims 1 to 7 are implemented; the inertial sensor is used to obtain acceleration data.

10. The target device according to claim 9, characterized in that the target device further includes a communication unit, and the communication unit is used to connect to a terminal device; the processor is configured to control the communication unit to send a positioning instruction to the terminal device when the user's motion state is in a walking state and the head state is in a bowed state or a raised state, and receive the real-time position information returned by the terminal device through the communication unit.

11. The target device according to claim 10, characterized in that the terminal device includes a mobile phone or a smart watch.

12. The target device according to any one of claims 9 to 11, characterized in that the target device is an earphone.

13. A computer-readable storage medium, the computer-readable storage medium stores a computer program, characterized in that when the computer program is executed by a processor, the steps of the safety reminder method according to any one of claims 1 to 7 are implemented.

Images