Information processing method, device and storage medium
By integrating image acquisition and sensing components in mobile electronic devices, the attitude of the equipment and target objects is detected in real time and the sliding risk warning information is output, the problem of equipment sliding safety hazards is solved and user safety is improved.
Patent Information
- Application Number
- CN201910826629.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-09-03
- Publication Date
- 2024-12-20
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Mobile electronic equipment is prone to slip off during use, resulting in safety hazards, and it is difficult for the existing technology to effectively prevent slip off accidents.
By integrating image acquisition components and sensing components in electronic devices, we can detect the attitude of the target object and the device in real time, judge whether the device is above the target object, and output slip risk warning information when specific conditions are met, and warn users.
Effectively prevent electronic equipment from sliding to target objects, reduce the probability of damage caused by sliding, and improve user safety.
Smart Images

Figure CN112445327B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer communications, and in particular to an information processing method, device and storage medium. Background Art
[0002] At present, mobile electronic devices, such as mobile phones and tablet computers, have been widely used in various fields such as communication, entertainment, and education. Because mobile electronic devices are easy to carry, users can use them anytime and anywhere. However, when users use mobile electronic devices, there is a safety problem that users may be injured by the mobile electronic devices. Summary of the invention
[0003] The present disclosure provides an information processing method, device and storage medium.
[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an information processing method, the method being applied to an electronic device, comprising:
[0005] determining whether the electronic device is located on a target object;
[0006] When it is determined that the electronic device is located on the target object, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
[0007] Optionally, determining whether the electronic device is located above the target object includes:
[0008] determining a current object pose of the target object;
[0009] When the current object posture represents that the target object is lying flat, determining a current device posture of the electronic device;
[0010] Based on the current object posture and the current device posture, determining whether the electronic device is facing the face of the target object lying flat;
[0011] When the electronic device is directed toward the face of the target object lying flat, it is determined that the electronic device is located above the target object.
[0012] Optionally, determining the current object posture of the target object includes:
[0013] Collecting image information based on the image acquisition component included in the electronic device;
[0014] Based on the image information, a current object pose of the target object is determined.
[0015] Optionally, determining the current device posture of the electronic device includes:
[0016] Collecting sensor data based on the sensor components included in the electronic device;
[0017] Determining a current device posture of the electronic device based on the sensor data;
[0018] Wherein, the sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
[0019] Optionally, the method further includes:
[0020] Determining whether the electronic device is in a holding state;
[0021] The determining the current object posture of the target object comprises:
[0022] When the electronic device is in a gripping state, a current object posture of the target object is determined.
[0023] Optionally, the method further includes:
[0024] When the electronic device is in a holding state, determining a holding time of the electronic device;
[0025] When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has a risk of sliding onto the target object includes:
[0026] When it is determined that the electronic device is located on the target object and the holding time is greater than or equal to the set time threshold, risk warning information indicating that the electronic device has a risk of slipping onto the target object is output.
[0027] Optionally, the set duration threshold corresponds to the attribute information of the electronic device and / or the holding state of the electronic device;
[0028] The attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force for fixing the electronic device.
[0029] Optionally, the method further includes:
[0030] Acquiring physiological condition parameters of the target object;
[0031] determining a fatigue state of the target object based on the physiological condition parameter;
[0032] When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has a risk of sliding onto the target object includes:
[0033] When it is determined that the electronic device is located on the target object and the fatigue state satisfies a set fatigue condition, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
[0034] According to a second aspect of an embodiment of the present disclosure, there is provided an information processing device, including:
[0035] a location determination module configured to determine whether the electronic device is located above a target object;
[0036] The information output module is configured to output risk warning information indicating that the electronic device has a risk of sliding onto the target object when it is determined that the electronic device is located on the target object.
[0037] Optionally, the location determination module includes:
[0038] A first posture determination submodule, configured to determine a current object posture of the target object;
[0039] A second posture determination submodule, configured to determine a current device posture of the electronic device when the current object posture represents that the target object is lying flat;
[0040] a first position determination submodule, configured to determine whether the electronic device is facing the face of the target object lying flat based on the current object posture and the current device posture;
[0041] The second position determination submodule is configured to determine that the electronic device is located above the target object when the electronic device is facing the face of the target object lying flat.
[0042] Optionally, the first posture determination submodule is specifically configured as follows:
[0043] Collecting image information based on the image acquisition component included in the electronic device;
[0044] Based on the image information, a current object pose of the target object is determined.
[0045] Optionally, the second posture determination submodule is specifically configured as follows:
[0046] Collecting sensor data based on the sensor components included in the electronic device;
[0047] Determining a current device posture of the electronic device based on the sensor data;
[0048] Wherein, the sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
[0049] Optionally, the device further comprises:
[0050] A first state determination module, configured to determine whether the electronic device is in a holding state;
[0051] The first posture determination submodule is further specifically configured as follows:
[0052] When the electronic device is in a gripping state, a current object posture of the target object is determined.
[0053] Optionally, the device further comprises:
[0054] a duration determination module, configured to determine a holding duration of the electronic device when the electronic device is in a holding state;
[0055] The information output module is specifically configured to: when it is determined that the electronic device is located above the target object and the holding time is greater than or equal to a set time threshold, output risk warning information indicating that the electronic device has a risk of slipping onto the target object.
[0056] Optionally, the set duration threshold corresponds to the attribute information of the electronic device and / or the holding state of the electronic device;
[0057] The attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force for fixing the electronic device.
[0058] Optionally, the device further comprises:
[0059] A physiological condition acquisition module, configured to acquire physiological condition parameters of the target object;
[0060] a second state determination module configured to determine a fatigue state of the target object based on the physiological condition parameter;
[0061] The information output module is further specifically configured to: when it is determined that the electronic device is located above the target object and the fatigue state meets the set fatigue condition, output risk warning information indicating that the electronic device has the risk of slipping onto the target object.
[0062] According to a third aspect of an embodiment of the present disclosure, there is provided an information processing device, including:
[0063] processor;
[0064] a memory configured to store processor-executable instructions;
[0065] Wherein, the processor is configured to: implement the steps in the information processing method in the first aspect mentioned above when executed.
[0066] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an information processing device, the device is enabled to execute the information processing method in the first aspect described above.
[0067] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:
[0068] It can be seen from the above technical solution that the present disclosure can output risk warning information indicating that the electronic device is likely to slip onto the target object when the electronic device is located on the target object, so as to provide risk warning, which can effectively prevent the electronic device from slipping onto the target object and reduce the probability of causing damage to the target object due to the slipping of the electronic device.
[0069] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0070] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0071] Figure 1 The following is a flow chart of an information processing method according to an exemplary embodiment. Figure 1 .
[0072] Figure 2A FIG. 2 is a second flowchart of an information processing method according to an exemplary embodiment.
[0073] Figure 2B is a schematic diagram showing an electronic device in a holding state according to an exemplary embodiment Figure 1 .
[0074] Figure 2C FIG2 is a second schematic diagram showing an electronic device in a holding state according to an exemplary embodiment.
[0075] Figure 3 The invention is a block diagram of an information processing device according to an exemplary embodiment.
[0076] Figure 4 The figure is a hardware structure block diagram of an information processing device according to an exemplary embodiment. DETAILED DESCRIPTION
[0077] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0078] Figure 1 The following is a flow chart of an information processing method according to an exemplary embodiment. Figure 1 ,like Figure 1 As shown, the method is applied to an electronic device, wherein the electronic device is a portable electronic device, including a mobile terminal, such as a mobile phone, a tablet computer, a wearable mobile device, etc. The method comprises the following steps:
[0079] In step 101 , it is determined whether the electronic device is located above a target object.
[0080] In step 102, when it is determined that the electronic device is located on the target object, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
[0081] Here, the image information can be collected based on the image collection component of the electronic device, and based on the image information, it can be determined whether the electronic device is located above the target object. Taking the image collection component as a camera as an example, the electronic device can control the camera to collect image information at a set time interval, such as collecting image information every 5 seconds, or collecting image information every 10 seconds, etc. The specific time interval can be set according to actual needs and is not specifically limited here.
[0082] In other optional embodiments, the image acquisition component may be started to acquire image information after detecting a change in the sensor data acquired by the sensor included in the electronic device. For example, if it is detected that at least one of the acceleration value acquired by the acceleration sensor, the pressure value acquired by the pressure sensor, and the rotational angular velocity value acquired by the gyroscope has changed, the image acquisition component may be started to acquire image information.
[0083] When it is determined that the electronic device is located above the target object, risk warning information can be output based on the current display interface of the electronic device. For example, graphic information can be output using the current display interface, and the risk warning content can be displayed in the form of graphics and text on the current display interface.
[0084] In the embodiments of the present disclosure, when the electronic device is located above the target object, risk warning information indicating that the electronic device has the risk of slipping onto the target object can be output. When the risk of the electronic device slipping is detected, the risk warning information can be output in advance for early warning, which can effectively prevent the electronic device from slipping onto the target object and reduce the probability of the target object being damaged by the slipping of the electronic device.
[0085] In other optional embodiments, step 101 includes:
[0086] determining a current object pose of the target object;
[0087] When the current object posture represents that the target object is lying flat, determining a current device posture of the electronic device;
[0088] determining, based on the current object posture and the current device posture, whether the electronic device is facing toward the face of the target object lying flat;
[0089] When the electronic device is directed toward the face of a target object lying flat, it is determined that the electronic device is located above the target object.
[0090] In the disclosed embodiment, by detecting the current object posture of the target object and the current device posture of the electronic device, and when the current object posture and the current device posture of the electronic device meet the set conditions, it is determined whether the electronic device is located above the target object. In this way, when necessary, it is further determined whether the electronic device is located above the target object, which can not only improve the accuracy of the information reminder, but also reduce the waste of device power consumption caused by determining whether the electronic device is located above the target object.
[0091] In other optional embodiments, determining the current object posture of the target object includes:
[0092] Collecting image information based on an image acquisition component included in the electronic device;
[0093] Based on the image information, a current object pose of the target object is determined.
[0094] Here, image information can be collected based on the image collection component of the electronic device, and the current object posture of the target object can be determined based on the image information. Taking the image collection component as a camera as an example, the electronic device can control the camera to collect image information of the target object at a set time interval, for example, collecting image information every 5 seconds, or collecting image information every 10 seconds, etc. The specific time interval can be set according to actual needs and is not specifically limited here.
[0095] In other optional embodiments, the image acquisition component may be started to acquire image information after detecting a change in the sensor data acquired by the sensor included in the electronic device. For example, if it is detected that at least one of the acceleration value acquired by the acceleration sensor, the pressure value acquired by the pressure sensor, and the rotational angular velocity value acquired by the gyroscope has changed, the image acquisition component may be started to acquire image information.
[0096] In other optional embodiments, determining the current device posture of the electronic device includes:
[0097] Collecting sensor data based on sensor components included in the electronic device;
[0098] Determine a current device posture of the electronic device based on the sensor data;
[0099] The sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
[0100] Correspondingly, the sensing data includes at least one of the following: an acceleration value collected by an acceleration sensor, a pressure value collected by a pressure sensor, and a rotational angular velocity value collected by a gyroscope.
[0101] In other optional embodiments, the electronic device may determine the current object posture of the target object based on the collected state information of the target object. The electronic device may collect the state information of the target object in at least one of the following ways: collecting the state information of the target object through sensors of wearable devices on the target object, such as accelerometers, gyroscopes, pressure sensors, etc.; collecting the state information of the target object through sensors of electronic devices held by the target object, such as accelerometers, cameras, etc.; collecting the state information of the target object through sensors on other electronic devices, such as beds, televisions, desk lamps, etc., such as accelerometers, cameras, pressure sensors, etc.
[0102] The current object posture includes at least one of the following: back orientation, face orientation. For example, if it is determined that the target object is lying flat on its back, it is determined that the front of the target object is at a greater risk of being hit by the electronic device, and it is necessary to further determine whether the electronic device is located above the target object.
[0103] Furthermore, it is possible to determine whether the target object is in a non-standing posture, such as a lying posture. For example, when the target object is a user of an electronic device, a wearable device worn by the user can be used to perform motion trajectory detection or posture detection to detect whether the target object is in a non-standing posture or other posture that meets the set posture condition. Wearable devices include but are not limited to smart watches, smart bracelets, etc.
[0104] In the disclosed embodiment, based on the image information collected by the image acquisition component included in the electronic device, the face of the target object can be accurately located, reducing the probability of the electronic device sliding onto the designated part of the target object. The designated part includes, but is not limited to, the face and / or the head. The designated part may be a pre-set part that requires special protection. When it is determined that the electronic device is located on the face and / or head of the target object, risk warning information is output, which can further accurately locate the designated part of the target object, and can effectively reduce the risk of the electronic device sliding onto the head and / or face of the target object.
[0105] In other optional embodiments, the method further includes:
[0106] Determining whether the electronic device is in a holding state;
[0107] Determine the current object pose of the target object, including:
[0108] When the electronic device is in a gripping state, a current object posture of the target object is determined.
[0109] In other optional embodiments, the method further includes:
[0110] When the electronic device is in a holding state, determining a holding time of the electronic device;
[0111] When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has the risk of slipping onto the target object includes:
[0112] When it is determined that the electronic device is located above the target object and the holding time is greater than or equal to the set time threshold, risk warning information indicating that the electronic device has the risk of slipping onto the target object is output.
[0113] Here, taking the target object holding an electronic device as an example, the longer the target object holds the electronic device, the weaker the target object's arm will be, and the higher the probability that the electronic device will fall and hit the face. When it is determined that the electronic device is directly above the target object, the risk warning information may not be output immediately, but when it is detected that the holding time of the electronic device is greater than or equal to the set time threshold, the risk warning information is output, so that unnecessary prompts can be reduced.
[0114] The set time threshold can be set as needed, for example, 5 minutes, 10 minutes, etc. If the holding time is greater than or equal to the set time threshold, the electronic device outputs a risk warning message to remind the target object to be careful of the device falling and hitting the face.
[0115] In other optional embodiments, the setting time threshold has a corresponding relationship with the attribute information of the electronic device and / or the holding state of the electronic device; wherein the attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force fixing the electronic device.
[0116] Here, the electronic device can be held by the target object or other fixed modules, wherein the fixed module can be a module capable of clamping the electronic device, for example, if the electronic device is a mobile phone, the fixed module can be a mobile phone holder. The holding time refers to the time difference between the start time of the electronic device in the holding state.
[0117] The setting method of setting the time threshold includes at least one of the following: determining the time threshold according to the weight of the electronic device. For example, the time threshold of a heavier electronic device may be lower than the time threshold of a lighter electronic device. For example, if the electronic device is a mobile phone, the time threshold of the mobile phone may be 6 minutes, while the time threshold of a tablet computer may be 5 minutes;
[0118] The set time threshold is determined according to the holding state of the electronic device. For example, the set time threshold when the target object holds the electronic device with one hand may be lower than the set time threshold when the target object holds the electronic device with both hands. Taking the holding state including the one-hand holding state and the two-hand holding state as an example, the set time threshold when the mobile phone is held with one hand may be 5 minutes, while the set time threshold when the mobile phone is held with both hands may be 6 minutes.
[0119] Since different electronic devices have different weights and sizes, and the external forces applied to electronic devices when in a gripped state are also different, by determining the set time threshold based on the attribute information of the electronic device and / or the gripping state of the electronic device, and comprehensively considering the attribute information of the electronic device and / or the gripping state of the electronic device before outputting the risk warning information, the output risk warning information can be more accurate and the probability of misjudgment can be reduced.
[0120] In other optional embodiments, the method further includes:
[0121] Obtaining physiological condition parameters of the target object;
[0122] Determining the fatigue state of the target subject based on the physiological condition parameters;
[0123] When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has the risk of slipping onto the target object includes:
[0124] When it is determined that the electronic device is located on the target object and the fatigue state meets the set fatigue condition, risk warning information indicating that the electronic device has the possibility of slipping onto the target object is output.
[0125] When the electronic device is placed on the target object and the target object becomes fatigued while using the electronic device, the target object may become weak in holding the device. At this time, the electronic device held by the target object may slip and injure the target object's face.
[0126] In the disclosed embodiment, the fatigue state of the target object can be determined based on the physiological condition parameters of the target object, and when the fatigue state meets the set fatigue condition, the risk warning information is output. For example, if the eye blinking frequency of the target object is lower than the set frequency threshold, it is determined that the fatigue state meets the set fatigue condition.
[0127] Here, the physiological condition parameters may include eye movement state parameters, eye blinking frequency, etc. of the target object. For example, the image acquisition component included in the electronic device is used to acquire the eye movement state information, eye blinking frequency, etc. of the target object, and then determine whether the target object has entered the fatigue period based on the eye movement state information, eye blinking frequency, etc. of the target object.
[0128] If it is determined that the target object is currently in the fatigue period, the target object may feel weak when holding the electronic device, causing the electronic device on the target object to slip and hit the target object. Therefore, the electronic device will output risk warning information only when it is determined that the target object has entered the fatigue period based on the physiological condition information. On the one hand, it reduces unnecessary prompts, and on the other hand, the output of risk warning information improves the safety of the target object's use of electronic devices.
[0129] In other optional embodiments, a pressure sensor on the electronic device may also be used to obtain changes in the pressure value applied by the target object on the electronic device to determine whether the target object has entered a fatigue period, etc.
[0130] In the disclosed embodiment, the fatigue state of the target object can be determined through the physiological condition parameters of the target object. When it is determined that the electronic device is located above the target object, it can be reasonably determined whether to output risk warning information based on the fatigue state, and the accuracy of the output risk warning information can be further improved to improve the user experience.
[0131] In other optional embodiments, taking the target object as a user currently using an electronic device as an example, Figure 2A is a flowchart 2 of an information processing method according to an exemplary embodiment. Figure 2A As shown, the method comprises the following steps:
[0132] In step 201a, the electronic device determines whether the user is lying down.
[0133] Here, the electronic device can determine whether the user is lying down based on the collected state information of the user. The electronic device collects the state information of the user in at least one of the following ways: collecting the state information of the user through sensors of wearable devices on the user, such as accelerometers, gyroscopes, pressure sensors, etc.; collecting the state information of the user through sensors of electronic devices held by the user, such as accelerometers, cameras, etc.; collecting the state information of the user through sensors on other electronic devices, such as beds, televisions, desk lamps, etc., such as accelerometers, cameras, pressure sensors, etc.
[0134] In step 202a, when the user lies down, it is determined whether the user is lying flat on his back.
[0135] Here, the electronic device can determine whether the user is lying flat on his back based on the collected state information of the user. The electronic device collects the state information of the user in at least one of the following ways: collecting the state information of the user through sensors of wearable devices on the user, such as accelerometers, gyroscopes, pressure sensors, etc.; collecting the state information of the user through sensors of electronic devices held by the user, such as accelerometers, cameras, etc.; collecting the state information of the user through sensors on other electronic devices, such as beds, televisions, desk lamps, etc., such as accelerometers, cameras, pressure sensors, etc.
[0136] In step 203a, if the user is lying flat on his back, it is determined whether the electronic device is above the user.
[0137] Here, the electronic device can determine whether the electronic device is above the user based on the collected state information of the user. The electronic device collects the state information of the user in at least one of the following ways: collecting the state information of the user through sensors of wearable devices on the user, such as accelerometers, gyroscopes, pressure sensors, etc.; collecting the state information of the user through sensors of electronic devices held by the user, such as accelerometers, cameras, etc.; collecting the state information of the user through sensors on other electronic devices, such as beds, televisions, desk lamps, etc., such as accelerometers, cameras, pressure sensors, etc.
[0138] When the electronic device determines that the user is lying flat on a bed or sofa, etc., and the electronic device held is above the user's head, it will be determined that the user is at risk of being hit in the face by the falling electronic device.
[0139] Figure 2B is a schematic diagram showing an electronic device in a holding state according to an exemplary embodiment Figure 1 ,like Figure 2BAs shown, the user 201b is lying flat on his back, holding the electronic device 202b in one hand, and the electronic device 202b is located directly above the face of the user 201b. At this time, it is determined that the user is at risk of being hit in the face by the falling electronic device 202b.
[0140] Figure 2C FIG. 2 is a second schematic diagram showing an electronic device in a holding state according to an exemplary embodiment. Figure 2C As shown, the user 201c is lying on his side and holding the electronic device 202c in one hand, and the electronic device 202c is located on the side of the face of the user 201c. At this time, it is determined that the user is not at risk of being hit on the face by the falling electronic device.
[0141] In other optional embodiments, the electronic device may continuously collect the user's status information, because the user may change the lying posture when using the electronic device, for example, Figure 2B The posture shown becomes Figure 2C The posture shown, or by Figure 2C The posture shown becomes Figure 2B Pose shown.
[0142] In step 204a, if the electronic device is above the user, it is determined whether the electronic device is held by the user.
[0143] In other optional embodiments, when the electronic device determines that the user is lying flat on a bed or sofa, etc., and the electronic device itself is above the user's head, the electronic device can further determine whether the user is holding the electronic device based on the user's status information.
[0144] Among them, the way in which the electronic device collects the user's status information includes at least one of the following: collecting the user's status information through sensors of wearable devices on the user, such as accelerometers, gyroscopes, pressure sensors, etc.; collecting the user's status information through sensors of electronic devices held by the user, such as accelerometers, cameras, etc.; collecting the user's status information through other electronic devices, such as sensors on beds, televisions, table lamps, etc., such as accelerometers, cameras, pressure sensors, etc.
[0145] In step 205a, if the electronic device is held by the user, it is determined whether the holding time of the electronic device is greater than or equal to the set time threshold. If the holding time of the electronic device is greater than or equal to the set time threshold, step 207a is executed.
[0146] Here, since the longer the user holds the electronic device, the higher the probability that the electronic device will fall and hit the face, the electronic device confirms that the user is in Figure 2BWhen a user enters a dangerous posture, the risk warning information may not be output immediately, but the user's status information may be continuously collected until the holding time of the electronic device is greater than or equal to the set time threshold.
[0147] The set time threshold can be set as needed, for example, 5 minutes, 10 minutes, etc. If the holding time is greater than or equal to the set time threshold, the electronic device prompts the user to be careful not to drop the device and hit the face.
[0148] The setting method of setting the time threshold includes at least one of the following: determining the time threshold according to the weight of the electronic device. For example, the time threshold of a heavier electronic device may be lower than the time threshold of a lighter electronic device. For example, if the electronic device is a mobile phone, the time threshold of the mobile phone may be 6 minutes, while the time threshold of a tablet computer may be 5 minutes;
[0149] The set time threshold is determined according to the holding state of the electronic device. For example, the set time threshold when the user holds the electronic device with one hand may be lower than the set time threshold when the user holds the electronic device with both hands. Taking the holding state including the one-hand holding state and the two-hand holding state as an example, the set time threshold when the mobile phone is held with one hand may be 5 minutes, while the set time threshold when the mobile phone is held with both hands may be 6 minutes.
[0150] In other optional embodiments, the electronic device determines the holding time of the device by the user in at least one of the following ways:
[0151] The holding time is determined based on a camera of the electronic device; and the holding time is determined based on a wearable device worn by the user.
[0152] For example, the length of time the user holds the electronic device can be determined through data collected by the camera of the electronic device held by the user. For example, the camera samples regularly, such as 5 seconds or 10 seconds, and the length of time the user holds the electronic device is calculated based on the number of times the camera samples. Other sensors, such as a temperature sensor or a pressure sensor, can also be used to determine the moment when the user starts holding the electronic device. When it is detected that the user starts holding the electronic device, the timing starts, and the length of time the user holds the electronic device is obtained.
[0153] In step 206a, if the electronic device is held by the user, it is determined whether the fatigue state meets the set fatigue condition. If the fatigue state meets the set fatigue condition, step 207a is executed.
[0154] In step 207a, risk warning information indicating that the electronic device is at risk of slipping onto the user is output.
[0155] If a user falls asleep while using an electronic device, the electronic device may slip and hit the user's face. Therefore, the front camera of the electronic device can be used to track the user's eye movement, eye blinking frequency, etc. to determine whether the user has entered a fatigue period. The pressure sensor on the electronic device can also be used to obtain the changes in the pressure value applied by the user to the electronic device to determine whether the user has entered a fatigue period.
[0156] In other optional embodiments, the electronic device may set a fatigue threshold for the user's fatigue. Once it is determined that the user's fatigue exceeds the preset fatigue threshold, the electronic device prompts the user to be careful not to let the electronic device fall and hit the face.
[0157] Here, the method of determining the user's fatigue threshold includes at least one of the following:
[0158] Determine the fatigue threshold based on the current time. For example, the later the time, the lower the fatigue threshold. For example, the fatigue threshold at night should be lower than the fatigue threshold during the day. For example, the fatigue threshold during the day is 10 minutes, while the fatigue threshold at night is 8 minutes.
[0159] The fatigue threshold is determined according to the length of time the user uses the electronic device. For example, the longer the user uses the electronic device, the lower the fatigue threshold. For example, if the user has used the electronic device for more than 30 minutes, the fatigue threshold may be 10, while if the user has used the electronic device for more than 1 hour, the fatigue threshold may be 5.
[0160] In the disclosed embodiments, not only can the risk of a user being hit on the face by a falling electronic device when using the electronic device while lying down can be avoided, but also the extra expense of purchasing accessories to prevent the electronic device from slipping and the various inconveniences caused by using other accessories can be avoided, thereby greatly improving the user experience when using the electronic device.
[0161] Figure 3 FIG. 1 is a block diagram of an information processing device according to an exemplary embodiment. Figure 3 As shown, the information processing device 300 mainly includes:
[0162] A location determination module 301 is configured to determine whether the electronic device is located above a target object;
[0163] The information output module 302 is configured to output risk warning information indicating that the electronic device has a risk of sliding onto the target object when it is determined that the electronic device is located on the target object.
[0164] In other optional embodiments, the location determination module 301 includes:
[0165] a first posture determination submodule configured to determine a current object posture of a target object;
[0166] A second posture determination submodule, configured to determine a current device posture of the electronic device when the current object posture represents that the target object is lying flat;
[0167] a first position determination submodule configured to determine whether the electronic device is facing the face of a target object lying flat based on a current object posture and a current device posture;
[0168] The second position determination submodule is configured to determine that the electronic device is located above the target object when the electronic device is facing the face of the target object lying flat.
[0169] In other optional embodiments, the first posture determination submodule is specifically configured as follows:
[0170] Collecting image information based on an image acquisition component included in the electronic device;
[0171] Based on the image information, a current object pose of the target object is determined.
[0172] In other optional embodiments, the second posture determination submodule is specifically configured as follows:
[0173] Collecting sensor data based on sensor components included in the electronic device;
[0174] Determine a current device posture of the electronic device based on the sensor data;
[0175] The sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
[0176] In other optional embodiments, the device 300 further includes:
[0177] A first state determination module, configured to determine whether the electronic device is in a holding state;
[0178] The first posture determination submodule is further specifically configured as follows:
[0179] When the electronic device is in a gripping state, a current object posture of the target object is determined.
[0180] In other optional embodiments, the apparatus 300 further includes:
[0181] A duration determination module, configured to determine a holding duration of the electronic device when the electronic device is in a holding state;
[0182] The information output module 302 is specifically configured to: when it is determined that the electronic device is located above the target object and the holding time is greater than or equal to the set time threshold, output risk warning information indicating that the electronic device has the risk of slipping onto the target object.
[0183] In other optional embodiments, the setting time threshold has a corresponding relationship with the attribute information of the electronic device and / or the holding state of the electronic device;
[0184] The attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force that fixes the electronic device.
[0185] In other optional embodiments, the apparatus 300 further includes:
[0186] A physiological condition acquisition module configured to acquire physiological condition parameters of a target object;
[0187] a second state determination module configured to determine a fatigue state of the target object based on the physiological condition parameter;
[0188] The information output module 302 is further specifically configured to: when it is determined that the electronic device is located on the target object and the fatigue state meets the set fatigue condition, output risk warning information indicating that the electronic device has the risk of sliding onto the target object.
[0189] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0190] Figure 4 4 is a hardware structure block diagram of an information processing device 400 according to an exemplary embodiment. For example, the device 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0191] Reference Figure 4 , the device 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .
[0192] The processing component 402 generally controls the overall operation of the device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.
[0193] The memory 404 is configured to store various types of data to support operations on the device 400. Examples of such data include instructions for any application or method operating on the device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0194] The power component 406 provides power to the various components of the device 400. The power component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 400.
[0195] The multimedia component 408 includes a screen that provides an output interface between the device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the device 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0196] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the device 400 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.
[0197] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0198] The sensor assembly 414 includes one or more sensors for providing various aspects of the status assessment of the device 400. For example, the sensor assembly 414 can detect the open / closed state of the device 400, the relative positioning of components, such as the display and keypad of the device 400, and the sensor assembly 414 can also detect the position change of the device 400 or a component of the device 400, the presence or absence of user contact with the device 400, the orientation or acceleration / deceleration of the device 400, and the temperature change of the device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0199] The communication component 416 is configured to facilitate wired or wireless communication between the device 400 and other devices. The device 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0200] In an exemplary embodiment, the apparatus 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above method.
[0201] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of the device 400 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0202] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform an information processing method, the method comprising:
[0203] determining whether the electronic device is located on a target object;
[0204] When it is determined that the electronic device is located on the target object, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
[0205] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
[0206] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. An information processing method, It is characterized in that include: determining a current object pose of the target object; When the current object posture indicates that the target object is lying flat, determining a current device posture of the electronic device; Based on the current object posture and the current device posture, determining whether the electronic device is facing the face of the target object lying flat; When the electronic device is facing the face of the target object lying flat, it is determined that the electronic device is located above the target object; When it is determined that the electronic device is located on the target object, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
2. The method according to claim 1, It is characterized in that The determining the current object posture of the target object comprises: Collecting image information based on the image acquisition component included in the electronic device; Based on the image information, a current object pose of the target object is determined.
3. The method according to claim 1, It is characterized in that The determining the current device posture of the electronic device includes: Collecting sensor data based on the sensor components included in the electronic device; Determining a current device posture of the electronic device based on the sensor data; Wherein, the sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
4. The method according to claim 1, It is characterized in that The method further comprises: Determining whether the electronic device is in a holding state; The determining the current object posture of the target object comprises: When the electronic device is in a gripping state, a current object posture of the target object is determined.
5. The method according to any one of claims 1 to 4, It is characterized in that The method further comprises: When the electronic device is in a holding state, determining a holding time of the electronic device; When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has a risk of sliding onto the target object includes: When it is determined that the electronic device is located on the target object and the holding time is greater than or equal to the set time threshold, risk warning information indicating that the electronic device has a risk of slipping onto the target object is output.
6. The method according to claim 5, It is characterized in that The set duration threshold has a corresponding relationship with the attribute information of the electronic device and / or the holding state of the electronic device; The attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force for fixing the electronic device.
7. The method according to any one of claims 1 to 4, It is characterized in that The method further comprises: Acquiring physiological condition parameters of the target object; determining a fatigue state of the target object based on the physiological condition parameter; When it is determined that the electronic device is located on the target object, outputting risk warning information indicating that the electronic device has a risk of sliding onto the target object includes: When it is determined that the electronic device is located on the target object and the fatigue state satisfies a set fatigue condition, risk warning information indicating that the electronic device has a risk of sliding onto the target object is output.
8. An information processing device, It is characterized in that include: a first posture determination submodule configured to determine a current object posture of a target object; A second posture determination submodule, configured to determine a current device posture of the electronic device when the current object posture represents that the target object is lying flat; a first position determination submodule, configured to determine whether the electronic device is facing the face of the target object lying flat based on the current object posture and the current device posture; a second position determination submodule, configured to determine that the electronic device is located above the target object when the electronic device is facing the face of the target object lying flat; The information output module is configured to output risk warning information indicating that the electronic device has a risk of sliding onto the target object when it is determined that the electronic device is located on the target object.
9. The device according to claim 8, It is characterized in that The first posture determination submodule is specifically configured as follows: Collecting image information based on the image acquisition component included in the electronic device; Based on the image information, a current object pose of the target object is determined.
10. The device according to claim 8, It is characterized in that The second posture determination submodule is specifically configured as follows: Collecting sensor data based on the sensor components included in the electronic device; Determining a current device posture of the electronic device based on the sensor data; Wherein, the sensor component includes at least one of the following: a gyroscope, an acceleration sensor, and a pressure sensor.
11. The device according to claim 8, It is characterized in that The device also includes: A first state determination module, configured to determine whether the electronic device is in a holding state; The first posture determination submodule is further specifically configured as follows: When the electronic device is in a gripping state, a current object posture of the target object is determined.
12. The device according to any one of claims 8 to 11, It is characterized in that The device also includes: a duration determination module, configured to determine a holding duration of the electronic device when the electronic device is in a holding state; The information output module is specifically configured to: when it is determined that the electronic device is located above the target object and the holding time is greater than or equal to a set time threshold, output risk warning information indicating that the electronic device has a risk of slipping onto the target object.
13. The device according to claim 12, It is characterized in that The set duration threshold has a corresponding relationship with the attribute information of the electronic device and / or the holding state of the electronic device; The attribute information of the electronic device includes at least one of the following: the weight of the electronic device, the size of the electronic device, and the external force for fixing the electronic device.
14. The device according to any one of claims 8 to 11, It is characterized in that The device also includes: A physiological condition acquisition module, configured to acquire physiological condition parameters of the target object; a second state determination module configured to determine a fatigue state of the target object based on the physiological condition parameter; The information output module is further specifically configured to: when it is determined that the electronic device is located above the target object and the fatigue state meets the set fatigue condition, output risk warning information indicating that the electronic device has the risk of sliding onto the target object.
15. An information processing device, It is characterized in that include: processor; a memory configured to store processor-executable instructions; Wherein, the processor is configured to: implement the steps of any one of the information processing methods in claims 1 to 7 when executed. 16 . A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an information processing device, the device is enabled to perform any one of the information processing methods of claims 1 to 7.
Citation Information
Patent Citations
Drop protection method and related products
CN108055414A
