Device reminder method, terminal device, and storage medium
By detecting light, screen status, and motion data, the system determines whether the terminal device has entered a storage scenario and provides a folding reminder when it is not folded. This solves the problem of foldable screens being squeezed when not folded, and achieves device self-protection and user reminders.
Patent Information
- Application Number
- PCT/CN2025/094680
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-05-20
- Filing Date
- 2025-05-13
- Publication Date
- 2025-11-27
AI Technical Summary
In existing technologies, foldable screens of terminal devices are easily damaged by foreign objects when placed in a bag or pouch in their folded state, and there is a lack of effective reminder mechanisms.
By detecting changes in light intensity, screen status, object obstruction, and motion data of the terminal device, it determines whether the device has entered a storage scenario and provides folding reminders in the non-folded state, including voice, vibration, flash, or text prompts, to reduce the pressure on the foldable screen.
It effectively reminds users to fold their terminal devices in a timely manner, reducing the squeezing and damage to foldable screens and improving the diversity and accuracy of human-computer interaction.
Smart Images

Figure CN2025094680_27112025_PF_FP_ABST
Abstract
Description
Device reminding method, terminal device and storage medium
[0001] The present application claims priority to the Chinese patent application No. 202410628773.8, filed on May 20, 2024, and entitled "Device reminding method, terminal device and storage medium", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD
[0002] The present application relates to the technical field of terminal devices, and in particular to a device reminding method, a terminal device and a storage medium. BACKGROUND
[0003] With the diversified development of terminal devices, the display screens of the terminal devices used by users are becoming larger and larger. The display screen of the terminal device can be of a folding design. The terminal device with a foldable screen can be in a folded state or an unfolded state. When the terminal device is in the unfolded state, the user can browse on the large screen, thereby improving the user experience. When the terminal device is in the folded state, the foldable screen can be protected from being pressed by foreign objects, and the area occupied by the device can be reduced, thereby facilitating carrying. The foldable screen is usually a flexible screen with bendable performance, which has an ultra-thin glass (UTG) cover plate on it and is easy to be pressed by foreign objects. SUMMARY
[0004] The present application provides a device reminding method, a terminal device and a storage medium, which can remind the user to store the terminal device after folding, thereby reducing the pressure on the foldable screen of the terminal device. The technical solution is as follows:
[0005] In a first aspect, a device reminding method is provided, which is applied to a terminal device with a foldable screen. The method comprises: when the terminal device is in a non-folded state and enters a storage scenario, performing a folding reminder to remind the user to store the terminal device after folding; wherein the storage scenario includes a scenario of being placed in a pocket or a bag.
[0006] In the present application, the storage scenario can be determined by detecting whether the light of the terminal device is dimmed, whether there is an object above the screen of the terminal device, or whether the camera of the terminal device is facing down. The object can be any shape of foreign object. The detection method of the storage scenario is not limited in the present application, as long as the terminal device can be determined to enter the storage scenario.
[0007] In the present application, the non-folded state refers to a state other than the folded state, for example, an unfolded state, a hovering state (which can also be referred to as a half-folded state or an incompletely folded state), etc.
[0008] In the case that the terminal device is in the non-folded state and enters the storage scene, it indicates that the foldable screen may be squeezed, and the user needs to be reminded to fold. The form of the folding reminder can be any one of text, voice, flashing light, vibration, or any combination of at least two. If the form of the folding reminder is text, the folding reminder information can be displayed on the interface of the terminal device. The above-mentioned folding reminder to issue folding reminder information, whether in the locked state or the unlocked state, the user can see the folding reminder information, so as to fold the terminal device when it is put into the bag next time. If the form of the folding reminder is voice, the terminal device can issue a voice, which can be a sentence or a prompt tone. If the form of the folding reminder is voice, flashing light or vibration, the user can immediately perceive the voice, flashing light or vibration, so as to timely fold the terminal device.
[0009] In the embodiments of the present application, it is judged whether the terminal device is in the non-folded state and whether the terminal device enters the storage scene, and in the case that the terminal device is in the non-folded state and enters the storage scene, the folding reminder is performed. The behavior of the terminal device being put into the bag or the bag without being folded is reminded, and the foldable screen of the terminal device is prevented from being squeezed.
[0010] In the embodiments of the present application, in the case that the terminal device is in the non-folded state and enters the storage scene, a reminder event can be marked once, and the folding reminder is performed. The steps of marking a reminder event and performing a folding reminder can be performed simultaneously or in any order. Marking a reminder event can be understood as the terminal device's dotting (or reporting) logic, which is used to record special events and can be used to develop personalized folding reminder strategies to improve the diversification of human-computer interaction.
[0011] In a possible implementation, the form of the folding reminder can be text, and the folding reminder information displayed on the card is shown. The folding reminder information is used to remind the user to fold and store the terminal device. The terminal device displays a first interface; the first interface includes a card, and the card includes not only folding reminder information but also a first function control (for example, "ignore" or "no longer prompt") and a second function control (for example, "view more" or "further understand"). After displaying the card on the first interface, the terminal device can also hide the card in response to the user's touch operation (for example, pressing or clicking operation) on the first function control. The terminal device can also display a second interface in response to the user's touch operation on the second function control; the second interface includes related information of the foldable screen, and the related information can include screen maintenance information or screen repair information. For example, whether the foldable screen is damaged, how to handle the damage or how to handle the undamaged, etc., to improve the diversification of human-computer interaction.
[0012] In a possible implementation, the identification of whether the terminal device enters the storage scenario can be achieved by the following manner: obtaining folding state information of the terminal device and an ambient light parameter of an environment in which the terminal device is located, where the folding state information is used to indicate that the terminal device is in a folded state or an unfolded state, and the ambient light parameter can be an illuminance, and the unit of the illuminance is lux, which represents the light flux received by a unit area of a subject surface. In a case where a light reduction rate of the ambient light parameter is greater than a first rate threshold, it is indicated that the ambient light parameter is suddenly reduced (or suddenly darkened), and in a case where the ambient light parameter is less than a first light threshold, it is indicated that the ambient light parameter is small enough to reach a feedback value, and the two are necessary conditions for entering the storage scenario. The light reduction rate of the ambient light parameter being greater than the first rate threshold and / or the ambient light parameter being less than the first light threshold are identified as the ambient light parameter reflecting that the environment changes. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, a duration in which the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold is determined, and in a case where the duration is greater than or equal to a preset duration, it is determined that the terminal device enters the storage scenario.
[0013] In the embodiments of the present application, the duration in which the terminal device is in the unfolded state and enters the storage scenario is counted, and when the duration reaches the preset duration, it is determined that the terminal device enters the storage scenario, and a folding reminder is given, thereby improving the accuracy of identifying the storage scenario. The behavior of the terminal device being placed in a bag or a bag without being folded is reminded, and the foldable screen of the terminal device is prevented from being squeezed.
[0014] In a possible implementation, the step of determining the duration can be implemented by the following examples.
[0015] Example one, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, a distance between the terminal device and an occlusion is obtained, and a duration in which the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold and the distance is less than a distance threshold is determined.
[0016] The distance between the terminal device and the occlusion includes a distance between an outer screen of the terminal device and an occlusion above the outer screen, and / or a distance between the foldable screen and an occlusion above the foldable screen; the outer screen refers to a screen of the terminal device except the foldable screen, and the outer screen and the foldable screen are opposite in the light-emitting direction in the unfolded state.
[0017] Generally, after the terminal device is put into the pocket or bag, if the terminal device is not folded, there can be an occlusion above the outer screen and the foldable screen of the terminal device. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment has changed, the distance between the terminal device and the occlusion is detected. The terminal device can detect the distance between the occlusion above the outer screen and the outer screen through a proximity light sensor, and detect the distance between the occlusion above the foldable screen and the foldable screen through an ultrasonic sensor.
[0018] In the embodiment of the application, when it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, and the distance is less than the distance threshold, it is indicated that the terminal device can be put into the pocket or bag without being folded. Therefore, the duration for which the terminal device remains in this state is detected, that is, a timer is started and the duration is counted under the condition that the terminal device is in the unfolded state, the ambient light parameter is less than the first light threshold, and the distance is less than the distance threshold. This example adds the distance between the terminal device and the occlusion as a judgment condition on the basis of whether the terminal device is in the unfolded state and whether the ambient light parameter is less than the first light threshold, and further improves the accuracy of identifying the storage scenario.
[0019] Example two, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment has changed, motion data of the terminal device in use is acquired; the motion data includes acceleration; and it is determined that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold, and the motion data reflects that the posture of the terminal device fluctuates for a duration.
[0020] Generally, the motion law of the terminal device when the user normally uses the terminal device is different from the motion law of the terminal device after the terminal device is put into the pocket or bag, and the terminal device moves or is stationary with the pocket or bag after the terminal device is put into the pocket or bag, which can be identified through motion features. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment has changed, motion data of the terminal device in use is detected. The terminal device can detect the acceleration of the terminal device through an acceleration sensor, and detect the angular velocity of the terminal device through a gyroscope sensor.
[0021] In the embodiments of the present application, the acceleration of the user's handheld terminal device in normal use (corresponding to the acceleration of the terminal device before the change of the environment reflected by the ambient light parameter, that is, the first acceleration) is detected, and the acceleration after the terminal device is placed in a pocket or bag (corresponding to the acceleration of the terminal device after the change of the environment reflected by the ambient light parameter, that is, the second acceleration) is detected. The frequency of the second acceleration is lower than that of the first acceleration; and the amplitude variation law of the second acceleration is different from that of the first acceleration, and the amplitude variation law of the second acceleration is changed compared with that of the first acceleration. Therefore, whether the posture of the terminal device fluctuates can be reflected by detecting the motion data to assist in determining whether the terminal device enters the storage scene.
[0022] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects the change of the environment, and the motion data reflects that the posture of the terminal device fluctuates, it indicates that the terminal device is likely to be placed in a pocket or bag without being folded. Therefore, the duration for which the terminal device remains in this state is detected, that is, a timer is started to count the duration under the condition that the unfolded state, the ambient light parameter is less than the first light threshold, and the motion data reflects that the posture of the terminal device fluctuates. This example adds the judgment condition of the motion data of the terminal device in use on the basis of the unfolded state and whether the ambient light parameter is less than the first light threshold, and further improves the accuracy of identifying the storage scene.
[0023] Example Three, in the case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, and the ambient light parameter reflects the change of the environment, the screen state of the terminal device is acquired; and the duration for which the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold and the screen state is the lock screen state is determined.
[0024] Generally, before the terminal device is placed in a pocket or bag, the user will lock the terminal device, or the terminal device will automatically trigger the lock screen operation when it is not used for a long time. Therefore, whether the terminal device enters the storage scene can be determined by detecting whether the screen state of the terminal device is the lock screen state. Based on this, in the case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, and the ambient light parameter reflects the change of the environment, the screen state of the terminal device is detected.
[0025] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, and the screen state is the lock screen state, it is possible that the terminal device is placed in the pocket or bag without being folded. Therefore, the duration for which the terminal device remains in this state is detected, that is, a timer is started to count the duration under the condition that the terminal device is in the unfolded state, the ambient light parameter is less than the first light threshold, and the screen state is the lock screen state. This example adds the judgment condition of the screen state of the terminal device on the basis of whether the terminal device is in the unfolded state and whether the ambient light parameter is less than the first light threshold, and further improves the accuracy of identifying the storage scenario.
[0026] Example four, obtaining the distance between the terminal device and the shielding object, the motion data of the terminal device in the use process, and the screen state of the terminal device; in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state, determining a duration for which the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold, the distance is less than the distance threshold, the posture of the terminal device fluctuates, and the screen state is the lock screen state.
[0027] In the embodiment of the application, the five judgment conditions that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state are used as the premise, and when the five judgment conditions are met at the same time, it is possible that the terminal device is placed in the pocket or bag without being folded. A timer is started to count the duration for which the terminal device remains in this state. This example adds the judgment conditions of the distance between the terminal device and the shielding object, the motion data of the terminal device in the use process, and the screen state of the terminal device on the basis of whether the terminal device is in the unfolded state and whether the ambient light parameter is less than the first light threshold, and further improves the accuracy of identifying the storage scenario.
[0028] In a possible implementation, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, and the ambient light parameter reflects that the environment has changed, a recognition mode is started to determine the duration; in a case where the duration is less than a preset duration, and the ambient light parameter is greater than or equal to a second light threshold, the recognition mode is exited; the second light threshold is greater than the first light threshold.
[0029] In the embodiments of the present application, a second light threshold greater than the first light threshold is set, the terminal device is in a non-folded state, and the ambient light parameter reflects a change in the environment. In this case, the identification mode is started, and the duration of maintaining the judgment condition is counted. In the case where the ambient light parameter is greater than or equal to the second light threshold, the identification mode is exited, and the power consumption is reduced. The identification mode is reminded of the fault tolerance space, and the accuracy of the identification result is improved.
[0030] In a possible implementation, the number of marks of the reminding event, the ambient light change event, the device flip event, the in-bag event, the night device static event, and the night carrying device motion event in a preset period are counted, and the folding reminding strategy is determined according to the number of marks of each event. The folding reminding strategy is used to determine the reminding mode for folding reminding in the next preset period. The reminding mode can include the reminding frequency, the form adopted for folding reminding, and the like. The folding reminding is performed according to the reminding mode in the next preset period. By setting the marking function of different special events, the events in which the state of the terminal device changes are recorded as much as possible, and the events are reported. The folding reminding strategy is determined in the manner of marking events, so that the corresponding folding reminding is performed, which is more in line with the use habits of users and improves the individuality and diversity of human-computer interaction.
[0031] In a possible implementation, the marking process of the in-bag event is as follows: the folding state information of the terminal device, the ambient light parameter of the environment in which the terminal device is located, the distance between the terminal device and the shelter, and the motion data of the terminal device in the use process are obtained. In the case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects a change in the environment, the motion data reflects a fluctuation in the posture of the terminal device, and the distance is greater than or equal to the distance threshold, it is indicated that the terminal device is likely to be placed in a pocket or bag, the outer screen of the terminal device faces downward, the foldable screen faces upward or the upper part of the foldable screen is away from the shelter. Therefore, the in-bag event is marked once.
[0032] Generally, according to the use habits of users, if the terminal device is placed in a pocket, the terminal device is inverted. Based on this, in the case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects a change in the environment, and the motion data reflects that the terminal device is inverted, that is, in the case of a non-folded state, dark light, and the camera of the terminal device facing downward, it is indicated that the terminal device is likely to be placed in a pocket. Therefore, the in-bag event is marked once.
[0033] In the embodiments of the present application, the in-bag event is marked, which can be used to determine the folding reminding strategy, so as to perform the corresponding folding reminding in the next preset period, and improve the individuality and diversity of human-computer interaction.
[0034] In a possible implementation, the marking process of the ambient light change event is as follows: obtaining folding state information of the terminal device and ambient light parameters of an environment in which the terminal device is located; in a case where it is detected that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameters reflect that the environment has changed, obtaining motion data of the terminal device in a use process. In a case where it is detected that the folding state information indicates that the terminal device is in the non-folded state, the ambient light parameters reflect that the environment has changed, and the motion data reflects that a posture of the terminal device has not obviously fluctuated (that is, a change in angular velocity before and after the ambient light parameters reflect that the environment has changed is within a preset range), it is considered that the terminal device is likely to have only entered a dark environment and has not been placed into a bag or a case, and therefore, one ambient light change event is marked.
[0035] In the embodiments of the present application, the folding reminding strategy can be determined by marking the ambient light change event, so as to perform corresponding folding reminding in a next preset period, and the personalization and diversity of human-computer interaction are improved.
[0036] In a possible implementation, generally, when the terminal device is turned over, the ambient light parameters also suddenly decrease (or suddenly become dark), but an ambient light parameter reduction amount is less than a reduction amount when the terminal device is placed into a bag or a case, that is, a light reduction rate is greater than a second rate threshold, and the second rate threshold is less than the first rate threshold corresponding to the terminal device being placed into the bag or the case. Moreover, when the terminal device is turned over, there is a feature that an amplitude of the angular velocity is reversed from positive to negative or from negative to positive. Based on this, the folding state information of the terminal device, the ambient light parameters of the environment in which the terminal device is located, and the motion data of the terminal device in the use process are obtained; in a case where it is detected that the folding state information indicates that the terminal device is in the non-folded state, a light reduction rate of the ambient light parameters is greater than the second rate threshold, and the angular velocity is reversed before and after the light reduction rate of the ambient light parameters is greater than the second rate threshold, it is considered that the terminal device is likely to be turned over, and therefore, one device turning event is marked.
[0037] In the embodiments of the present application, the folding reminding strategy can be determined by marking the device turning event, so as to perform corresponding folding reminding in a next preset period, and the personalization and diversity of human-computer interaction are improved.
[0038] In a possible implementation, there is also a scenario of using the terminal device at night in general cases. In the night scenario, the ambient light parameter does not change. The event can be marked by the change rule of the motion data. The motion data of the terminal device changes obviously when the user normally uses the terminal device at night, and the motion data of the terminal device does not change basically (the change rule of the amplitude of the acceleration and the angular velocity does not change) when the terminal device is stationary at night. Therefore, the folding state information of the terminal device, the ambient light parameter of the environment in which the terminal device is located, and the motion data of the terminal device in the use process are acquired; the motion data includes acceleration and angular velocity; in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter does not change, and the amplitude change rule of the acceleration and the amplitude change rule of the angular velocity both change from change to no change, and the keeping time length of no change is greater than a preset stationary time length, a night device stationary event is marked.
[0039] When the user moves at night with the terminal device, the user will first put the terminal device into a pocket or a bag, and then move. Therefore, the motion data will appear in three stages: the user normally uses the terminal device at night, the terminal device is put into a pocket or a bag, and the user moves with the terminal device. The three stages will present different motion distribution rules. Therefore, in a case where it is detected that the folding state information of the terminal device, the ambient light parameter does not change, and the amplitude change rule of the acceleration and the amplitude change rule of the angular velocity both experience a first distribution rule to a second distribution rule to a third distribution rule, a night device moving event is marked.
[0040] In the embodiments of the present application, the night device stationary event and the night device moving event are marked, which can be used to determine a folding reminding strategy, so as to perform a corresponding folding reminding in a next preset period, and improve the individuality and diversity of human-computer interaction.
[0041] In a second aspect, a terminal device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the computer program is executed by the processor, the device reminding method in the first aspect or any of the implementation manners of the first aspect is implemented.
[0042] In a third aspect, a computer readable storage medium is provided, which stores instructions, and when the instructions are executed on a computer, the computer executes the device reminding method in the first aspect or any of the implementation manners of the first aspect.
[0043] In a fourth aspect, an embodiment of the present application provides a chip system, which can be applied to an electronic device, and the chip system comprises one or more processors configured to invoke computer instructions to cause the electronic device to perform the device reminding method as described in the first aspect or any of the implementation manners of the first aspect.
[0044] In a fifth aspect, a computer program product comprising instructions which, when executed on a computer, cause the computer to perform the device reminding method as described in the first aspect or any of the implementation manners of the first aspect.
[0045] The technical effects obtained by the second aspect, the third aspect, the fourth aspect and the fifth aspect are similar to the technical effects obtained by the corresponding technical means in the first aspect, and thus are not described herein. BRIEF DESCRIPTION OF DRAWINGS
[0046] FIG. 1 is a schematic diagram of an application scenario according to an embodiment of the present application;
[0047] FIG. 2 is a schematic diagram of a structure of a terminal device according to an embodiment of the present application;
[0048] FIG. 3 is a block diagram of a software system of a terminal device according to an embodiment of the present application;
[0049] FIG. 4 is a schematic diagram of folding state information of a terminal device according to an embodiment of the present application;
[0050] FIG. 5 is a schematic diagram of a card according to an embodiment of the present application;
[0051] FIG. 6 is a schematic diagram of another card according to an embodiment of the present application;
[0052] FIG. 7 is a schematic diagram of starting of a reminding function according to an embodiment of the present application;
[0053] FIG. 8 is a flowchart of a device reminding method according to an embodiment of the present application;
[0054] FIG. 9 is a flowchart of a device reminding method according to an embodiment of the present application;
[0055] FIG. 10 is a flowchart of a device reminding method according to an embodiment of the present application;
[0056] FIG. 11 is a flowchart of a device reminding method according to an embodiment of the present application;
[0057] FIG. 12 is a flowchart of a device reminding method according to an embodiment of the present application;
[0058] FIG. 13 is a schematic diagram of a marked event according to an embodiment of the present application;
[0059] FIG. 14 is a schematic diagram II of marking an event according to an embodiment of the present application;
[0060] FIG. 15 is a schematic diagram III of marking an event according to an embodiment of the present application;
[0061] FIG. 16 is a schematic diagram IV of marking an event according to an embodiment of the present application;
[0062] FIG. 17 is a schematic diagram V of marking an event according to an embodiment of the present application;
[0063] FIG. 18 is a schematic diagram VI of a device reminding method according to an embodiment of the present application;
[0064] FIG. 19 is a schematic diagram of a reminding scenario according to an embodiment of the present application. DETAILED DESCRIPTION
[0065] In order to make the objects, technical solutions and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the drawings.
[0066] It should be understood that the "multiple" mentioned in the present application refers to two or more. In the description of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, in order to clearly describe the technical solutions of the present application, the same items or similar items with basically the same functions and effects are distinguished by using "first", "second", etc. The skilled in the art can understand that "first", "second", etc. do not limit the quantity and execution order, and "first", "second", etc. also do not necessarily mean different.
[0067] For a terminal device with a foldable screen, in actual application process, after the user uses the terminal device, the terminal device may be placed in a container such as a pocket or a bag, at this time, if the terminal device is in a non-folded state (unfolded state or not completely closed), the foldable screen is easily pressed by foreign matter, causing the foldable screen to be damaged. There is no related technology to detect this situation at present, therefore, how to realize reminding the behavior of placing the terminal device in the pocket or bag without folding is a problem to be solved at present.
[0068] The device reminding method provided in the embodiments of the present application is applied to a scenario in which a terminal device is placed in a pocket, a backpack or a bag in an unfolded state (for example, an unfolded state), and the following scenario is exemplarily described. As shown in FIG. 1, FIG. 1 is a schematic diagram of an application scenario provided in the embodiments of the present application. Taking a foldable mobile phone as an example, FIG. 1A shows a vertically foldable mobile phone in an unlocked state, and the vertically foldable mobile phone is placed in a pocket in an unfolded state. FIG. 1B shows a horizontally foldable mobile phone in a locked state, and the horizontally foldable mobile phone is placed in a bag in an unfolded state.
[0069] In view of the above problems, the embodiments of the present application provide a device reminding method, which can remind a user to fold a terminal device when the terminal device is placed in a pocket or a backpack in an unfolded state. That is, the terminal device is reminded to be folded when the terminal device is placed in a pocket or a backpack in an unfolded state. The reminding form can be any one or a combination of at least two of voice, vibration, flashing, and text, so as to remind the user not to place the terminal device in a pocket or a backpack in an unfolded state as much as possible, so as to avoid damage to a flexible panel of a foldable screen caused by clothes / objects rubbing against the flexible panel. Thus, the user is reminded to fold the terminal device, and the foldable screen of the terminal device is prevented from being squeezed.
[0070] Before the device reminding method provided in the embodiments of the present application is explained in detail, the terminal device related to the embodiments of the present application is described.
[0071] FIG. 2 is a structural schematic diagram of a terminal device according to an embodiment of the present application. Referring to FIG. 2, the terminal device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0072] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.
[0073] The processor 110 can include one or more processing units, such as: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated into one or more processors.
[0074] The controller can be the nerve center and command center of the terminal device 100. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching and executing instructions.
[0075] The processor 110 can also have internal memory for storing instructions and data. In some embodiments, the internal memory of the processor 110 is a cache memory. The cache memory can hold instructions or data that the processor 110 has recently used or is likely to use again. If the processor 110 needs to use that instruction or data again, it can be retrieved directly from the cache memory. This avoids the repetition of access and reduces the latency of the processor 110, thus improving the efficiency of the system.
[0076] The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.
[0077] The modem processor can include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is transmitted to the application processor. The application processor outputs the sound signal through the audio device (not limited to the loudspeaker 170A, the receiver 170B, etc.), or displays the image or video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and be arranged in the same device as the mobile communication module 150 or other functional modules.
[0078] In some embodiments, the antenna 1 of the terminal device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
[0079] The terminal device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected with the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.
[0080] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the terminal device 100 can include one or N display screens 194, where N is an integer greater than 1.
[0081] In the embodiments of the present application, the display screen 194 can be a foldable screen (also referred to as a flexible display screen).
[0082] The terminal device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, and the like.
[0083] The external memory interface 120 can be configured to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, music, video, and the like are saved in the external memory card.
[0084] The internal memory 121 can be configured to store computer executable program codes including instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, and the like), and the like. The data storage area can store data (such as audio data, a phone book, and the like) created during use of the terminal device 100, and the like. In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
[0085] The terminal device 100 can implement audio functions such as music playing, recording, etc. through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc.
[0086] In the embodiments of the present application, when the form of the folding reminder is a voice form, the speaker 170A can be used to play the voice.
[0087] The speaker 170A, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The terminal device 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0088] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be arranged on the display screen 194. There are many types of pressure sensors 180A, such as a resistance type pressure sensor, an inductance type pressure sensor, a capacitance type pressure sensor, etc. The capacitance type pressure sensor can include at least two parallel plates with a conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure according to the change in the capacitance. When a touch operation is applied to the display screen 194, the terminal device 100 detects the touch operation intensity according to the pressure sensor 180A. The terminal device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.
[0089] The gyroscope sensor 180B can be used to determine the motion posture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (i.e., the x, y, and z axes) can be determined through the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100 shaking, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the terminal device 100 through reverse motion to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.
[0090] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can detect the opening and closing of a flip cover using the magnetic sensor 180D. In some embodiments, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. The terminal device 100 sets a feature such as automatic unlocking of the flip cover according to the detected opening and closing state of the cover or the flip cover.
[0091] The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (typically three axes). The acceleration sensor 180E can detect the magnitude and direction of gravity when the terminal device 100 is stationary. The acceleration sensor 180E can also be used to identify the posture of the terminal device 100, and can be applied to landscape / portrait switching, a pedometer, and the like.
[0092] The distance sensor 180F is used to measure distance. The terminal device 100 can measure distance using infrared or laser. In some embodiments, the terminal device 100 can use the distance sensor 180F to measure distance to achieve fast focusing when photographing a scene.
[0093] The proximity light sensor 180G can include a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode can be an infrared light emitting diode. The terminal device 100 emits infrared light outwardly using the light emitting diode. The terminal device 100 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, the terminal device 100 can determine that there is an object near the terminal device 100. When insufficient reflected light is detected, it can be determined that there is no object near the terminal device 100. The terminal device 100 can use the proximity light sensor 180G to detect that a user is holding the terminal device 100 close to the ear for a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used for automatic unlocking and locking of the cover in a cover mode or a pocket mode.
[0094] The ambient light sensor 180L is used to sense ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust white balance when taking a photograph. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touch.
[0095] Touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 together form a touch screen, also referred to as a "touch panel". The touch sensor 180K is configured to detect a touch operation acting on or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the terminal device 100, which is different from the position where the display screen 194 is located.
[0096] The keys 190 include a power-on key, a volume key, and the like. The keys 190 can be mechanical keys or touch keys. The terminal device 100 can receive key inputs and generate key signal inputs related to user settings and function control of the terminal device 100.
[0097] The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, and the like) can correspond to different vibration feedback effects. Touch operations acting on different regions of the display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, receiving messages, alarms, games, and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effects can also be customizable.
[0098] The indicator 192 can be an indicator light and can be used to indicate charging status, power changes, and can also be used to indicate messages, missed calls, notifications, and the like.
[0099] In the embodiments of the present application, the angular velocity of the terminal device can be detected by the gyroscope sensor 180B, and the angular velocity variation law can be obtained. The folding state information of the terminal device can be detected by the magnetic sensor 180D, and the folding state information indicates that the terminal device is in an unfolded state or a folded state. The acceleration of the terminal device can be detected by the acceleration sensor 180E, and the acceleration variation law can be obtained. The distance sensor 180F can be an ultrasonic sensor, and the distance between the upper part of the foldable screen and the obstruction can be detected by the ultrasonic sensor. The distance between the upper part of the outer screen of the terminal device and the obstruction can be detected by the proximity light sensor 180G. The ambient light parameter can be detected by the ambient light sensor 180L, and the light reduction rate of the ambient light parameter can be obtained. The pressure sensor 180A is configured to detect a pressing operation of a user on a folding reminder information in a text form (for example, a card). The touch sensor 180K is configured to detect a clicking operation of a user on the folding reminder information in a text form. When the folding reminder form is a vibration form, a vibration prompt can be generated by the motor 191 to achieve the technical effect of reminding the user.
[0100] Next, the software system of the terminal device 100 is described.
[0101] The software system of the terminal device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application exemplarily describe the software system of the terminal device 100 by taking an Android system with a layered architecture as an example.
[0102] FIG. 3 is a block diagram of a software system of a terminal device 100 according to an embodiment of the present application. Referring to FIG. 3, the layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Android runtime and a system layer, and a kernel layer. The kernel layer and the hardware layer in the layered architecture communicate with each other.
[0103] The application layer can include a series of application packages. As shown in FIG. 3, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, and the like. As an example, the recognition algorithm of the storage scene used in the device reminding method provided in an embodiment of the present application can be implemented as an application with a reminding function, and the application layer includes the reminding application. The reminding application can be presented to the user for use, and the user can start or stop the application to realize opening or closing the reminding function. Of course, the reminding application can also not be presented to the user, and the terminal device defaults to turn on the reminding function.
[0104] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. The application framework layer includes some predefined functions. As shown in FIG. 3, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like. Similarly, the reminder application can also call the content provider, the resource manager, the notification manager, the window manager, the view system, and the like according to actual business requirements, and the embodiments of the present application do not make any limitation in this regard. For example, the notification manager enables the application to display notification information in the status bar, can be used to convey a message of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to display a folded reminder information in the form of text. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background. The notification manager can also be a notification in the form of a dialog window appearing on the screen, such as a text information prompt in the status bar, a prompt sound, an electronic device vibration, a flashing indicator light, and the like.
[0105] In the embodiments of the present application, the reminder application of the application layer calls the algorithm library of the system library to execute the recognition algorithm of the accommodation scene through the application programming interface of the application framework layer, and calls the corresponding sensor driver in the kernel layer to pull up the Hall sensor, the ambient light sensor, the gyroscope sensor, the acceleration sensor, and the distance sensor of the hardware layer, respectively, to obtain the folding state information of the terminal device, the ambient light parameter, the angular velocity, the acceleration, and the distance.
[0106] In some implementations, the reminder application also calls the display driver of the kernel layer to pull up the display screen of the hardware layer through the application programming interface of the application framework layer to obtain the screen state of the display screen. The reminder application also calls the camera driver of the kernel layer to pull up the camera of the hardware layer through the application programming interface of the application framework layer to obtain the orientation of the camera and determine whether the terminal device is inverted.
[0107] When the form of the folding reminder is a voice form, a text form, or a flashing form, the reminder application also calls the audio driver of the kernel layer to pull up the loudspeaker of the hardware layer, the display driver of the kernel layer to pull up the display screen of the hardware layer, and the flash driver of the kernel layer to pull up the flash of the hardware layer through the application programming interface of the application framework layer, respectively, to realize the reminder effects of playing voice, displaying text, and flashing.
[0108] The Android Runtime includes a core library and a virtual machine. The Android Runtime is responsible for scheduling and managing the Android system. The core library includes two parts: one part is a function function that the java language needs to call, and the other part is the core library of Android. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection and the like.
[0109] The system library can include a plurality of function modules, such as a surface manager, media libraries, a three-dimensional graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), and the like. The surface manager is used for managing the display subsystem and provides a plurality of applications with the fusion of 2D and 3D layers. The media library supports a plurality of commonly used audio, video format playback and recording, and static image files and the like. The media library can support a plurality of audio and video coding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG and the like. The three-dimensional graphics processing library is used for realizing three-dimensional graphics drawing, image rendering, synthesis, and layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing. The system library further includes an algorithm library, and the algorithm library stores a recognition algorithm of a receiving scene. The reminder application of the application layer calls the algorithm library of the system library through the application programming interface of the application framework layer to execute the recognition algorithm of the receiving scene.
[0110] The kernel layer is a layer between the hardware layer and the software. The kernel layer at least includes a display driver, a camera driver, an audio driver, a sensor driver, and a flash driver.
[0111] The hardware layer at least includes a hall sensor, an ambient light sensor, a distance sensor, an acceleration sensor, a gyroscope sensor, a loudspeaker, a display screen, a flash, and a camera.
[0112] In the embodiments of the present application, by calling the hardware interface in the application framework layer, the connection between the application layer above the application framework layer, the system layer below the application framework layer, the kernel layer, and the hardware layer can be realized, and the transmission of the folding state information of the terminal device, the screen state, the ambient light parameter, the motion data, and the distance information of the occlusion can be realized.
[0113] The execution subject of the device reminding method provided in the embodiments of the present application can be the terminal device, or a functional module and / or functional entity in the terminal device that can implement the device reminding method, and the present application can be implemented in hardware and / or software, and the specific implementation can be determined according to actual use requirements, which is not limited in the embodiments of the present application.
[0114] The folding state information of the terminal device in the embodiments of the present application is described below.
[0115] The folding state information of the terminal device with a foldable screen is used to indicate that the terminal device is in a folded state or an unfolded state. As shown in FIG. 4, FIG. 4 is a schematic diagram of folding state information of a terminal device according to an embodiment of the present application. FIG. 4A shows a folded state of a vertically folded screen mobile phone, and FIG. 4B shows a folded state of a horizontally folded screen mobile phone. After folding, the terminal device divides the foldable screen into two display screens, and the folded state can mean that the included angle between the two display screens of the foldable screen is 0°. The unfolded state means other states except the folded state, for example, an unfolded state, a hovering state (a state between the folded state and the unfolded state, which can also be referred to as a half-folded state or an incomplete folded state), etc. The unfolded state can mean that the included angle between the two display screens of the foldable screen is 180°, and the hovering state can mean that the included angle between the two display screens of the foldable screen is between 0° and 180°. FIG. 4C shows a hovering state of a vertically folded screen mobile phone, FIG. 4D shows an unfolded state of a vertically folded screen mobile phone, FIG. 4E shows a hovering state of a horizontally folded screen mobile phone, and FIG. 4F shows an unfolded state of a horizontally folded screen mobile phone. FIG. 4C-FIG. 4F all represent the unfolded state of the terminal device.
[0116] The display form of the card in the embodiments of the present application is described below taking the card reminding form as an example.
[0117] In the embodiments of the present application, the form of the folding reminder can be a text form, for example, the folding reminder information is displayed in the form of a card on the interface of the terminal device. For example, the terminal device can push (or display) the folding reminder information in the card in the "message center" at the top of the screen of the terminal device. Whether in a locked state or an unlocked state, the user can see the message on the card, so as to fold the terminal device when putting it into the pocket next time. The message on the card can be appropriately set according to actual conditions, and the specific content and form of the message on the card are not limited in the embodiments of the present application, and the following FIG. 5 is only an example. As shown in FIG. 5, FIG. 5 is a schematic diagram of a card according to an embodiment of the present application.
[0118] Taking a terminal device being a vertically folding screen mobile phone as an example, FIG. 5A shows a card on the interface of the vertically folding screen mobile phone in a locked state, and the card displays "Screen protection reminder: It is detected that your mobile phone may not be folded and stored, and for better protection of the inner screen of the mobile phone, please fold and store it". FIG. 5B shows a card on the interface of the vertically folding screen mobile phone in an unlocked state, and the card displays "Screen protection reminder: For better protection of the inner screen, it is suggested that you fold the mobile phone and then store it".
[0119] Taking a terminal device being a horizontally folding screen mobile phone as an example, the horizontally folding screen mobile phone in a folded state or an unfolded state can respond to a user instruction. FIG. 5C shows a card on the interface of the horizontally folding screen mobile phone in an unfolded state and in a locked state, and the card displays "Screen protection reminder: For better protection of the inner screen, it is suggested that you fold the mobile phone and then store it". FIG. 5D shows a card on the interface of the horizontally folding screen mobile phone in a folded state and in an unlocked state, and the card displays "Screen protection reminder: It is detected that your mobile phone may not be folded and stored, and for better protection of the inner screen of the mobile phone, please fold and store it".
[0120] In the above FIG. 5, the card can further display a function control for human-computer interaction, including a first function control (for example, "ignore" or "no longer prompt") and a second function control (for example, "view more" or "further understand"). If the user does not want to pay attention to the message, the first function control such as "ignore" or "no longer prompt" can be touched to delete the reminder and hide the card. If the user needs to further understand the information about the foldable screen, the second function control such as "view more" or "further understand" can be touched to realize the next message prompt, and the related information about the foldable screen can be displayed on the interface of the terminal device, and the related information can include screen maintenance information or screen repair information. The function control on the card can be appropriately set according to actual conditions, and the present application embodiment does not limit the function that can be implemented by the function control and the form of the function control. The above FIG. 5 is only exemplary.
[0121] In the embodiments of the present application, the form of the folding reminder can be any one of text, voice, flashing light, vibration, or any combination of at least two of them. Among them, the text can be carried on the card to be displayed on the interface of the terminal device. For example, the form of the folding reminder can be a composite form, such as voice plus card, vibration plus card, voice plus vibration plus card, voice plus vibration plus flashing light plus card. In this way, the folding reminder in the composite form can remind the user through multiple paths, wherein the frequency and intensity of voice, vibration and flashing light can be set by those skilled in the art according to the actual situation, as long as the user can be reminded and the user is not disturbed too much. For example, the voice, vibration and flashing light reminder mode can stop after a period of time, or be reminded again after a period of time.
[0122] Based on the above B of FIG. 5, if the user needs to further understand the information about the foldable screen, the related message about the foldable screen can be prompted by touching the “view more” function control (corresponding to the second function control). As shown in FIG. 6, FIG. 6 is a schematic diagram of another card provided by an embodiment of the present application. The A of FIG. 6 shows that the terminal device displays a second interface in response to the touch operation (for example, clicking or pressing) of the user, that is, in response to the touch operation on the second function control. The second interface displays a message notification, such as the message notification shown in the B or C of FIG. 6, which is displayed in the form of a card on the interface of the vertically folding screen mobile phone, as shown in the B of FIG. 6, the message notification displays whether the folding display screen is damaged, and displays two function controls: “damaged” and “undamaged”. When the user selects “undamaged”, the user is shown information about device consultation to remind the user how to maintain the screen, as shown in the C of FIG. 6. When the user selects “damaged”, as shown in the D of FIG. 6, the user is shown a message about device repair to remind the user to further select a solution, as shown in the E of FIG. 6. The E of FIG. 6 also displays two function controls: “on-site repair” and “appointment”. Further, the user can select the function controls of “on-site repair” or “appointment” to enter the next prompt, and the prompt content can be appropriately set by those skilled in the art according to the actual situation, as long as it can help the user solve the problem of the foldable screen damage. The embodiments of the present application will not be repeated.
[0123] The reminder function in the embodiments of the present application is described below.
[0124] In the embodiments of the present application, the terminal device can directly and by default open the reminding function, detect in real time whether the reminding condition is met, and perform folding reminding when it is detected that the reminding condition is met. Of course, the reminding function can be determined by the user whether to open, which is similar to the functions of Bluetooth connection, Near Field Communication (NFC) connection, Wireless Fidelity (Wi-Fi) connection, etc. When the terminal device is in the unfolded state, the terminal device displays the interface shown in FIG. 7A, and sends a message to the user: the unfolded mode has been switched, please open the 'pocket / backpack mode reminding'. The user clicks or presses the message, and the terminal device displays the interface shown in FIG. 7B. As shown in FIG. 7B, an open button for the 'pocket / backpack mode reminding' is shown. The user clicks or presses the open button to open the reminding function. Of course, the embodiments of the present application can also place the reminding function in the setting interface, and open or close the pocket mode by clicking or pressing a switch or selecting an option. The switch or option can be 'pocket mode', 'backpack mode', 'automatic answering', 'glove mode','storage mode' or similar names. The embodiments of the present application do not limit this. The terminal device in the embodiments of the present application sets the opening mode of the reminding function, and improves the diversity of human-computer interaction.
[0125] Based on the interfaces of the terminal device shown in FIGS. 4-7, the device reminding method of the embodiments of the present application is described. As shown in FIG. 8, FIG. 8 is a flowchart of a device reminding method according to an embodiment of the present application.
[0126] In S101, the folding state information of the terminal device and the ambient light parameter of the environment in which the terminal device is located are obtained.
[0127] The folding state information indicates that the terminal device is in the folded state or the unfolded state. The terminal device can detect whether the foldable screen of the terminal device is folded through a Hall sensor. The ambient light parameter of the environment in which the terminal device is located indicates the ambient brightness (ambient_brightness). The ambient light parameter can be the illuminance, and the unit of the illuminance is lux. The terminal device can detect the illuminance of the environment in which the terminal device is located through a light sensor, and obtain the falling rate (i.e., the light reduction rate) or the rising rate of the illuminance when the ambient light changes.
[0128] S102, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment has changed, determining a duration that the ambient light parameter is less than the first light threshold in the unfolded state; wherein the ambient light parameter reflecting that the environment has changed comprises: a light reduction rate of the ambient light parameter being greater than a first rate threshold, and / or the ambient light parameter being less than the first light threshold.
[0129] In a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment has changed, it is indicated that the terminal device is likely to be placed into a pocket or bag without being folded. Therefore, the duration that the terminal device remains in this state is detected, that is, a timer is started to count the duration under the condition that the unfolded state and the ambient light parameter being less than the first light threshold are met.
[0130] Generally, the ambient light parameter detected during use of the terminal device is quite different from the ambient light parameter detected after the terminal device is placed into a pocket or bag, and the ambient light parameter may suddenly decrease (or suddenly become dark). The first rate threshold and the first light threshold can be appropriately set by a person skilled in the art according to actual conditions, for example, the first light threshold is set to 5 lux, 6 lux, 4 lux, etc., and the present embodiment does not limit this. In fact, the ambient light parameter suddenly decreases or the ambient light parameter is less than the first light threshold is not very common during use of the terminal device. Therefore, whether the terminal device is placed into a pocket or bag (that is, whether the storage scene is entered) can be detected by judging whether the light reduction rate is greater than the first rate threshold or whether the ambient light parameter is less than the first light threshold.
[0131] S103, in a case where the duration is greater than or equal to a preset duration, performing folding prompting.
[0132] In the present embodiment, if either of the unfolded state and the ambient light parameter being less than the first light threshold is not met when the duration has not reached the preset duration, the counting is stopped, and when the conditions of the unfolded state and the ambient light parameter being less than the first light threshold are met again, the counting needs to be restarted and is not cumulative. If the duration reaches or exceeds the preset duration (that is, is equal to or greater than the preset duration), it is indicated that the user places the unfolded terminal device into a pocket or bag, and the current scene is identified as the terminal device being in the unfolded state and entering the storage scene, so that the user is prompted to fold.
[0133] If the user takes the terminal device out of the pocket or bag or folds the terminal device within the preset time period after putting the unfolded terminal device into the pocket or bag, the user does not need to be reminded, avoiding excessive disturbance to the user. Therefore, the embodiment of the present application sets a preset time period, counts the duration that the ambient light parameter is less than the first light threshold in the unfolded state, and regards the scenario that the duration is greater than or equal to the preset time period as the scenario that the unfolded terminal device is put into the pocket or bag, which also indicates that the user really forgets to fold the terminal device. The folding reminder is given to the user, and the accuracy of the reminding opportunity is improved.
[0134] It should be noted that the preset time period can be set by a person skilled in the art according to actual conditions, for example, 1 minute (min), 3 min, etc., which is not limited in the embodiment of the present application, as long as it can represent that the terminal device enters the storage scenario.
[0135] In the embodiment of the present application, the duration that the terminal device is in the unfolded state and enters the storage scenario is counted, and the folding reminder is given when the duration reaches the preset time period. The behavior that the terminal device is put into the pocket or bag without being folded is reminded, and the foldable screen of the terminal device is reduced.
[0136] Based on the above Fig. 8, as shown in Fig. 9, Fig. 9 is a flowchart of a device reminding method provided by an embodiment of the present application; on the basis of whether the terminal device is in the unfolded state and the ambient light parameter is less than the first light threshold, the distance between the terminal device and the shielding object is added as a judgment condition to further improve the accuracy of identifying the storage scenario.
[0137] S201, acquire folding state information of a terminal device and an ambient light parameter of an environment where the terminal device is located.
[0138] S202, in a case where it is detected that the folding state information indicates that the terminal device is in an unfolded state and the ambient light parameter reflects that the environment has changed, start an identification mode, and acquire a distance between the terminal device and a shielding object.
[0139] The distance between the terminal device and the shielding object includes: a distance between an outer screen of the terminal device and a shielding object above the outer screen, and / or a distance between the foldable screen and a shielding object above the foldable screen. The outer screen refers to a screen of the terminal device except the foldable screen, and the outer screen and the foldable screen are opposite in the light emitting direction in the unfolded state.
[0140] Generally, after the terminal device is placed in a bag or a bag, if the terminal device is folded, there may be an obstruction above the outer screen of the terminal device. If the terminal device is not folded, there may be an obstruction above the outer screen and the inner screen (i.e., the foldable screen) of the terminal device. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in an unfolded state and the ambient light parameter reflects that the environment has changed, the identification mode is started. In the identification mode, the terminal device detects the distance between the terminal device and the obstruction. The terminal device can detect the distance between the obstruction above the outer screen and the outer screen through a proximity light sensor, and detect the distance between the obstruction above the inner screen and the inner screen through an ultrasonic sensor.
[0141] It should be noted that other distance sensors can also be used to detect the distance between the outer screen and the obstruction above the outer screen, and the distance between the foldable screen and the obstruction above the foldable screen, such as an infrared sensor, a radar sensor, etc. The embodiments of the present application are only described by taking the proximity light sensor and the ultrasonic sensor as examples, and do not represent that the embodiments of the present application are limited thereto.
[0142] S203, determine that the ambient light parameter is less than the first light threshold and the distance is less than the distance threshold in the unfolded state for a duration.
[0143] In the embodiments of the present application, the proximity light sensor can be located in the upper half region of the outer screen of the terminal device, that is, the region close to the camera. Generally, the user will not block the proximity light sensor when holding the terminal device for normal use. Under the condition that the ambient light parameter is less than the first light threshold in the unfolded state, the scenario in which the proximity light sensor detects that the distance is less than the distance threshold is relatively rare. Therefore, whether the terminal device enters the storage scene can be judged by detecting whether the distance is less than the distance threshold.
[0144] The ultrasonic sensor can be located in the upper half region of the foldable screen of the terminal device, and can be arranged on both sides of the earpiece or in the groove of the terminal device. Generally, the user will not block the ultrasonic sensor when holding the terminal device for normal use. Under the condition that the ambient light parameter is less than the first light threshold in the unfolded state, the scenario in which the ultrasonic sensor detects that the distance is less than the distance threshold is relatively rare. Therefore, whether the terminal device enters the storage scene can be judged by detecting whether the distance is less than the distance threshold.
[0145] It should be noted that the distance threshold value can be appropriately set by a person skilled in the art according to actual conditions, for example, the distance threshold value is set to 2 centimeters (cm), 5 cm, 0.5 cm, 10 cm, 12 cm, etc., and the present embodiment does not limit this as long as the distance of the shielding object can be distinguished as close. Of course, the proximity light sensor and the ultrasonic sensor can directly detect whether the distance is close or far away, and the detection result includes close and far away. Thus, it is determined that the ambient light parameter is less than the first light threshold value in the unfolded state, and the detection result maintains close for a continuous time length.
[0146] It can be understood that when the distance between the terminal device and the shielding object includes the distance between the outer screen of the terminal device and the shielding object above the outer screen, and the distance between the foldable screen and the shielding object above the foldable screen, two different distance threshold values can be set. One of them is less than its corresponding distance threshold value, that is, it is judged that the condition of the shielding object distance close is met, and then the continuous time length is determined, and the comprehensiveness of identifying the shielding object is improved.
[0147] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, and the distance is less than the distance threshold value, it means that the terminal device may be placed in the pocket or bag without being folded. Therefore, the continuous time length of the terminal device in this state is detected, that is, the timer is started under the condition that the unfolded state, the ambient light parameter is less than the first light threshold value, and the distance is less than the distance threshold value, and the continuous time length is counted.
[0148] S204, whether the continuous time length is greater than or equal to a preset time length?
[0149] If yes, S205 is executed; if no, S206 is executed. If the continuous time length is less than the preset time length, S207 is executed when it is detected that the folding state information indicates that the terminal device is in the folded state or the distance is greater than or equal to the distance threshold value.
[0150] S205, in the case where the continuous time length is greater than or equal to the preset time length, folding reminder is performed.
[0151] S206, whether the ambient light parameter is greater than or equal to a second light threshold value?
[0152] Among them, the second light threshold value is greater than the first light threshold value.
[0153] If yes, S208 is executed, and if no, S207 is executed, that is, the identification mode is executed to obtain the distance between the terminal device and the shielding object until it is detected that the continuous time length is greater than or equal to the preset time length, or it is detected that the light data is greater than or equal to the second light threshold value.
[0154] S207, the distance between the terminal device and the shielding object is obtained.
[0155] After S207 is performed, S203 is continuously performed.
[0156] S208, exit the identification mode.
[0157] In the embodiments of the present application, if the duration has not reached the preset duration, for the case that the non-folded state is not met or the distance is less than the distance threshold, the timing is stopped, the identification mode is exited, the step of acquiring the distance is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended, thereby reducing the power consumption. For the case that the non-folded state is met, the distance is less than the distance threshold, and the ambient light parameter is greater than the first light threshold but has not reached or exceeded the second light threshold (i.e., is equal to or greater than the second light threshold), the identification mode is not exited, the step of acquiring the distance is continuously performed, and the timing is restarted when the non-folded state is met again, the ambient light parameter is less than the first light threshold, and the distance is less than the distance threshold. For the case that the ambient light parameter reaches or exceeds the second light threshold (i.e., is equal to or greater than the second light threshold), the identification mode is exited, the step of acquiring the distance is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended.
[0158] It should be noted that the second light threshold can be appropriately set by a person skilled in the art according to actual conditions, for example, the second light threshold is set to 20 lux, 17 lux, 22 lux, etc., and the embodiments of the present application do not limit this, as long as the terminal device can be distinguished from being taken out of the pocket or bag.
[0159] In the embodiments of the present application, the second light threshold greater than the first light threshold is set to provide a fault tolerance space for the exit of the identification mode, thereby improving the accuracy of the identification result.
[0160] In the embodiments of the present application, the steps of starting the identification mode and exiting the identification mode in the above-mentioned FIG. 9 can also not be set, and thus the embodiments include the following steps: acquiring folding state information of a terminal device and an ambient light parameter of an environment in which the terminal device is located; in the case that it is detected that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameter reflects that the environment has changed, acquiring a distance between the terminal device and an occlusion; determining a duration in which the ambient light parameter is less than the first light threshold and the distance is less than the distance threshold in the non-folded state; and in the case that the duration is greater than or equal to a preset duration, performing a folding reminder. That is, in the case that the ambient light parameter is less than the first light threshold and the distance is less than the distance threshold in the non-folded state, the duration is counted, if any condition is not met, the duration is no longer counted, until all three conditions are met, and the duration is counted again.
[0161] In an implementation manner of the embodiment, the distance between the terminal device and the shelter is the distance between the outer screen of the terminal device and the shelter above the outer screen. By focusing on whether there is a shelter above the outer screen, it can be determined whether the storage scenario is entered. In another implementation manner, the distance between the terminal device and the shelter is the distance between the foldable screen and the shelter above the foldable screen, that is, focusing on whether there is a shelter above the foldable screen. For the scenario that the terminal device is placed in a pocket or bag, the outer screen faces downward, and the inner screen (the foldable screen) faces upward, no folding reminder is performed, the number of reminders can be reduced, the user is not disturbed excessively, and the accuracy of the reminder is improved. In another implementation manner, the distance between the terminal device and the shelter includes the distance between the outer screen of the terminal device and the shelter above the outer screen, and the distance between the foldable screen and the shelter above the foldable screen. Thus, for the scenario that the terminal device is placed in a pocket or bag, the outer screen faces downward, and the foldable screen faces upward, the folding reminder is still performed, and the comprehensiveness of the folding reminder is improved.
[0162] Based on the above FIG. 8, as shown in FIG. 10, FIG. 10 is a flow diagram of a device reminding method provided in an embodiment of the present application; on the basis of whether the terminal device is in the unfolded state and whether the ambient light parameter is less than the first light threshold, a judgment condition of motion data of the terminal device in use is added to further improve the accuracy of identifying the storage scenario.
[0163] S301, obtain folding state information of a terminal device and an ambient light parameter of an environment in which the terminal device is located.
[0164] S302, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, start an identification mode, and obtain motion data of the terminal device in use; the motion data includes acceleration.
[0165] Generally, the motion law when the user normally uses the terminal device by hand is different from the motion law after the terminal device is placed in a pocket or bag. After the terminal device is placed in a pocket or bag, the terminal device moves or is static with the pocket or bag, and the motion includes but is not limited to walking, running, and cycling. In practice, static, walking, running, and cycling can be identified through motion characteristics. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, the identification mode is started. In the identification mode, the terminal device detects the motion data of the terminal device in use. The terminal device can detect the acceleration of the terminal device through an acceleration (ACC) sensor, and detect the angular velocity of the terminal device through a gyroscope (GY) sensor.
[0166] S303, determine that the ambient light parameter is less than the first light threshold in the unfolded state, and the motion data reflects that the posture of the terminal device fluctuates for a duration; wherein the motion data reflecting that the posture of the terminal device fluctuates includes that the frequency of the second acceleration decreases compared with the first acceleration and the amplitude change rule changes; the first acceleration is the acceleration of the terminal device before the ambient light parameter reflects that the environment changes, and the second acceleration is the acceleration of the terminal device after the ambient light parameter reflects that the environment changes.
[0167] In the embodiment of the application, the acceleration of the terminal device when the user normally uses the terminal device is detected (corresponding to the acceleration of the terminal device before the ambient light parameter reflects that the environment changes, that is, the first acceleration), and the acceleration of the terminal device after the terminal device is placed in a pocket or bag is detected (corresponding to the acceleration of the terminal device after the ambient light parameter reflects that the environment changes, that is, the second acceleration). The frequency of the second acceleration decreases compared with the first acceleration; and the amplitude change rule of the second acceleration is different from that of the first acceleration, and the amplitude change rule of the second acceleration changes compared with that of the first acceleration. Therefore, whether the posture of the terminal device fluctuates can be detected to assist in determining whether the terminal device enters the storage scene.
[0168] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment changes, and the motion data reflects that the posture of the terminal device fluctuates, it indicates that the terminal device is likely to be placed in a pocket or bag without being folded. Therefore, the duration for which the terminal device remains in this state is detected, that is, the duration is counted when the conditions of the unfolded state, the ambient light parameter being less than the first light threshold, and the motion data reflecting that the posture of the terminal device fluctuates are met.
[0169] S304, determine whether the duration is greater than or equal to a preset duration.
[0170] If yes, S305 is performed; if no, S306 is performed. If the duration is less than the preset duration, S307 is performed when it is detected that the folding state information indicates that the terminal device is in the folded state or the motion data reflects that the posture of the terminal device does not fluctuate. S305, in the case where the duration is greater than or equal to the preset duration, a folding reminder is performed.
[0171] S306, determine whether the ambient light parameter is greater than or equal to a second light threshold.
[0172] The second light threshold is greater than the first light threshold.
[0173] If yes, S308 is performed, and if no, S307 is continuously performed, that is, the identification mode is performed to obtain the motion data of the terminal device in use until the duration is greater than or equal to the preset duration, or the light data is greater than or equal to the second light threshold.
[0174] S307, the motion data of the terminal device in use is obtained.
[0175] After S307 is performed, S303 is continuously performed.
[0176] S308, the identification mode is exited.
[0177] In the embodiments of the present application, if the duration has not reached the preset duration, for the case that the non-folded state is not met or the motion data reflects that the posture of the terminal device fluctuates, the timing is stopped, the identification mode is exited, the step of obtaining the motion data is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended, thereby reducing the power consumption. For the case that the non-folded state is met, the motion data reflects that the posture of the terminal device fluctuates, and the ambient light parameter is greater than the first light threshold but has not reached or exceeded the second light threshold (that is, equal to or greater than the second light threshold), the identification mode is not exited, the step of obtaining the motion data is continuously performed, and the timing is restarted when the non-folded state is met again, the ambient light parameter is less than the first light threshold, and the motion data reflects that the posture of the terminal device fluctuates. For the case that the ambient light parameter reaches or exceeds the second light threshold (that is, equal to or greater than the second light threshold), the identification mode is exited, the step of obtaining the motion data is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended, thereby reducing the power consumption.
[0178] In the embodiments of the present application, the second light threshold greater than the first light threshold is set to provide a fault tolerance space for the exit of the identification mode, and improve the accuracy of the identification result. The motion data of the terminal device in use is increased to improve the accuracy of the identification of the storage scene.
[0179] In the embodiment of the present application, the step of starting the identification mode and the step of exiting the identification mode in FIG. 10 can also not be set, and thus the embodiment includes the following steps: obtaining folding state information of the terminal device and ambient light parameters of an environment in which the terminal device is located; in a case where it is detected that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameters reflect that the environment has changed, obtaining motion data of the terminal device in a use process; determining that the ambient light parameters are less than a first light threshold in the non-folded state and the motion data reflects that a posture of the terminal device fluctuates for a continuous time length; and in a case where the continuous time length is greater than or equal to a preset time length, performing a folding reminder. That is, in a case where the ambient light parameters are less than the first light threshold in the non-folded state and the motion data reflects that the posture of the terminal device fluctuates, the continuous time length is counted, if any condition is not met, the continuous time length is no longer counted, until all three conditions are met, and the continuous time length is counted again.
[0180] Based on the above FIG. 8, as shown in FIG. 11, FIG. 11 is a flow diagram of a device reminding method provided in an embodiment of the present application; on the basis of whether the terminal device is in a non-folded state and whether the ambient light parameters are less than a first light threshold, a screen state of the terminal device is added as a judgment condition to further improve the accuracy of identifying the storage scene.
[0181] S401, obtaining folding state information of a terminal device and ambient light parameters of an environment in which the terminal device is located.
[0182] S402, in a case where it is detected that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameters reflect that the environment has changed, starting an identification mode and obtaining a screen state of the terminal device.
[0183] Generally, before the terminal device is placed in a pocket or a bag, the user will lock the screen of the terminal device. Based on this, in a case where it is detected that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameters reflect that the environment has changed, the identification mode is started. In the identification mode, the terminal device detects the screen state of the terminal device. The operating system of the terminal device can provide an application programming interface (API) to allow an application to query whether the terminal device is locked, and thus the screen state of the terminal device can be detected by checking whether the screen is in an “off” or “locked” state. The screen state includes a locked state and an unlocked state, wherein the locked state refers to all states except the unlocked state, that is, a non-unlocked state, and the locked state includes an off-screen state (non-bright screen state), an always-on display (AOD), and the AOD includes an off state, a doze state, and a doze suspend state.
[0184] S403, determine the duration that the ambient light parameter is less than the first light threshold and the screen state is the lock screen state in the unfolded state.
[0185] Generally, most users are used to locking the terminal device when not using the terminal device, or the terminal device will automatically trigger the lock screen operation when not used for a long time. Therefore, whether the terminal device enters the storage scene can be assisted by detecting whether the screen state of the terminal device is the lock screen state.
[0186] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, and the screen state is the lock screen state, it means that the terminal device may be put into the pocket or bag without being folded. Therefore, the duration that the terminal device remains in this state is detected, that is, the timer is started to count the duration under the condition that the unfolded state, the ambient light parameter is less than the first light threshold, and the screen state is the lock screen state.
[0187] S404, determine whether the duration is greater than or equal to a preset duration.
[0188] If yes, S405 is executed; if no, S406 is executed. If the duration is less than the preset duration, S407 is executed when it is detected that the folding state information indicates that the terminal device is in the folded state or the screen state is the unlock state.
[0189] S405, in the case that the duration is greater than or equal to the preset duration, folding reminder is performed.
[0190] S406, determine whether the ambient light parameter is greater than or equal to a second light threshold.
[0191] The second light threshold is greater than the first light threshold.
[0192] If yes, S408 is executed, and if no, S407 is continuously executed, that is, the screen state of the terminal device is obtained until it is detected that the duration is greater than or equal to the preset duration, or it is detected that the light data is greater than or equal to the second light threshold.
[0193] S407, obtain the screen state of the terminal device.
[0194] After S407 is executed, S403 is continuously executed.
[0195] S408, exit the identification mode.
[0196] In the embodiment of the present application, if the duration has not reached the preset duration, for the case that the non-folded state or the lock screen state is not met, the timing is stopped, the identification mode is exited, the step of obtaining the screen state of the terminal device is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended, thereby reducing the power consumption. For the case that the non-folded state is met, the screen state is the lock screen state, and the ambient light parameter is greater than the first light threshold but has not reached or exceeded the second light threshold (that is, equal to or greater than the second light threshold), the identification mode is not exited, the step of obtaining the screen state of the terminal device is continued to be performed, and the timing is restarted when the non-folded state is met again, the ambient light parameter is less than the first light threshold, and the screen state is the lock screen state. For the case that the ambient light parameter reaches or exceeds the second light threshold (that is, equal to or greater than the second light threshold), the identification mode is exited, the step of obtaining the screen state of the terminal device is not performed, and the identification algorithm for detecting whether the terminal device enters the storage scene is ended, thereby reducing the power consumption.
[0197] In the embodiment of the present application, the second light threshold greater than the first light threshold is set to provide a fault tolerance space for the exit of the identification mode, and improve the accuracy of the identification result. In addition, the screen state of the terminal device is added to improve the accuracy of the identification of the storage scene.
[0198] In the embodiment of the present application, the steps of starting the identification mode and exiting the identification mode in the above-mentioned FIG. 11 can also not be set. In this embodiment, the following steps are included: obtaining the folding state information of the terminal device and the ambient light parameter of the environment in which the terminal device is located; obtaining the screen state of the terminal device in the case that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameter reflects that the environment has changed; determining the duration in which the ambient light parameter is less than the first light threshold and the screen state is the lock screen state in the non-folded state; and performing the folding reminder in the case that the duration is greater than or equal to the preset duration. That is, in the case that the ambient light parameter is less than the first light threshold and the screen state is the lock screen state in the non-folded state, the duration is counted. If any condition is not met, the duration is not counted again until all three conditions are met, and the duration is counted again.
[0199] Based on the judgment condition of the distance between the terminal device and the shielding object added in the above-mentioned FIG. 9, the judgment condition of the motion data of the terminal device in the use process added in FIG. 10, and the judgment condition of the screen state of the terminal device added in FIG. 11, any two of them can be combined to constitute different technical solutions, including example one, example two, and example three.
[0200] Example one, in the case that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, and the motion data reflects that the posture of the terminal device fluctuates, the recognition mode is started; the duration that the ambient light parameter is less than the first light threshold, the distance is less than the distance threshold, and the posture of the terminal device fluctuates in the unfolded state is determined; in the case that the duration is greater than or equal to the preset duration, the folding reminder is performed.
[0201] Example two, in the case that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, and the screen state is the lock screen state, the recognition mode is started; the duration that the ambient light parameter is less than the first light threshold, the distance is less than the distance threshold, and the screen state is the lock screen state in the unfolded state is determined; in the case that the duration is greater than or equal to the preset duration, the folding reminder is performed.
[0202] Example three, in the case that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state, the recognition mode is started; the duration that the ambient light parameter is less than the first light threshold, the posture of the terminal device fluctuates, and the screen state is the lock screen state in the unfolded state is determined; in the case that the duration is greater than or equal to the preset duration, the folding reminder is performed.
[0203] It can be understood that the above three increased judgment conditions can be combined. As shown in FIG. 12, FIG. 12 is a flowchart of a device reminding method provided by an embodiment of the present application.
[0204] S501, obtain folding state information of a terminal device, an ambient light parameter of an environment in which the terminal device is located, a distance between the terminal device and an occlusion, motion data of the terminal device in a use process, and a screen state of the terminal device.
[0205] S502, in the case that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state, determine the duration that the ambient light parameter is less than the first light threshold, the distance is less than the distance threshold, the posture of the terminal device fluctuates, and the screen state is the lock screen state in the unfolded state.
[0206] In the embodiments of the present application, the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment has changed, the distance is less than the distance threshold, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state. These five judgment conditions are used as the premise. When the five judgment conditions are met at the same time, the timer is started, and the duration of the terminal device in this state is counted.
[0207] In S503, it is judged whether the duration is greater than or equal to the preset duration.
[0208] If yes, S504 is executed; if no, S501 is continuously executed.
[0209] In S504, the folding reminder is performed when the duration is greater than or equal to the preset duration.
[0210] In the embodiments of the present application, the judgment conditions of the distance between the terminal device and the shielding object, the motion data of the terminal device in use, and the screen state of the terminal device are added. The implementation scheme and the technical effects achieved can be referred to the corresponding description of the three judgment conditions above, and will not be repeated here. By considering the use habits of most users and the characteristics of the terminal device in the scenario of entering the pocket or bag, the accuracy of identifying the storage scenario is improved.
[0211] In the related technology, a scheme of pocket mode (also referred to as pocket scenario) identification is provided, which is mainly aimed at the touch or fingerprint false touch scenario. When the ambient light is dark and the camera is downward, it is uniformly determined as the pocket mode. This scheme needs to accurately identify that the user puts the terminal device without a lock screen into the pocket / bag, and then realizes the function of reminding the user to lock the screen. The judgment method of this judgment scheme is single, and when the ambient light is dark and the camera is downward, it is not necessarily the pocket or bag scenario, for example, the terminal device is inverted when the ambient light is dark. Therefore, the related technology defaults the ambient light to be dark and the camera to be downward as being put into the pocket mode, the scene judgment method is single, and misidentification phenomenon is easy to occur. Moreover, the judgment method of the pocket mode cannot be directly applied to the unfolded reminding scenario.
[0212] The device reminding method provided in the embodiments of the present application involves detecting whether the terminal device enters a storage scenario in a non-folded state. The terminal device is detected as entering a pocket scenario by detecting at least one of the following conditions: whether the ambient light parameter reflects a change in the environment, whether the distance between the terminal device and an occlusion is less than a distance threshold, whether the motion data of the terminal device in use reflects fluctuations in the posture of the terminal device, and whether the screen state of the terminal device is a locked screen state. The duration for which the terminal device remains in the above conditions is detected when the terminal device is in the non-folded state and the above conditions are met. If the duration is greater than or equal to a preset duration, the terminal device is determined to enter a storage scenario in the non-folded state, thereby improving the accuracy of identifying the storage scenario. The method can be used in an unfolded reminding scenario, and can remind the user to store the terminal device after folding, thereby reducing the pressure on the foldable screen of the terminal device.
[0213] Next, the marking (also referred to as reporting or dotting) events in the terminal device are described.
[0214] The above Figs. 8-12 identify the storage scenario, which can be understood as being identified by using a storage scenario identification model. On this basis, the embodiments of the present application further provide a scheme for determining a user's personalized folding reminding strategy according to big data marking. The embodiments of the present application further provide a device reminding method, which includes: obtaining the number of markings of preset events in a preset period; the preset events include at least one of a reminding event, an ambient light change event, a device flipping event, a bag-in event, a night device stationary event, and a night device motion event; determining a folding reminding strategy according to the number of markings; and determining a reminding mode of folding reminding in a next preset period according to the folding reminding strategy.
[0215] In the embodiments of the present application, the marking function of different special events is set to record the events in which the state of the terminal device changes as much as possible, and the events are reported. The reporting of events does not necessarily remind the user, and the user is not aware of the reporting of events. Some events need to remind the user, for example, a reminding event, and the user is aware of the reminding. The number of markings of the reminding event, the ambient light change event, the device flipping event, the bag-in event, the night device stationary event, and the night device motion event in a preset period is counted, and a folding reminding strategy is determined according to the number of markings of each event. The folding reminding strategy is used to determine a reminding mode of folding reminding in a next preset period, and the reminding mode can include a reminding frequency, a form used for folding reminding, etc. Folding reminding is performed according to the reminding mode in the next preset period. The folding reminding strategy is determined by marking events, so that the corresponding folding reminding is performed, which is more in line with the user's usage habits and improves the personalization and diversity of human-computer interaction.
[0216] It should be noted that the preset period can be appropriately set by those skilled in the art according to actual conditions, for example, one day, half a day, three days, one week, etc. Of course, the preset period can also be modified by collecting the use habits of the user in a period of time, and the embodiments of the present application do not limit this, as long as the user can be reminded in time and the user is not disturbed too much.
[0217] Next, the scenario of detecting sharp darkening of ambient light is illustrated by FIGS. 13-15, and the scenario of unchanged ambient light and changed acceleration is illustrated by FIGS. 16 and 17.
[0218] In some embodiments, in a case where it is detected that the terminal device is in the unfolded state and enters the storage scenario, a reminding event is marked once, and a folding reminder is performed.
[0219] Referring to the description in FIG. 10, the duration that the ambient light parameter is less than the first light threshold and the motion data reflects that the posture of the terminal device fluctuates in the unfolded state is counted. In a case where the duration is greater than or equal to a preset duration, it is indicated that the terminal device is put into a pocket or a bag without being folded. As shown in FIG. 13, FIG. 13 is a schematic diagram of marking an event provided by an embodiment of the present application. FIG. 13 shows the following use scenario: the user normally uses the terminal device by hand → the screen is locked or not turned off → put into a pocket or a bag → stationary or continue walking. Taking the ambient light parameter as the illuminance for example, the A graph in FIG. 13 is a curve graph of the illuminance changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of the illuminance, the unit is lux. The B graph in FIG. 13 is a curve graph of the acceleration changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of the acceleration. The time in the A graph in FIG. 13 and the B graph in FIG. 13 has a corresponding relationship. As can be seen from the A graph in FIG. 13, compared with the illuminance when the user normally uses the terminal device by hand, the illuminance sharply decreases (or suddenly darkens) after the terminal device is put into a pocket or a bag, and decreases to below 5 lux; and when the user normally uses the terminal device by hand again, the amplitude of the illuminance increases. As can be seen from the B graph in FIG. 13, the frequency of the acceleration (including the X-axis acceleration, the Y-axis acceleration and the Z-axis acceleration) when the user normally uses the terminal device by hand is relatively high, the frequency of the acceleration is relatively low after the terminal device is put into a pocket or a bag, and the amplitude change rule of the acceleration changes before and after the terminal device is put into a pocket or a bag; and when the user normally uses the terminal device by hand again, the frequency of the acceleration increases, and the amplitude change rule changes again. Based on this, the embodiments of the present application mark a reminding event. The reminding event is marked once in FIG. 13. And the event that the user normally uses the terminal device by hand again is marked, and the marking shown in FIG. 13 includes the start time and the end time of the reminding event.
[0220] In the embodiments of the present application, the reminder event is marked, which can be used to determine a folding reminder strategy, so as to perform corresponding folding reminders in the next preset period, and improve the personalization and diversity of human-computer interaction.
[0221] In some embodiments, the folding state information of the terminal device, the ambient light parameter of the environment in which the terminal device is located, the distance between the terminal device and the shelter, and the motion data of the terminal device in use are acquired; in a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects that the environment has changed, the motion data reflects that the posture of the terminal device fluctuates, and the distance is greater than or equal to a distance threshold, a one-time in-bag event is marked; or in a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects that the environment has changed, and the motion data reflects that the terminal device is inverted, a one-time in-bag event is marked.
[0222] As described above with reference to FIGS. 9 and 10, the distance between the terminal device and the shelter refers to the distance between the foldable screen and the shelter above the foldable screen. In a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects that the environment has changed, the motion data reflects that the posture of the terminal device fluctuates, and the distance is greater than or equal to a distance threshold, it is indicated that the terminal device is likely to be placed in a pocket or bag, the outer screen of the terminal device faces downward, the foldable screen faces upward, or the foldable screen is far away from the shelter above, and therefore, a one-time in-bag event is marked. Generally, according to the use habit of a user, if the terminal device is placed in a pocket, the terminal device is inverted. Based on this, in a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects that the environment has changed, and the motion data reflects that the terminal device is inverted, that is, in a case where the non-folded state, dark light, and the camera of the terminal device faces upward, it is indicated that the terminal device is likely to be placed in a pocket, and therefore, a one-time in-bag event is marked.
[0223] In the embodiments of the present application, the case where the terminal device is inverted can be detected by using the gyroscope of the camera, or can be detected by using other manners, which are not limited in the embodiments of the present application, as long as whether the terminal device is inverted can be detected.
[0224] For a case where the non-folded state, dark light, and the camera of the terminal device faces upward, the case can be judged by using other manners, which can be referred to the descriptions of FIGS. 8-12, and will not be described herein. In a case where it is judged that the terminal device is likely to be placed in a pocket or bag, a one-time in-bag event is marked.
[0225] In the embodiments of the present application, the in-bag event is marked, which can be used to determine a folding reminder strategy, so as to perform corresponding folding reminders in the next preset period, and improve the personalization and diversity of human-computer interaction.
[0226] In some embodiments, the folding state information of the terminal device and the ambient light parameter of the environment in which the terminal device is located are acquired; in the case that the folding state information indicates that the terminal device is in a non-folded state and the ambient light parameter reflects that the environment has changed, the recognition mode is started, and the motion data of the terminal device in the use process is acquired; the motion data includes angular velocity; in the case that the change of the angular velocity before and after the ambient light parameter reflects that the environment has changed is within a preset range, a first ambient light change event is marked.
[0227] In the case that the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameter reflects that the environment has changed, and the motion data reflects that the posture of the terminal device has not obviously fluctuated (i.e., the change of the angular velocity before and after the ambient light parameter reflects that the environment has changed is within a preset range), it is indicated that the terminal device is likely to only enter a dark environment and is not placed into a pocket or bag, and thus a first ambient light change event is marked.
[0228] As shown in FIG. 14, FIG. 14 is a schematic diagram II of marking an event according to an embodiment of the present application. FIG. 14 shows the following scenario: the user normally uses the terminal device by hand → the screen is locked or not turned off → enters a dark room. Taking the ambient light parameter as the illuminance for example, FIG. 14A is a curve diagram of the illuminance changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of the illuminance, the unit being lux. FIG. 14B is a curve diagram of the acceleration changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of the acceleration. The time in FIG. 14A and the time in FIG. 14B have a corresponding relationship. As can be seen from FIG. 14A, compared with the illuminance when the user normally uses the terminal device by hand, the illuminance sharply decreases after the terminal device enters the dark room. As can be seen from FIG. 14B, compared with the frequency of the acceleration (including the X-axis acceleration, the Y-axis acceleration and the Z-axis acceleration) when the user normally uses the terminal device by hand, the frequency does not obviously change after the terminal device enters the dark room, and the amplitude change rule of the acceleration does not obviously change after the terminal device enters the dark room. Correspondingly, compared with the angular velocity when the user normally uses the terminal device by hand, the change of the angular velocity is small after the terminal device enters the dark room, and is within a preset range. Based on this, the ambient light change event is marked according to an embodiment of the present application. The first ambient light change event is marked in FIG. 14. The marking of the ambient light change event shown in FIG. 14 includes the start time and the end time of the ambient light change event.
[0229] In the embodiments of the present application, by marking the ambient light change event, the folding reminder strategy can be determined, so as to perform the corresponding folding reminder in the next preset period, and the individuality and diversity of human-computer interaction are improved.
[0230] In some embodiments, the folding state information of the terminal device, the ambient light parameter of the environment where the terminal device is located, and the motion data of the terminal device in use are acquired; the motion data includes angular velocity; a first device turnover event is marked when it is detected that the folding state information indicates that the terminal device is in a non-folded state, and the light reduction rate of the ambient light parameter is greater than a second rate threshold, and the amplitude of the angular velocity before and after the light reduction rate of the ambient light parameter is greater than the second rate threshold is reversed; wherein the second rate threshold is less than the first rate threshold.
[0231] Generally, when the terminal device is turned over, the ambient light parameter will also suddenly decrease (or suddenly become dark), but the decrease amount of the ambient light parameter is less than that when the terminal device is placed in a pocket or bag, that is, the light reduction rate is greater than the second rate threshold, and the second rate threshold is less than the first rate threshold corresponding to the terminal device being placed in a pocket or bag. Moreover, when the terminal device is turned over, the amplitude of the angular velocity will have a reverse feature from positive to negative or from negative to positive. Based on this, when it is detected that the folding state information indicates that the terminal device is in a non-folded state, the light reduction rate of the ambient light parameter is greater than the second rate threshold, and the angular velocity before and after the light reduction rate of the ambient light parameter is greater than the second rate threshold is reversed, it is indicated that the terminal device is likely to be turned over, and therefore a first device turnover event is marked.
[0232] As shown in FIG. 15, FIG. 15 is a schematic diagram III of marking an event provided by an embodiment of the present application; FIG. 15 shows the following scenario: a user normally uses a terminal device by hand → locks or does not lock the screen → turns over and buckles on a desktop. Taking the ambient light parameter as illuminance for example, FIG. 15A is a curve graph of illuminance changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of illuminance, the unit is lux. FIG. 15B is a curve graph of acceleration changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of acceleration. FIG. 15C is a curve graph of angular velocity changing with time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of angular velocity. The time in FIG. 15A, FIG. 15B and FIG. 15C has a corresponding relationship.
[0233] As can be seen from the A diagram in FIG. 15, compared with the illumination when the user holds the terminal device normally, the illumination after the terminal device is flipped decreases suddenly (or suddenly becomes dark). For the scenario in which the terminal device is stationary after being flipped, as can be seen from the B diagram in FIG. 15, compared with the frequency of acceleration (including X-axis acceleration, Y-axis acceleration, and Z-axis acceleration) when the user holds the terminal device normally, the frequency after the terminal device is flipped decreases, and the amplitude change law of the acceleration after the terminal device is flipped changes obviously. Moreover, the amplitude of the angular velocity after the terminal device is flipped is reversed: the amplitude of the angular velocity when the user holds the terminal device normally is a positive value, and the amplitude of the angular velocity after the terminal device is flipped is a negative value. Based on this, the embodiments of the present application mark a device flipping event. The device flipping event is marked once in FIG. 15.
[0234] In the embodiments of the present application, the device flipping event is marked, which can be used to determine a folding reminder strategy, so as to perform a corresponding folding reminder in the next preset period, and improve the individuality and diversity of human-computer interaction.
[0235] In some embodiments, folding state information of a terminal device, ambient light parameters of an environment in which the terminal device is located, and motion data of the terminal device in a use process are acquired; the motion data includes acceleration and angular velocity; in a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameters do not change, and the amplitude change law of the acceleration and the amplitude change law of the angular velocity both change from change to no change, and the keeping time of no change is greater than a preset stationary time length, a night device stationary event is marked once; in a case where the folding state information of the terminal device, the ambient light parameters do not change, and the amplitude change law of the acceleration and the amplitude change law of the angular velocity both experience three distribution laws, a night carrying device motion event is marked once.
[0236] There is also a scenario of using the terminal device at night in general cases. In a night scenario, the ambient light parameters do not change. The event can be marked by the change law of the motion data. The motion data of the user holding the terminal device normally at night changes obviously, and the motion data of the terminal device stationary at night basically does not change (the amplitude change law of the acceleration and the angular velocity both do not change). Therefore, in a case where the folding state information indicates that the terminal device is in a non-folded state, the ambient light parameters do not change, and the amplitude change law of the acceleration and the amplitude change law of the angular velocity both change from change to no change, and the keeping time of no change is greater than a preset stationary time length, a night device stationary event is marked once.
[0237] As shown in FIG. 16, FIG. 16 is a schematic diagram IV of marking an event according to an embodiment of the present application. FIG. 16 shows the following scenario: dark room -> screen locked or not locked -> static. FIG. 16A is a curve diagram of acceleration changing over time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of acceleration. FIG. 16B is a curve diagram of angular velocity changing over time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of angular velocity. The time in FIG. 16A and the time in FIG. 16B have a corresponding relationship.
[0238] As can be seen from FIG. 16A, compared with the frequency of acceleration (including X-axis acceleration, Y-axis acceleration and Z-axis acceleration) when the user normally uses the terminal device, the frequency of acceleration after the terminal device is static decreases and basically does not change in a period of time, and the amplitude of acceleration after the terminal device is static basically does not change in a period of time. As can be seen from FIG. 16B, compared with the frequency of angular velocity (including X-axis angular velocity, Y-axis angular velocity and Z-axis angular velocity) when the user normally uses the terminal device, the frequency of angular velocity after the terminal device is static decreases and basically does not change in a period of time, and the amplitude of angular velocity after the terminal device is static basically does not change in a period of time. Based on this, the night device static event is marked by the embodiment of the present application. The night device static event is marked once in FIG. 16.
[0239] Further, the embodiment of the present application can set a preset static duration T1, and when the static state of the terminal device exceeds T1, distance detection is started, and when it is detected that the distance between the foldable screen and the obstruction above the foldable screen (or the distance between the outer screen and the obstruction above the outer screen) is less than a distance threshold, it is identified that the terminal device is in a non-folded state and enters a static state. According to the system time, the night device static event is marked once.
[0240] There is also a scenario of using the terminal device at night in general cases, and in the night scenario, the ambient light parameter does not change. The event can be marked by the change rule of motion data. When the user carries the terminal device to move at night, the user will first put the terminal device into a pocket or bag and then move, or the user holds the terminal device to change greatly and then moves. Therefore, the motion data will appear three stages: the user normally uses the terminal device at night, the terminal device is put into a pocket or bag (or the user holds the terminal device to change greatly), and the user carries the terminal device to move, and the three stages will present different motion distribution rules. Therefore, when it is detected that the folding state information of the terminal device, the ambient light parameter does not change, and the amplitude change rule of acceleration and the amplitude change rule of angular velocity all experience the first distribution rule to the second distribution rule to the third distribution rule, the night carrying device motion event is marked once.
[0241] As shown in FIG. 17, FIG. 17 is a schematic diagram V of marking an event according to an embodiment of the present application. FIG. 17 shows the following scenario: dark room→ screen lock or non-screen lock→ motion. FIG. 17A is a curve diagram of acceleration changing over time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of acceleration. FIG. 17B is a curve diagram of angular velocity changing over time, the horizontal coordinate is time, and the vertical coordinate is the amplitude of angular velocity. The time in FIG. 17A and the time in FIG. 17B have a corresponding relationship.
[0242] As can be seen from FIG. 17A and FIG. 17B, both the acceleration and the angular velocity show three distribution rules. Based on this, the night device carrying motion event is marked in the embodiment of the present application. The night device carrying motion event is marked once in FIG. 17. The marking shown in FIG. 17 includes the start time and the end time of the night device carrying motion event.
[0243] Further, the present application can set a preset motion duration T2, and divide the change area in FIG. 17 into P1 (corresponding to the first distribution rule), P2 (corresponding to the second distribution rule) and P3 (corresponding to the third distribution rule). Comparing P2 and P3, when the time T2 (the rate change in this time can be less than the preset rate change a1) is less than the threshold M, the angular velocity change is identified as a user action or a change in the scene. And after identifying the user action or the change in the scene, the distance detection is started to distinguish whether the terminal device is held in the hand for a long time or placed in the pocket or bag. When it is detected that the distance between the foldable screen and the obstruction above the foldable screen (or the distance between the outer screen and the obstruction above the outer screen) is less than the distance threshold, it is identified that the terminal device is in the unfolded state and enters the motion state, and the night device carrying motion event is marked once.
[0244] In the embodiment of the present application, by marking the night device stationary event and the night device carrying motion event, the folding reminder strategy can be determined to make corresponding folding reminders in the next preset period, so as to improve the personalization and diversity of human-computer interaction.
[0245] Based on the device reminding method provided in FIG. 8-FIG. 12 and the terminal device event marking provided in FIG. 13-FIG. 17, the device reminding method and the event marking are comprehensively described as follows. As shown in FIG. 18, FIG. 18 is a flowchart VI of a device reminding method according to an embodiment of the present application.
[0246] S601, acquiring an ambient light parameter.
[0247] The ambient light parameter of the environment where the terminal device is located can be the illumination. The terminal device can detect the ambient light parameter of the environment where the terminal device is located through the ambient light sensor, and acquire the light reduction rate of the ambient light parameter when the ambient light changes.
[0248] S602, in a case where the light reduction rate of the ambient light parameter is less than the first rate threshold, starting the identification mode.
[0249] The light reduction rate being less than the first rate threshold indicates that the ambient light is suddenly reduced, which is likely that the terminal device is put into a pocket or a bag. Therefore, in a case where the light reduction rate is less than the first rate threshold, the identification mode is started.
[0250] S603, whether the ambient light parameter is less than the first light threshold?
[0251] If yes, S605 is executed, and if no, S604 is executed.
[0252] Generally, the ambient light sensor is usually arranged at the upper half of the terminal device, for example, at the top end of the terminal device. When the user normally uses the terminal device, the detection of the ambient light is not affected. However, the user mistakenly holding the upper half of the terminal device will also cause the ambient light to be suddenly reduced. For the scenario of the user mistakenly holding the upper half of the terminal device, the ambient light can still pass through the fingers to enter the ambient light sensor, and the ambient light sensor can still detect part of the ambient light. Therefore, it is still necessary to determine whether the ambient light parameter is less than the first light threshold. By detecting whether the light reduction rate of the ambient light parameter indicates that the ambient light is suddenly reduced and whether the ambient light parameter reaches the feedback value (i.e., is less than the first light threshold), it is determined whether the terminal device enters the storage scenario, thereby improving the accuracy of the storage scenario detection.
[0253] S604, whether the ambient light parameter is greater than or equal to the second light threshold?
[0254] If yes, S613 is executed, and if no, S605 is executed.
[0255] When the ambient light parameter is less than the first light threshold, the identification mode is entered; the threshold for exiting the identification mode is the second light threshold, and the second light threshold is greater than the first light threshold, thereby providing a fault tolerance space for the identification algorithm of the storage scenario.
[0256] S605, obtaining folding state information of the terminal device.
[0257] The terminal device can detect whether the foldable screen of the terminal device is folded through a Hall sensor. The non-folded state judgment index is added, the folding state information fed back by the Hall sensor is obtained when the ambient light is suddenly reduced and reaches the feedback value, the folding state information indicates that the terminal device is in a folded state or a non-folded state, and the unfolded state and the hovering state are both regarded as the non-folded state.
[0258] S606, whether the folding state information indicates that the terminal device is in a non-folded state?
[0259] If yes, S607 is performed, and if no, S613 is performed.
[0260] The device reminding method provided in the embodiments of the present application is for the scenario where the foldable screen of the terminal device is not folded, and therefore the folding state information of the terminal device needs to be judged. If the terminal device is in the folded state, no folding reminding is needed, and the identification mode is exited.
[0261] The precondition for entering the storage scenario in the embodiments of the present application includes that the terminal device is in the unfolded state, the ambient light suddenly becomes dark (i.e., the light reduction rate of the ambient light parameter is less than a first rate threshold), and reaches a feedback value (i.e., less than a first light threshold).
[0262] S607, motion data of the terminal device in use is acquired, the motion data including acceleration and angular velocity.
[0263] The terminal device can detect the acceleration of the terminal device through an acceleration (ACC) sensor, and detect the angular velocity of the terminal device through a gyroscope (GY) sensor.
[0264] S608, in the case where the acceleration fluctuation of the terminal device tends to be stable after the detection that the ambient light parameter reflects the change of the environment, the distance between the terminal device and the shielding object is acquired.
[0265] The acceleration and angular velocity before and after the ambient light parameter reflects the change of the environment (for example, the ambient light suddenly drops, the ambient light reaches a feedback value) are acquired. The changes of the acceleration and angular velocity are analyzed.
[0266] Generally, the process that the terminal device is put into a pocket or a bag is as follows: the ambient light suddenly drops below the first light threshold, and is accompanied by that the acceleration sensor X axis, Y axis and Z axis are all in high-amplitude fluctuation, the fluctuation frequency is switched from M0 to M1, M0>M1, that is, the fluctuation frequency is reduced. The amplitude is from K0 to K1, K0 and K1 reflect the amplitudes of different motion rules, for example, from the normal use of the terminal device by the user to the running of the terminal device put into the pocket or bag by the user after the terminal device is put into the pocket or bag, the amplitudes present different change rules. After the ambient light is stable, the acceleration sensor restores small-amplitude fluctuation, for example, the fluctuation frequency is M2, and the maximum peak K2.
[0267] Exemplarily, whether the acceleration X axis and Y axis reach balanced fluctuation, and whether the frequency fluctuation is less than M0 within a period of time (for example, 4s) after the balanced fluctuation is reached, and whether the z axis of the acceleration fluctuation is obvious, for example, whether all are less than M2 within a period of time (for example, 4s) are detected. If yes, it is indicated that the posture of the terminal device is changed, and the terminal device is put into the pocket or bag.
[0268] S609, in the case that the angular velocity fluctuation before and after the change of the ambient light is small, mark an ambient light change event.
[0269] When the change of the angular velocity before and after the change of the ambient light parameter is within the preset range, that is, the angular velocity fluctuation is small, it is indicated that the terminal device is likely to only enter a dark environment and is not put into a pocket or bag. In this scenario, the posture of the terminal device does not change, and the data reflects that the angular velocity does not change too much. Therefore, an ambient light change event is marked.
[0270] For example, whether the angular velocity rule is unchanged can be detected. If the angular velocity fluctuation is small, for example, the fluctuation similarity is less than a threshold G0, it is indicated that the posture of the terminal device does not change, and the terminal device only enters a dark environment.
[0271] S610, obtain the distance between the terminal device and the shielding object.
[0272] The terminal device detects the distance between the terminal device and the shielding object through the distance sensor. The distance between the terminal device and the shielding object can include the distance between the outer screen of the terminal device and the shielding object above the outer screen detected by the near light sensor, and / or the distance between the foldable screen and the shielding object above the foldable screen detected by the ultrasonic sensor.
[0273] S611, determine whether the distance is less than a distance threshold?
[0274] If yes, perform S614, and if no, perform S612 and S613.
[0275] The distance sensor is usually located in the upper half region of the terminal device. In general, the distance light sensor will not be shielded when the user holds the terminal device for normal use. Therefore, in the scenario that the ambient light parameter is less than the first light threshold in the unfolded state, the distance sensor detects that the distance is less than the distance threshold, which is rare. Therefore, whether the terminal device enters the storage scenario can be determined by detecting whether the distance is less than the distance threshold.
[0276] Taking 10 cm as an example, under the condition that the terminal device is in the unfolded state and enters the storage scenario, the ultrasonic sensor of the foldable screen can be used to obtain whether there is an obstacle within 10 cm above the foldable screen. If there is an obstacle within 10 cm above the foldable screen, it indicates that the foldable screen is downward or faces the side. As shown in FIG. 19, FIG. 19 is a schematic diagram of a reminding scenario provided by an embodiment of the present application; taking the scenario that the mobile phone is placed in the bag as an example, FIG. 19A shows the scenario that the mobile phone is placed in the bag with the inner screen (foldable screen) upward, FIG. 19B shows the scenario that the mobile phone is placed in the bag with the inner screen downward, and FIG. 19C shows the scenario that the mobile phone is placed in the bag with the inner screen sideways. In these three scenarios, the device reminding method provided by the embodiment of the present application can remind the user that the terminal device is not folded, thereby reducing the pressure on the foldable screen of the terminal device.
[0277] S612, marking a bag-in event.
[0278] When it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light drops sharply, the ambient light reaches the feedback value, and the acceleration fluctuation of the terminal device tends to be stable, it is possible that the terminal device is placed in the pocket or bag, but the outer screen of the terminal device faces downward, the foldable screen faces upward, or the upper side of the foldable screen is far away from the obstacle, so the distance greater than or equal to the distance threshold is detected. Based on this, a bag-in event is marked.
[0279] S613, exiting the identification mode.
[0280] When the folding state information indicates that the terminal device is in the folded state, the identification mode is exited. When the distance is greater than or equal to the distance threshold, the bag-in event is marked and the identification mode is exited. When the ambient light parameter is greater than or equal to the second light threshold, the identification mode is exited. The steps of obtaining the folding state information, motion data, and distance between the terminal device and the obstacle are no longer performed, thereby reducing power consumption.
[0281] S614, determining that the ambient light parameter is less than the first light threshold, the distance is less than the distance threshold, and the fluctuation is stable for a continuous duration in the unfolded state.
[0282] S615, determining whether the continuous duration is greater than or equal to a preset duration.
[0283] If yes, S616 and S617 are performed. If no, S604 is performed.
[0284] If the continuous duration reaches or exceeds the preset duration (i.e., is equal to or greater than the preset duration), it indicates that the user places the unfolded terminal device in the pocket or bag, and the current scenario is identified as the terminal device being in the unfolded state and entering the storage scenario, thereby marking a reminding event and performing folding reminding.
[0285] It should be noted that by simulating the user behavior in the scene, the user will lock the terminal device in the common scene, and then put it into the pocket or bag, or with a small probability, put it into the pocket or bag when the terminal device is on screen (in the unlocked state). Based on this, the application embodiment can also obtain whether the user has a lock screen action (that is, whether the screen state of the terminal device is a lock screen state) before the ambient light drops, to assist in determining whether the terminal device enters the storage scene.
[0286] The judgment condition of the lock screen state can be at any stage, as long as it is before S616, and when determining the duration, it is necessary to determine the duration that the ambient light parameter is less than the first light threshold, the distance is less than the distance threshold, and the fluctuation is stable in the non-folded state and the lock screen state. By adding the judgment condition of whether in the lock screen state, it is more in line with the user's habits, and the accuracy of identifying the storage scene is improved.
[0287] S616, mark a reminder event.
[0288] In the case that the terminal device is in a non-folded state, put into a pocket or bag, and the duration that the distance is less than the distance threshold is greater than the preset duration, mark a reminder event and remind the user.
[0289] S617, fold reminder.
[0290] Remind the user through voice or card that the terminal device in the non-folded state is placed in the pocket or bag, which may cause wear and tear / nicking to the flexible inner screen.
[0291] The application embodiment focuses on using the terminal device itself sensor data to construct a scene model used by the user, the scene model is used to identify the storage scene, and according to the scene model, it is determined whether the terminal device enters the storage scene. For the case of entering the storage scene and the non-folded state, report big data (that is, mark a reminder event). Further, the user's behavior habits can be analyzed by dotting the big data, different folding reminder strategies can be developed, and according to the folding reminder strategy, the folding reminder can be pushed to the user in the next preset period, guiding the user to reduce the behavior of putting the foldable screen into the pocket or bag without folding.
[0292] Based on the device reminding method and the marking event (i.e., the dotting event) shown in FIGS. 8-19, a specific example is listed to illustrate the dotting timing. Exemplarily, a mobile phone is taken as the terminal device, and a dot is taken as the mark to illustrate the dotting in the embodiments of the present application. The dotting process of a user P is as follows: the user P gets on a vehicle at 8:00 in the morning, and uses the mobile phone in an unfolded state in the vehicle. The mobile phone is always in a handheld state. At 9:30, the user P arrives at the company, and then puts the mobile phone in a pocket in an unfolded state after turning off the screen. At this time, the scenario of the non-folded state, the dark light, and the camera of the terminal device facing downward is met. At 10:00, the user P takes out the mobile phone, and then turns on the screen and unlocks the mobile phone. At 10:20, the user P returns to the work position, and then continues to put the mobile phone in the pocket in an unfolded state. At this time, the scenario of the non-folded state, the dark light, and the camera of the terminal device facing upward is met. The user P works until 12:00, and then goes downstairs to have lunch. At 13:00, the user P returns to the work position, and then wants to rest at the work position. After watching the mobile phone, the user P turns on the inner screen, and then buckles the inner screen on the desktop in an unfolded state. At this time, the scenario of the non-folded state and the terminal device being flipped is met. Then, the user P rests until 14:00. In the example, a, 9:30 triggers the pocket mode, and enters the storage scenario. The triggering time is recorded. b, 10:00 triggers the pocket exit mode. The exit time is recorded. c, 10:20 is put into the pocket. The triggering time is recorded. d, 12:00 is taken out of the pocket. The exit time is recorded. e, 13:00 is unfolded and placed on the desktop. The triggering time is recorded. f, the exit time 14:00 is recorded. The dotting times in the example include three times, wherein a to b dot 1 time, c to d dot 1 time, and f to e dot 1 time. The time is (b-a)+(d-c)+(f-e).
[0293] In the embodiments of the present application, if the terminal device is put into a pocket or a bag in a non-folded state, a pop-up reminding service is triggered, for example, a folding reminding information is displayed in a text form, or a voice is broadcasted for reminding, and the like. It can be judged that the terminal device adopts the device reminding method provided in the embodiments of the present application. Further, the log can be captured according to the reminding push logic to judge whether the judgment logic and the threshold in the reminding algorithm provided in the embodiments of the present application are adopted.
[0294] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general purpose computer, a special purpose computer, a computer network or other programmable apparatus. The computer instructions can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, such as the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium accessible by a computer, or a data storage device such as a server, data center, etc. integrated with one or more available media. The available media can be magnetic media (such as floppy disk, hard disk, magnetic tape), optical media (such as digital versatile disc (DVD)) or semiconductor media (such as solid state disk (SSD)) and the like.
[0295] The above is an optional embodiment provided by the present application, and is not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the technical scope disclosed by the present application shall be included in the protection scope of the present application.
Claims
1. A device reminding method characterized by, The method is applied to a terminal device with a foldable screen, and the method comprises: In a case where the terminal device is in a non-folded state and enters a storage scenario, a folding reminder is performed to remind a user to fold and store the terminal device, the storage scenario including a scenario of being placed in a pocket or bag.
2. The method of claim 1, wherein, The folding reminder comprises: displaying a first interface, the first interface comprising a card, the card comprising folding reminder information for reminding the user to fold and store the terminal device and a first function control; after the folding reminder is performed, the method further comprises: in response to a touch operation on the first function control, the card is hidden.
3. The method of claim 2, wherein, The card further comprises a second function control, and the method further comprises: in response to a touch operation on the second function control, a second interface is displayed, the second interface comprising relevant information of the foldable screen, the relevant information comprising screen maintenance information or screen repair information.
4. The method according to any one of claims 1 to 3, characterized in that, Before the folding reminder is performed, the method further comprises: obtaining folding state information of the terminal device and ambient light parameters of an environment in which the terminal device is located, the folding state information being used to indicate whether the terminal device is in a folded state or a non-folded state; in a case where it is detected that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameters reflect that the environment has changed, determining a duration in which the ambient light parameters of the terminal device in the non-folded state are less than a first light threshold; wherein the ambient light parameters reflecting that the environment has changed comprises that a light reduction rate of the ambient light parameters is greater than a first rate threshold and / or the ambient light parameters are less than the first light threshold; in a case where the duration is greater than or equal to a preset duration, determining that the terminal device enters the storage scenario.
5. The method of claim 4, wherein, The determination of the duration in which the ambient light parameters of the terminal device in the non-folded state are less than the first light threshold in the case where it is detected that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameters reflect that the environment has changed comprises: in the case where it is detected that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameters reflect that the environment has changed, obtaining a distance between the terminal device and an occlusion; determining the duration in which the ambient light parameters of the terminal device in the non-folded state are less than the first light threshold and the distance is less than a distance threshold.
6. The method of claim 4, wherein, The determination of the duration in which the ambient light parameters of the terminal device in the non-folded state are less than the first light threshold in the case where it is detected that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameters reflect that the environment has changed comprises: in the case where it is detected that the folding state information indicates that the terminal device is in the non-folded state and the ambient light parameters reflect that the environment has changed, obtaining motion data of the terminal device in a use process; the motion data comprising acceleration; determine a duration that the ambient light parameter of the terminal device in the unfolded state is less than a first light threshold and the motion data reflects that a posture of the terminal device fluctuates; wherein the motion data reflecting that the posture of the terminal device fluctuates comprises that a frequency of a second acceleration decreases compared with a first acceleration and a change rule of an amplitude changes; the first acceleration is an acceleration of the terminal device before the ambient light parameter reflects that the environment changes, and the second acceleration is an acceleration of the terminal device after the ambient light parameter reflects that the environment changes.
7. The method of claim 4, wherein, The determining, in the case that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, a duration that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold comprises: In the case that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, obtaining a screen state of the terminal device; determining a duration that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold and the screen state is a lock screen state.
8. The method of claim 4, wherein, The method further comprises, before the determining, in the case that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, a duration that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold: obtaining a distance between the terminal device and an occlusion, motion data of the terminal device in a use process, and a screen state of the terminal device; The determining, in the case that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes, a duration that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold comprises: determining a duration that the ambient light parameter of the terminal device in the unfolded state is less than the first light threshold, the distance is less than a distance threshold, the posture of the terminal device fluctuates, and the screen state is the lock screen state, in the case that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter reflects that the environment changes, the distance is less than the distance threshold, the motion data reflects that the posture of the terminal device fluctuates, and the screen state is the lock screen state.
9. The method according to any one of claims 4 to 8, wherein, The method further comprises: starting an identification mode to determine the duration, in the case that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameter reflects that the environment changes; quitting the identification mode, in the case that the duration is less than the preset duration and the ambient light parameter is greater than or equal to a second light threshold; the second light threshold is greater than the first light threshold.
10. The method of any one of claims 5-8, wherein, The distance between the terminal device and the shelter includes a distance between an outer screen of the terminal device and a shelter above the outer screen, and / or a distance between the foldable screen and a shelter above the foldable screen. The outer screen refers to a display screen on the terminal device other than the foldable screen, and the outer screen and the foldable screen are opposite in light-out direction in the unfolded state.
11. The method of any one of claims 1, 4-10, wherein, The folding reminder is in any one or any combination of at least two of the following forms: voice, vibration, flashing, text.
12. The method of any one of claims 1-11, wherein, The method further includes: Obtaining a number of marks of a preset event in a preset period; the preset event includes at least one of a reminder event, an ambient light change event, a device flip event, an in-bag event, a night device stationary event, and a night device carrying motion event; Determining a folding reminder strategy according to the number of marks; According to the folding reminder strategy, determining a reminder mode for folding reminder in the next preset period.
13. The method of claim 12, wherein, The folding reminder includes: In a case where it is detected that the terminal device is in the unfolded state and enters the storage scene, marking the reminder event once and performing folding reminder.
14. The method of claim 12, wherein, The method further includes: Obtaining folding state information of the terminal device, ambient light parameters of an environment in which the terminal device is located, a distance between the terminal device and a shelter, and motion data of the terminal device in use; In a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameters reflect that the environment has changed, the motion data reflects that the posture of the terminal device fluctuates, and the distance is greater than or equal to a distance threshold, marking the in-bag event once; Or, in a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameters reflect that the environment has changed, and the motion data reflects that the terminal device is inverted, marking the in-bag event once.
15. The method of claim 12, wherein, The method further includes: Obtaining folding state information of the terminal device and ambient light parameters of an environment in which the terminal device is located; In a case where it is detected that the folding state information indicates that the terminal device is in the unfolded state and the ambient light parameters reflect that the environment has changed, obtaining motion data of the terminal device in use; the motion data includes angular velocity; In a case where it is detected that the change of the angular velocity before and after the ambient light parameters reflect that the environment has changed is within a preset range, marking the ambient light change event once.
16. The method of claim 12, wherein, The method further includes: Obtaining folding state information of the terminal device, ambient light parameters of an environment in which the terminal device is located, and motion data of the terminal device in use; the motion data includes angular velocity; In a case where the folding state information indicates that the terminal device is in the unfolded state, the light reduction rate of the ambient light parameter is greater than the second rate threshold, and the amplitude of the angular velocity is reversed before and after the light reduction rate of the ambient light parameter is greater than the second rate threshold, the device overturning event is marked once; wherein the second rate threshold is less than the first rate threshold.
17. The method of claim 12, wherein, The method further comprises: obtaining folding state information of the terminal device, an ambient light parameter of an environment in which the terminal device is located, and motion data of the terminal device during use; the motion data includes acceleration and angular velocity; In a case where the folding state information indicates that the terminal device is in the unfolded state, the ambient light parameter does not change, and the amplitude variation law of the acceleration and the amplitude variation law of the angular velocity both satisfy a change to no change, and the holding time of no change is greater than a preset stationary time, the night device stationary event is marked once; In a case where the folding state information of the terminal device, the ambient light parameter does not change, and the amplitude variation law of the acceleration and the amplitude variation law of the angular velocity both experience three distribution laws, the night carrying device motion event is marked once.
18. A terminal device, comprising: The terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is executed by the processor to implement the method of any one of claims 1-17.
19. A computer-readable storage medium, characterized in that, The computer readable storage medium stores instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-17.
20. A computer program product comprising instructions, characterized in that, When executed on a computer, it causes the computer to perform the method of any one of claims 1-17.
Citation Information
Patent Citations
Scene mode starting method and device and terminal
CN107888769A
Screen display control method, foldable terminal and computer-readable storage medium
CN109639879A
Folding screen terminal control method and device and electronic equipment
CN111049953A
Message reminding method, message reminding apparatus and mobile terminal
CN112689975A
Display method for folding screen, and related device
WO2024001900A1