Folding screen foreign matter detection method, electronic equipment and storage medium

Abstract

The invention discloses a folding screen foreign matter detection method, electronic equipment and a storage medium, relates to the technical field of terminals, and can conveniently and timely detect foreign matters on the surface of a screen by identifying capacitance value characteristics on the screen in the folding process of the folding screen. Specifically, when the folding screen is switched from the unfolded state to the folded state, touch information on the folding screen can be obtained; wherein the touch information comprises the position and the capacitance value of the touch point. Under the condition that the first screen and the second screen have the touch control area which is large in capacitance value and is symmetrical based on the folding shaft, and / or under the condition that the rotating shaft area of the folding shaft comprises the touch control area with the large capacitance value, it is indicated that the foreign matter exists, foreign matter reminding can be carried out, and therefore adverse effects caused by the foreign matter are avoided or reduced.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a method for detecting foreign objects in a foldable screen, an electronic device, and a storage medium. Background Technology

[0002] Compared to traditional screens, foldable screens are flexible and bendable, making them increasingly popular in portable electronic devices such as smartphones and tablets, hence the name foldable devices. For example, foldable phones have been a major trend in consumer electronics in recent years. Currently, foldable devices can be categorized into those with screens folding outwards (hereinafter referred to as "outward-folding devices") and those with screens folding inwards (hereinafter referred to as "inward-folding devices").

[0003] Both outward-folding and inward-folding devices can fold a screen into at least two screens during folding. The difference lies in the fact that with inward-folding devices, the two screens face each other, and the gap between the screens gradually decreases with each fold. Therefore, if there are foreign objects on the screen of an inward-folding device during folding, it can have adverse effects. For example, if there are hard foreign objects such as screws or metal shavings, it may cause screen deformation or damage, rendering the screen unusable. Another example is when a user's finger gets caught in the folded screen during folding.

[0004] Therefore, it is necessary to propose a solution that can detect and identify foreign objects on foldable screens in order to mitigate the adverse effects generated during the folding process. Summary of the Invention

[0005] This application provides a method for detecting foreign objects in a foldable screen, an electronic device, and a storage medium to mitigate or avoid adverse effects during the folding process.

[0006] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0007] Firstly, this application provides a foreign object detection method for foldable screens, applied to electronic devices including foldable screens. The foldable screen can be folded along a folding axis into a first screen and a second screen. When the foldable screen is in a folded state, the first screen and the second screen face each other, and the display surfaces of the first screen and the second screen are not visible to the user. The electronic device can acquire touch information on the foldable screen when the foldable screen switches from an unfolded state to a folded state; wherein, the touch information includes the position and capacitance value of the touch point. After creative effort, the inventors of this application discovered that after the screen is folded to a certain extent, a foreign object will come into contact with the two screens of the inner screen, and the two positions where the foreign object comes into contact are generally symmetrical about the folding axis. Therefore, the electronic device can accurately determine the presence of a foreign object on the screen after detecting two touch areas symmetrical about the folding axis (i.e., a first touch area and a second touch area, where the first touch area includes a first touch point with a capacitance value greater than a first capacitance threshold, and the second touch area includes a second touch point with a capacitance value greater than the first capacitance threshold; or, the sum of the capacitance values ​​of the first touch area and the second touch area is greater than the second capacitance threshold). Furthermore, the inventors of this application discovered through research that foreign objects easily fall into the hinge area during screen folding. Therefore, by detecting the hinge area of ​​the folding hinge, which includes a third touch area with a capacitance value greater than the third capacitance threshold, the presence of foreign objects on the screen can be accurately determined. Consequently, electronic devices can conveniently and accurately provide foreign object alerts.

[0008] In the above solution, when the foldable screen switches from unfolded to folded state, the presence of foreign objects on the surface of the foldable screen can be easily identified based on the capacitance value in the foldable screen, and a foreign object warning can be issued without the need to set up some additional hardware components. Thus, the impact of foreign objects on the foldable screen during the folding process can be avoided or reduced while saving hardware costs.

[0009] Furthermore, the above method can accurately determine whether there are foreign objects on the screen, thus improving the accuracy of foreign object detection.

[0010] In one possible implementation of the first aspect, the electronic device can trigger the acquisition of touch information on the folding screen when the folding screen switches from an unfolded state to a folded state and the angle between the display surfaces of the first screen and the second screen is less than a preset angle threshold.

[0011] In the above solution, triggering the acquisition of touch information for foreign object detection after the object has been folded to a certain extent can determine a more accurate triggering time for foreign object detection and reduce the waste of system resources caused by unnecessary detection.

[0012] In one possible implementation of the first aspect, the electronic device acquires a first touch point on a first screen and a second touch point on a second screen; wherein the capacitance value of the first touch point is greater than a first capacitance threshold, and the capacitance value of the second touch point is greater than the first capacitance threshold. Further, if there is a first touch area including the first touch point and a second touch area including the second touch point, a foreign object warning is issued; wherein the positions of the first touch area and the second touch area are symmetrical about a folding axis.

[0013] In the above scheme, the information of the touch point is first obtained, and then the touch area is determined based on the touch point. In the case of two touch areas that are axially symmetrical and have a high capacitance, the presence of a foreign object is accurately determined, and then a foreign object warning is issued.

[0014] In one possible implementation of the first aspect, after a touch point is detected, in order to perform the detection more accurately, the touch point area can be expanded. Specifically, a first touch area is obtained by expanding a first preset range based on the first touch point; a second touch area is obtained by expanding a second preset range based on the second touch point; if the positions of the first touch area and the second touch area are symmetrical about the folding axis, then a foreign object warning is issued.

[0015] In the above scheme, after expanding the area of ​​touch points with high capacitance (greater than the first capacitance threshold), axisymmetric recognition is performed, which can improve the recognition accuracy and enable more accurate foreign object recognition and alerts in the future.

[0016] In one possible implementation of the first aspect, the first touch area and the second touch area are contained within the pivot area of ​​the folding axis.

[0017] In the above scheme, symmetrical point identification can also be performed within the rotation axis area, rather than being limited to non-rotation axis areas, which greatly improves applicability.

[0018] In one possible implementation of the first aspect, the electronic device can obtain that the first screen includes a first touch area and the second screen includes a second touch area, and then determine a first capacitance range corresponding to the capacitance values ​​of the first touch point and the second touch point; and provide a foreign object reminder according to the reminder method corresponding to the first foreign object type; wherein, the electronic device has multiple preset capacitance ranges, each capacitance range corresponds to a foreign object type, and each foreign object type is set with a corresponding reminder method; the first foreign object type corresponds to the first capacitance range.

[0019] The above solution can accurately identify the type of foreign object by using the capacitance value of the touch point based on the correspondence between the preset capacitance range and the type of foreign object, and then provide more accurate foreign object reminders according to the type of foreign object.

[0020] In one possible implementation of the first aspect, the switching of the foldable screen from an unfolded state to a folded state includes: detecting a change in the angle between the display surfaces of the first screen and the second screen from large to small.

[0021] In the above solution, the electronic device can conveniently and accurately identify whether the foldable screen is folded by detecting the change in the angle between the display surfaces of the first screen and the second screen, thereby triggering foreign object detection more accurately.

[0022] In one possible implementation of the first aspect, the electronic device may further control the folding screen to stop switching to the folded state or reduce the speed at which the folding screen switches to the folded state when it obtains that the first screen includes a first touch area and the second screen includes a second touch area.

[0023] In the above solution, when two touch areas on the two screens with capacitance values ​​greater than the first capacitance threshold and axial symmetry are obtained during the folding process, not only can foreign object alerts be issued, but the folding screen can also be controlled. For example, the folding screen can be controlled to stop switching to the folded state or the speed of switching to the folded state can be reduced, thereby avoiding or reducing the adverse effects caused by subsequent folding.

[0024] In one possible implementation of the first aspect, controlling the folding screen to stop switching to the folded state includes: controlling the folding axis to lock; or, activating a resistance device to generate resistance in a second direction to counteract the force of the folding axis, causing the first screen and the second screen in the folding screen to stop relative movement; or, generating resistance in a second direction greater than the force of the folding axis through the resistance device, causing the folding screen to return to the unfolded state; wherein the second direction is opposite to the first direction of the force of the folding axis.

[0025] In the above solution, by controlling the folding axis to lock or by generating the opposite resistance through a resistance device to counteract the force of the folding axis, the folding screen stops or nearly stops folding. Alternatively, by generating a resistance in the opposite direction that is greater than the force of the folding axis to counteract the force of the folding axis, the folding screen returns to its unfolded state. This solution can avoid or mitigate the adverse effects caused by the screen continuing to fold after foreign objects are detected.

[0026] In one possible implementation of the first aspect, a resistance device is activated to generate resistance in the second direction that is less than the force of the folding axis, thereby reducing the speed at which the foldable screen switches to the folded state. That is, after detecting a foreign object, the force or intensity of subsequent folding can be reduced to mitigate the adverse effects of the foreign object on the foldable screen.

[0027] Secondly, this application provides an electronic device comprising at least: a foldable screen, a memory, and one or more processors. The foldable screen can be folded into a first screen and a second screen. The foldable screen is used to display images, and the memory is used to store computer instructions, which, when executed by the one or more processors, cause the electronic device to perform the method described in any of the first aspects above.

[0028] Thirdly, this application provides a chip system applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform any of the methods described in the first aspect above.

[0029] Fourthly, this application provides a computer storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the method described in any of the first aspects.

[0030] Fifthly, this application provides a computer program product that, when run on a computer, causes the computer to perform any of the methods described in the first aspect. Attached Figure Description

[0031] Figure 1 A schematic diagram of the outward folding device provided in the embodiments of this application;

[0032] Figure 2 This is a schematic diagram of an inward folding device provided in an embodiment of this application;

[0033] Figure 3 A schematic diagram of another inward folding device provided in an embodiment of this application;

[0034] Figure 4 This is a schematic diagram of a vertical folding device provided in an embodiment of this application;

[0035] Figure 5 A schematic diagram illustrating the folding process of the inward folding device provided in an embodiment of this application;

[0036] Figure 6 A schematic diagram illustrating the adverse effects of the folding process provided in the embodiments of this application;

[0037] Figures 7 to 9 This is a schematic diagram illustrating the change in capacitance caused by the presence of a foreign object in an embodiment of this application.

[0038] Figure 10 A schematic diagram illustrating the included angle of a display surface provided in an embodiment of this application;

[0039] Figure 11A schematic diagram illustrating the supplementary angle of the included angle of a display surface provided in an embodiment of this application;

[0040] Figure 12 A schematic diagram of symmetrical positions provided for embodiments of this application;

[0041] Figures 13A to 13B A schematic diagram illustrating a method for determining a symmetrical position according to an embodiment of this application;

[0042] Figures 14A to 14B A schematic diagram illustrating another method for determining symmetrical positions provided in an embodiment of this application;

[0043] Figure 15 This is a schematic diagram of the rotating shaft area provided in an embodiment of this application;

[0044] Figure 16 This is a schematic diagram of a foreign object sliding into the pivot area according to an embodiment of this application;

[0045] Figure 17 This is a schematic diagram illustrating the change in capacitance of the pivot area caused by a foreign object sliding into it, as provided in an embodiment of this application.

[0046] Figures 18 to 21 A schematic diagram illustrating four foreign object alert schemes provided in the embodiments of this application;

[0047] Figure 22 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0048] Figure 23 This is a schematic diagram of the software system structure of an electronic device provided in an embodiment of this application;

[0049] Figure 24 A flowchart illustrating a foreign object detection method for a foldable screen provided in an embodiment of this application;

[0050] Figure 25 A flowchart illustrating another foreign object detection method for foldable screens provided in this application embodiment;

[0051] Figure 26 A flowchart illustrating another foreign object detection method for foldable screens provided in this application embodiment;

[0052] Figure 27 A simplified flowchart illustrating a foreign object detection method for a foldable screen provided in this application embodiment;

[0053] Figure 28 This is a flowchart illustrating another foreign object detection method for foldable screens provided in an embodiment of this application. Detailed Implementation

[0054] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. In the description of the embodiments, unless otherwise stated, "multiple" means two or more.

[0055] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. The terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more of that feature.

[0056] In the embodiments of this application, the words "exemplary," "for example," or "for instance" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplary," "for example," or "for instance" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of the words "exemplary," "for example," or "for instance" is intended to present the relevant concepts in a specific manner.

[0057] To facilitate understanding, some knowledge involved in the embodiments of this application will be introduced below.

[0058] Foldable screens: These are flexible screens with excellent flexibility and the ability to be bent and folded, making them suitable for use in electronic devices. Based on this characteristic, electronic devices with foldable screens can be folded for use. For simplicity, electronic devices with foldable screens will be simply referred to as electronic devices below. When an electronic device is folded, the foldable screen is typically folded into multiple (at least two) screens based on a folding axis (also called a "hinge").

[0059] It should be understood that electronic devices can be classified into different categories based on different dimensions. The specific categories are as follows:

[0060] Based on the number of screens that can be folded into, electronic devices can be at least divided into: bi-fold devices and electronic devices with more than two folds. A bi-fold device refers to an electronic device that folds its screen to form two screens (i.e., a first screen and a second screen). Electronic devices with more than two folds refer to electronic devices that fold their screen to form more than two screens, such as tri-fold devices and quadruple-fold devices.

[0061] It should be understood that the electronic device in the embodiments of this application may be a bi-fold device or an electronic device with more than two folds. For ease of description, the following embodiments of this application use a bi-fold device as an example for illustration, but it does not limit the methods in the embodiments of this application to be applicable to electronic devices with more than two folds.

[0062] II. Based on the direction in which they can be folded, electronic devices can be classified into at least two categories: outward-folding devices and inward-folding devices.

[0063] (a) Outward folding device:

[0064] For example, please refer to the bi-fold outward folding device. Figure 1 When the outward folding device 100 is in the unfolded state, the first screen 101a and the second screen 101b of the folding screen 101 are close to the same plane, and their display surfaces constitute a large screen. Figure 1 The A and B sides in the diagram represent the display surfaces of the first screen 101a and the second screen 101b, respectively. The display surface refers to the side of the first screen 101a and the second screen 101b used to present content to the user. Figure 1 The bracket state shown refers to the intermediate state between the unfolded and folded states, with the arrow indicating the folding direction. From Figure 1 It can be seen that the two-fold outward folding device 100 is completely folded (i.e. Figure 1 In the folded state (also known as the closed state), the display surfaces of the first screen 101a and the second screen 101b—that is, surface A and surface B—are opposite to each other and both are visible to the user. It should be noted that due to the angle, Figure 1Only the B-side in the folded state is shown; the A-side is not shown.

[0065] (ii) Inner folding device:

[0066] For example, please refer to the bi-fold inward folding device. Figure 2 When the inward folding device 200 is folded, the folding screen 201 is folded to form a first screen 201a and a second screen 201b. To distinguish the display surface of the screen from the back surface, in... Figure 2 In this design, the display surfaces of the first screen 201a and the second screen 201b of the inward-folding device 200 are represented by surfaces C and D, respectively, and the back of the screens are filled with a pattern. The display surfaces of the first screen 201a and the second screen 201b refer to the sides of the first screen 201a and the second screen 201b used to present content to the user. For example... Figure 2 As shown, in the unfolded state, the first screen 201a and the second screen 201b are nearly on the same plane, forming a large screen. When folded along the arrow and in the folded state (i.e., fully closed), the display surface C of the first screen 201a and the display surface D of the second screen 201b are both invisible to the user.

[0067] In some embodiments, please refer to Figure 3 In addition to the folding screen 201, the inward-folding device 200 may also include a third screen 202, which is disposed behind the first screen 201a or the second screen 201b of the folding screen 201. The display surface of the third screen 202 is denoted by E. When the folding screen 201 is in the folded state (i.e., the closed state), the display surfaces C of the first screen 201a and D of the second screen 201b are no longer visible to the user, and the display surface E of the third screen 202 of the inward-folding device 200 is used to present content to the user. Therefore, the third screen 202 can also be called the "outer screen," and the folding screen 201 can be called the "inner screen."

[0068] In some embodiments, based on the folding method of the inward folding device, the inward folding device can be further divided into: vertically folding inward folding devices (hereinafter referred to as vertically folding devices) and horizontally folding inward folding devices (hereinafter referred to as horizontally folding devices). The above... Figure 2 or Figure 3 The image shows a horizontally folding device, that is, an electronic device whose screen folds horizontally. A vertically folding device refers to an electronic device whose screen folds vertically, such as... Figure 4As shown, for the vertically folding device 400, in the unfolded state, the first screen 401a and the second screen 401b face the user for use. In the stand state, the first screen 401a and the second screen 401b are folded inwards. Subsequently, the third screen 402, which was originally located behind the first screen 401a or the second screen 401b, can then display content to the user. The methods in the various embodiments of this application can be applied to any type of inwardly folding device, such as vertically folding or horizontally folding devices.

[0069] It should be understood that for inward-folding devices, during the folding process, the display surfaces of the first and second screens gradually approach each other; that is, the angle between the display surfaces of the first and second screens continuously decreases. Now, in conjunction with... Figure 5 The folding process of the inward folding device will be explained in more detail. To facilitate a more intuitive understanding of the continuously decreasing angle between the display surfaces, Figure 5 This is illustrated from the side of the screen (i.e., a side view). For example... Figure 5 As shown, the foldable screen includes a first screen 501 and a second screen 502. During the folding process, the angle between the first screen 501 and the second screen 502 decreases from θ1 to θ2, thereby causing the display surfaces of the first screen 501 and the second screen 502 to gradually approach each other.

[0070] In some embodiments, the angle between the display surfaces of the first screen and the second screen can range from (0° to 180°). When the angle is equal to or close to 180°, it is in the unfolded state. The folding process is a process of gradually decreasing the maximum angle of 180°. When the angle is close to 0°, the folded state, i.e., the closed state, can be achieved.

[0071] As mentioned above, Figure 5 When the device is folded, the display surfaces of the first and second inner screens will face each other and gradually move closer together. It should be understood that... Figure 5 The middle screen has a three-dimensional structure with two sides. 501 and 502 indicate the display surfaces of the first and second screens, respectively. In this case, the presence of foreign objects on either screen (either the first or the second screen) will have adverse effects.

[0072] The following will explain the adverse effects of foreign objects during the folding process. For example, Figure 6 As shown in (a), there are metal fragments on the second screen 502, which are not easily noticed by the user. The metal fragments are shown in the dashed box 503. Therefore, as... Figure 6As shown in (b), when the device is closed or folded to a certain extent, metal fragments can damage the first screen 501 and the second screen 502. For example, when closing the inward-folding device, fingers may be accidentally pinched, especially when a young child is using the phone; such accidental pinching of a finger can have a significant impact on a young child.

[0073] To avoid the aforementioned adverse effects such as screen damage or finger pinching when using inward-folding devices, there are currently two related solutions (i.e., Solution 1 and Solution 2):

[0074] Solution 1: Install a pressure sensor below the screen to detect foreign objects on the screen surface. If there is a foreign object on the screen surface, it will exert pressure on the screen. Therefore, the electronic device uses the pressure sensor to detect the pressure and determine whether there is a foreign object on the screen based on the detected pressure.

[0075] In the aforementioned solution 1, a pressure sensor needs to be specially installed in the electronic device to achieve foreign object detection, which will increase the hardware cost accordingly.

[0076] Solution 2: Use in-display fingerprint technology such as optical fingerprint / ultrasonic fingerprint to detect foreign objects in a designated area on the screen.

[0077] Specifically, the under-display fingerprint module is placed below a designated area of ​​the screen, allowing it to capture images. The electronic device can then analyze the captured images to determine if any foreign objects are present in that designated area.

[0078] The aforementioned Solution 2 has the following problems:

[0079] Question 1: An additional under-display fingerprint module needs to be specially set up in the electronic device to perform foreign object detection, which also has the problem of increased hardware cost mentioned in Solution 1.

[0080] Question 2: Screen fingerprint modules are usually set in a designated area, so they can only detect foreign objects in the designated area and cannot detect foreign objects in non-designated areas, which is too limiting.

[0081] Question 3: If the above-mentioned solution 2 is to expand the foreign object detection range, it is necessary to add a sufficient number of screen fingerprint modules or set up screen fingerprint modules with a larger coverage area. For example, if electronic devices are to support full-screen fingerprint recognition and use screen fingerprint modules to detect foreign objects on the entire screen, a sensor array that can cover the entire screen is required, which will further increase the hardware cost.

[0082] In summary, both Solution 1 and Solution 2 suffer from excessively high hardware costs.

[0083] To address the aforementioned issues, this application provides a method for detecting foreign objects on a foldable screen, applicable to inward-folding devices. This method eliminates the need for additional pressure sensors or under-display fingerprint modules, enabling the detection of foreign objects on the surface of the foldable screen during the folding process, thus saving hardware costs.

[0084] Specifically, the foldable screen in each embodiment of this application is a capacitive touchscreen. During the folding process of the foldable screen, the presence of foreign objects on the surface of the foldable screen is identified based on the change in capacitance, so as to avoid or reduce the impact of foreign objects on the foldable screen during the folding process. Similarly, for the sake of brevity, "inner folding device" will be uniformly referred to as "electronic device" in the following text.

[0085] To facilitate understanding of the technical solutions in the embodiments of this application, the capacitive touchscreen and its working principle are described below:

[0086] Capacitive touch screen: It is a four-layer composite glass screen. The inner surface and interlayer of the glass screen are each coated with a layer of ITO (Indium Tin Oxide). The outermost layer is a thin layer of silica glass for protection. The interlayer ITO layer serves as the working surface, with four electrodes leading out from the four corners. The inner ITO layer is a shielding layer to ensure a good working environment.

[0087] The working principle of a capacitive touchscreen is as follows:

[0088] The conductive material in the ITO layer forms an invisible electrostatic mesh within the screen. This mesh consists of multiple rows of X-axis electrodes and multiple columns of Y-axis electrodes, creating a capacitor between the electrodes. When the capacitive touchscreen is working, the X-axis electrodes emit an AC signal. This AC signal can pass through the capacitor, meaning it can be sensed along the Y-axis. As the AC current passes through, the capacitor undergoes a charging and discharging process; detecting this charging time reveals the capacitance. When a charged object (or a "conductive object") touches the capacitive touchscreen, it affects the coupling between the two electrodes near the touch point, thus changing the capacitance between them. If a change in capacitance or capacitance value is detected at a certain location, a touch action can be detected at that location.

[0089] Based on the working principle of capacitive touchscreens, it is known that if a conductive object comes into contact with the surface of a capacitive touchscreen, it will cause a change in the capacitance value of the touchscreen. Therefore, the foreign object detected and identified in this application embodiment refers to a conductive object, which can be simply referred to as a conductive foreign object. If a conductive foreign object exists on the surface of a foldable screen (foldable capacitive screen), it will cause a change in the capacitance value on the screen. Therefore, this application embodiment identifies foreign objects on the surface of the foldable screen by considering the change in capacitance value during the folding process.

[0090] Generally, if a conductive foreign object is present on a foldable screen, it will generate touch information on the screen. Therefore, in this embodiment, during the transition of the foldable screen from an unfolded state to a folded state, the electronic device can acquire the touch information on the foldable screen in real time; wherein, the touch information includes the position and capacitance of the touch point. The presence of a foreign object on the screen is determined by at least one of the following methods.

[0091] Method 1:

[0092] Under normal circumstances, when a foldable screen is folded to a certain angle, a conductive foreign object may come into contact with the two screens of the foldable screen (i.e., the first screen and the second screen), thus generating touch information on the first screen and the second screen.

[0093] Therefore, if two touch points based on the folding axis are found on the first and second screens of the folding screen, and the capacitance values ​​of the two touch points meet the preset conditions, it is determined that there is a foreign object on the screen.

[0094] Method 2:

[0095] In some cases, conductive foreign objects may also be present in the hinge area of ​​the folding hinge, thus generating touch information in the hinge area. Therefore, electronic devices can determine the presence of a foreign object on the screen if they detect a touch point or touch area with a capacitance value greater than a preset capacitance threshold within the hinge area. The hinge area refers to the screen area near the folding hinge, such as the screen area within a preset range around the folding hinge.

[0096] For example, conductive foreign objects may include metal shavings, screws, or fingers. For ease of understanding, the following is combined with... Figures 7 to 9 This illustration demonstrates the capacitance change caused by a foreign object on the surface of a foldable screen. A capacitive touchscreen can be understood as a screen comprising multiple capacitance detection points arranged sequentially and covering the entire touchscreen. The size of each capacitance detection point can be the smallest touch point that the capacitive touchscreen can detect, and each detection point represents a position on the screen. In specific implementations, a capacitive foldable screen may not have fixed capacitance detection points, or the concept of capacitance detection points may not be defined. The embodiments of this application propose a capacitive touchscreen comprising multiple sequentially arranged capacitance detection points, which is only used to better illustrate the solution provided in this application and should not be construed as a limitation of this application. Figures 7 to 9 The folding screen shown includes multiple capacitance detection points (i.e., small square grids).

[0097] It should be noted that when a conductive foreign object comes into contact with the screen, it generally only has a significant impact on the capacitance of the surrounding area. Figures 7 to 9The capacitance changes at other locations are not shown; only the capacitance values ​​of the area where the foreign object is located and the surrounding area are shown.

[0098] Please see Figure 7 , Figure 7 This illustration shows how the capacitance value changes when screws are present on the screen surface. Figure 7 It can be seen that the area of ​​the screen where the screw is located (i.e. Figure 7 The capacitance value in the cell with the thickened middle line is significantly higher than that in the surrounding area.

[0099] Please continue reading Figure 8 , Figure 8 This is used to illustrate how the capacitance value changes when metal debris is present on the screen surface. From Figure 8 It can be seen that the screen area where the metal debris is located (i.e. Figure 8 The capacitance value in the cell with the thickened middle line is significantly higher than that in the surrounding area.

[0100] Please continue reading Figure 9 , Figure 9 This is used to illustrate the change in capacitance caused by a finger pressing on the screen surface. Figure 9 It can be seen that the area of ​​the screen touched by the finger (i.e. Figure 9 The capacitance value in the cell with the thickened middle line is significantly higher than that in the surrounding area.

[0101] It should be understood that for electronic devices using capacitive touchscreens, detecting the capacitance value on the screen is an inherent function. However, in traditional methods, electronic devices detect the capacitance value on the screen only to determine the user's touch position in order to respond to the user's touch operation. The inventors of this application break with traditional thinking, not only applying the detection of screen capacitance value to touch response, but also innovatively utilizing the original capacitance detection function of electronic devices, combined with the foreign object detection and analysis algorithms mentioned in the various embodiments of this application, to achieve foreign object detection on the surface of a foldable screen. Thus, without adding any additional hardware components, foreign object detection on the screen surface is achieved, effectively saving hardware costs and improving the utilization rate of system resources compared to the aforementioned related solutions 1 and 2.

[0102] Furthermore, since the electronic device can detect the capacitance value of any area or position within the entire foldable screen, combined with the foreign object detection and analysis algorithms in the various embodiments of this application, full-screen foreign object detection can be achieved. Compared to the aforementioned related solution 2, which can only detect foreign objects in a specified area, the detection range is larger and more flexible, avoiding limitations. Because it can flexibly perform full-screen foreign object detection, it is more likely to detect foreign objects during the folding process of the foldable screen, thus reducing the probability of adverse effects during folding to some extent.

[0103] As mentioned above, when a user actively inputs interactive operations by touching a capacitive touchscreen, it also causes a change in the capacitance value of the capacitive touchscreen. To differentiate this from regular user touch interactions, this embodiment of the application can add a trigger condition for initiating foreign object detection, hereinafter referred to as the foreign object detection trigger condition. After the foreign object detection trigger condition is met, the foldable screen foreign object detection method in this embodiment of the application is then executed. Specifically, after the foreign object detection trigger condition is met, the device can enter a foreign object detection state. Once in the foreign object detection state, the electronic device will acquire touch information on the foldable screen, such as the position and capacitance value of the touch points on the foldable screen, and analyze whether there are foreign objects on the surface of the foldable screen based on the capacitance value.

[0104] In some embodiments, the foreign object detection triggering condition may specifically include at least one of the following conditions:

[0105] Condition 1: Respond to the folding operation and start folding for the foldable screen.

[0106] It should be understood that when the foldable screen is unfolded and not folded, a change in capacitance is highly likely due to the user intentionally touching the screen to interact. Therefore, to avoid confusion, it is not suitable to activate foreign object detection in this situation. If the screen is folded, users usually will not intentionally touch the screen. In this case, a change in capacitance is highly likely due to the user accidentally placing a finger on the screen or other foreign objects appearing on the screen surface. Therefore, foreign object detection can be activated when the screen begins to fold.

[0107] Specifically, when responding to a folding operation and starting to fold the screen (e.g., when switching from an unfolded state to a folded state), a foreign object detection state can be entered to execute the folding screen foreign object detection method in this embodiment of the application. That is, the capacitance value in the folding screen is read, and the presence of foreign objects on the surface of the folding screen is analyzed based on the capacitance value. When the folding screen is not folded, for example, in the unfolded state, foreign object detection is not initiated.

[0108] Exemplarily, an electronic device can detect whether folding has begun using a sensor. In some embodiments, the electronic device can determine that folding has begun when it first detects a sensor signal indicating or characterizing folding. In other embodiments, the electronic device can determine that folding has begun if it continues to receive sensor signals indicating or characterizing folding for a preset time.

[0109] In the above solution, the foreign object detection state is entered when the foldable screen begins to fold, which can detect foreign objects in a timely manner to avoid adverse effects caused during the folding process.

[0110] Condition 2: The angle between the display surfaces of the first screen and the second screen is less than or equal to a preset angle threshold.

[0111] The inventors of this application discovered through research that foreign objects that are not easily detected by users and can adversely affect the folding process are usually small in size. Therefore, when the angle between the display surfaces of the first and second screens is large, on the one hand, it will not adversely affect the folding screen; on the other hand, even if foreign object detection is activated in this situation, the detection results may not be accurate enough. Therefore, the electronic device can enter a foreign object detection state when the angle between the display surfaces of the first and second screens is less than or equal to a preset angle threshold. The preset angle threshold can be denoted as the first angle threshold. In the foreign object detection state, the electronic device can read the touch information in the folding screen and analyze whether there are foreign objects on the surface of the folding screen based on the position and capacitance of the touch points in the touch information. If the angle between the display surfaces of the first and second screens is greater than the first angle threshold, then foreign object detection is not activated.

[0112] The first angle threshold can be obtained through unified big data analysis, or it can be determined based on the user's historical usage data analysis after user authorization. For example, different users have different folding force or folding speed, so the first angle threshold can be set differently for each user. The size of the first angle threshold set for a user is positively correlated with the user's folding force or folding speed. That is, the smaller the user's folding force or folding speed, the smaller the corresponding first angle threshold is set, and vice versa. In this case, when the folding force or folding speed is relatively large, the foreign object detection state can be entered as soon as possible, so that foreign objects can be identified before the screen is fully folded, avoiding entering the foreign object detection state too late, which would result in the screen being fully folded before the foreign object is detected, and thus failing to avoid adverse effects in time. In addition, when the folding force is too small, not entering the foreign object detection state too early can save system resources.

[0113] Please see Figure 10 , Figure 10 This diagram illustrates the angle between the display surfaces of the first and second screens from two different perspectives (i.e., a front view and a side view). Figure 10 It can be seen that the angle between the display surfaces of the first screen and the second screen is θ.

[0114] In some embodiments, the electronic device can detect the angle of the display surface using at least one sensor, such as an A+G sensor (a combined accelerometer and gyroscope sensor that can measure the acceleration and angular velocity of an object) or an electronic compass. The A+G sensor and electronic compass can be built into the electronic device itself, allowing for foreign object detection without incurring additional hardware costs.

[0115] In some embodiments, at the data processing level, the electronic device can identify whether the angle between the display surfaces of the first screen and the second screen (hereinafter also referred to as "the angle between the display surfaces") is less than a preset angle threshold by any of at least two of the following methods:

[0116] Method 1: Detect the included angle of the screen display surface and compare the included angle with the first angle threshold.

[0117] Specifically, electronic devices can detect the state of the foldable screen through sensors and directly obtain the angle between the display surfaces of the first and second screens, for example, Figure 10 In this process, the electronic device can directly compare the included angle θ of the display surface with a preset first angle threshold to identify whether the included angle θ is less than the first angle threshold.

[0118] Method 2: Determine the supplementary angle of the included angle of the display surface and compare the supplementary angle with the second angle threshold.

[0119] That is, the electronic device does not need to compare the angle between the display surfaces of the first screen and the second screen with the first angle threshold. Instead, it can obtain the supplementary angle of the angle between the display surfaces and analyze whether the angle between the display surfaces is less than the first angle threshold based on the supplementary angle.

[0120] Please see Figure 11 Similarly, the diagram is presented from two different perspectives (i.e., the front view and the side view). From Figure 11 It can be seen that angle α is the supplementary angle of the angle θ between the two display surfaces of the screen. In the unfolded state, the supplementary angle α is 0 degrees or close to 0 degrees. The change in angle from the unfolded state to the folding state is the size of the supplementary angle. Angle α plus the angle θ between the display surfaces equals 180 degrees. Electronic devices can compare the supplementary angle α of the angle θ between the display surfaces with a second angle threshold. If the supplementary angle α is greater than the second angle threshold, it means that the angle θ between the display surfaces is less than the first angle threshold. Conversely, if the supplementary angle α is less than the second angle threshold, it means that the angle θ between the display surfaces is greater than the first angle threshold.

[0121] As mentioned above, foreign object detection is performed after entering the foreign object detection state (for example, after the angle between the display surfaces of the first and second screens is less than or equal to a first angle threshold). To avoid adverse effects caused by folding too quickly during foreign object detection (i.e., reserving time for foreign object detection), the electronic device can control the folding screen to reduce the subsequent folding force / folding speed (i.e., reduce the speed at which the folding screen switches to the folded state), or control the folding screen to stop switching to the folded state, thereby detecting foreign objects as early as possible before any adverse effects occur. For example, foreign objects can be detected as early as possible before the user presses the two screens hard, when they only slightly touch the two screens, thus reducing the damage caused by foreign objects to the screens.

[0122] Specifically, electronic devices can reduce the subsequent folding force / folding speed (i.e., reduce the speed at which the folding screen switches to the folded state) by controlling the folding axis or activating a resistance device, or control the folding screen to stop switching to the folded state.

[0123] The following will introduce two control methods for controlling the folding shaft and the starting resistance device:

[0124] Control method 1: Control the folding axis.

[0125] In some examples, upon entering the foreign object detection state, the electronic device can first lock the folding hinge, thereby stopping the folding screen from transitioning to the folded state. That is, by locking the folding hinge, the first and second screens within the folding screen stop or nearly stop relative movement, thus preventing the display surfaces of the first and second screens from approaching each other. Further, once the foreign object detection result indicates the absence of a foreign object, the folding hinge can be unlocked, and the folding screen can continue transitioning to the folded state until both screens are closed (in the folded state).

[0126] In other examples, electronic devices may not lock the folding axis, but instead control the folding axis to reduce the force by adjusting the torque, thereby reducing the subsequent folding force / folding speed.

[0127] Control method two: Activate the resistance device to generate resistance in the second direction to counteract the force of the folding shaft.

[0128] Among them, the direction of the force exerted by the folding axis is the first direction.

[0129] In some examples, when entering the foreign object detection state, the electronic device can activate a resistance device to generate a force in a second direction opposite to the first direction to counteract the force of the folding axis, thereby stopping or nearly stopping the relative movement of the first screen and the second screen in the folding screen, thus achieving the purpose of controlling the folding screen to stop switching to the folding state.

[0130] In other examples, electronic devices can also generate resistance in the second direction that is less than the force of the folding axis through a resistance device. This resistance does not counteract the force of the folding axis, but only reduces the force actually applied to the folding screen by the folding axis. Therefore, the folding screen will continue to fold and switch to the folded state continuously. However, the switching speed or folding speed will be slower, which can also help to buy time for foreign object detection.

[0131] As described above, after entering the foreign object detection state and reading the current capacitance value in the foldable screen, the electronic device can analyze the capacitance value to identify whether there is a foreign object on the surface of the foldable screen. Therefore, the electronic device can employ either analysis method 1 or analysis method 2, or both of these methods, to analyze the capacitance value and identify the foreign object.

[0132] Analysis Method 1:

[0133] As mentioned above, foldable screens are formed by folding along a folding axis to create a first screen and a second screen. Two positions on the first and second screens that are axially symmetrical about the folding axis are considered symmetrical positions. Please refer to [link / reference]. Figure 12 The capacitance detection point 1201 in the first screen and the capacitance detection point 1202 in the second screen are axially symmetrical about the folding axis. Each capacitance detection point represents a position on the screen, so 1201 and 1202 are symmetrical positions.

[0134] Specifically, the electronic device can detect touch points on the foldable screen and determine whether there are two touch points that are symmetrical about the folding axis (or simply symmetrical positions) based on the position of the touch points. If there are two touch points that are symmetrical about the folding axis and the capacitance values ​​of these two touch points meet preset conditions, then it is determined that there is a foreign object on the foldable screen.

[0135] For example, the preset conditions may include the capacitance values ​​of the two touch points that are symmetrical about the folding axis being greater than the first capacitance threshold (i.e., condition 1), the capacitance values ​​of the two touch points that are symmetrical about the folding axis being greater than the adjacent area (i.e., condition 2), or the sum of the capacitance values ​​of the two touch points that are symmetrical about the folding axis being greater than the second capacitance threshold (condition 3).

[0136] The following sections will detail conditions 1, 2, and 3:

[0137] Condition 1: The capacitance values ​​of both touch points / two touch areas based on the folding axis symmetry are greater than the first capacitance threshold.

[0138] Please see Figure 12 If touch point 1201 on the first screen and touch point 1202 on the second screen are axially symmetrical about the folding axis, and the capacitance value of touch point 1201 is greater than the first capacitance threshold, and the capacitance value of touch point 1202 is also greater than the first capacitance threshold, then it can be determined that there is a foreign object on the folding screen. It should be noted that, in order to better distinguish touch points 1201 and 1202 from other locations, Figure 12 The fact that touch points 1201 and 1202 are marked in black, without indicating the capacitance values ​​of the various capacitor detection points on the screen, does not mean that the capacitor detection points do not have capacitance values, nor does it mean that there are no touch points in other locations on the screen. The following... Figures 13A to 14B , Figure 15 and Figure 17 Similarly, the specific capacitance values ​​of each capacitance detection point on the screen were not shown.

[0139] Specifically, the electronic device can compare the capacitance values ​​of 1201 and 1202 with a first capacitance threshold. If both are greater than the first capacitance threshold, then the presence of a foreign object at the symmetrical positions 1201 and 1202 can be identified. That is, when the screen is folded, the foreign object comes into contact with 1201 in the first screen and 1202 in the second screen, causing the capacitance values ​​at 1201 and 1202 to increase, thus confirming the presence of a foreign object.

[0140] Condition 2: The capacitance values ​​of both touch points / two touch areas based on the folding axis symmetry are greater than those of the adjacent areas.

[0141] In the second example, if the capacitance value at each position in the symmetrical location is significantly greater than the capacitance value of the adjacent area (i.e., the capacitance value at each position in the symmetrical location tends to be significantly greater than the capacitance value of the adjacent area), it is determined that there is a foreign object at the symmetrical location of the foldable screen. Here, "significantly greater than the capacitance value of the adjacent area" can mean that the capacitance difference (i.e., the difference between the capacitance value at each position in the symmetrical location and the capacitance value of the adjacent area) is greater than or equal to a preset difference threshold. Similarly, using... Figure 12 For example, the electronic device can calculate the first difference between the capacitance value of 1201 and the capacitance value of the adjacent area, and calculate the second difference between the capacitance value of 1202 and the capacitance value of the adjacent area. If both the first difference and the second difference are greater than or equal to the preset difference threshold, it is determined that there are foreign objects at the symmetrical positions 1201 and 1202.

[0142] Condition 3: The sum of the capacitance values ​​of the two touch points / two touch areas based on the folding axis symmetry is greater than the second capacitance threshold.

[0143] Please continue reading. Figure 12The electronic device can add the capacitance values ​​of touch points 1201 and 1202, and compare the sum with a second capacitance threshold. If the sum of the capacitance values ​​is greater than the second capacitance threshold, it is determined that there is a foreign object at the symmetrical position of the foldable screen. The second capacitance threshold is greater than the first capacitance threshold.

[0144] Furthermore, the electronic device can combine conditions 1 and 3 to determine whether a foreign object exists. Specifically, if the capacitance values ​​of touch points 1201 and 1202 are each greater than a first capacitance threshold, and the sum of the capacitance values ​​of touch points 1201 and 1202 is greater than a second capacitance threshold, then it is determined that a foreign object exists at the symmetrical position of the folding screen. The second capacitance threshold is greater than the first capacitance threshold. It should be noted that the electronic device can first determine whether the two symmetrical touch points satisfy condition 1, and if condition 1 is satisfied, then determine whether condition 2 is satisfied. Alternatively, the electronic device can first determine whether the two symmetrical touch points satisfy condition 2, and if condition 2 is satisfied, then determine whether condition 1 is satisfied. This application does not limit the order in which the two conditions are used.

[0145] In the above scheme, the electronic device can not only judge foreign objects based on whether the capacitance value of a single location (single capacitor detection point) is too high, but also further combine whether the sum of the capacitance values ​​of the axisymmetric touch area / touch point is high enough, so as to more accurately identify foreign objects.

[0146] It should be understood that in traditional touch position detection scenarios, the capacitance threshold (which can be denoted as the "fourth capacitance threshold") used to trigger the reporting of TP events is 800. That is, a TP event will be reported when the absolute capacitance value is greater than 800, i.e., the screen is reported as touched, and the touch position is displayed on the screen. In the embodiments of this application, the first capacitance threshold and the second capacitance threshold can be smaller than the fourth capacitance threshold of 800. In this way, the foldable screen foreign object detection method in the embodiments of this application can be implemented without triggering the reporting of TP events, which greatly improves the sensitivity of foreign object detection.

[0147] In some embodiments, for the first or second example described above, the electronic device first filters out touch points / touch areas with excessively high capacitance values ​​in the entire folding screen, and then identifies whether there are touch points / touch areas symmetrical about the folding axis among the filtered touch points / touch areas. If so, it is identified that there is a foreign object. Specifically, the electronic device can first traverse each touch point / touch area in the folding screen (including the first screen and the second screen), filter out touch points / touch areas with capacitance values ​​greater than a first capacitance threshold or filter out touch points / touch areas with capacitance values ​​significantly greater than those of adjacent areas, and then pair the filtered touch points / touch areas to determine whether there are touch points / touch areas symmetrical about the folding axis among the filtered touch points / touch areas. If so, it is determined that there is a foreign object on the folding screen. For positions with capacitance values ​​significantly greater than those of adjacent areas, the difference between the capacitance value at this position and the capacitance value of the adjacent area is greater than or equal to a preset difference threshold.

[0148] For example, please refer to Figures 13A to 13B , Figure 13A In the diagram, the black-filled areas represent the selected touch points (touch points with capacitance values ​​greater than the first capacitance threshold or touch points with capacitance values ​​significantly greater than adjacent areas). After selecting touch points, the electronic device can identify whether there are touch points symmetrical about the folding axis among multiple selected touch points using the following method: For each selected touch point, a preset range is expanded outward to form an M*N region (M and N can be different or the same), for example, expanding to form a 4m*4m region, denoted as the touch area. Then, based on the folding axis, each touch area is paired to identify whether there are two touch areas that are symmetrical about the folding axis. If two touch areas that are symmetrical about the folding axis exist, for example... Figure 13B In this model, 1301 and 1302 are two touch areas that are axially symmetrical about the folding axis, indicating the presence of a foreign object on the folding screen. This solution first filters out touch points with excessively high capacitance values ​​from the entire folding screen, then expands the area around these points to more accurately identify the axial symmetry, thus improving the accuracy of foreign object identification.

[0149] In other embodiments, for the first or second example described above, the electronic device may first filter out touch points / touch areas with excessively large capacitance values ​​from one screen of the folding screen, and then determine whether the capacitance value of the corresponding touch point / touch area in the other screen is too large. If the corresponding touch point / touch area in the other screen is also too large, then the presence of a foreign object is identified.

[0150] Specifically, the electronic device can first identify touch points / touch areas on one of the first and second screens, where the capacitance value is greater than a first capacitance threshold or significantly greater than that of adjacent areas. The electronic device then determines the corresponding point / area on the other screen (i.e., a capacitance detection point / area on the other screen that is axially symmetrical to the identified touch point / area). The electronic device can then determine whether the capacitance value of the corresponding touch point / area on the other screen is greater than the first capacitance threshold or significantly greater than that of adjacent areas. If so, it indicates that the symmetrical position on the other screen is also touched, and it is highly likely that a foreign object is simultaneously contacting the symmetrical position on both screens, thus confirming the presence of a foreign object on the folding screen. If not, it can be determined that no foreign object is present on the folding screen. This eliminates the need to process all positions on the folding screen, allowing for more targeted processing, saving system resources, and improving recognition efficiency.

[0151] For example, please refer to Figures 14A to 14B The electronic device can first identify touch points on the first screen whose capacitance value is greater than the first capacitance threshold or whose capacitance value is significantly greater than that of the adjacent area (i.e., Figure 14A (The area filled with black in the middle). Then, the corresponding touch point can be determined on the second screen as follows: The electronic device can expand the touch point found on the first screen outward by a preset range, for example, expanding it outward to form a 4*4 area, which is recorded as the touch area. Then, the area corresponding to this touch area is determined from the second screen. For example, ... Figure 14A The leftmost black square expands outward to form Figure 14B The second region 1401 is shown in the image. 1402 is the third region on the second screen corresponding to the second region 1401. The electronic device can determine whether the average capacitance value of each point in the third region 1402 or the maximum capacitance value in the third region 1402 is greater than the first capacitance threshold. If so, it is determined that there is a foreign object in the foldable screen. Alternatively, the electronic device can determine whether the capacitance value at each position in the third region 1402 is significantly greater than that of the adjacent regions. If so, it is determined that there is a foreign object in the foldable screen.

[0152] Analysis Method 2:

[0153] Specifically, the electronic device can detect touch point information (also called touch information) on the foldable screen. This touch point information includes the location and capacitance value of the touch point. The electronic device can determine which touch points are located within the hinge area based on their location. If a third touch area with a capacitance value greater than or equal to a third capacitance threshold exists within the hinge area, it is determined that a foreign object exists on the screen. The third touch area refers to the area that includes the touch point.

[0154] It should be understood that the third capacitance threshold can be equal to or different from the first or second capacitance threshold, and can be set according to actual needs.

[0155] At the data processing level, electronic devices can determine whether there is a third touch area within the hinge area with a capacitance value greater than or equal to the third capacitance threshold, according to either of the following two examples:

[0156] Example 1: After detecting a touch point located within the hinge area, the electronic device compares the capacitance value of the touch point with a third capacitance threshold. If a touch point with a capacitance value greater than the third capacitance threshold is found, it is determined that a foreign object exists on the screen. It should be understood that if the capacitance value of a touch point within the hinge area is greater than or equal to the third capacitance threshold, it is equivalent to the existence of a third touch area within the hinge area with a capacitance value greater than or equal to the third capacitance threshold; therefore, it can be determined that a foreign object exists on the screen. Furthermore, the electronic device can provide a foreign object warning.

[0157] Example 2: After detecting a touch point located within the hinge area, the electronic device can expand the touch point outward by a third preset range to obtain a third touch area. Then, the capacitance value within the third touch area is compared with a third capacitance threshold to determine if the capacitance value of the third touch area is greater than or equal to the third capacitance threshold. If so, it is determined that a foreign object exists on the screen. Furthermore, the electronic device can provide a foreign object warning.

[0158] Please see Figure 15 The first and second screens are formed by folding a single foldable screen, therefore, the first and second screens are connected at the folding axis. Figure 15 The dotted area 1501 in the diagram represents the hinge area, which is formed by the portion of the first screen near the folding axis and the portion of the second screen near the folding axis.

[0159] During the folding process of a foldable screen based on its hinge, foreign objects often slide to the vicinity of the hinge, causing a change in the capacitance value of the hinge area. In this case, the foreign object is likely to be located on only one of the first or second screens within the hinge area, so analysis method 1 described above may not be able to detect it. Therefore, electronic devices can analyze the capacitance value of touch points within the hinge area to identify whether a foreign object is present on the screen. Please continue reading. Figure 16 After the foldable screen is folded, the metal debris 1502 gradually slides to the hinge area 1501, which is equivalent to generating touch information in the hinge area, causing the capacitance value of the touch point in the hinge area 1501 to change.

[0160] It should be understood that a foreign object landing within the hinge area is likely to contact an area rather than a single point, such as a 3m*3m or 4m*4m area. Therefore, the electronic device can average the capacitance values ​​of multiple locations or points within the area occupied by the touch point (i.e., the third touch area), or select the largest capacitance value as the capacitance value corresponding to that area. Furthermore, the capacitance value corresponding to this area can be compared with the third capacitance threshold, or with the capacitance values ​​of adjacent areas, to identify whether a foreign object exists within the hinge area.

[0161] Please see Figure 17 , Figure 17 It means Figure 16 The specific capacitance change caused by the sliding of metal debris 1502 into the pivot region 1501 should be understood. Figure 17 The reason why the various capacitance detection points are displayed unfolded is simply to better illustrate the capacitance changes in the hinge area caused by metal debris; therefore, they are not folded up for marking. However, it should be understood that foldable screens actually behave as follows... Figure 16 As shown, it is folded up and in a support position.

[0162] Figure 17 Region 1502' (the bold black square area) is the area where metal debris 1502 landed on the screen, corresponding to the area of ​​the touch point (i.e., the third touch area). Due to the influence of the metal debris, the capacitance of region 1502' is relatively larger, that is, larger than the capacitance of the surrounding areas, or greater than or equal to the third capacitance threshold. Therefore, the electronic device can identify whether there is a touch area / touch point in the hinge area with a capacitance greater than or equal to the third capacitance threshold, or whether there is a touch area / touch point in the hinge area with a capacitance significantly higher than the adjacent areas. If a touch area / touch point that meets the above conditions is identified, it is determined that there is a foreign object in the hinge area.

[0163] It should be understood that when both analysis method 1 and analysis method 2 are included, the electronic device can set the priority order between analysis method 1 and analysis method 2. If the analysis method used first fails to detect foreign objects, the analysis method used later will be started to detect foreign objects.

[0164] Example 1: Analysis method 1 takes precedence over analysis method 2. Generally, foreign objects are easier to detect at symmetrical locations. Therefore, electronic devices can first analyze the capacitance at symmetrical locations based on analysis method 1. If foreign objects cannot be detected based on analysis method 1 (for example, no foreign objects are detected at the symmetrical locations), then analysis method 2 is used to analyze the capacitance of the hinge area to detect whether there are foreign objects in the hinge area.

[0165] Example 2: Analysis method 2 takes precedence over analysis method 1. Electronic devices can also first use analysis method 2 to analyze whether there are foreign objects in the pivot area. If analysis method 2 detects that there are no foreign objects in the pivot area, then analysis method 1 is used to analyze whether there are foreign objects in the symmetrical position.

[0166] In the above embodiments, by combining analysis method 1 and analysis method 2, full-screen foreign object detection can be performed more comprehensively and accurately.

[0167] It should be noted that the above two methods of capacitance analysis are not limited; other analysis methods are also provided in the embodiments of this application. Specifically, the inventors of this application discovered that during the folding process, in addition to the capacitance value on the screen increasing due to the touch of an external object (foreign object), since the capacitive touchscreen itself is conductive, the capacitance value on the screen also changes when the two folded screens approach or overlap each other. Therefore, the capacitance value generated solely by the approach or contact between the two screens can be determined in advance through repeated experiments without the influence of external objects. Since users usually do not intentionally touch the screen during the folding process, excluding the capacitance value change caused by the screen's own proximity during the folding process, it is highly likely that the excessive capacitance value on the screen is due to the presence of foreign objects. Therefore, the electronic device can identify areas in the folded screen with capacitance values ​​greater than a preset fifth capacitance threshold during the folding process. If an area with a capacitance value greater than the fifth capacitance threshold exists, it can be determined that there are foreign objects on the surface of the folded screen.

[0168] The fifth capacitance threshold is determined based on the capacitance value generated solely from the proximity or contact between the two screens. That is, without external object interference, the capacitance value generated solely from the proximity or contact between the two screens will always be less than or equal to the fifth capacitance threshold. If the electronic device detects an area or location on the foldable screen with a capacitance value greater than this fifth capacitance threshold, it indicates that the capacitance value is not solely generated from the proximity or contact between the two screens, but rather caused by a foreign object on the screen. This scheme enhances the feasibility of full-screen detection and improves the flexibility of foreign object detection.

[0169] In some embodiments, during the folding process of the foldable screen, the user's finger being pinched by the screen may not affect the screen itself, and except for special groups such as children, it will not cause much pain. Therefore, the situation where the user's finger is a foreign object can be ruled out, meaning that the foreign object to be detected can exclude the user's finger. To further exclude the situation where the capacitance value changes due to the user's finger (intentional or unintentional) touch, and to more accurately detect other external foreign objects besides the user, the electronic device can, after identifying areas in the foldable screen where the capacitance value is greater than a preset fifth capacitance threshold, add filtering conditions or advanced identification schemes. For example, it can compare the capacitance value of that area with a preset capacitance value range. If the capacitance value of that area is not within the range, then a foreign object (other than the user's finger) is identified on the foldable screen; if the capacitance value of that area is within the range, then no foreign object is identified on the foldable screen. Here, the preset capacitance value range refers to the range of capacitance values ​​that a capacitive touchscreen might normally generate when touched by a user.

[0170] It should be noted that foreign object detection is continuous. That is, during the folding process, the current capacitance value of the foldable screen is continuously acquired for foreign object detection. If no foreign object is detected, the capacitance value on the screen continues to be read and foreign object detection continues until the detection stop condition is met. The detection stop condition can include the foldable screen being completely closed (or in a folded state), or it can include the number of detections reaching a preset threshold.

[0171] In some embodiments, the electronic device can issue a foreign object warning when a foreign object is detected on the surface of the foldable screen. Exemplarily, the warning method includes, but is not limited to, at least one of motor vibration, flashing light, external screen output of a prompt message, or voice prompt (i.e., a speaker playing a voice message).

[0172] It should be understood that electronic devices can uniformly use a default reminder method without differentiation, which can be one or more of the methods mentioned above. Furthermore, to improve the flexibility of reminders, electronic devices can also adopt appropriate reminder methods based on the current actual situation, rather than uniformly using the default reminder method in all circumstances, thus achieving flexible reminders.

[0173] The flexible reminder methods can specifically include any one or more of the following reminder examples 1 to 3:

[0174] Example 1: Personalized reminders can be given to different users.

[0175] For example, the settings app could provide a settings interface for foreign object detection, allowing users to customize their notification methods. Alternatively, with user authorization, the current notification method could be determined based on the user's historical notification patterns when using the electronic device.

[0176] Please see Figure 18 , Figure 18 The magnified image of the foreign object shows that a screw was detected when the phone was folded. Assume that user A and user B chose motor vibration and voice prompt as the notification methods, respectively. Then, after detecting the foreign object, motor vibration would alert user A to the presence of the foreign object on their screen. For user B, a voice prompt, "Please be aware of the foreign object," would alert user B to the presence of the foreign object on their screen.

[0177] Example 2: The reminder method is adaptively determined based on the usage scenario of the electronic device.

[0178] Specifically, electronic devices can analyze the current usage scenario and determine the appropriate reminder method for different scenarios. For example, Figure 19 As shown, in a silent environment (or silent mode), voice prompts are no longer suitable for electronic devices. Instead, a flashing light (or motor vibration, not shown in the diagram) can be used to provide a reminder, matching the silent mode. Similarly, if the electronic device is in a brightly lit environment (e.g., outdoors), flashing light is no longer suitable. Instead, a motor vibration (or voice prompt, not shown in the diagram) can be used to provide a reminder, matching the bright light environment.

[0179] Example 3: Differentiated reminders based on different types of foreign objects.

[0180] Specifically, electronic devices can also analyze the type of foreign object and provide targeted prompts to the user based on that type. Each type of foreign object has a corresponding prompting method, thus providing more accurate foreign object alerts.

[0181] In some embodiments, the type of foreign object may include at least one of metal shavings, screws, or fingers.

[0182] For example, different types of foreign objects have different electrical conductivity, resulting in different capacitance changes upon contact with the screen. See [link to relevant documentation] for details. Figures 7 to 9 ,from Figures 7 to 9 It is known that the capacitance value is close to 2000 when a finger touches the screen, close to 1000 when a screw is on the screen surface, and around 200-200 when metal debris is on the screen surface. Therefore, electronic devices can analyze the type of foreign object based on the characteristics of the capacitance value at the location of the foreign object on the screen.

[0183] Characteristic analysis of foreign object types based on capacitance values ​​can include at least one of the following methods:

[0184] Method A1: Different types of foreign objects, such as screws, metal shavings, and fingers, generally have different capacitance ranges. Therefore, corresponding capacitance ranges can be pre-set for different types of foreign objects. That is, each type of foreign object has a corresponding capacitance range. After a foreign object is detected on the screen surface, the type of foreign object is determined based on the target capacitance range where the detected foreign object's capacitance falls. For example, if a foreign object is detected during folding and its capacitance is 280, it can be found to be within the capacitance range of 200-200, thus identifying the foreign object as metal shavings.

[0185] Method A2: Alternatively, instead of pre-setting the tolerance range, a pre-trained type recognition model can be used. The tolerance value corresponding to the detected foreign object is input into the type recognition model to obtain the foreign object type. The type recognition model is a machine learning model pre-trained using sample data, capable of identifying the foreign object type based on the tolerance value generated after the foreign object contacts the screen. Specifically, the sample data can include the tolerance value and the corresponding foreign object type label. Iterative training based on this sample data can train the aforementioned type recognition model.

[0186] Differentiated alerts for different types of foreign objects include any of the following methods:

[0187] Method B1: Different types of foreign objects will be given matching alert methods.

[0188] It should be understood that in the embodiments of this application, the electronic device can adopt a matching reminder method for different types of foreign objects, rather than a fixed and single reminder method, so as to provide reminders more flexibly and accurately.

[0189] In some embodiments, different alert methods can be pre-set for different types of foreign objects, with each type corresponding to a different alert method. This allows users to quickly know what foreign object is on the screen through the alert method, enabling the object to be removed more quickly, reducing its negative impact, and improving the alerting effect. Please refer to [link / reference]. Figure 20 For metal shavings, a flashing light can be used to alert the user; for screws, a voice prompt can be used. It should be understood that... Figure 20 It simply illustrates different warning methods for different types of foreign objects, without specifying a particular warning method for each type of foreign object.

[0190] In other embodiments, the inventors of this application discovered through research that different types of foreign objects have their own characteristics, and some reminder methods may not be suitable. Therefore, using the same reminder method may be too limiting or even counterproductive. For example, if there are hard foreign objects such as screws or metal shavings on the screen, direct motor vibration may cause the hard foreign objects to slide and scratch the screen, so motor vibration is not suitable for reminders. Therefore, electronic devices can analyze the attribute characteristics corresponding to each type of foreign object and adaptively determine the matching reminder method based on the attribute characteristics to provide more accurate and effective reminders.

[0191] Continuing with the above example, screws or metal shavings are characterized by their hardness. Therefore, given this hardness, a warning method is needed that won't cause the hard object to slide and scratch the screen. This could be achieved by displaying a notification on the external screen, flashing the flashlight, or providing a voice prompt. For softer objects like fingers, a vibration mechanism could be used to warn of the presence of these objects.

[0192] Method B2: Provide different reminders based on the target reminder method for different types of foreign objects.

[0193] Specifically, the same target reminder method is used to send reminders, but different prompt messages will be output for different types of foreign objects under the target reminder method.

[0194] Example 1: Taking voice prompts as an example, different voice prompts can be output for different types of foreign objects. Please refer to [link / reference]. Figure 21 If the foreign object is a finger, then a voice prompt can be given saying "Please avoid pinching your fingers when folding your phone." If the foreign object is metal shavings, then a voice prompt can be given saying "There may be metal shavings on your screen. Do not fold."

[0195] Example 2: Taking the flashing of the flashlight as an example, the flashing frequency can be controlled according to different flashing frequencies for different types of foreign objects. For example, the flashing frequency for fingers and metal fragments can be different. Specifically, when folding, metal fragments can damage the screen, so the adverse effects of metal fragments are greater than those of fingers. Therefore, the flashing frequency for metal fragment alerts can be higher than the flashing frequency for finger alerts.

[0196] Similarly, the motor can be controlled to vibrate at different frequencies for different types of foreign objects, or the screen can be controlled to output different prompts for different types of foreign objects. These will not be listed one by one here, as long as different prompts can be output for different types of foreign objects in the same way.

[0197] In other embodiments, after identifying the specific type of foreign object, the electronic device may not issue a warning for a first preset foreign object type, but may issue a warning for a second preset foreign object type. For example, the first preset foreign object type may include a finger, because generally, pinching a finger will not damage the screen, and except for very young children, pinching a finger usually does not cause significant pain to the user. Therefore, no warning may be issued when a finger is identified as the foreign object. The second preset foreign object type includes at least one type of foreign object that is relatively hard and can damage the screen, such as metal shavings or screws. In this case, a warning may be issued.

[0198] In some embodiments, when a foreign object is detected on the surface of the folding screen, in addition to alerting the user, the electronic device can also control the folding screen to slow down the folding speed (i.e., reduce the speed at which the folding screen switches to the folded state) or control the folding screen to stop switching to the folded state, thereby minimizing the adverse effects during the folding process.

[0199] In this embodiment, controlling the foldable screen to stop switching to the folded state may include: controlling the first screen and the second screen in the foldable screen to stop relative movement, or controlling the foldable screen to return to the unfolded state.

[0200] Specifically, electronic devices can use control methods such as controlling the folding axis or starting resistance devices to reduce subsequent folding force / folding speed, or control the folding screen to stop switching to the folding state.

[0201] Next, we will explain in detail how to control the folding shaft or resistance device when a foreign object is detected.

[0202] (a) Control the folding axis.

[0203] In some examples, after detecting a foreign object on the screen, the electronic device can first lock the folding hinge, thereby stopping or nearly stopping the relative movement of the first and second screens in the folding screen. Further, after receiving an unlock operation from the user, the folding hinge can be unlocked, and the folding screen can be driven to continue switching to the folded state, or the folding screen can continue switching to the folded state in response to the user operation, until the two screens are closed (in the folded state).

[0204] In other examples, electronic devices may not lock the folding axis, but instead control the folding axis to reduce the force by adjusting the torque, thereby reducing the subsequent folding force / folding speed. This way, even if the screen comes into contact with foreign objects, it will not cause serious adverse effects. For example, the screen can gently contact foreign objects, which can reduce the damage to the screen caused by metal foreign objects, or reduce the clamping force of the screen on foreign objects such as fingers, thus reducing finger pain.

[0205] (ii) Start the resistance equipment.

[0206] In some examples, after detecting a foreign object on the screen, the electronic device can activate a resistance device to generate a force in a second direction opposite to the first direction (i.e., the first direction of the folding axis force) to counteract the folding axis force. This causes the first screen and the second screen in the folding screen to stop or nearly stop relative movement, thereby controlling the folding screen to stop switching to the folded state.

[0207] It should be understood that, in addition to controlling the foldable screen to stop switching to the folded state through the above-mentioned methods, the electronic device can also apply a reaction force through a resistance device (i.e., apply a resistance force greater than the force of the folding axis in the second direction) after detecting the presence of foreign objects, so that the foldable screen returns to the unfolded state.

[0208] In other examples, electronic devices can also generate resistance in the second direction that is less than the force of the folding axis through a resistance device. This resistance does not counteract the force of the folding axis, but it reduces the force actually applied to the folding screen by the folding axis. Therefore, the folding screen will continue to fold and switch to the folded state. However, the switching speed or folding speed will be slower, so that even if the screen comes into contact with foreign objects, the adverse effects of foreign objects on the folding screen can be reduced to some extent.

[0209] The foldable screen foreign object detection method provided in this application can be applied to electronic devices such as mobile phones, tablets, desktop, laptop, and handheld computers, laptops, in-vehicle devices, smart screens, large screens and other smart home devices, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), wearable devices, augmented reality (AR) and virtual reality (VR) devices, etc. The specific form of the electronic device is not particularly limited in this application.

[0210] Now combined Figure 22 A more detailed explanation of the internal structure of electronic device 2200 will be provided.

[0211] Electronic device 2200 may include processor 2210, external memory interface 2220, internal memory 2221, universal serial bus (USB) interface 2230, charging management module 2240, power management module 2241, battery 242, antenna 1, antenna 2, mobile communication module 2250, wireless communication module 2260, audio module 2270, speaker 2270A, receiver 2270B, microphone 2270C, headphone jack 2270D, sensor module 2280, button 2290, motor 2291, indicator 2292, camera 2293, foldable screen 2294, and user identification module (SIM) card interface 2295, etc. The sensor module 2280 may include a gyroscope sensor 2280B, a magnetic sensor 2280D, an accelerometer sensor 2280E, a touch sensor 2280K, etc.

[0212] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 2200. In other embodiments of this application, the electronic device 2200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0213] Processor 2210 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0214] The controller can serve as the nerve center and command center of the electronic device 2200. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0215] The processor 2210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 2210 is a cache memory. This memory can store instructions or data that the processor 2210 has just used or that are used repeatedly. If the processor 2210 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 2210, and thus improves the efficiency of the system.

[0216] In some embodiments, the processor 2210 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscribing identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0217] Electronic device 2200 implements display functions through a GPU, a foldable screen 2294, and an application processor. The GPU is a microprocessor for image processing, connecting the foldable screen 2294 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering; for example, the GPU can receive rendering instructions from the application processor (AP) and perform graphics rendering. Processor 2210 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0218] In this embodiment, the electronic device is an inward-folding device, and the folding screen 2294 is the inner screen. The inner screen can be folded to form at least two screens. Taking the formation of two screens (i.e., the first screen and the second screen) when folded as an example, when switching from the support state to the unfolded state, the two screens can form a complete large screen display area for display. During the folding process from the unfolded state, the display surfaces of the first screen and the second screen gradually approach each other. The method in this embodiment utilizes the change in screen capacitance caused by foreign objects during the folding process of the folding screen to achieve foreign object detection.

[0219] In some embodiments of this application, the foldable screen 2294 may include a display and a touch device. The display is used to output display content to the user, and the touch device is used to receive touch events input by the user on the foldable screen 2294. It should be understood that when the foldable screen 2294 is not folded, for example, in an unfolded state, the display included in the foldable screen 2294 can present specific content to the user.

[0220] In some embodiments of this application, in addition to the folding screen 2294, the electronic device also has a third screen. The third screen is disposed on the back of the first screen or the second screen of the folding screen 2294. During the folding process, if the electronic device detects a foreign object from the surface of the folding screen, it can output a prompt message through the third screen (i.e., display the prompt message on the outer screen).

[0221] Electronic device 2200 can achieve shooting function through ISP, camera 2293, video codec, GPU, foldable screen 2294 and application processor.

[0222] The external storage interface 2220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 2200. The external memory card communicates with the processor 2210 through the external storage interface 2220 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0223] Internal memory 2221 can be used to store executable program code, including instructions. Processor 2210 executes various functional applications and data processing of electronic device 2200 by running the instructions stored in internal memory 2221. Internal memory 2221 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 2200 (such as audio data, phonebook, etc.). Furthermore, internal memory 2221 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0224] Electronic device 2200 can implement audio functions, such as music playback and recording, through audio module 2270, speaker 2270A, receiver 2270B, microphone 2270C, headphone jack 2270D, and application processor.

[0225] The audio module 2270 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 2270 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 2270 may be located in the processor 2210, or some functional modules of the audio module 2270 may be located in the processor 2210.

[0226] The speaker 2270A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 2200 can listen to music or make hands-free calls through the speaker 2270A.

[0227] In some embodiments of this application, after the electronic device detects a foreign object from the surface of the foldable screen using the method mentioned in the embodiments of this application, a preset voice prompt can be played through the audio module 2270 and the speaker 2270A to remind the user of the presence of the foreign object via voice.

[0228] The receiver 2270B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 2200 receives a telephone call or voice message, the receiver 2270B can be brought close to the ear to hear the voice.

[0229] Microphone 2270C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 2270C, inputting the sound signal into microphone 2270C. Electronic device 2200 may be equipped with at least one microphone 2270C.

[0230] The 2270D headphone jack is used to connect wired headphones. The 2270D headphone jack can be a USB 2230 interface or a 3.5mm Open Mobile Electronic Device Platform (OMTP) standard interface, a CTIA (Cellular Communications Industry Association of the USA) standard interface.

[0231] Touch sensor 2280K, also known as a "touch panel," can be located on foldable screen 2294. The touch sensor 2280K and foldable screen 2294 together form a touchscreen, also known as a "touch screen." Touch sensor 2280K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through foldable screen 2294. In other embodiments, touch sensor 2280K may also be located on the surface of electronic device 2200, in a different position than foldable screen 2294.

[0232] The gyroscope sensor 2280B can be used to determine the motion attitude of the electronic device 2200. In some embodiments, the gyroscope sensor 2280B can determine the angular velocity of the electronic device 2200 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 2280B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 2280B detects the angle of the shake of the electronic device 2200, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 2200 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 2280B can also be used in navigation and motion-sensing game scenarios.

[0233] The magnetic sensor 2280D includes a Hall sensor. The electronic device 2200 can use the magnetic sensor 2280D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 2200 is a flip phone, the electronic device 2200 can detect the opening and closing of the flip cover based on the magnetic sensor 2280D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0234] The 2280E accelerometer sensor can detect the magnitude of acceleration of an electronic device 2200 in various directions (typically three axes). When the electronic device 2200 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the electronic device, and can be applied to applications such as screen orientation switching and pedometers.

[0235] In some embodiments of this application, the electronic device may use the aforementioned accelerometer 2280E, magnetometer 2280D, or gyroscope sensor 2280B to detect the folding state of the folding screen (i.e., whether the folding screen is folded / whether folding has started) and detect the angle of the specific display surface.

[0236] Motor 2291 can generate vibration alerts. Motor 2291 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to different touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 2291 can also correspond to different vibration feedback effects for touch operations applied to different areas of the foldable screen 2294. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0237] In some embodiments of this application, the electronic device can control the motor 2291 to vibrate after detecting a foreign object on the surface of the foldable screen, so as to indicate that the foreign object is in place and achieve the purpose of foreign object reminder.

[0238] The indicator 2292 can be an indicator light, used to indicate charging status, battery level changes, or messages, missed calls, notifications, etc. In some embodiments of this application, the indicator 2292 can be a flashlight, which can indicate the presence of foreign objects on the foldable screen when the flashlight flashes, thus achieving the purpose of foreign object reminder.

[0239] Taking a mobile phone as an example, the software system of a mobile phone can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture of the Android system as an example to exemplify the software structure of a mobile phone. It should be noted that this application embodiment is not limited to the software structure of a mobile phone; it is applicable to any electronic device with a foldable screen and running the Android system, such as a tablet. Figure 22 The software architecture diagram shown is not limited to Android; it can also be other mobile operating systems.

[0240] Figure 23 This is a software structure block diagram of a mobile phone provided in an embodiment of this application.

[0241] As we can understand, a layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. For example... Figure 23 As shown, the Android system can include four layers, from top to bottom: the application layer, the application framework layer (Framework layer), the system library, and the kernel layer (also known as the driver layer).

[0242] The application layer can include a series of application packages. For example... Figure 23 As shown, the application package may include a foreign object detection module, which is used to detect whether there are foreign objects on the surface of the foldable screen during the folding process.

[0243] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0244] The application framework layer may include a window manager, content providers, a view system, a phone manager, a resource manager, a notification manager, etc. Figure 23 The image only shows the notification manager and the view system.

[0245] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0246] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0247] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0248] In some embodiments of this application, an alarm can be triggered after detecting and identifying a foreign object on the foldable screen. For example, an alarm can be triggered by displaying a prompt message on the external screen. In this case, the view system in the application framework layer can be used to achieve the effect of displaying the prompt message on the external screen.

[0249] The notification manager allows applications to display notification information in the status bar. It can be used to convey informational messages and can disappear automatically after a short time without user interaction.

[0250] In some embodiments of this application, the notification manager can be used to notify the presence of a foreign object, i.e., to send a foreign object alert message. The notification manager can also be a notification appearing in the system's top status bar as an icon or scrollbar text, such as a notification from a background application, or a notification appearing on the screen as a dialog window. Examples include displaying text messages in the status bar, emitting alert sounds, vibrating electronic devices, and flashing indicator lights.

[0251] System libraries may include graphics libraries and surface managers, etc.

[0252] The graphics library provides drawing and rendering capabilities for 2D and 3D graphics within the application. In some embodiments, the graphics library may include at least one of the following: OpenGL, OpenGL ES (Open Graphics Library for Embedded Systems), Vulkan, etc. Vulkan is a cross-platform 2D and 3D graphics application programming interface (API).

[0253] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0254] The kernel layer, also known as the driver layer, is the layer between hardware and software. The kernel layer includes drivers for various hardware components.

[0255] In some embodiments of this application, the kernel layer may include at least a display driver and a sensor driver.

[0256] A display driver is a type of software or firmware used to control and manage display devices. It acts as a bridge between the computer system and the display device, providing the operating system with access to and control over the display device. For example, a display driver is used to display content on a foldable screen for users to view.

[0257] A sensor driver is used to drive a sensor to acquire data. For example, in some embodiments of this application, a sensor driver can be used to drive a sensor to detect the included angle of the display surface of a foldable screen. Exemplarily, the sensor used to detect the included angle of the display surface may include, but is not limited to, at least one of an A+G sensor, an electronic compass, a Hall sensor, an optical sensor, or an eddy current sensor, etc., and the embodiments of this application do not limit this.

[0258] Next, in Figures 24 to 26 The foreign object detection method for foldable screens in this application embodiment is described in conjunction with some hardware structures of electronic devices and some modules of software systems.

[0259] In some embodiments, please refer to Figure 24 The foreign object detection method for foldable screens in this application embodiment specifically includes the following steps:

[0260] (a1) Obtain the included angle θ of the display surface.

[0261] Specifically, during the transition from an unfolded to a folded state (i.e., the folding process), sensors in the hardware layer can detect the angle of the display surface in real time. The foreign object detection module in the application layer can then obtain the current angle of the display surface and analyze whether it is necessary to enter the foreign object detection state.

[0262] (b1) Determine whether the included angle θ of the display surface is less than or equal to the first angle threshold φ.

[0263] Specifically, the foreign object detection module can determine to enter the foreign object detection state when it determines that the included angle of the display surface is less than or equal to the first angle threshold, so as to perform subsequent foreign object detection analysis and processing, that is, to execute steps (a3) ​​to (a5).

[0264] (c1) Get the current touch information in the foldable screen.

[0265] Specifically, during the folding process, the touch sensor of the electronic device can acquire touch information and report it to the foreign object detection module at the application layer.

[0266] (d1) Foreign object detection based on the position and capacitance of the touch point.

[0267] Specifically, the foreign object detection module can detect whether there are foreign objects on the foldable screen based on the position and tolerance of the touch point in the touch information.

[0268] (e1) Output the foreign object detection results.

[0269] The foreign object detection result is used to characterize whether there are foreign objects on the surface of the foldable screen. It should be noted that outputting the foreign object detection result includes, but is not limited to, at least one of the following processes: outputting the foreign object detection result to the front end or reporting it to the back end.

[0270] In some embodiments, the foreign object detection module can output the foreign object detection result to the front end to provide a foreign object reminder, so that the user knows whether there is a foreign object on the screen surface, thereby stopping the folding operation and avoiding or reducing the adverse effects caused by foreign objects during the folding process.

[0271] For example, the foreign object detection module at the application layer can issue a vibration command to control the motor in the hardware layer to vibrate, thereby alerting the user to the presence of a foreign object. Alternatively, it can issue a flashing light command to control the flashlight in the hardware layer to flash in response to a foreign object. Or, it can issue an external screen notification command to control the third screen (i.e., the external screen) of the electronic device to display relevant information about the foreign object. Furthermore, the application layer's foreign object detection module can also issue a voice broadcast command to instruct the speaker in the hardware layer to play a notification voice message.

[0272] In other embodiments, the foreign object detection module may also report the foreign object detection results to the backend as basic data for subsequent processing. Using foreign object detection results as basic data can include at least the following scenarios:

[0273] Scenario 1: Screen damage under warranty.

[0274] Specifically, in screen damage warranty assessment scenarios, it is usually necessary to trace the root cause of the screen damage. The method in this application embodiment can accurately detect the presence of foreign objects (i.e., foreign objects on the screen). Since foreign objects can sometimes damage the screen, after detecting a foreign object, the detection result can be reported as an abnormal event to the big data monitoring system as the basis for subsequent official screen repair warranty assessment.

[0275] Scenario 2: Equipment optimization scenario.

[0276] Specifically, when optimizing the performance of electronic devices, the adverse effects of foreign objects on foldable screens can be considered. This allows for performance optimization to minimize the presence of foreign objects or their attraction / stuck on the device. For example, screws typically remain on foldable screens because the screens possess a certain degree of magnetism, attracting them. If foreign object detection results indicate that screen breakage due to screws attracting the screen is common, then the performance of the electronic device can be optimized to reduce screw attraction, thereby decreasing the risk of screen breakage and improving the user experience to some extent.

[0277] Please see Figure 25 In some embodiments, another method for detecting foreign objects on a foldable screen is provided, which specifically includes the following steps:

[0278] (a2) Obtain the included angle θ of the display surface.

[0279] like Figure 25 As shown, when an electronic device responds to a user's folding operation, it can fold the screen, switching the screen from an unfolded state to a folded state. During the folding process, sensors can continuously detect the angle of the display surface of the folding screen, and the foreign object detection module in the application layer can obtain the angle of the display surface detected by the sensors.

[0280] (b2) Determine whether the included angle θ of the display surface is less than or equal to the first angle threshold φ.

[0281] like Figure 25 As shown, the foreign object detection module can determine whether the included angle θ of the display surface is less than or equal to the first angle threshold φ. If yes, it enters the foreign object detection state and executes step (c2). If no, it returns to the execution step (a2).

[0282] (c2) Obtain touch information from the foldable screen.

[0283] The touch information includes the location and capacitance of the touch point.

[0284] (d2) Determine whether it includes two touch areas that are symmetrical about the fold axis and have high capacitance.

[0285] Electronic devices can determine whether two screens contain two touch areas symmetrical about a folding axis, wherein each of the two touch areas contains a touch point with a capacitance value greater than a first capacitance threshold.

[0286] Specifically, the electronic device can determine whether the first screen includes a first touch area and the second screen includes a second touch area, wherein the positions of the first touch area and the second touch area are symmetrical about the folding axis; the first touch area includes a first touch point with a capacitance value greater than a first capacitance threshold, and the second touch area includes a second touch point with a capacitance value greater than the first capacitance threshold. If yes, it indicates that there is a foreign object on the screen surface, and (e2) can be executed; if no, it is determined that there is currently no foreign object on the surface of the folding screen. Since the folding process is continuous, it is necessary to return to execute (c2) to continue foreign object detection in the subsequent folding process until the folding screen is closed.

[0287] (e2) Foreign object alert.

[0288] In the above scheme, the foreign object detection state is entered only after the included angle of the display surfaces is less than or equal to a first angle threshold. Foreign object identification is performed based on the capacitance value detected in real time on the screen, which improves the accuracy of the foreign object detection trigger timing and avoids premature entry into the foreign object detection state, thus avoiding the consumption of system resources. In addition, if a foreign object is present, it will usually come into contact with the two folded screens when folded. Therefore, by detecting whether the capacitance value at symmetrical positions is too high, foreign objects can be identified more accurately.

[0289] like Figure 26 As shown, in some embodiments, another method for foreign object detection on a foldable screen is provided. This method is also described in conjunction with parts of the hardware structure or software system of the electronic device, and specifically includes the following steps:

[0290] (a3) Obtain the included angle θ of the display surface.

[0291] (b3) Determine whether the included angle θ of the display surface is less than or equal to the first angle threshold φ.

[0292] If yes, then enter the foreign object detection state and execute (c3); otherwise, return to execute (a3).

[0293] (c3) Obtain touch information from the foldable screen.

[0294] The touch information includes the location and capacitance of the touch point.

[0295] It should be understood that the processing method of steps (a3) ​​to (c3) above is the same as that of... Figure 24 and Figure 25 All of these are implemented by the foreign object detection module, which will not be elaborated further.

[0296] (d3) Determine whether there is a touch area within the pivot area with a capacitance value greater than the third capacitance threshold.

[0297] Specifically, the foreign object detection module can determine whether there is a touch area (i.e., the third touch area) with a capacitance value greater than the second capacitance threshold in the hinge area of ​​the folding screen. If so, (e3) is executed. If not, it is determined that there is currently no foreign object on the surface of the folding screen. Since the folding process is continuous, it is necessary to return to execute (c3) to continue foreign object detection in the subsequent folding process until the folding screen is closed.

[0298] (e3) Foreign object alert.

[0299] In addition to improving the accuracy of foreign object detection triggering timing, the above solution also identifies foreign objects by detecting whether the capacitance value in the pivot area is too high. This makes it applicable to special cases where foreign objects slip into the pivot area and are not easily detected, further improving the accuracy of foreign object identification.

[0300] In some embodiments, such as Figure 27 As shown, taking a foldable phone as an example, a simplified flowchart illustrates a method for detecting foreign objects on a foldable screen. Figure 27 It can be seen that this method includes the following steps:

[0301] 1. When the angle between the displayed surface and the reading surface is less than or equal to the first angle threshold (i.e., a certain set value), the electronic device enters the foreign object detection state.

[0302] 2. After entering the foreign object detection state, read the TP capacitance value (i.e., capacitance value) of the inner screen (i.e., the foldable screen).

[0303] 3. Make the following two judgments: (1) Determine whether the TP capacitance value of the hinge area exceeds the threshold a; (2) Determine whether the TP capacitance value of the symmetrical point of the folding axis in the inner screen (i.e., the symmetrical position that is symmetrical about the folding axis) is greater than the threshold b (i.e., the second capacitance threshold).

[0304] For example, at the data processing level, determining whether the TP capacitance value of the hinge area exceeds the threshold a may include: determining whether there is a touch area within the hinge area with a TP capacitance value greater than the third capacitance threshold, or determining whether the sum of the TP capacitance values ​​within the hinge area is greater than the sixth capacitance threshold.

[0305] 4. If any of the judgment conditions in (1) or (2) of the above 3 are met, it is determined that there is a foreign object in place (i.e. there is a foreign object on the surface of the folding screen), and the mobile phone will remind the user.

[0306] In some embodiments, such as Figure 28 The diagram shows a flowchart of a foreign object detection method for foldable screens. The method specifically includes the following steps:

[0307] S2801 acquires the angle of the display surface of the foldable screen in real time during the folding process.

[0308] S2802, determine whether the included angle of the display surface of the foldable screen is less than or equal to the first angle threshold.

[0309] If yes, then enter the foreign object detection state and execute S2803; otherwise, return to execute S2801.

[0310] S2803 reads the touch information in the foldable screen, including the position and capacitance of the touch point.

[0311] S2804, determine whether the first screen includes a first touch area and the second screen includes a second touch area.

[0312] The positions of the first touch area and the second touch area are symmetrical about the folding axis; the first touch area includes a first touch point with a capacitance value greater than a first capacitance threshold, and the second touch area includes a second touch point with a capacitance value greater than the first capacitance threshold; or, the sum of the capacitance values ​​of the first touch area and the second touch area is greater than the second capacitance threshold.

[0313] If not, execute S2805; if yes, execute S2806.

[0314] S2805, determine whether there is a third touch area in the hinge area of ​​the foldable screen with a capacitance value greater than the third capacitance threshold.

[0315] If yes, then execute S2806; otherwise, determine that there are currently no foreign objects on the surface of the foldable screen. Since the folding process is continuous, it is necessary to return to execute S2803 to continue foreign object detection during subsequent folding processes until the foldable screen is closed.

[0316] It should be understood that if foreign objects cannot be identified in symmetrical positions, further foreign object detection processing can be performed in the rotating area to improve the accuracy of detection.

[0317] It should be noted that in other embodiments, the processing order of S2805 and S2804 can also be interchanged. That is, the electronic device can also perform object position detection first and then hinge region detection. Specifically, the electronic device can first determine whether there is a region with a capacitance value greater than the second capacitance threshold within the hinge region. If not, it can then determine whether the capacitance value at the symmetrical position on the first screen and the second screen is greater than the first capacitance threshold. The embodiments of this application do not limit the order between hinge region detection and symmetrical position detection.

[0318] S2806, It is determined that there is a foreign object on the surface of the foldable screen.

[0319] S2807, Determine the type of foreign object based on the capacitance value at the location where the foreign object is present.

[0320] S2808, provide foreign object alerts according to the prompting method corresponding to the type of foreign object.

[0321] This application also provides a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the functions or steps described in the above method embodiments.

[0322] This application also provides a computer-readable storage medium including computer instructions that, when executed on the electronic device, cause the electronic device to perform the various functions or steps described in the method embodiments.

[0323] This application also provides a computer program product that, when run on a computer, causes the computer to perform the functions or steps described in the above method embodiments.

[0324] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0325] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0326] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0327] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0328] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0329] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for detecting foreign objects in a foldable screen, characterized in that, The invention relates to an electronic device including a foldable screen, wherein the foldable screen can be folded along a folding axis into a first screen and a second screen; wherein the foldable screen is in a folded state, the first screen and the second screen face each other, and the display faces of the first screen and the second screen are not visible to the user; The method includes: The foldable screen switches from an unfolded state to a folded state to acquire touch information on the foldable screen; wherein, the touch information includes the position and capacitance of the touch point; The pivot area of ​​the folding axis includes a third touch area with a capacitance value greater than a third capacitance threshold, and / or the first screen includes a first touch area and the second screen includes a second touch area, then a foreign object warning is issued; wherein, the positions of the first touch area and the second touch area are symmetrical about the folding axis; the first touch area includes a first touch point with a capacitance value greater than the first capacitance threshold, and the second touch area includes a second touch point with a capacitance value greater than the first capacitance threshold; or, the sum of the capacitance values ​​of the first touch area and the second touch area is greater than the second capacitance threshold.

2. The method according to claim 1, characterized in that, The foldable screen switches from an unfolded state to a folded state, and the touch information on the foldable screen is acquired, including: When the foldable screen switches from the unfolded state to the folded state, the angle between the display surfaces of the first screen and the second screen is less than a preset angle threshold, and touch information on the foldable screen is acquired.

3. The method according to claim 1 or 2, characterized in that, If the first screen includes a first touch area and the second screen includes a second touch area, then a foreign object warning is issued, including: The first screen includes the first touch point, and the second screen includes the second touch point; wherein the capacitance value of the first touch point is greater than the first capacitance threshold, and the capacitance value of the second touch point is greater than the first capacitance threshold. If there is a first touch area including the first touch point and a second touch area including the second touch point, a foreign object warning is issued; wherein the positions of the first touch area and the second touch area are symmetrical about the folding axis.

4. The method according to claim 3, characterized in that, If a first touch area including the first touch point and a second touch area including the second touch point exist, a foreign object warning is issued, including: The first touch area is obtained by expanding the first touch point outward by a first preset range; The second touch area is obtained by expanding the second touch point outwards by a second preset range; If the positions of the first touch area and the second touch area are symmetrical about the folding axis, a foreign object warning will be issued.

5. The method according to any one of claims 1-4, characterized in that, The first touch area and the second touch area are contained within the pivot area of ​​the folding axis.

6. The method according to any one of claims 1-5, characterized in that, If the first screen includes a first touch area and the second screen includes a second touch area, then a foreign object warning is issued, including: If it is found that the first screen includes a first touch area and the second screen includes a second touch area, then the first capacitance range corresponding to the capacitance values ​​of the first touch point and the second touch point is determined. Foreign object alerts are issued according to the alert method corresponding to the first foreign object type; wherein, the electronic device has multiple preset tolerance ranges, each tolerance range corresponds to a foreign object type, and each foreign object type is set with a corresponding alert method; the first foreign object type corresponds to the first tolerance range.

7. The method according to any one of claims 1-6, characterized in that, The switching of the foldable screen from an unfolded state to a folded state includes: The angle between the display surfaces of the first screen and the second screen was detected to change from large to small.

8. The method according to any one of claims 1-7, characterized in that, The method further includes: If the first screen includes the first touch area and the second screen includes the second touch area, control the folding screen to stop switching to the folded state or reduce the speed at which the folding screen switches to the folded state.

9. The method according to claim 8, characterized in that, The control of the foldable screen to stop switching to the folded state includes: Control the folding axis to lock; or, Activate the resistance device to generate resistance in the second direction to counteract the force of the folding axis, thereby stopping the relative movement of the first and second screens in the folding screen; or... The resistance device generates a resistance greater than the force of the folding axis in the second direction, causing the folding screen to return to its unfolded state; wherein the second direction is opposite to the first direction of the force of the folding axis.

10. The method according to claim 8, characterized in that, The method of reducing the speed at which the foldable screen switches to the folded state includes: The resistance device is activated to generate resistance in the second direction that is less than the force exerted by the folding axis, thereby reducing the speed at which the folding screen switches to the folded state.

11. An electronic device, characterized in that, The electronic device includes at least: a foldable screen, a memory, and one or more processors; the foldable screen can be folded into a first screen and a second screen; the foldable screen is used to display images, and the memory is used to store computer instructions, which, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1-10.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-10.

13. A computer program product, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1-10.

Images