Foreign matter detection method, device, chip system, storage medium, and program product

Abstract

Embodiments of the present application provide a foreign matter detection method and device, a chip system, a storage medium and a program product, and relate to the technical field of terminals. The method comprises: in the case where a folding screen device is switched from a non-folded state to a folded state, detecting at least one capacitance value between a first screen and a second screen; judging whether there is foreign matter between the first screen and the second screen based on the at least one capacitance value; and in the case where there is foreign matter between the first screen and the second screen, outputting a first prompt, the first prompt being used to remind that there is foreign matter between the first screen and the second screen. In this way, the service life of the folding screen device can be significantly improved, and the user experience can be improved.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to foreign object detection methods, devices, chip systems, storage media and program products. Background Technology

[0002] With the development of terminal technology, foldable screen devices have become widely used due to their portability and larger screen size. However, when dust, tiny particles, or other foreign objects enter and become trapped between the inner screens of a foldable device, these objects may cause physical damage to the screen with frequent folding and unfolding, resulting in scratches, dents, or even screen breakage. This not only affects the user experience but may also shorten the device's lifespan. Summary of the Invention

[0003] This application provides a foreign object detection method, apparatus, chip system, storage medium, and program product, applicable to the field of terminal technology. When a foldable screen device switches from an open to a foldable state, it detects at least one capacitance value between the inner screens of the foldable screen device and determines whether a foreign object exists between the inner screens based on this capacitance value. If a foreign object is found between the inner screens, the user is prompted to remove it. This can significantly extend the lifespan of the foldable screen device and improve the user experience.

[0004] In a first aspect, embodiments of this application propose a foreign object detection method applied to a foldable screen device. The foldable screen device includes a foldable first screen and a foldable second screen. The method includes: detecting at least one capacitance value between the first screen and the second screen when the foldable screen device switches from an open state to a foldable state; determining whether a foreign object exists between the first screen and the second screen based on the at least one capacitance value; and outputting a first prompt when a foreign object exists between the first screen and the second screen, the first prompt being used to remind that a foreign object exists between the first screen and the second screen.

[0005] The foldable screen device can be a two-fold or three-fold device, or other devices capable of folding multiple times. The foldable screen device can fold vertically, horizontally, or in other ways. This application does not impose specific limitations in this regard.

[0006] The non-folded state can be understood as the unfolded state and an intermediate state. The first screen and the second screen can be understood as two screens that can touch each other when the foldable screen device is in the folded state. The first screen can be, for example, screen 101 as described below, and the second screen can be, for example, screen 102 as described below; or, the first screen can be, for example, screen 801 as described below, and the second screen can be, for example, screen 802 as described below.

[0007] Detecting at least one capacitance value between the first screen and the second screen can be understood as: detecting the capacitance value of at least one capacitor node formed between the first screen and the second screen.

[0008] Detecting at least one capacitance value between the first screen and the second screen can be, for example, detecting the capacitance value of the capacitance node formed between screen 801 and screen 802 of the foldable screen device, as described below.

[0009] Determining whether there is a foreign object between the first screen and the second screen based on at least one capacitance value can be understood as determining whether there is a foreign object between the first screen and the second screen based on at least one capacitance value detected by the foldable screen device.

[0010] Based on at least one capacitance value, it can be used to determine whether there is a foreign object between the first screen and the second screen. For example, it can be used as described below to determine whether there is a foreign object between screen 101 and screen 102, or to determine whether there is a foreign object between screen 801 and screen 802 based on at least one capacitance value.

[0011] The first prompt can be understood as notifying the user that there is a foreign object between the first and second screens of the foldable screen device. When there is a foreign object between the first and second screens, the first prompt can be interpreted as the foldable screen device notifying the user of the presence of a foreign object on the inner screen and / or requesting its removal.

[0012] The first hint could be something like the following text. Figure 10 The screen pop-up prompt shown can also be presented in various ways, such as a beep or vibration. In the event of foreign objects between the first and second screens, the first prompt could be, for example, S305 as described below. When the foldable device detects foreign objects between the inner screens, it can prompt the user to remove the foreign objects in various ways.

[0013] The foreign object detection method of this application allows the foldable screen device to determine whether a foreign object exists between the first and second screens based on at least one capacitance value. If a foreign object is present, the user is prompted to remove it. This way, if a foreign object exists between the inner screens, the user can promptly identify the presence of a foreign object based on the initial prompt and remove it in a timely manner. This reduces the risk of damage to the inner screens caused by foreign objects remaining between them for extended periods, helps extend the lifespan of the foldable screen device, and improves the user experience.

[0014] Furthermore, users may find it difficult to detect smaller foreign objects in a timely manner. However, with the foreign object detection method of this application, even if a small foreign object exists between the first and second screens, the capacitance value between the first and second screens may change significantly. This allows the foldable screen device to promptly determine the presence of a foreign object between the first and second screens and alert the user via a first prompt to remove the foreign object from the inner screen.

[0015] In one possible implementation, determining whether there is a foreign object between the first screen and the second screen based on at least one capacitance value includes: calculating the difference between each capacitance value and a capacitance reference value to obtain at least one signal quantity; and determining whether there is a foreign object between the first screen and the second screen based on the at least one signal quantity.

[0016] The capacitance value can be understood as the capacitance value detected in real time by the foldable screen device. The capacitance reference value can be understood as the capacitance value when the foldable screen device is in the folded state and there are no foreign objects between its inner screens; this capacitance reference value can be a preset value. The semaphore can be understood as the difference between the real-time detected capacitance value and the capacitance reference value. Therefore, the closer the semaphore is to 0, the greater the probability that there are no foreign objects between the inner screens; conversely, the greater the probability that there are foreign objects between the inner screens.

[0017] The capacitance value can be, for example, the capacitance value of the inner screen of the foldable device acquired in real time based on the capacitance sensor, as described below. The semaphore can be, for example, similar to the semaphores detected in real time in Tables 1 and / or 2 below.

[0018] Based on at least one semaphore, it can be determined whether there is a foreign object between the first screen and the second screen. For example, it can be determined whether there is a foreign object between screen 101 and screen 102 based on the semaphore, or determined whether there is a foreign object between screen 801 and screen 802 based on the semaphore.

[0019] In this way, by calculating the difference between the real-time detected capacitance value and the capacitance reference value, tiny foreign objects can be accurately identified, thereby improving the precision and accuracy of foreign object detection.

[0020] In one possible implementation, determining whether there is a foreign object between the first screen and the second screen based on at least one semaphore includes: inputting at least one semaphore into a first model; obtaining a first result output by the first model, the first result being used to indicate whether there is a foreign object between the first screen and the second screen.

[0021] The first model can be understood as a model or network capable of identifying the presence of foreign objects based on semaphores. Inputting at least one semaphore into the first model can be understood as inputting at least one semaphore into a model or network capable of identifying the presence of foreign objects.

[0022] The first model could be, for example, the AI ​​perception module described below.

[0023] Optionally, the method further includes: preprocessing at least one semaphore to obtain at least one preprocessed semaphore; and inputting at least one semaphore into a first model, including: inputting at least one preprocessed semaphore into an AI perception module.

[0024] The preprocessing can involve removing at least one abnormal semaphore from the semaphores. Abnormal semaphores include, for example, those exceeding the normal value range. The normal value range includes the range of semaphore values ​​when there are no foreign objects, and may also include the range of semaphore values ​​when there are foreign objects. Abnormal semaphores can also include those that exhibit abrupt changes compared to semaphores of adjacent capacitor nodes. For example, combining... Figure 8 For multiple capacitor nodes arranged in adjacent rows, if the signal quantity of one capacitor node is significantly higher or lower than the signal quantity of other capacitor nodes (e.g., the difference is greater than a certain threshold), then the signal quantity of that capacitor node can be an abnormal signal quantity.

[0025] The first result can be understood as information indicating the presence or absence of foreign objects. Obtaining the first result from the first model output can be understood as the foldable screen device obtaining the result of whether a foreign object exists through the first model.

[0026] The first result can be, for example, whether the foreign object exists or not, as described below. Obtaining the first result from the first model's output can be, for example, the result of whether a foreign object exists in a foldable screen device, as described below, through the AI ​​perception module.

[0027] In this way, by using a model to detect the presence of foreign objects, foldable screen devices can accurately and efficiently detect whether there are foreign objects between the inner screens.

[0028] In one possible implementation, the foreign object detection method further includes: acquiring multiple training samples, where each training sample is a collection of multiple signal quantities between the third and fourth screens at a given time, and the third and fourth screens are foldable screens; inputting the multiple training samples into a first model to be trained; the first model to be trained outputting a second result, which is used to indicate whether there is a foreign object between the third and fourth screens; and obtaining the trained first model based on the second result.

[0029] The multi-frame training samples can be understood as the dataset used to train the first model. Each frame training sample can be understood as one sample in the multi-frame training samples. Similar to the first and second screens, the third and fourth screens can be understood as two screens that can touch each other when the foldable device is in a folded state.

[0030] Acquiring multi-frame training samples, where each frame of the training samples consists of multiple semaphores collected at a given time between the third and fourth screens, can be understood as acquiring a dataset for training the first model. Each frame of the training samples in the dataset consists of multiple semaphores collected at a given time between the third and fourth screens.

[0031] The multi-frame training samples can be, for example, the N frames of semaphores in S901 below. Each frame of training samples can be, for example, each frame of semaphores in the N frames of semaphores in S901 below. The third screen can be, for example, screen 101 or screen 801 below. The fourth screen can be, for example, screen 102 or screen 802 below. Acquiring multi-frame training samples, where each frame of training samples is multiple semaphores collected between the third and fourth screens at a given time, can be, for example, acquiring a dataset for a foldable screen device in S901 below.

[0032] The first model to be trained can be understood as the first untrained model. For example, the first model to be trained can be a CNN in S903 below.

[0033] Optionally, the method further includes: preprocessing the multi-frame training samples to obtain preprocessed training samples; and inputting the multi-frame training samples into the first model to be trained, including: inputting the preprocessed training samples into the first model to be trained.

[0034] The preprocessed training samples are similar to the preprocessed dataset described below. Inputting the preprocessed training samples into the first model to be trained can be, for example, inputting the preprocessed dataset into a CNN as described in S903 below.

[0035] The second result can be understood as the foreign object detection result output during the training of the first model. The output of the second result by the first model to be trained can be understood as the foreign object detection result output by the untrained first model.

[0036] The second result could be, for example, whether a foreign object exists in S904 below. The first model to be trained outputs a second result, for example, the result of whether a foreign object exists in the foldable screen device output in S904 below.

[0037] The trained first model can be understood as a pre-trained model that can be applied to foreign object detection in foldable screen devices. Based on the second result, obtaining the trained first model can be understood as adjusting the parameters of the first model based on the foreign object detection results, thus obtaining the trained first model.

[0038] The first trained model can be, for example, described below. Figure 9The AI ​​perception module obtained by the method shown. Based on the second result, the trained first model can be understood as adjusting the parameters of the CNN based on the foreign object detection results, thereby obtaining the trained CNN.

[0039] In this way, by acquiring multiple training samples that cover signal changes at different time points and under different states, the generalization ability and accuracy of the first model can be improved.

[0040] In one possible implementation, the foreign object detection method further includes: performing state detection when a first condition is met; the first condition includes one or more of the following: detecting that a user touches the foldable screen device; detecting a face; detecting that the distance between the user and the foldable screen device is less than a first threshold; or detecting that the user folds the foldable screen device.

[0041] The first condition can be understood as the condition that triggers the foldable screen device to perform state detection. State detection can be understood as the state detection of the foldable screen device. The first threshold can be understood as a preset threshold value.

[0042] The first condition can be, for example, condition 1 in S301 below. State detection can be, for example, determining whether the foldable screen device has switched to a folded state in S302 below. Detecting that the distance between the user and the foldable screen device is less than a first threshold can be, for example, detecting that the distance between the user and the foldable screen device is less than a certain threshold in S301 below.

[0043] In this way, by performing state detection when specific conditions are met, unnecessary detection processes can be effectively reduced, thereby saving computing resources and power consumption of foldable screen devices.

[0044] In one possible implementation, the foldable screen device further includes a Hall sensor; state detection includes: acquiring first data from the Hall sensor; if the first data indicates that the foldable screen device is in a folded state, obtaining the angle between the first screen and the second screen; if the angle is less than or equal to a second threshold, determining that the foldable screen device is in a folded state.

[0045] Here, the first data can be understood as data collected by the Hall sensor that reflects the state of the foldable screen device. When the first data indicates that the foldable screen device is in a folded state, obtaining the angle between the first and second screens can be understood as obtaining the angle between the first and second screens of the foldable screen device when it is in a folded state. Similar to the first threshold, the second threshold can be understood as a preset threshold value.

[0046] The first data could be, for example, the Hall sensor data in S401 below. When the first data indicates that the foldable screen device is in a folded state, the angle between the first screen and the second screen is obtained, for example, in S403 below. Based on the Hall sensor data, when the foldable screen device is in a folded state, the foldable screen device obtains the hinge angle. The second threshold could be, for example, threshold 1 below.

[0047] By combining the data from the Hall sensor with the angle between the first and second screens to determine the status of the foldable screen device, the accuracy of status detection for the foldable screen device is significantly improved.

[0048] In one possible implementation, the foreign object detection method further includes: determining that the foldable screen device is in an open state when the first data indicates that the foldable screen device is not in a folded state; and / or determining that the foldable screen device is in an open state when the included angle is greater than a second threshold.

[0049] In the case where the first data indicates that the foldable screen device is not in a folded state, determining that the foldable screen device is in an open state can be understood as the foldable screen device being considered to be in an open state when the data collected by the Hall sensor indicates that the foldable screen device is in an open state.

[0050] If the first data indicates that the foldable screen device is not in a folded state, determine that the foldable screen device is in an open state, for example, based on Hall sensor data as described below. If the foldable screen device is in an open state, execute S406.

[0051] Determining that a foldable screen device is in an unfolded state when the included angle is greater than the second threshold can be understood as the foldable screen device being considered to be in an unfolded state when the included angle between the first screen and the second screen is greater than the preset threshold.

[0052] If the included angle is greater than the second threshold, it is determined that the foldable screen device is in an unfolded state. For example, if the hinge angle is greater than or equal to the threshold 1, it means that the foldable screen device is not in a folded state, and the foldable screen device executes S406.

[0053] In this way, using multiple methods to determine the non-folded state of a foldable screen device helps reduce the possibility of misjudgment, thereby improving the accuracy of state detection.

[0054] In one possible implementation, the foldable screen device further includes a touch panel control chip; detecting at least one capacitance value between the first screen and the second screen includes: detecting at least one capacitance value between the first screen and the second screen via the touch panel control chip.

[0055] The touch panel control chip can be understood as being used to measure the capacitance value between the first and second screens of a foldable screen device. Detecting at least one capacitance value between the first and second screens through the touch panel control chip can be understood as the touch panel control chip being able to measure at least one capacitance value between the first and second screens.

[0056] In this way, the capacitance value between the first and second screens of the foldable screen device can be effectively measured through the touch panel control chip, thereby providing a basis for foreign object detection in the foldable screen device.

[0057] In one possible implementation, the foldable screen device further includes a fifth screen; the first prompt is a first pop-up window displayed on the fifth screen; the first pop-up window includes a first button and a second button; the first button is used to trigger the foldable screen device to close the first pop-up window; the second button is used to trigger the foldable screen device to display first information through the fifth screen, the first information including the location information of the foreign object; or, the second button is used to trigger the display of a first animation, the first animation being used to demonstrate the method of removing the foreign object.

[0058] The fifth screen can be understood as a screen that prompts the user to remove foreign objects. The first pop-up window can be understood as a pop-up window that prompts the user to remove foreign objects. The first button and the second button can be understood as different buttons; by operating these two buttons, different follow-up actions can be performed.

[0059] The fifth screen could be, for example, the outer screen of a foldable device (described below). The first pop-up window could be, for example, the outer screen of a foldable device (described below). Figure 9 The pop-up window shown. The first button could be, for example, as described below. Figure 9 The "Ignore" button is shown. The second button could be, for example, as described below. Figure 9 The "View More" button is shown.

[0060] In this way, by displaying a pop-up message on the fifth screen, users can be prompted to remove foreign objects.

[0061] In one possible implementation, the location information of the foreign object is determined based on the location of the capacitor node corresponding to the N semaphores with the largest absolute values ​​among at least one semaphore, where at least one semaphore includes the difference between each capacitance value and a capacitance reference value among at least one capacitance value, and N is a positive integer.

[0062] As can be understood, similar to the description in Table 2 below, capacitor nodes closer to foreign objects have a larger distance between their two plates (the upper and lower halves of the capacitor node), therefore the absolute value of the signal at these capacitor nodes may be larger. Capacitor nodes farther from foreign objects have a smaller distance, and the absolute value of the signal is relatively smaller. By analyzing these signal quantities, regions with larger absolute values ​​of signal quantity can be identified. These regions are usually close to the location of the foreign object; for example, the locations of the capacitor nodes corresponding to the bolded signal quantities in Table 2 may indicate the presence of a foreign object.

[0063] Among at least one semaphore, the N semaphores with the largest absolute values ​​are at locations where there is a greater probability of foreign objects.

[0064] In this way, by selecting the signal quantity with the largest absolute value, the node with the most significant capacitance change can be accurately identified, thereby precisely locating the foreign object.

[0065] Secondly, embodiments of this application provide a foreign object detection device, which can be a foldable screen device, or a chip or chip system within the foldable screen device. The foreign object detection device may include a display unit and a processing unit. When the foreign object detection device is a foldable screen device, the display unit may be a display screen. The display unit is used to perform display steps to enable the foldable screen device to implement a foreign object detection method described in the first aspect or any possible implementation of the first aspect. When the foreign object detection device is a foldable screen device, the processing unit may be a processor. The foreign object detection device may further include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the foldable screen device to implement a foreign object detection method described in the first aspect or any possible implementation of the first aspect. When the foreign object detection device is a chip or chip system within the foldable screen device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to enable the foldable screen device to implement a foreign object detection method described in the first aspect or any possible implementation of the first aspect. The storage unit can be a storage unit within the chip (e.g., a register, cache, etc.) or a storage unit located outside the chip within the foldable screen device (e.g., a read-only memory, random access memory, etc.).

[0066] For example, a display unit is used to display a pop-up screen prompting the user to remove foreign objects.

[0067] The processing unit is used to detect the status of the foldable screen device.

[0068] Thirdly, embodiments of this application provide a foldable screen device, including a processor and a memory, wherein the memory is used to store code instructions and the processor is used to run the code instructions to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0069] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program or instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0070] Fifthly, embodiments of this application provide a computer program product including a computer program, which, when run on a computer, causes the computer to perform the methods described in the first aspect or any possible implementation thereof.

[0071] Sixthly, this application provides a chip or chip system including at least one processor and a communication interface. The communication interface and the at least one processor are interconnected via a circuit. The at least one processor is used to run computer programs or instructions to perform the methods described in the first aspect or any possible implementation of the first aspect. The communication interface in the chip can be an input / output interface, pins, or circuits, etc.

[0072] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0073] In a seventh aspect, this application provides yet another foreign object detection device, including a module for performing the method as described in any of the possible implementations of the first aspect.

[0074] It should be understood that the second to seventh aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0075] Figure 1 A schematic diagram illustrating an application scenario provided in an embodiment of this application;

[0076] Figure 2 A schematic diagram illustrating the presence of foreign objects between the inner screen of a foldable screen device provided in this application embodiment;

[0077] Figure 3A schematic diagram of a foreign object detection method provided in an embodiment of this application;

[0078] Figure 4 This is a schematic diagram of a method for determining the state of a foldable screen device according to an embodiment of this application;

[0079] Figure 5 This is a schematic diagram of a method for foreign object detection in a foldable screen device provided in an embodiment of this application;

[0080] Figure 6 This is a schematic diagram of a method for signal detection in a foldable screen device provided in an embodiment of this application;

[0081] Figure 7 This is a schematic diagram showing the distance d between the inner screens of the foldable screen device provided in this application embodiment when there are foreign objects between them;

[0082] Figure 8 A schematic diagram of multiple capacitor plates on the inner screen of the foldable screen device provided in the embodiments of this application;

[0083] Figure 9 This application provides a schematic diagram illustrating the process of training an AI perception module in an embodiment of the present application.

[0084] Figure 10 This is a schematic diagram illustrating a method for prompting a user to remove foreign objects from a foldable screen device, as provided in an embodiment of this application.

[0085] Figure 11 This application provides a schematic diagram illustrating the interaction between the software modules and hardware of a foldable screen device.

[0086] Figure 12 A schematic block diagram illustrating the hardware architecture of a foldable screen device provided in an embodiment of this application;

[0087] Figure 13 This is a schematic block diagram of a foreign object detection device provided in an embodiment of this application. Detailed Implementation

[0088] To facilitate a clear description of the technical solutions in the embodiments of this application, some terms and technologies involved in the embodiments of this application will be briefly introduced below:

[0089] 1. Foldable screen devices

[0090] This can be understood as an electronic device with a foldable screen. In other words, it is an electronic device that achieves a foldable screen display form through flexible components, such as hinges or flexible screens.

[0091] 2. Folded state, unfolded state, and intermediate state

[0092] These terms are used to describe three different states of foldable screen devices.

[0093] The folded state can refer to the state where the angle between the two screen parts of a foldable device connected by a flexible component is less than or equal to a first threshold, which can be, for example, 0 or a value close to 0. The unfolded state can refer to the state where the angle between the two screen parts of a foldable device connected by a flexible component is greater than or equal to a second threshold, which can be, for example, 180° or a value close to 180°.

[0094] In one possible implementation, the first threshold is equal to the second threshold. This implementation can be understood as the foldable screen device being either in a folded state or an unfolded state. That is, the foldable screen device has no intermediate state.

[0095] In another possible implementation, the second threshold is greater than the first threshold. In this implementation, the foldable screen device exists in an intermediate state, and the foldable screen device is in an intermediate state when the included angle between the two screens connected by the flexible component is greater than the first threshold and less than the second threshold.

[0096] It should be understood that the intermediate state can also be called a transitional state, a partially folded state, a partially unfolded state, an incompletely folded state, or an incompletely unfolded state, etc., and this application does not make any specific limitation on it.

[0097] 2. Inner screen and outer screen

[0098] Foldable screen devices typically include multiple screens connected by flexible components. Furthermore, for the same foldable screen device, the screen used by the user when the device is in the folded state is usually different from the screen used when the device is in the unfolded state. The screen used by the user when the device is folded can be called the outer screen; the screen used by the user when the device is unfolded can be called the inner screen.

[0099] In other words, the inner screen can refer to the screen that displays the main content when the foldable device is in the unfolded state. It is usually a larger screen formed by multiple screens connected by flexible components, which is used to provide a wider field of view and a more comfortable operating experience.

[0100] The outer screen refers to the screen used to display content when a foldable device is in its folded state. It is usually a smaller screen (relative to the inner screen) and can be used to display basic information, notifications, and quick actions. The outer screen can typically display information such as time, date, and incoming call information, making it easier for users to operate the device when it is folded.

[0101] 3. Hall effect sensor

[0102] Hall effect sensors are used in electronic devices to determine the device's state. Taking foldable screen devices as an example, a Hall effect sensor can identify whether the device is folded or unfolded. Typically, a small magnet is embedded on one side of a foldable screen device, while a Hall effect sensor is located on the other side. When the device is folded, the magnet approaches the Hall effect sensor, which detects the magnetic field and sends a signal to the processor to notify that the device is currently folded.

[0103] 4. Hinge corner

[0104] The hinge angle can be understood as the angle between the two foldable screens of a foldable device when it is in a folded or unfolded state. This angle can be used to determine the state of the foldable device, i.e., whether it is in a folded or unfolded state. When the hinge angle is close to 0° or equal to 0°, it is generally considered to be in a folded state; when the hinge angle is close to 180° or equal to 180°, it is generally considered to be in an unfolded state.

[0105] 5. Other terms

[0106] In the embodiments of this application, terms such as "first" and "second" are used to distinguish identical or similar items with substantially the same function and purpose. For example, "first chip" and "second chip" are used only to distinguish different chips and do not limit their order of execution. Those skilled in the art will understand that terms such as "first" and "second" do not limit the quantity or execution order, and that "first" and "second" do not necessarily imply that they are different.

[0107] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0108] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0109] 6. Foldable screen devices

[0110] The foldable screen device in this application embodiment can also be a foldable screen device with a foldable screen. This foldable screen device may include handheld devices, vehicle-mounted devices, etc., with a foldable screen. For example, some foldable screen devices include: mobile phones, tablets, PDAs, laptops, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to a wireless modem, in-vehicle devices, wearable devices, foldable screen devices in 5G networks, or future evolution of public land mobile communication networks. The embodiments of this application are not limited to foldable screen devices in a network (PLMN), etc.

[0111] By way of example and not limitation, in this embodiment, the foldable screen device can also be a wearable device. Wearable devices, also known as wearable smart devices, are a general term for devices that utilize wearable technology to intelligently design and develop everyday wearables, such as glasses, gloves, watches, clothing, and shoes. Wearable devices are portable devices that are worn directly on the body or integrated into the user's clothing or accessories. Wearable devices are not merely hardware devices, but also achieve powerful functions through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include those that are feature-rich, large in size, and can achieve complete or partial functions without relying on a smartphone, such as smartwatches or smart glasses, as well as those that focus on a specific type of application function and require the use of other devices such as smartphones, such as various smart bracelets and smart jewelry for vital sign monitoring.

[0112] Furthermore, in this embodiment, the foldable screen device can also be a foldable screen device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network of human-machine interconnection and object-to-object interconnection.

[0113] The foldable screen device in this application embodiment can also be referred to as: electronic device, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent, or user equipment, etc.

[0114] In this embodiment, the foldable screen device or various network devices include a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also called main memory). The operating system can be any one or more computer operating systems that implement business processing through processes, such as Linux, Unix, Android, iOS, or Windows. The application layer includes applications such as browsers, address books, word processing software, and instant messaging software.

[0115] With the rapid advancement of terminal technology, foldable screen devices have gradually gained widespread attention from consumers. Foldable screen devices maintain high-quality display effects while allowing for free folding. This not only improves the portability of the device but also brings users a large-screen visual experience.

[0116] To facilitate understanding of the embodiments of this application, the following uses a foldable screen phone as an example of a foldable screen device, and combines it with... Figure 1 The application scenarios of the embodiments of this application will be described in detail.

[0117] Figure 1 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application. For example... Figure 1 As shown in (a), this is a schematic diagram of a foldable phone when it is fully unfolded, or it can be understood as a schematic diagram of a foldable phone in its unfolded state.

[0118] In this state, the phone screen is fully open, forming a seamless large screen that provides a wider visual experience.

[0119] In response to user actions on the foldable screen phone, the foldable screen phone can display, for example... Figure 1 The state shown in (b) can also be understood as an intermediate state.

[0120] In this state Figure 1 The large screen of the foldable phone shown in (b) consists of two screens, namely screen 101 and screen 102. Screen 101 and screen 102 can be understood as the inner screen of the foldable phone.

[0121] The angle between the inner screens can be called the hinge angle, such as the angle formed between screen 101 and screen 102, which is hinge angle 103. The change of hinge angle 103 can reflect the dynamic process of the foldable screen phone from the unfolded state to the folded state.

[0122] Users can adjust the screen's opening angle (i.e., hinge angle) as needed to achieve different usage modes. For example, in an intermediate mode, a user can watch a video on screen 101 while chatting or taking notes on screen 102.

[0123] like Figure 1 As shown in (c), in response to the user's continued operation of folding the foldable phone, the foldable phone can be in a folded state.

[0124] In this state, the outer screen 104 of the foldable phone can light up, providing basic operation and information display functions. Users can answer calls, view notifications, and quickly reply to messages through the outer screen without unfolding the device. The foldable phone in its folded state is more portable and easier to carry around, while also protecting the inner screen from external damage.

[0125] It should be noted that the above example of a foldable phone folding horizontally is merely an illustration and does not limit the type or folding method of foldable devices. In real-world applications, foldable devices can employ a variety of folding methods, and their types can include, but are not limited to, laptops, tablets, and smart home control systems. The folding design of different foldable devices can be adjusted and expanded based on actual needs and technological capabilities. For example, a foldable phone might fold vertically, or it might not include an external screen when folded. Furthermore, foldable devices are not limited to two-fold devices; they can also include three-fold devices and other devices with more foldable screens. For simplicity, these will not be shown individually here.

[0126] However, despite the numerous advantages of foldable screen devices in terms of functionality and design, the durability of their screens remains a significant issue. This is especially true when users are folding the device, such as... Figure 2 As shown, if foreign objects 201, such as dust, sand, or other tiny particles, enter between the inner screens, these objects may scratch or indent the screen of the foldable device during the folding process. Because the screen structure of foldable devices is relatively complex, the presence of foreign objects can not only affect the screen's display performance but may also lead to permanent damage.

[0127] In view of this, embodiments of this application provide a foreign object detection method. When a foldable screen device switches from an intermediate state to a folded state, the foldable screen device can determine whether there is a foreign object between the inner screens by detecting the capacitance value between the inner screens. If a foreign object is found, the foldable screen device can remind the user to remove the foreign object through a first prompt.

[0128] Alternatively, the foldable screen device may not output the first prompt if there are no foreign objects present.

[0129] For example, Figure 3 This is a schematic diagram of the foreign object detection method 300 provided in an embodiment of this application. Figure 3 The specific steps of method 300 shown are as follows:

[0130] S301, Foldable screen device trigger status detection.

[0131] Triggering state detection can also be understood as initiating state detection. State detection can be understood as the process of detecting the state of a foldable screen device, which includes the unfolded state, intermediate state, and folded state.

[0132] It's understandable that since folding a foldable screen device is a continuous (or potentially prolonged) operation, and the device may undergo multiple state changes during this process, state detection can also refer to the foldable screen device continuously or periodically performing state checks over a certain period.

[0133] It should be understood that, in the embodiments of this application, the user folding the foldable screen device includes operations such as folding the foldable screen device from an unfolded or intermediate state to a folded state, folding the unfolded foldable screen device to an intermediate state, and unfolding the folded device to an intermediate or unfolded state. That is, folding the foldable screen device can involve either reducing the hinge angle between the inner screens of the foldable screen device or increasing the hinge angle between the inner screens of the foldable screen device. This application does not specifically limit this.

[0134] In one possible implementation, the foldable screen device triggers state detection when condition 1 is met. Condition 1 may include any one or more of the following: detecting user touch on the foldable screen device, detecting a face, detecting the distance between the user and the foldable screen device is less than a certain threshold, or detecting user folding the foldable screen device, etc.

[0135] Thus, if condition 1 is met, it indicates that the state of the foldable screen device may have changed, and state detection can then begin.

[0136] In another possible implementation, S301 can also be replaced by: the foldable screen device continuously or periodically performing status detection. That is, the foldable screen device can perform status detection in real time without triggering conditions.

[0137] For example, foldable screen devices can use their internal sensors (such as Hall sensors) and / or other technologies (such as detecting the angle of the inner screen hinge corner, software algorithms, etc.) to determine whether the foldable screen device has undergone a process of switching from an intermediate state to a folded state. See the description below for details, which will not be elaborated here.

[0138] S302, Foldable screen devices determine whether to switch to foldable mode.

[0139] When the foldable screen device switches to the folded state, the foldable screen device executes S303-S305.

[0140] If the foldable screen device has not switched to the folded state, the foldable screen device executes S306.

[0141] It can be understood that switching to a folded state can include switching from any state to a folded state.

[0142] For example, the switching of a foldable screen device to a folded state can include, but is not limited to, the following situations: the initial state of the foldable screen device is an unfolded state, and the final state is a folded state, with a transition from an intermediate state to a folded state during the transition from the initial state to the final state; the initial state of the foldable screen device is a folded state, and the final state is a folded state, with a transition from a folded state to an intermediate state and then back to a folded state during the transition from the initial state to the final state; the initial state of the foldable screen device is a folded state, and the final state is a folded state, with a transition from a folded state to an unfolded state and then back to a folded state during the transition from the initial state to the final state.

[0143] There are several situations where a foldable screen device does not switch to the folded state: the initial state of the foldable screen device is the unfolded state, and the foldable screen device is directly folded from the unfolded state to the intermediate state; the initial state of the foldable screen device is the intermediate state, and the foldable screen device is directly folded from the intermediate state to the unfolded state.

[0144] S303, Foldable screen devices start foreign object detection function.

[0145] In other words, when a foldable screen device switches to a folded state, the foreign object detection function is activated.

[0146] It is understandable that, since the state of a foldable screen device changes from any state to the folded state, foreign objects may enter between the inner screens of the foldable screen device, thus foreign object detection can be activated.

[0147] The main purpose of the foreign object detection function is to ensure that no foreign objects are trapped between the screens of the foldable screen device when it is folded, thereby protecting the screen of the foldable screen device.

[0148] S304. Based on the foreign object detection results, the foldable screen device determines whether there are foreign objects between the inner screens.

[0149] If the foldable screen device determines that there is a foreign object in the inner screen, execute S305.

[0150] If the foldable screen device determines that there are no foreign objects between the inner screens, execute S306.

[0151] Foldable screen devices can determine whether there are foreign objects between the screens based on foreign object detection results, and then decide whether the user needs to clean them.

[0152] S305, Foldable screen devices prompt users to remove foreign objects.

[0153] For example, when a foldable screen device detects a foreign object inside the inner screen, it can prompt the user to remove the object in various ways, including but not limited to visual cues (such as screen pop-ups), sound alarms (such as beeps), and vibration feedback. These prompts allow the user to take timely action to remove the foreign object and protect the foldable screen device. Prompting the user to remove the foreign object can also be understood as informing the user that there is a foreign object on the screen.

[0154] S306, Foldable screen devices do not prompt the user.

[0155] The foldable screen device does not notify the user when it is not in folded mode or when it does not detect a foreign object. This lack of notification can be interpreted as the foldable screen device taking no action.

[0156] Through the steps described above, foldable screen devices can detect their status and the presence of foreign objects, and take appropriate measures based on the detection results. This method can protect the screen of foldable screen devices, thereby improving the user experience.

[0157] It is understandable that, regarding S301 in method 300, in one possible scenario, the foldable screen device can stop state detection after detecting that the foldable screen device has switched to a folded state in S302; and it can also trigger state detection again when it detects that the above condition 1 is met again. In another possible scenario, the foldable screen device can also stop state detection when it detects that condition 2 is met. Condition 2 may include, but is not limited to, one or more of the following: detecting that the user no longer touches the foldable screen device (e.g., the hand leaves the foldable screen device), detecting that the distance between the user and the foldable screen device is greater than a certain threshold, or detecting that the user's operation of folding the foldable screen device has terminated, etc.

[0158] Foldable screen devices can determine their state at a certain moment through various methods. Based on the state of the foldable screen device at multiple moments, it can be determined whether the foldable screen device has undergone a state transition, such as switching from an intermediate state to a folded state.

[0159] For example, a foldable screen device can determine its state at a given moment using a Hall sensor and the hinge angle, as described below. Figure 4 The method 400 shown provides a detailed description of this process.

[0160] S401, Foldable screen devices acquire Hall sensor data.

[0161] Hall effect sensors are used to detect the strength of the magnetic field around foldable screen devices. By embedding a small magnet in a part of the foldable screen device (such as the screen or body), the Hall effect sensor can detect the proximity of the magnet.

[0162] For example, the foldable screen device acquires the current magnetic field strength data through a Hall sensor. This data can be used to make a preliminary judgment on the state of the foldable screen device.

[0163] S402. Based on Hall sensor data, determine whether the foldable screen device is in a folded state.

[0164] If the foldable screen device is in a folded state based on Hall sensor data, execute S403-S405.

[0165] If the foldable screen device is in an open state based on Hall sensor data, execute S406.

[0166] "Not in folded state" indicates that the foldable screen device is in an unfolded state or an intermediate state.

[0167] When the Hall sensor detects a strong magnetic field (e.g., greater than or equal to threshold a), it indicates that the foldable screen device is in a folded state. When the Hall sensor detects a weak magnetic field (e.g., less than threshold b, where threshold b is less than or equal to threshold a), it indicates that the foldable screen device is not in a folded state.

[0168] However, due to external electromagnetic interference, Hall effect sensors may misinterpret an unfolded or intermediate state as a folded state. Therefore, relying solely on Hall effect sensors to determine the state of a foldable screen device may not be accurate enough. Thus, the state of the foldable screen device can be further determined by the hinge angle.

[0169] S403, The angle of the hinge angle of the foldable screen device.

[0170] For example, an angle sensor can be installed at the hinge of a foldable screen device to accurately measure the hinge angle. The foldable screen device can obtain the current hinge angle data from the angle sensor.

[0171] S404, Foldable screen devices determine whether the hinge angle is less than the threshold 1.

[0172] If the hinge angle of the foldable screen device is less than the threshold 1, it indicates that the foldable screen device is in a folded state, and the foldable screen device executes S405.

[0173] If the foldable screen device determines that the hinge angle is greater than or equal to the threshold 1, it indicates that the foldable screen device is not in a folded state, and the foldable screen device executes S406.

[0174] When the hinge angle is less than threshold 1 (e.g., threshold 1 is 5 degrees), the foldable screen device is considered to be in a folded state. When the hinge angle is greater than or equal to threshold 1 (e.g., threshold 1 is 5 degrees), the foldable screen device is considered to be in an unfolded state or an intermediate state.

[0175] It should be noted that threshold 1 is a preset value and can be adjusted according to the design and usage scenario of the foldable screen device. In another possible implementation, the foldable screen device is considered to be in a folded state when the hinge angle is less than or equal to threshold 1, and in an unfolded state when the hinge angle is greater than threshold 1. This application does not specifically limit this aspect.

[0176] S405, The foldable screen device is in a folded state.

[0177] The foldable screen device is confirmed to be in a folded state only when the Hall sensor detects a strong magnetic field and the hinge angle is less than the threshold 1.

[0178] S406, The foldable screen device is not in a folded state.

[0179] When the Hall sensor detects a weak magnetic field or the hinge angle is greater than or equal to the threshold 1, it confirms that the foldable screen device is not in a folded state.

[0180] It should be noted that, in addition to the methods for detecting the state of a foldable screen device described above, other sensors and / or methods can also be used to determine its state. For example, a foldable screen device can utilize accelerometers and gyroscopes to detect its motion and angular changes to further confirm the state of the foldable screen device. This application does not specifically limit this approach.

[0181] The above describes the process by which foldable screen devices determine their state. Foldable screen devices can activate foreign object detection to protect the screen when switched to a folded state. The following section combines... Figure 5 The method 500 shown details the process of foreign object detection in a foldable screen device (which can be understood as the implementation of S304-S305 and S304-S306).

[0182] S501, the touch panel integrated circuit (TPIC) control chip for foldable screen devices, delays power-down (or delays entering low-power mode).

[0183] Among them, TP IC is an integrated circuit used to manage and process input signals of the touch panel. It can convert user input operations (such as clicks, swipes, etc.) into digital signals so that the processor of the foldable screen device can understand and respond to the user's input operations.

[0184] Under normal circumstances, to reduce the power consumption of foldable screen devices, when the device switches to a folded state, since the user may not be able to touch the inner screen, the TP IC can be powered down or put into a low-power mode. Furthermore, upon detecting that the foldable screen device has switched from a folded state to another state, the TP IC can be powered on or exit low-power mode to promptly understand and respond to user input.

[0185] However, in this embodiment, to facilitate foreign object detection based on the TP IC, after the foldable screen device detects that its state has switched to a folded state, the TP IC can be controlled to power down for a delay (or enter a low-power mode for a delay). Powering down or entering the low-power mode can be performed after a preset time, or after the foreign object detection is completed. This allows the foldable screen device sufficient time to complete the foreign object detection through the TP IC.

[0186] S502: Foldable screen devices determine whether there are foreign objects between the inner screens by detecting the signal quantity of the TP IC.

[0187] If there are foreign objects between the inner screens of a foldable screen device, execute S503.

[0188] If there are no foreign objects between the inner screens of the foldable screen device, execute S504.

[0189] The semaphore can be understood as the difference between the capacitance value collected by the TP IC and the capacitance reference value when the foldable screen device is in the folded state. The capacitance reference value can be understood as the capacitance value when there are no foreign objects between the inner screens of the foldable screen device in the folded state, and this capacitance reference value can be a preset value.

[0190] For example, the capacitance reference value can be set based on experience or obtained through multiple experimental measurements.

[0191] Therefore, the closer the difference between the capacitance value acquired by the TP IC and the capacitance reference value, i.e. the signal quantity, is to 0, the greater the probability that there is no foreign object.

[0192] Optionally, the foldable screen device can input the acquired signal into the artificial intelligence (AI) sensing module, which can then output the foreign object detection result.

[0193] To improve detection accuracy, foldable screen devices can perform capacitance detection in multiple areas of the inner screen using TP ICs.

[0194] S503, the foldable screen device transmits information 1 to the application layer. Information 1 is used to indicate that there are foreign objects in the inner screen.

[0195] It is understandable that when a foldable screen device detects a foreign object between its inner screen and the inner screen, it sends this information 1 to the application layer so that the application layer can process it further, such as notifying the user of the presence of a foreign object between the inner screen through pop-ups, prompts, notifications, etc.; or, playing voice messages through devices such as microphones to notify the user of the presence of a foreign object between the inner screen and the inner screen.

[0196] S504, the TP IC of the foldable screen device is powered down (or enters low power mode).

[0197] The TP IC power-down step refers to turning off the power supply to the TP IC. This step is typically performed when touch functionality is not required and capacitance detection is not needed, in order to save power and protect the hardware. Power-down (or entering a low-power mode) can be temporary, such as when a foldable device enters sleep mode, or permanent, such as when the foldable device is powered off.

[0198] It should be noted that, in addition to the foreign object detection methods described above, foldable screen devices can also employ other sensors and / or methods to determine the presence of foreign objects. For example, foldable screen devices can utilize optical sensors to detect foreign objects between the inner screens, because optical sensors can emit light and detect changes in reflected light, thereby identifying the presence of foreign objects. This application does not specifically limit the scope of this application.

[0199] The following is combined with Figure 6 right Figure 5 The process of signal detection in foldable screen devices is explained in detail.

[0200] S601, foldable screen devices acquire signal quantities based on TP IC.

[0201] When the foldable screen device is in the folded state, the TP IC can collect the capacitance value on the current inner screen through its sensor array, and calculate the difference between the collected capacitance value and the capacitance reference value, thereby obtaining the signal.

[0202] The sensor array can be understood as a group of capacitive sensors arranged beneath the inner screen of a foldable device. The TP IC can scan these capacitive sensors and collect the capacitance value obtained by each sensor.

[0203] S602, The foldable screen device preprocesses the acquired signal.

[0204] Because the signals acquired by TP IC may contain anomalous signals, preprocessing is necessary. Preprocessing steps include denoising, filtering, and normalization to improve data accuracy and consistency. Denoising removes anomalous signals using algorithms, filtering smooths data fluctuations, and normalization adjusts the data to a standard range for easier subsequent analysis.

[0205] Abnormal semaphores can also be understood as semaphores whose semaphores change abruptly (e.g., the difference is greater than a certain threshold) at adjacent (or nearby) capacitor node locations.

[0206] S603, the foldable screen device inputs the pre-processed signal into the AI ​​sensing module.

[0207] The AI ​​perception module, composed of a neural network, analyzes preprocessed signals to determine the presence of foreign objects between the inner screens. The trained AI perception module can identify outliers in the signal, which indicate the presence of foreign objects.

[0208] S604, the AI ​​perception module outputs foreign object detection results.

[0209] The AI ​​sensing module analyzes the preprocessed signal and outputs a foreign object detection result. If a foreign object is detected, the AI ​​sensing module outputs a result indicating the presence of a foreign object. If no foreign object is detected, the AI ​​sensing module outputs a result indicating the absence of a foreign object.

[0210] It's understandable that for foldable screen devices, multiple capacitor nodes can be set on the inner screen. For any pair of capacitor nodes between two inner screens, a capacitance value can be measured. Therefore, multiple signal quantities can be obtained through the TP IC. The AI ​​sensing module can determine the presence of foreign objects between the inner screens based on these pre-processed signal quantities.

[0211] For example, the AI ​​perception module can compare the preprocessed signal with threshold 2. If the number of preprocessed signals that are greater than or equal to threshold 2 is greater than or equal to threshold 3, then it is considered that there are foreign objects between the inner screens of the foldable screen device; otherwise, it is considered that there are no foreign objects between the inner screens of the foldable screen device.

[0212] It should be noted that, like threshold 1, thresholds 2 and 3 are preset values ​​that can be adjusted according to the design and usage scenarios of foldable screen devices.

[0213] The following is combined with Figure 7 right Figure 6 The semaphores in the text are explained.

[0214] For example, such as Figure 7As shown in (a), when the inner screen of the foldable screen device is folded normally and there are no foreign objects, the distance d between the upper and lower halves of the screen is the reference value d1. In this case, there are no foreign objects between the two plates of the capacitor (i.e., the upper and lower halves of the inner screen), and the capacitance value is in a normal state. For example, the capacitance value is in the range of 20,000 to 30,000, and the capacitance value is close to the capacitance reference value. Because the capacitance value fluctuates, the range of the signal quantity (the difference between the capacitance value and the capacitance reference value) acquired by the TP IC is -50 to 50.

[0215] like Figure 7 As shown in (b), when there is a foreign object between the upper and lower halves of the inner screen of the foldable screen device, the distance d > d1. In this case, the capacitance value is in an abnormal state, which can be understood as the capacitance value being less than the capacitance reference value, or the difference between the capacitance value and the capacitance reference value being large. For example, assuming the capacitance reference value is 25000, when the distance d between the upper and lower halves of the inner screen of the foldable screen device is greater than d1, its capacitance value is 24600~24700, then the range of the signal value acquired by the TP IC at this time is 200~300.

[0216] Comparing 200-300 with -50-50, it can be seen that there are significant differences in signal strength between the presence and absence of foreign objects on the inner screen.

[0217] It can be understood that the capacitance value satisfies the following formula 1:

[0218] C = ε × S / d (Formula 1),

[0219] Where C is the capacitance value, ε is the dielectric constant, representing the conductivity of the dielectric material in the capacitor, S is the area of ​​the two corresponding capacitor plates, and d is the maximum distance between the two corresponding plates.

[0220] Therefore, when there are foreign objects between the inner screens, the distance between them may be large, causing the capacitance value to change. In this embodiment, the signal quantity obtained based on the capacitance value can accurately determine whether there are foreign objects between the inner screens.

[0221] Understandable, such as Figure 8 As shown, the inner screen of a foldable device has multiple capacitor plates, or it can be understood as an electrode array distributed on the inner screen, which can be understood as capacitor plates. Two corresponding capacitor plates can form a capacitor node. Each capacitor node can be regarded as a small capacitor.

[0222] Assuming the inner screen of the foldable device includes screen 801 and screen 802, each screen 801 and screen 802 has multiple capacitor plates (shown as black circles in the diagram). Furthermore, the capacitor plates on screen 801 and screen 802 are in one-to-one correspondence. For example, capacitor plate A corresponds to capacitor plate B, and capacitor plates A and B can form a capacitor node; capacitor plate C corresponds to capacitor plate D, and capacitor plates C and D can form a capacitor node. The corresponding capacitor plates can also be understood as overlapping when the foldable device is folded into a folded state.

[0223] For example, assuming there is a capacitor plate at position (x1, y1) on screen 801, there is also a corresponding capacitor plate at position (x1, y1) on screen 802. These two capacitor plates have equal areas and can form a capacitor node. In the folded state, the TP IC can measure a capacitance value for each capacitor node.

[0224] For example, assuming that 112 capacitor nodes can be formed between the capacitor plates of screen 801 and screen 802, then the foldable screen device can determine 14 × 8 = 112 capacitor values.

[0225] Based on the above 112 capacitance values ​​and the capacitance reference value, the foldable screen device can calculate 112 semaphores.

[0226] When there are no foreign objects between the inner screens, the 112 semaphores can be represented as shown in Table 1.

[0227] In this table, the numbers 1-14 in the first row represent the number of rows of the capacitor nodes on the screen; and the numbers 1-8 in the first column represent the number of columns of the capacitor nodes on the screen.

[0228] Table 1

[0229] 1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 15 0 6 21 12 45 3 27 36 18 22 8 49 31 2 6 43 45 12 5 16 40 -10 23 7 34 29 41 19 3 20 32 14 41 -11 38 2 25 47 9 30 14 46 21 4 21 20 -50 41 4 33 20 6 48 13 35 28 44 -1 5 12 14 5 23 17 32 24 39 15 26 37 0 43 42 6 20 23 2 20 12 -5 23 7 41 19 1 50 19 42 7 13 12 10 2 23 7 42 15 34 29 5 41 10 3 8 29 42 62 11 37 2 48 20 9 26 40 14 33 16

[0230] When there are foreign objects between the inner screens, the 112 semaphores can be represented as shown in Table 2.

[0231] In this table, the numbers 1-14 in the first row represent the number of rows of the capacitor nodes on the screen; and the numbers 1-8 in the first column represent the number of columns of the capacitor nodes on the screen.

[0232] Table 2

[0233] 1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 200 207 208 233 215 221 221 240 223 237 210 236 229 258 2 220 225 220 229 227 214 222 239 213 222 260 268 275 231 3 216 203 213 218 227 235 212 264 278 271 275 279 289 273 4 230 225 202 232 219 210 238 261 283 280 272 274 276 273 5 206 214 228 217 201 224 217 278 286 295 292 299 283 281 6 222 239 221 225 205 217 232 258 280 290 297 293 261 276 7 239 234 214 210 239 234 226 267 277 300 296 291 276 280 8 219 203 223 219 225 237 213 252 288 298 294 290 280 273

[0234] By comparing Tables 1 and 2, it can be found that the absolute values ​​of the semaphores in Table 2 (range 200–300) are greater than the absolute values ​​of the semaphores in Table 1 (range -50–50). The semaphores in bold in Table 2 are significantly higher than the absolute values ​​of the semaphores of other nodes. This is because the distance between the two plates (the upper and lower halves of the capacitor node) of the capacitor nodes closer to the foreign object is larger, so the absolute values ​​of the semaphores of these capacitor nodes may be larger. The capacitor nodes farther away from the foreign object have smaller distances, and the absolute values ​​of their semaphores are relatively smaller. By analyzing these semaphores, regions with larger absolute values ​​of semaphores can be identified. These regions are usually close to the location of the foreign object; for example, the location of the capacitor node corresponding to the bolded semaphore in Table 2 may contain a foreign object.

[0235] The following is combined with Figure 9 right Figure 6 The training process of the AI ​​perception module will be explained in detail. It should be understood that the AI ​​perception module is composed of a convolutional neural network (CNN), so training the AI ​​perception module can also be understood as training a CNN.

[0236] It should also be understood that the training process described below can be performed before the foldable screen device leaves the factory, or it can be performed after the foldable screen device leaves the factory, or training data can be acquired periodically (or triggered by other events) to train the model. This application does not make any specific limitations in this regard.

[0237] S901, Foldable screen device acquires dataset.

[0238] The dataset can include N frames of signal data continuously acquired by the TP IC over a period of time, where N is a positive integer greater than or equal to 1. Each frame of the N frames can represent the signal acquired by the TP IC at a certain moment.

[0239] The acquisition of datasets by foldable screen devices can be understood as the foldable screen device acquiring N frames of signal data continuously collected by the inner screen over a period of time through its built-in TP IC (or acquiring them from other devices such as the cloud), and using these N frames of signal data as input to the CNN.

[0240] The data structure of this N-frame semaphore is width (W) * height (H). W can be understood as the number of columns of the capacitor nodes; H can be understood as the number of rows of the capacitor nodes. This indicates that W × H capacitor nodes can be formed between the screens included in the inner screen.

[0241] It should be understood that the dataset contains both the signal with and without foreign objects.

[0242] S902, Foldable screen devices preprocess the signal quantities in the data set.

[0243] Foldable screen devices preprocess the semaphores in the dataset, including but not limited to outlier removal and feature extraction.

[0244] Outlier Removal: During the preprocessing stage, outlier data can be identified and removed. For example, if the data in a frame shows a sudden change compared to other frames (such as the previous frame, adjacent frames, etc.) (e.g., the absolute value of the difference in average values ​​exceeds a certain threshold), then the data in that frame is considered outlier and deleted, replaced by data from the previous frame. This effectively prevents outlier data from causing abnormalities in CNN training.

[0245] Feature Extraction: To improve the accuracy of CNNs, feature extraction can be performed on the semaphores in the dataset. For example, the semaphores in each channel can be summed. Each channel can be understood as all the semaphores when W or H is a certain value (i.e., the semaphore corresponding to a capacitor node in a certain row, or the semaphore corresponding to a capacitor node in a certain column). For example, the first channel value in Table 1 could be all the capacitor values ​​when H=1 (such as 15, 6, 20, 21, 12, 20, 13, and 29). These extracted features (e.g., the summed value of 136 for each channel) are then fed into the CNN to help it better learn the features of the data.

[0246] It should be noted that using the summation of capacitance values ​​for each channel as a feature extraction example is merely an illustration. In practical applications, other methods can be used for feature extraction. For example, the capacitance values ​​for each channel can be summed and then averaged.

[0247] By preprocessing, we can obtain the preprocessed dataset.

[0248] S903, the foldable screen device inputs the preprocessed dataset into the CNN.

[0249] CNNs can learn the spatial features (the semaphore variation patterns between different capacitor nodes in any frame) and temporal information (such as the variation patterns between semaphores in each frame) in a preprocessed dataset.

[0250] Spatial characteristics can be understood as the distribution of the input capacitance value on the inner screen, especially when there are foreign objects, the capacitance value of a certain area or certain areas (a certain node or certain nodes) changes abnormally.

[0251] The time dimension information can be understood as the trend of the input capacitance value over a time series (i.e., a period of time when N frames of capacitance information are acquired). By analyzing the changes in capacitance value at different points in the time series, CNNs can identify sudden changes in capacitance value at certain points due to the presence of foreign objects.

[0252] By combining spatial features and temporal information, CNNs can more comprehensively understand the complexity of capacitance data, thereby improving the detection accuracy of foreign object features.

[0253] S904. Are there any foreign objects in the output of the foldable screen device?

[0254] CNNs can determine whether there are foreign objects between the inner screens by analyzing spatial features and temporal dimensions.

[0255] CNNs can determine whether there are foreign objects between the inner screens of a foldable device in the following way:

[0256] Example 1: Set the output of the CNN to a binary result, such as 0 and 1. In this case, 1 can be used to indicate the presence of a foreign object, while 0 indicates the absence of a foreign object.

[0257] Example 2: Set the output of the CNN to a probability value (or score) to represent the likelihood (or degree) of detecting a foreign object. For example, output a probability value from 0 to 100, where a probability value greater than or equal to 90% indicates the presence of a foreign object, and otherwise indicates the absence of a foreign object.

[0258] The model parameters of the CNN are adjusted based on the accuracy of the foreign object detection results output by the CNN, thereby optimizing the model until the accuracy of the CNN prediction reaches a certain threshold, at which point the CNN training is considered complete.

[0259] It should be understood that the above description uses CNN as an example for the AI ​​perception module. In actual application scenarios, the CNN mentioned above can also be replaced by other types of models, and this application does not make any specific restrictions on this.

[0260] Below, we will take the example of a foldable screen device displaying a message to the user indicating the presence of a foreign object on the inner screen, combined with... Figure 10 right Figure 3 The instructions for users to remove foreign objects from foldable screen devices are explained.

[0261] When a foldable screen device detects a foreign object between the inner screens, it can immediately activate a user notification mechanism, providing multiple ways to alert the user that there is a foreign object between the inner screens, so that the user can remove the foreign object in a timely manner.

[0262] For example, such as Figure 10As shown, taking the screen pop-up as an example, foldable screen devices can display a foreign object reminder pop-up on the outer screen to alert users that there may be foreign objects between the inner screens.

[0263] exist Figure 10 The interface shown includes a pop-up notification about foreign objects on the inner screen. This pop-up not only includes the time to remind the user to remove the foreign object, but also the text to remind the user to remove the foreign object: "The system has detected that there may be a foreign object pressing on the screen of your phone. In order to better protect the inner screen of your phone, please remove it in time."

[0264] In addition, the foreign object alert pop-up on the inner screen also includes two interactive buttons: shown in the image as "Ignore" and "View More".

[0265] It should be noted that the two interactive buttons mentioned above are merely examples. In actual application scenarios, the in-screen foreign object alert pop-up may or may not contain any interactive buttons, or it may contain one or more interactive buttons. This application embodiment does not impose specific limitations on this.

[0266] For the "Ignore" button: In response to the user's input action on the "Ignore" button, such as clicking the "Ignore" button, the foldable screen device can close the pop-up window.

[0267] Optionally, the foldable device can record the user's choices. If the user repeatedly chooses to ignore the notification, the foldable device will no longer frequently prompt the user, avoiding excessive notifications that could negatively impact the user experience. The foldable device will continuously monitor the foreign object's status in the background until the user actively unlocks the notification or the foreign object is detected and removed.

[0268] For the "View More" button: In response to the user's input action on the "View More" button, such as clicking the "View More" button, the foldable screen device will provide more detailed information, that is, display more relevant information.

[0269] For example, Figure 10 The interface can also display the specific location of the foreign object and guide the user on how to remove it through animation. This animation may include highlighting the area where the foreign object is located and demonstrating the steps for safely removing it, enabling the user to successfully remove the object.

[0270] Understandably, after the user takes steps to remove the foreign object (or displays a foreign object alert pop-up on the inner screen), the foldable device can continue to monitor the status of the inner screen (continuously monitoring whether there are still foreign objects between the inner screens). If the foreign object is successfully removed, the foldable device will update the status (from monitoring the inner screen status to not monitoring the inner screen status) and cancel the alert.

[0271] If foreign objects are not removed, the foldable screen device can remind the user again at appropriate time intervals (e.g., every five minutes) to protect the inner screen of the foldable screen device.

[0272] It should be noted that the above-described method of prompting the user to remove foreign objects via a screen pop-up is merely an example. In actual application scenarios, foldable screen devices can also prompt the user to remove foreign objects through various methods such as beeps and vibrations. This application embodiment does not impose specific limitations on this.

[0273] Figure 11 This is a schematic diagram illustrating the interaction between the software modules and hardware of a foldable screen device provided in an embodiment of this application. Figure 11 As shown, the layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the system is divided into five layers, from top to bottom: application layer (APP), application framework layer (FWK), hardware abstraction layer (HAL), driver layer, and hardware layer.

[0274] The application layer, also known as the application layer, can include a series of application packages. For example... Figure 11 As shown, the application layer may include applications such as intelligent detection. Intelligent detection applications may include various functions; for example, an intelligent detection application may include foreign object detection functionality.

[0275] Foreign object detection can use sensors and algorithms to accurately identify tiny particles, dust, or other foreign objects between the inner screens of a foldable device, preventing these foreign objects from damaging the screen when the device is folded.

[0276] In addition, the foreign object detection function can include various methods to prompt users to remove foreign objects, such as, but not limited to, screen pop-ups, beeps, and vibrations. For example, in the screen pop-up method, users can view the foreign object detection results through the outer screen of the foldable device and take necessary measures.

[0277] The application framework layer, also known as the application framework layer, provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes a set of predefined functions.

[0278] like Figure 11 As shown, the application framework layer may include a foreign object message passing module.

[0279] The foreign object message transmission module efficiently and accurately transmits relevant information to the intelligent detection application in the application layer when a foreign object is detected between the inner screens of the foldable screen device. Through this mechanism, the foreign object detection result can promptly trigger the foldable screen device to prompt the user to remove the foreign object, enabling the user to quickly take necessary measures to protect the foldable screen device.

[0280] The application layer and application framework layer run in a virtual machine environment. The virtual machine compiles and executes the code in the Java files of the application layer and application framework layer into binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0281] The Hardware Abstraction Layer (HAL) serves as an integrated encapsulation of the hardware driver, providing a standardized interface for upper-layer software applications. The HAL can include a motion hardware abstraction (motion HAL) module and an algorithm processing module.

[0282] The algorithm processing module can be set to enter foreign object detection mode, that is, to start foreign object detection.

[0283] The motion hardware abstraction module is used to enable interaction between the application framework layer and the algorithm processing module. Through the motion hardware abstraction layer, the algorithm processing module can transmit the result of foreign object detection to the application framework layer.

[0284] The algorithm processing module can initiate foreign object detection when the foldable screen device is in a folded state, and after the detection is completed, it feeds back to the touch panel driver (TP driver). The touch panel driver will no longer drive the algorithm processing module to initiate foreign object detection.

[0285] The driver layer is used to drive hardware resources and can contain multiple driver modules, such as a touch panel driver. The touch panel driver drives the algorithm processing module of the hardware abstraction layer to initiate various detections. When the touch panel driver is in a certain mode, it can drive the algorithm processing module to initiate the detection corresponding to that mode.

[0286] For example, when the foldable screen device is in a folded state and the touch panel driver is in foreign object detection mode, the touch panel driver can be used to drive the algorithm processing module to start foreign object detection.

[0287] The hardware layer may include touch panel integrated circuits (TP ICs), etc. A description of touch panel integrated circuits can be found above, and will not be repeated here.

[0288] For example, in combination Figure 11 From the software architecture level Figure 3 The process of determining the presence of a foreign object using the method 300 shown is described in detail.

[0289] When a user folds a foldable screen device, the driver layer can determine the device's state using a Hall sensor and the hinge angle. When the foldable screen device is detected to be in a folded state, the touch panel driver transmits the device's state (folded state) information to the hardware abstraction layer.

[0290] At the hardware abstraction layer, the algorithm processing module receives the status (folded state) information of the foldable screen device, activates the foreign object detection function, and determines whether there are foreign objects between the inner screens of the foldable screen device through capacitance detection.

[0291] When the foreign object detection function detects the presence of a foreign object, the foldable screen device transmits the result of the presence of a foreign object to the application layer through the motion hardware abstraction layer and the application framework layer.

[0292] At the application layer, the intelligent detection application receives a foreign object message from the application framework layer and prompts the user to remove the foreign object. Foldable screen devices can... Figure 10 The pop-up message shown indicates that there are foreign objects on the inner screen of the foldable device and suggests that the user clean them.

[0293] Figure 12 This is a structural schematic diagram of the foldable screen device 1200 provided in an embodiment of this application. Figure 12 As shown, the foldable screen device 1200 may include a processor 1210, an external memory interface 1220, an internal memory 1221, a universal serial bus (USB) interface 1230, a charging management module 1240, a power management module 1241, a battery 1242, an antenna 1, an antenna 2, a mobile communication module 1250, a wireless communication module 1260, an audio module 1270, a sensor module 1280, buttons 1290, a motor 1291, an indicator 1292, a camera 1293, a display screen 1294, and a subscriber identification module (SIM) card interface 1295, etc.

[0294] The audio module 1270 may include a speaker, receiver, microphone, and headphone jack. The sensor module 1280 may include Hall effect sensors, capacitive sensors, pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, proximity sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, and bone conduction sensors.

[0295] Among these methods, Hall effect sensors can be used to determine the state of foldable screen devices, while capacitive sensors can be used to obtain the capacitance value of the internal screen of the foldable screen device.

[0296] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the foldable screen device 1200. In other embodiments of this application, the foldable screen device 1200 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0297] Processor 1210 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0298] In some examples, processor 1210 can be a system on-chip (SOC) of foldable screen device 1200. In one possible implementation, processor 1210 includes an AI sensing module, and processor 1210 can determine whether there are foreign objects between the inner screens of the foldable screen device based on the AI ​​sensing module.

[0299] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0300] The processor 1210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 1210 is a cache memory. This memory can store instructions or data that the processor 1210 has just used or that are used repeatedly. If the processor 1210 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 1210, and thus improves the efficiency of the system.

[0301] In some embodiments, processor 1210 may include one or more interfaces.

[0302] The foldable screen device 1200 implements display functions through a GPU, a display screen 1294, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 1294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 1210 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0303] Display screen 1294 is used to display images, videos, etc. Display screen 1294 includes a DDIC and a display panel. In some embodiments, foldable screen device 1200 may include one or N displays screens 1294, where N is a positive integer greater than 1.

[0304] Internal memory 1221 can be used to store computer executable program code, which includes instructions. Internal memory 1221 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the foldable screen device 1200 (such as audio data, phonebook, etc.). Furthermore, internal memory 1221 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 1210 executes various functional applications and data processing of the foldable screen device 1200 by running instructions stored in internal memory 1221 and / or instructions stored in memory located in the processor.

[0305] It should be understood that Figure 12 The connection relationships between the modules shown are merely illustrative and do not constitute a limitation on the connection relationships between the modules of the foldable screen device 1200. Optionally, the modules of the foldable screen device 1200 may also adopt a combination of various connection methods described in the above embodiments.

[0306] Figure 13This is a schematic block diagram of a foreign object detection device 1300 provided in an embodiment of this application. The device 1300 includes a processor 1301, a transceiver 1302, and a memory 1303. The processor 1301, transceiver 1302, and memory 1303 communicate with each other via internal connections. The memory 1303 stores instructions, and the processor 1301 executes the instructions stored in the memory 1303. The transceiver 1302 can be used to send signals to other devices (e.g., the processor 1301 or the touchscreen of a foldable screen device) and to receive signals from other devices (e.g., the memory 1303). For example, the transceiver 1302 reads instructions stored in the memory 1303 and sends the instructions to the processor 1301.

[0307] It should be understood that the device 1300 may specifically be the UE in the above embodiments, and may be used to execute the various steps and / or processes corresponding to the UE in the above method embodiments. Optionally, the memory 1303 may include read-only memory and random access memory, and provide instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information. The processor 1301 may be used to execute instructions stored in the memory, and when the processor 1301 executes instructions stored in the memory, the processor 1301 is used to execute the various steps and / or processes in the above method embodiments.

[0308] It should be understood that, in the embodiments of this application, the processor may be a central processing unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0309] In implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software. The steps of the method disclosed in the embodiments of this application can be directly manifested as execution by a hardware processor, or as a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor executes the instructions in the memory, combining them with its hardware to complete the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0310] The foreign object detection method provided in this application can be applied to foldable screen devices with communication functions. Foldable screen devices include electronic devices, and the specific device form of the electronic devices can be referred to the above-mentioned descriptions, which will not be repeated here.

[0311] This application provides a foldable screen device, which includes a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, causing the foldable screen device to perform the above-described method.

[0312] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0313] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0314] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage or other magnetic storage devices, or any other medium targeted to carry or to store the required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, Digital Versatile Discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0315] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0316] This application describes embodiments of methods, apparatus (systems), and computer program products according to embodiments of this application with reference to flowchart illustrations and / or block diagrams. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0317] The above specific embodiments further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for detecting foreign objects, characterized in that, Applied to a foldable screen device, the foldable screen device including a foldable first screen and a second screen, the method includes: When the foldable screen device switches from an open state to a foldable state, at least one capacitance value between the first screen and the second screen is detected. Based on the at least one capacitance value, determine whether there is a foreign object between the first screen and the second screen; If there is a foreign object between the first screen and the second screen, a first prompt will be output, which is used to remind that there is a foreign object between the first screen and the second screen.

2. The method according to claim 1, characterized in that, The step of determining whether there is a foreign object between the first screen and the second screen based on the at least one capacitance value includes: Calculate the difference between each of the at least one capacitance values ​​and the capacitance reference value to obtain at least one signal quantity; Based on the at least one signal quantity, it is determined whether there is a foreign object between the first screen and the second screen.

3. The method according to claim 2, characterized in that, The step of determining whether there is a foreign object between the first screen and the second screen based on the at least one signal includes: Input the at least one semaphore into the first model; Obtain the first result output by the first model, which is used to indicate whether there is a foreign object between the first screen and the second screen.

4. The method according to claim 3, characterized in that, The method further includes: Acquire multiple training samples, where each training sample is a collection of multiple signal quantities between the third and fourth screens at a given moment, and the third and fourth screens are foldable screens. The multi-frame training samples are input into the first model to be trained. The first model to be trained outputs a second result, which is used to indicate whether there is a foreign object between the third screen and the fourth screen. Based on the second result, the trained first model is obtained.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: If the first condition is met, perform a state check; The first condition includes one or more of the following: The system detected that the user touched the foldable screen device; Face detected; The distance between the user and the foldable screen device is detected to be less than a first threshold; or, The user's action of folding the foldable screen device was detected.

6. The method according to claim 5, characterized in that, The foldable screen device also includes a Hall sensor; The state detection includes: First data is acquired from the Hall sensor; When the first data indicates that the foldable screen device is in a folded state, obtain the angle between the first screen and the second screen; If the included angle is less than or equal to the second threshold, the foldable screen device is determined to be in a folded state.

7. The method according to claim 6, characterized in that, The method further includes: If the first data indicates that the foldable screen device is not in a folded state, determine that the foldable screen device is in an open state; and / or, If the included angle is greater than the second threshold, the foldable screen device is determined to be in an unfolded state.

8. The method according to any one of claims 1 to 7, characterized in that, The foldable screen device also includes a touch panel control chip; Detecting at least one capacitance value between the first screen and the second screen includes: The touch panel control chip detects at least one capacitance value between the first screen and the second screen.

9. The method according to any one of claims 1 to 8, characterized in that, The foldable screen device also includes a fifth screen; The first prompt is the first pop-up window displayed on the fifth screen; the first pop-up window includes a first button and a second button; The first button is used to trigger the foldable screen device to close the first pop-up window; The second button is used to trigger the foldable screen device to display first information through the fifth screen, the first information including the location information of the foreign object; or, the second button is used to trigger the display of a first animation, the first animation being used to demonstrate the method of removing the foreign object.

10. The method according to claim 9, characterized in that: The location information of the foreign object is determined based on the location of the capacitor node corresponding to the N semaphores with the largest absolute values ​​among at least one semaphore, wherein the at least one semaphore includes the difference between each capacitance value and the capacitance reference value among the at least one capacitance value, and N is a positive integer.

11. A foldable screen device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the foldable screen device to perform the method as described in any one of claims 1-10.

12. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-10.

13. A chip system, characterized in that, It includes at least one processor and a communication interface, the communication interface and the at least one processor being interconnected via a line, the at least one processor being configured to run a computer program or instructions to perform the method as described in any one of claims 1-10.

14. A computer program product, characterized in that, Includes a computer program that, when run, causes a computer to perform the method as described in any one of claims 1-10.

Images