Hinge state detection method of folding screen equipment and folding screen equipment

Abstract

The invention provides a hinge state detection method of folding screen equipment and the folding screen equipment, relates to the technical field of terminals, and can enable a user to know the state of a hinge and obtain better use experience. According to the method, the folding screen device obtains sensor data collected by at least one sensor in the process that a foldable display screen is opened and closed, the sensor data at least comprises acoustic data of a hinge and / or angle data of the hinge, the acoustic data is from a sound sensor in the at least one sensor, and the angle data of the hinge is from the sound sensor in the at least one sensor. The angle data originates from an angle sensor of the at least one sensor. Afterwards, the folding screen device obtains the state detection result of the hinge according to the sensor data, the hinge state can be detected without using an external hinge detection device, a user can conveniently know the real state and the prediction state of the hinge of the folding screen device in time, and better use experience is brought to the user.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a hinge state detection method for a foldable screen device and a foldable screen device. Background Technology

[0002] The hinge is the key mechanism that enables the folding function of a foldable screen. Damage to the hinge will affect the user experience of the foldable phone, and replacing a screen damaged due to hinge failure will significantly increase costs.

[0003] Currently, hinge detection devices can be used to detect the condition of hinges. These devices can include a host computer, a jig, sensors, and other structural components. The host computer controls the movement of the jig's swing arm to drive the folding terminal to complete the opening and closing action. At the same time, the corresponding sensors (such as acoustic signal sensors and torque sensors) collect hinge-related signals and transmit them to the host computer for signal analysis, thereby determining whether the hinge is damaged and the extent of the damage.

[0004] However, the aforementioned methods for hinge status detection do not allow users to know the hinge status in a timely manner, nor can users repair the hinge in a timely manner, thus affecting the user experience. Summary of the Invention

[0005] This application provides a hinge status detection method and a foldable screen device, which allows users to understand the hinge status in a timely manner and obtain a better user experience.

[0006] A first aspect provides a hinge state detection method for a foldable screen device, wherein the foldable screen device includes a foldable display screen, a hinge stacked on top of a bendable portion of the foldable display screen, and at least one sensor for detecting the hinge state. In this method, during the opening and closing action of the foldable display screen, the foldable screen device acquires sensor data collected by at least one sensor, wherein the sensor data includes at least acoustic data of the hinge and / or angle data of the hinge, the acoustic data originating from a sound sensor among the at least one sensors, and the angle data originating from an angle sensor among the at least one sensors. Subsequently, the foldable screen device obtains a hinge state detection result based on the sensor data.

[0007] In the above method, the foldable screen device can use its own sensors to collect acoustic data and / or angle data of the hinge to detect the hinge status. Its own sensors can acquire data in a timely manner, and users can also understand the status of the hinge in a timely manner and determine whether to repair the adhesive based on the status of the hinge, thereby providing users with a better user experience.

[0008] In one possible implementation of the first aspect, the foldable screen device acquires sensor data collected by at least one sensor during the opening and closing action of the foldable display screen. Specifically, this includes: in response to a user's trigger operation of the hinge state detection function, the foldable screen device acquires sensor data collected by at least one sensor during the opening and closing action of the foldable display screen; or, if the foldable display screen meets preset conditions, the foldable screen device acquires sensor data collected by at least one sensor during the opening and closing action of the foldable display screen, wherein the preset conditions include the duration of use of the foldable display screen meeting a preset duration or the number of times the foldable display screen is opened and closed meeting a preset number of times.

[0009] In the above implementation, hinge state detection can be actively triggered by the user, or the foldable screen device can detect the hinge state without user intervention, and it is triggered when the foldable display meets preset conditions. After the hinge state detection is triggered, the foldable screen device then acquires sensor data. It is evident that the methods provided in this application can trigger hinge state detection in multiple ways, and sensor data reflecting the hinge state can be acquired regardless of the method used.

[0010] In one possible implementation of the first aspect, the foldable screen device, in response to a user's trigger operation of the hinge state detection function, acquires sensor data collected by at least one sensor during the opening and closing action of the foldable display screen, including: the foldable screen device, in response to the user's trigger operation of the hinge state detection function, displays guidance information, wherein the guidance information is used to guide the user to perform at least one opening and closing action on the foldable display screen. During the at least one opening and closing action of the foldable display screen by the user, the foldable screen device acquires sensor data collected by at least one sensor.

[0011] In the above implementation, if a user wants to know the status of the hinge at any time while using the foldable screen device, the user can actively control the foldable screen device to acquire sensor data and open and close the foldable display screen according to the guidance information. During this process, the foldable screen device can acquire sensor data and determine the hinge status based on the sensor data, making the hinge status detection operation more convenient and more real-time, thus bringing a better user experience.

[0012] In one possible implementation of the first aspect, when the foldable display screen meets preset conditions, the foldable screen device acquires sensor data collected by at least one sensor during the opening and closing action of the foldable display screen, including: when the foldable display screen meets preset conditions, the foldable screen device acquires historical sensor data collected by at least one sensor, wherein the historical sensor data is data acquired by at least one sensor during multiple opening and closing actions of the foldable display screen before the foldable display screen meets the preset conditions; the historical sensor data is data continuously acquired by at least one sensor or data acquired by at least one sensor according to a preset sampling interval, the preset sampling interval including a preset time or a preset number of times.

[0013] In the above implementation, if the foldable display meets preset conditions and the user does not trigger hinge state detection, the foldable screen device can automatically detect the hinge state based on acquired historical sensor data, thus proactively providing the user with hinge state detection results. Furthermore, this also helps the foldable screen device detect hinge state change trends based on sensor data over a period of time, improving the accuracy of hinge state prediction.

[0014] In one possible implementation of the first aspect, after obtaining the hinge's state detection result, if the state detection result indicates that the hinge's damage level is greater than a preset level, or if the hinge's health score is less than a preset score, the foldable screen device displays the state detection result.

[0015] In the above implementation, the foldable screen device may not immediately display the hinge status detection result after obtaining it, in order to reduce the impact on the user experience. Furthermore, the foldable screen device will display the status detection result under specific circumstances, such as when the hinge damage level is too high or the hinge health score is too low, thus ensuring that the user can understand the hinge status in a timely manner.

[0016] In one possible implementation of the first aspect, after acquiring the hinge state detection result, the foldable screen device saves the state detection result in the log of a first application, wherein the first application is used to provide the hinge state detection function. The foldable screen device displays the state detection result in response to the user's operation of opening the first application; or, the foldable screen device displays the state detection result in response to the user's triggering operation of the hinge state detection function.

[0017] In the above implementation, the foldable screen device may not immediately display the hinge status detection result after obtaining it, in order to reduce the impact on the user experience. Furthermore, the foldable screen device will display the status detection result under specific circumstances, such as when the user launches the "Health Manager" app or triggers the hinge status detection function, thus allowing the user to understand the hinge's status.

[0018] In one possible implementation of the first aspect, the foldable screen device obtains a hinge state detection result based on sensor data, including: the foldable screen device obtaining a hinge health score based on the sensor data; and the foldable screen device obtaining the state detection result corresponding to the health score from a preset state mapping table, wherein the state mapping table is used to represent the correspondence between different hinge health scores and different state detection results.

[0019] In the above implementation, the hinge health score is obtained based on a preset state mapping table. The preset state mapping table enables foldable screen devices to obtain hinge state detection results more quickly, thereby reducing the user's waiting time.

[0020] In one possible implementation of the first aspect, the foldable screen device obtains the hinge state detection result based on sensor data, including: the foldable screen device sending sensor data to a server; and the foldable screen device receiving the hinge state detection result sent by the server, wherein the hinge state detection result is the state detection result corresponding to the health score obtained by the server from a preset state mapping table after obtaining the hinge's health score based on the sensor data.

[0021] In the above implementation, the hinge health score is obtained based on a preset state mapping table. The preset state mapping table enables foldable screen devices to obtain hinge state detection results more quickly, thereby reducing the user's waiting time.

[0022] In one possible implementation of the first aspect, the sensor data further includes at least one of the following: hinge vibration data, hinge acceleration data, and hinge opening / closing time data.

[0023] In the above implementation, the more types of sensor data are acquired, the better the hinge state detection results obtained by the foldable screen device based on the sensor data can reflect the true state of the hinge, making the hinge state prediction more accurate, thereby improving the user experience.

[0024] In one possible implementation of the first aspect, the condition detection result includes at least one of the hinge's damage level, damage type, and remaining service life. The damage level and damage type also reflect the hinge's health status, condition, and remaining service life. In another possible implementation, the condition detection result may include the hinge's health status and / or remaining service life.

[0025] In the above implementation, displaying the status detection results allows users to better understand the hinge's status, enabling them to change their usage habits or make timely modifications to prevent the hinge from becoming more severely damaged.

[0026] In one possible implementation of the first aspect, the foldable screen device also displays operation guidance information based on the status detection results. The operation guidance information is used to prompt the user to perform status detection on the hinge again using other methods to obtain more accurate and professional detection results; or, to prompt the user to change their operating habits when using the foldable display.

[0027] In one possible implementation of the first aspect, the foldable screen device obtains a hinge health score based on sensor data, including: the foldable screen device converting various analog time-series signals, which are the sensor data, into voltage time-series signals respectively; and the foldable screen device performing time-domain sliding window segmentation on the various voltage time-series signals at the same time interval to obtain multiple windows; wherein the multiple windows correspond to the same time start and end points. The foldable screen device obtains the MFCC feature matrix corresponding to each window, and performs feature fusion on the MFCC feature matrices corresponding to at least one window respectively to obtain a new feature matrix. Finally, the foldable screen device obtains the hinge health score based on the new feature matrix.

[0028] In the above implementation, multiple analog time-series signals may come from different sensors. Since the acquisition frequencies of different sensors cannot be kept consistent, the same time interval is used to perform time-domain sliding window segmentation on the converted multiple voltage time-series signals to obtain multiple windows with start and end times aligned. Thus, more accurate calculation of the MFCC feature matrix and feature fusion are performed based on the aligned windows.

[0029] In one possible implementation of the first aspect, the display status detection result of the foldable screen device further includes: a health score of the display hinge.

[0030] In a second aspect, a foldable screen device is provided, comprising a foldable display screen, a hinge stacked with a bendable portion of the foldable display screen, and at least one sensor for detecting the hinge state; the foldable screen device further comprises a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the foldable screen device to perform the hinge state detection method of the foldable screen device as described in the first aspect and any of its implementable embodiments.

[0031] Thirdly, a computer-readable storage medium is provided, including computer instructions that, when executed on a foldable screen device, cause the foldable screen device to perform the hinge state detection method for the foldable screen device as described in the first aspect and any of its possible implementations.

[0032] Fourthly, a computer program product is provided that, when run on a computer, causes the computer to execute the hinge state detection method for a foldable screen device as described in the first aspect and any of its implementable methods. Attached Figure Description

[0033] Figure 1 shows a schematic diagram of the structure of a foldable screen device provided in an embodiment of this application;

[0034] Figure 2 A schematic diagram of the structure of the foldable screen device provided in the embodiments of this application is shown. Figure 2 ;

[0035] Figure 3 This illustration shows a schematic diagram of the interaction between a foldable screen device and a server provided in an embodiment of this application;

[0036] Figure 4 A flowchart illustrating the hinge state detection method for a foldable screen device provided in an embodiment of this application is shown.

[0037] Figure 5 This application provides a schematic flowchart illustrating the hinge state detection method for foldable screen devices according to an embodiment of the present application. Figure 2 ;

[0038] Figure 6 This illustration shows a schematic diagram of the guide page displayed on a foldable screen phone according to an embodiment of this application;

[0039] Figure 7 A schematic diagram of the user-triggered hinge state detection function provided in an embodiment of this application is shown;

[0040] Figure 8 This application provides a schematic flowchart illustrating the hinge state detection method for foldable screen devices according to an embodiment of the present application. Figure 3 ;

[0041] Figure 9 A schematic diagram illustrating the feature fusion of the foldable screen device provided in an embodiment of this application is shown;

[0042] Figure 10 A schematic diagram showing the state detection result of the foldable screen mobile phone display provided in an embodiment of this application is shown;

[0043] Figure 11 illustrates the state detection results of the foldable screen mobile phone display provided in the embodiment of this application. Figure 2 ;

[0044] Figure 12 A schematic diagram of the hinge degradation process provided in an embodiment of this application is shown;

[0045] Figure 13 A schematic diagram of the structure of the foldable screen device provided in the embodiments of this application is shown. Figure 3 . Detailed Implementation

[0046] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0047] Furthermore, the business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0048] Foldable screens achieve their folding function by relying on flexible organic light-emitting diodes (OLEDs) and hinges. The hinge, also known as metal injection molding (MIM), is the key mechanism for enabling the folding function of foldable screens and is closely related to user experience issues such as the lifespan of the foldable screen, the feel of opening and closing, and the depth of the crease.

[0049] Foldable devices, such as foldable phones, are prone to hinge damage during logistics and user use. Severe hinge damage can lead to abnormal noises, jamming, and even screen damage or leakage due to sand or liquid seepage. Hinge damage affects the user experience of foldable phones, and replacing a damaged screen due to hinge issues significantly increases costs.

[0050] Currently, some solutions include a hinge detection device to detect the hinge's condition. This device can include a host computer, a jig, sensors, and other structural components. The host computer controls the jig's swing arm to move, causing the folding terminal to open and close. Simultaneously, corresponding sensors (such as acoustic sensors and torque sensors) collect hinge-related signals and transmit them to the host computer for signal analysis, thereby determining whether the hinge is damaged and the extent of the damage.

[0051] This hinge detection method requires specific hinge detection devices. If users need to know the status of the hinge, they cannot know the status of the hinge in a timely manner without these hinge detection devices.

[0052] In addition, the logic or method of opening and closing the clamp is fixed, and the host computer can only analyze limited information. It cannot integrate and analyze information such as complex user habits and long-term hinge state change trends, resulting in poor accuracy in predicting the hinge state.

[0053] Based on the above, this application provides a hinge status detection method for foldable screen devices. This method can obtain hinge detection results, such as whether the hinge is damaged, the degree of damage, and its remaining lifespan, based on relevant hinge data collected from the foldable screen device. This eliminates the need for an external hinge detection device, allowing users to promptly obtain information about the actual and predicted hinge status of the foldable screen device, thus providing a better user experience.

[0054] For example, in the hinge state detection method of the above-described foldable screen device, the foldable screen device can acquire sensor data collected by at least one sensor during the opening and closing action of the foldable display screen. The foldable screen device includes at least one sensor for detecting the hinge state, and the sensor data includes acoustic data of the hinge and / or angle data of the hinge. The acoustic data originates from a sound sensor among the at least one sensors, and the angle data originates from an angle sensor among the at least one sensors. Subsequently, the foldable screen device obtains the hinge state detection result based on the sensor data.

[0055] In this method, the foldable screen device can use its own sensors to collect acoustic data and / or angle data of the hinge to detect the hinge status. Its own sensors can acquire data in a timely manner, and users can also understand the status of the hinge in a timely manner and determine whether to repair the adhesive based on the status of the hinge, thereby providing users with a better user experience.

[0056] In some embodiments, referring to Figure 1(a), the foldable screen device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0057] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the foldable screen device 100. In other embodiments of this application, the foldable screen device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements.

[0058] Processor 110 may include one or more processing units (not shown in Figure 1(a)), such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0059] The controller can serve as the central nervous system and command center of the foldable screen device 100. The controller can generate operation control signals based on instruction operation codes and timing signals to control the fetching and execution of instructions.

[0060] The processor 110 may also include a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is recurring. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0061] In some examples, processor 110 may also be a central processing unit (CPU).

[0062] In some examples, processor 110 may include one or more interfaces (not shown in (a) of Figure 1). Interfaces may include inter-integrated circuit (I2C) interfaces, inter-integrated circuit sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industry processor interfaces (MIPI), general-purpose input / output (GPIO) interfaces, subscriber identity module (SIM) interfaces, and / or universal serial bus (USB) interfaces, etc.

[0063] The USB port 130 is a USB standard compliant interface, specifically a Mini USB port, MicroUSB port, or USB Type-C port. USB port 130 can be used to connect a charger to charge the foldable screen device 100, and can also be used for data transfer between the foldable screen device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0064] The charging management module 140 receives charging input from a charger, which can be either a wireless or wired charger. While charging the battery 142, the charging management module 140 can also supply power to the foldable screen device via the power management module 141.

[0065] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0066] The wireless communication function of the foldable screen device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0067] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0068] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the foldable screen device 100.

[0069] The wireless communication module 160 can provide solutions for wireless communication applications on the foldable screen device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0070] In some examples, antenna 1 of foldable screen device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling foldable screen device 100 to communicate with networks and other devices via wireless communication technology.

[0071] The foldable screen device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering.

[0072] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel.

[0073] The foldable screen device 100 can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0074] The ISP is used to process the data fed back by the camera 193.

[0075] Camera 193 is used to capture still images or videos.

[0076] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the foldable screen device 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0077] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the foldable screen device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc. The data storage area may store data created during the use of the foldable screen device 100 (such as audio data, phone book, etc.). In addition, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0078] The foldable screen device 100 can implement audio functions through the audio module 170 and application processor, such as music playback and recording.

[0079] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. The foldable screen device 100 can receive button input and generate key signal inputs related to user settings and function control of the foldable screen device 100.

[0080] Motor 191 can generate vibration alerts.

[0081] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0082] The SIM card interface 195 is used to connect the SIM card.

[0083] In some examples, as shown in Figure 1(b), the aforementioned display screen 194 of the foldable screen device 100 may be a flexible foldable display screen, and the foldable screen device 100 may also include a hinge 200 stacked with the bendable portion of the foldable display screen, etc.

[0084] The foldable display screen may include at least two parts, such as display screen 194a and display screen 194b.

[0085] The audio module 170 includes a microphone 170A.

[0086] Furthermore, the sensor module 180 may include a sound sensor 180A, an angle sensor 180B, a gyroscope sensor 180C, an accelerometer sensor 180D, etc.

[0087] Understandably, the gyroscope sensor 180C and the accelerometer sensor 180D can be replaced with an A+G sensor (i.e., a combination of an accelerometer and a gyroscope), and the sensor module 180 can include at least two A+G sensors.

[0088] The foldable screen device 100 may be equipped with at least one sensor module 180. During the opening and closing action of the foldable display screen, the foldable screen device 100 can acquire sensor data representing the hinge state through the sensor module 180. Furthermore, the processor 110 determines the hinge state based on the sensor data.

[0089] The sensor data may include at least one of the following: hinge vibration data, hinge sound data, hinge angle data, hinge acceleration data, and hinge opening and closing time data.

[0090] Angle sensor 180B can be installed on hinge 200 to collect hinge angle data, opening and closing time data, etc.

[0091] At least two A+G sensors can be set on both sides of the hinge 200 to collect the hinge's acceleration data, vibration data, etc.

[0092] In some examples, a gyroscope sensor 180C and an accelerometer sensor 180D can also be respectively installed on both sides of the hinge 200.

[0093] The gyroscope sensor 180C can be used to determine the motion attitude of the hinge 200. In some examples, the angular velocity of the hinge 200 about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180C.

[0094] The accelerometer 180D can detect the magnitude of the acceleration of the hinge 200 in various directions (generally three axes).

[0095] The sound sensor 180A can detect the sound data of the hinge 200, so the processor 110 can determine whether there is any abnormal noise in the hinge based on the sound data.

[0096] In some examples, the microphone 170A can also capture sound data from the hinge.

[0097] In some examples, after the processor 110 determines the hinge status based on relevant hinge data, the foldable display screen can also display the hinge status, such as the hinge's health score and remaining usage time. In some examples, the foldable display screen can also display prompts to prompt the user to perform an opening or closing action on the foldable display screen. During this process, the foldable screen device 100 can acquire sensor data through the sensor module 180, microphone 170A, etc.

[0098] In some examples, the foldable screen device 100 may also include an interface for acquiring sensor data from a sensor module, or for acquiring sound data from the hinge from a microphone.

[0099] In other embodiments, in order to detect the state of the hinge more accurately, external sensors, microphones, etc., can be used to acquire hinge vibration data, hinge sound data, hinge angle data, hinge acceleration data, hinge opening and closing time data, etc.

[0100] During the use of the aforementioned foldable screen device, if the user wants to know the status of the hinge at any time, the user can actively control the foldable screen device to obtain sensor data and determine the hinge status based on the sensor data. This makes the hinge status detection operation more convenient and more real-time, and can bring a better user experience.

[0101] Alternatively, foldable devices can automatically acquire historical sensor data during user operation and determine the hinge status based on this data. This sensor data collected during device use can also reflect user habits and other information.

[0102] In some examples, the hinge state determined above may include the hinge's health level, health status, damage type, damage degree, remaining service life, etc. The determined hinge state can also be regarded as the hinge state predicted by the foldable screen device.

[0103] Understandably, the aforementioned hinge condition detection method can also more accurately predict hinge condition based on user habits, allowing users to understand in advance whether there is a risk of hinge damage, and improve operating habits before hinge malfunctions occur, or use low-cost repairs instead of high-cost repairs after serious hinge damage, thereby improving the user experience.

[0104] In some embodiments, the foldable screen device 100 may also send the acquired sensor data to a server, which will determine the hinge state based on the sensor data and send the hinge state to the foldable screen device 100.

[0105] In some embodiments, see Figure 2 As shown, the foldable screen device 100 may include a signal acquisition module, a signal processing module, a computing module, a communication module, and a human-computer interaction module.

[0106] The signal acquisition module is used to acquire analog timing signals corresponding to the data representing the hinge state, such as sound timing signals acquired by a microphone, angle timing signals acquired by an angle sensor, angle timing signals, angular velocity timing signals, and attitude timing signals acquired by an A+G sensor. In some examples, the signal acquisition module may include a sound sensor, a microphone, an angle sensor, an A+G sensor, etc.

[0107] The signal processing module converts the analog timing signals acquired by the signal acquisition module into voltage timing signals that the arithmetic module can process, and sends them to the arithmetic module (such as the CPU), or transmits them to the server's arithmetic module via the communication module, for example, see [link to relevant documentation]. Figure 3 As shown in the figure. The communication module may include the aforementioned antenna, mobile communication module, wireless communication module, etc.

[0108] The computation module determines the hinge state based on the received voltage timing signal. Specifically, the computation module extracts features from the voltage timing signal, generates a Mel-frequency cepstral coefficient (MFCC) feature matrix, and fuses feature matrices from multiple sensors in the signal acquisition module to evaluate the current or future hinge state of the foldable screen device. In some examples, the computation module aligns the voltage timing signals acquired from multiple sensors to keyframes, then performs sliding window segmentation in the time domain, calculates the voltage timing signal, converts it into an MFCC feature matrix, and finally concatenates the MFCC feature matrices to complete feature fusion.

[0109] The human-computer interaction module is used to display the hinge status, that is, to display the hinge status detection results. In some examples, the human-computer interaction module can also display prompts to prompt the user to perform opening and closing actions on the foldable display. During this process, the signal acquisition module acquires the analog timing signals corresponding to the data representing the hinge status.

[0110] The aforementioned foldable screen device 100 can be a foldable screen mobile phone, foldable screen laptop, foldable screen watch, or other terminal device that can have a flexible foldable display screen.

[0111] The following describes the hinge state detection method for foldable screen devices provided in this application embodiment, taking the above-mentioned hinge state detection method applied to foldable screen mobile phones as an example.

[0112] In some embodiments, see Figure 4 As shown, the above method may include the following steps S401-S403.

[0113] S401. During the opening and closing action of the foldable display screen, the foldable screen phone acquires sensor data collected by at least one sensor.

[0114] The sensor data includes at least the acoustic data of the hinge and / or the angular data of the hinge.

[0115] In some examples, the sensor data may also include at least one of the following: hinge vibration data, hinge acceleration data, and hinge opening and closing time data.

[0116] Understandably, the more types of sensor data acquired, the better the hinge status detection results obtained by the foldable screen phone based on the sensor data can reflect the true state of the hinge, making the hinge status prediction more accurate and thus improving the user experience.

[0117] In some examples, the process of the foldable phone acquiring sensor data can be either actively triggered by the user or performed automatically by the foldable phone.

[0118] If the user actively triggers the aforementioned process of acquiring sensor data, the foldable phone can respond to the user's trigger operation on the hinge state detection function and acquire sensor data collected by at least one sensor during the opening and closing action of the foldable display. During this process, the foldable phone can provide operation guidance to the user, allowing the user to perform the opening and closing action of the foldable display according to the guidance. During this process, at least one sensor will collect sensor data.

[0119] For example, see Figure 5 As shown, the user can actively trigger the hinge status detection function, and the foldable phone can respond to this trigger by displaying guidance information. This guidance information guides the user to perform at least one opening and closing action on the foldable display. During this process, the foldable phone acquires sensor data collected by at least one sensor.

[0120] For example, after a user actively triggers the hinge status detection function, the foldable phone can display something like this: Figure 6 The onboarding page shown in (a) displays guidance information such as "Repeat opening and closing 5 times" and "Please repeatedly unfold and close the foldable screen phone 5 times." This guidance information is used to guide the user to perform multiple opening and closing actions on the foldable display. During the process of the foldable display being opened and closed 5 times, the foldable screen phone acquires sensor data collected by at least one sensor.

[0121] For example, the guidance information can also guide the user to perform actions such as hovering or stopping the foldable display, so that the foldable phone can acquire sensor data collected by at least one sensor during the hovering, stopping, opening and closing of the foldable display.

[0122] For example, after a user actively triggers the hinge status detection function, the foldable phone can display something like this: Figure 6 The guide page shown in (b) displays guide information such as "hover for 10 seconds", "repeat opening and closing 5 times", "hover for 5 seconds", etc. According to the guide information, the user can first perform the action of hovering for 10 seconds, then perform the action of opening and closing 5 times, and then perform the action of hovering for 5 seconds. During the process of the foldable display performing this series of actions, the foldable screen phone acquires sensor data collected by at least one sensor.

[0123] The hinge status detection function mentioned above can be a system function provided by the foldable screen phone, or it can be a function provided by an application (third-party application, non-third-party application, etc.) installed in the foldable screen phone.

[0124] For example, the system settings page of a foldable phone can be like... Figure 7 As shown in (a), users can click the control corresponding to the hinge status detection function on this page to trigger the hinge status detection function; or, if the foldable phone has an application such as "Health Manager" installed, one of the application's function pages can be as follows: Figure 7 As shown in (b) above, users can click the control corresponding to the hinge status detection on this page to trigger the hinge status detection function.

[0125] For example, the aforementioned guidance information may also include progress information prompting the user to perform an action, such as the above. Figure 6 The phrase "Opened and closed once, ready for the next opening and closing" shown in (a) or Figure 6 The progress bar shown in (b) allows users to understand the progress of hinge status detection.

[0126] As mentioned above, users can actively trigger hinge status detection, allowing the foldable phone to respond to the user's actions and promptly detect the hinge status. This makes hinge status detection more real-time and the detection process more convenient, providing users with a better user experience.

[0127] If the foldable phone automatically performs the aforementioned sensor data acquisition process, the process of the foldable display screen opening and closing can be viewed as the process of the foldable display screen opening and closing during the user's daily use, or it can be viewed as the process of the foldable display screen opening and closing without the user triggering the hinge state detection function. That is, at least one sensor can collect sensor data during the user's daily use of the foldable display screen.

[0128] In solutions for automatically acquiring sensor data, foldable phones can also automatically acquire sensor data collected by at least one sensor during the opening and closing process of the foldable display, provided that the foldable display meets preset conditions. For example... Figure 8 As shown.

[0129] The preset conditions include the duration of use of the foldable display screen meeting a preset duration or the number of times the foldable display screen is opened and closed meeting a preset number of times.

[0130] For example, after the foldable display has been used for 6 months, 12 months, and 18 months, the foldable phone can automatically trigger the acquisition of sensor data. Alternatively, after the foldable display has been opened and closed 100 times, 150 times, and 200 times, the foldable phone can automatically trigger the acquisition of sensor data.

[0131] When the foldable display meets the preset conditions, the foldable screen phone can obtain historical sensor data collected by at least one sensor during the multiple opening and closing actions of the foldable display before the foldable display meets the preset conditions. The historical sensor data is data continuously acquired by at least one sensor or data acquired by at least one sensor according to a preset sampling interval, which includes a preset time or a preset number of times.

[0132] For example, if a foldable display meets a preset condition after being opened and closed 100 times, the foldable phone can obtain sensor data corresponding to each of those 100 opening and closing actions; or, if a foldable display meets a preset condition after being used for six months, the foldable phone can obtain sensor data corresponding to each opening and closing action over those six months.

[0133] For example, if the preset sampling interval has a preset number of times of 5, after the foldable display has been opened and closed 100 times, the foldable phone will sample multiple sensor data from the sensor data corresponding to the 100 opening and closing actions at intervals of 5. Alternatively, if the preset sampling interval has a preset time of 3 days, after the foldable display has been used for half a year, the foldable phone will sample multiple days of sensor data from the sensor data corresponding to multiple opening and closing actions within the past six months at intervals of 3 days.

[0134] As described above, if the foldable display meets preset conditions and the user does not trigger hinge state detection, the foldable phone can automatically acquire historical sensor data. Furthermore, this helps the foldable device detect hinge state changes based on sensor data over a period of time, improving the accuracy of hinge state prediction.

[0135] S402: Foldable screen phones obtain hinge status detection results based on sensor data.

[0136] In some examples, foldable phones can obtain a hinge health score based on sensor data, and retrieve the corresponding state detection results from a preset state mapping table. The state mapping table represents the correspondence between different hinge health scores and different state detection results.

[0137] For example, the state mapping table can be seen in Table 1 below.

[0138] Table 1

[0139]

[0140]

[0141] For example, the aforementioned health score can also be converted into a hinge damage level. For instance, a health score of 90-100 corresponds to a damage level of 1; a health score of 80-90 corresponds to a damage level of 2; a health score of 60-80 corresponds to a damage level of 3; and a health score <60 corresponds to a damage level of 4. The higher the damage level, the higher the predicted degree of hinge damage and the more severe the damage. It is understood that the aforementioned damage level and damage type can also reflect the hinge's health status, remaining service life, etc. For example, a damage level of 1 indicates the hinge is very healthy; a damage level of 2 indicates the hinge is relatively healthy; a damage level of 3 indicates the hinge is not very healthy; and a damage level of 4 indicates the hinge is very unhealthy, etc. Based on this, in some other examples, the condition detection result may also include the hinge's health status and / or remaining service life.

[0142] In some examples, after at least one sensor in the foldable phone acquires analog timing signals, the foldable phone converts these analog timing signals into voltage timing signals. Also, see reference... Figure 9 As shown, for various voltage timing signals, the foldable phone performs keyframe alignment on these signals. Based on the timestamps of the acquired signals, it aligns them with the same set of start and end times. Since the acquisition frequencies of different sensors cannot be kept consistent, a time interval is used for temporal sliding window segmentation to obtain the window more accurately. Then, the foldable phone calculates the MFCC for each window, thus obtaining MFCC feature matrices of consistent size. Finally, feature fusion is performed to obtain the numerical range in the new feature matrix. This numerical range can be represented as the hinge's health score.

[0143] In some examples, foldable screen phones can obtain MFCC by referring to the following formula (1):

[0144]

[0145] in,

[0146]

[0147] C j X represents MFCC, where L represents the order of the MFCC system, typically ranging from 2 to 13. i H represents the logarithmic energy of the output of each filter bank, where i represents the filter bank number, and M represents the number of triangular filters, typically ranging from 22 to 40. X(k) represents the spectrum of each frame obtained by performing a Fast Fourier Transform on the windowed frame signal, where k represents the frame number, and H... i (k) represents the frequency response of the triangular filter, N represents the number of points in the Fourier transform, and log 10 The symbol for a logarithm with a base of 10.

[0148] If the foldable screen phone acquires only one type of analog timing signal, then the corresponding voltage timing signal is also only one type. The foldable screen phone can perform sliding window segmentation based on this voltage timing signal, and obtain the MFCC feature matrix based on the segmented window, as well as the data range in the MFCC feature matrix, as the health score of the hinge.

[0149] In other examples, foldable phones can also predetermine the hinge state detection results based on neural networks, classification networks, etc.; or, associate the state detection results with health scores to create a pre-defined state mapping table.

[0150] For example, after obtaining the MFCC feature matrix, the foldable screen phone extracts the deep time-frequency features of the MFCC feature matrix by fusing convolutional neural networks (CNN), and constructs a fully connected multilayer perceptron (MLP) classification network. The MLP classification network is then used to realize hinge fault category detection, hinge health status diagnosis, etc., thereby obtaining the status detection results.

[0151] Among them, the extraction of deep time-frequency features involves using multi-layer CNNs to capture deep time-frequency features, which can effectively represent the changes of hinge fault MFCC feature components on the time axis.

[0152] Furthermore, a fully connected MLP classification network can construct hinge fault category detection and hinge health status score diagnosis using multiple MLP classifiers.

[0153] In the above example, the state mapping table can be stored locally on the foldable phone, and the foldable phone can automatically obtain the corresponding state detection result from the state mapping table based on the hinge's health score.

[0154] In other examples, the state mapping table can also be stored on a server. After acquiring sensor data from at least one of the aforementioned sensors, the foldable phone sends the sensor data to the server. Upon receiving the sensor data, the server can obtain a health score for the hinge based on the sensor data and retrieve the corresponding state detection result from a preset state mapping table. The server then sends the state detection result to the foldable phone. The foldable phone receives the hinge state detection result sent by the server.

[0155] In other examples, after the foldable phone obtains the hinge's health score based on sensor data, it can send that health score to the server. Upon receiving the health score, the server retrieves the corresponding state detection result from a pre-defined state mapping table. Then, the server sends the state detection result to the foldable phone. The foldable phone receives the hinge's state detection result sent by the server.

[0156] Whether the foldable phone obtains the status detection results on its own or obtains them from the server, it does so based on a preset status mapping table. This preset status mapping table allows the foldable phone or the server to obtain the hinge status detection results more quickly, thereby reducing the user's waiting time.

[0157] S403, Status detection results of the hinge display on the foldable screen phone.

[0158] The condition detection results can include at least one of the following: the hinge's damage level, damage type, and remaining service life. Displaying the condition detection results allows users to better understand the hinge's condition, enabling them to promptly change or modify their usage habits to prevent further damage.

[0159] In some examples, when foldable phones display hinge status detection results, they can also show the hinge's health score, the time of the most recent detection, etc.

[0160] For example, foldable screen phones can display things like... Figure 10 The page shown in (a) includes status detection results such as "Health Score: 70 points" and "Predicted remaining lifespan of the hinge is 2 months. Please contact the nearest after-sales service center for professional diagnosis to avoid affecting your continued normal experience."

[0161] For example, foldable screen phones can display things like... Figure 10The page shown in (b) includes status detection results such as "Health Score: 70 points", "Hinge damage level is level three, the hinge is predicted to be damaged due to dust ingress, and the remaining life of the hinge is predicted to be 3 weeks", etc.

[0162] As mentioned above, foldable screen phones can display the status detection results of the hinge, allowing users to know the status of the hinge in a timely manner, improve their operating habits, or replace high-cost repairs for severely damaged hinges with low-cost repairs, thereby improving the user experience.

[0163] In the examples above, the foldable phone can directly display the hinge's status detection result after obtaining it. In other examples, the foldable phone can only display the status detection result if the status detection result indicates that the hinge's damage level is greater than a preset level, or that the hinge's health score is less than a preset score.

[0164] For example, if the preset level is level 2, when the status detection result indicates that the hinge damage level is level 3, the foldable screen phone will push the status detection result to the user. However, when the status detection result indicates that the hinge damage level is level 2, the foldable screen phone will save the status detection result locally or in the application log, and will not push it to the user.

[0165] It is evident that foldable phones may not immediately display the hinge status detection results after obtaining them, in order to minimize any impact on the user experience. Furthermore, foldable phones will display the status detection results under specific circumstances, such as when the hinge damage level is too high or the hinge health score is too low, ensuring that users can promptly understand the hinge's status.

[0166] Alternatively, in other examples, the foldable phone can also save the acquired status detection results in the log of a first application. This first application provides the hinge status detection function; for example, it could be a third-party application or a non-third-party application installed on the foldable phone, such as "Health Manager". Then, in response to the user opening the first application, the foldable phone can display the status detection results. For example, as shown in Figure 11(a), after the user opens "Health Manager", the foldable phone pushes the most recent status detection result to the user, such as displaying "Current hinge health score is 20 points, last detection time is XXXX". Alternatively, the foldable phone can respond to the user's triggering of the hinge status detection function and display the status detection results. For example, as shown in Figure 11(b), after the user opens "Health Manager" and clicks the "Hinge Status Detection" control, the foldable phone pushes the most recent status detection result to the user, such as displaying "Current hinge health score is 20 points, last detection time is XXXX".

[0167] It's clear that foldable phones may not immediately display the hinge status detection results after obtaining them, in order to minimize any impact on the user experience. Furthermore, foldable phones will display the status detection results under specific circumstances, such as when the user launches the "Health Manager" app or triggers the hinge status detection function, thus allowing the user to understand the hinge's status.

[0168] In some examples, foldable phones also display operation guidance information based on the status detection results. This guidance prompts users to perform the hinge status detection again using alternative methods to obtain more accurate and professional results. For example, the guidance might read, "Please contact your nearest after-sales service center for professional inspection to avoid affecting your continued normal use." Alternatively, the guidance can also be used to advise users to change their operating habits when using a foldable display.

[0169] As can be seen from the above, the hinge state detection method for foldable screen devices provided in this application embodiment can determine the hinge state by using sensor data collected by sensors and other sensors set on the foldable screen phone itself. This method does not require a specific hinge detection device. If the user needs to know the hinge state, they can control the foldable screen phone to start detection at any time, thereby making the hinge state detection more real-time and providing the user with a better user experience.

[0170] In addition, the above method can also acquire sensor data in the background during the user's daily use of the foldable screen phone, so as to analyze complex user habits and long-term hinge state change trends, thereby obtaining more accurate hinge state detection results.

[0171] The hinge status detection results mentioned above allow users to know in advance whether the hinge is at risk of damage, and to improve their operating habits before the hinge malfunctions, or to use low-cost repairs instead of high-cost repairs after the hinge is seriously damaged, thereby improving the product user experience.

[0172] Understandably, hinge deterioration occurs gradually, but some signs will appear earlier, exhibiting "signs of potential failure," see [reference needed]. Figure 12 As shown, the lifespan of a hinge is affected by its health status. Point A on the curve is the point where the fault begins, and point P is the potential fault point. During the period from point A to point P, the health status of the hinge will begin to change, but it will not be detected by the sensor or can not be predicted based on the sensor data. After point P, the fault persists and continues to affect the lifespan of the hinge. The fault becomes more and more serious, which will cause the hinge to fail at point F on the curve, that is, the lifespan of the hinge ends at this point.

[0173] Using the method described in this application embodiment, the above-mentioned "potential fault symptoms" can be captured and analyzed within a time period T after point P, and the health status of the hinge can be determined in a timely manner. This allows for the determination of whether the hinge needs maintenance and what kind of maintenance to perform, thus preventing potential faults from developing into functional faults, i.e., complete failure.

[0174] In the above embodiments, a foldable screen mobile phone is used as an example to illustrate the hinge state detection method of a foldable screen device. In other embodiments, the hinge state detection method of a foldable screen device can also be applied to terminal devices with flexible foldable displays, such as foldable screen laptops and foldable screen watches. The specific implementation method can be referred to the above content, and will not be repeated here.

[0175] In some other embodiments, the hinge status detection method for foldable screen devices described above can also be used to detect the health status of the hinge in a terminal device with a hinge. For example, a terminal device with a hinge can be a foldable laptop, a flip phone, etc., where the hinge is used to enable folding between the laptop screen and the keyboard, etc.

[0176] For example, when detecting the health status of a rotating shaft, the sensor data acquired by the terminal device may include acoustic data of the rotating shaft, angle data of the rotating shaft, vibration data of the rotating shaft, acceleration data of the rotating shaft, opening and closing time data of the rotating shaft, etc.

[0177] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the processes of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described in the embodiments of this application. In addition, it should be noted that the process details involved in one embodiment of this application are also applicable to other embodiments in a similar manner, or different embodiments may be combined.

[0178] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0179] Furthermore, the various method embodiments can be implemented individually or in combination.

[0180] It is understood that, in order to achieve the above functions, the aforementioned foldable screen device includes hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0181] This embodiment can divide the foldable screen device into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0182] This application also provides a foldable screen device, such as... Figure 13 As shown, the foldable screen device may include a foldable display screen, a hinge stacked on the bendable portion of the foldable display screen, and at least one sensor for detecting the hinge state. It may also include one or more processors 1301, memory 1302, and communication interface 1303.

[0183] The memory 1302, communication interface 1303, and processor 1301 are coupled together. For example, the memory 1302, communication interface 1303, and processor 1301 can be coupled together via bus 1304.

[0184] The communication interface 1303 is used for data transmission with other devices. The memory 1302 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1301, cause the foldable screen device to perform the hinge state detection method of the foldable screen device in this embodiment.

[0185] The processor 1301 may be a processor or controller, such as a CPU, a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0186] The bus 1304 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus 1304 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 13 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0187] This application also provides a computer-readable storage medium that includes computer instructions. When the computer instructions are executed on a foldable screen device, the foldable screen device performs the relevant method steps described in the above method embodiments.

[0188] This application also provides a computer program product that, when run on a computer, causes the computer to execute the relevant method steps described in the above method embodiments.

[0189] The foldable screen device, computer-readable storage medium, or computer program product provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0190] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0191] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0192] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0193] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0194] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0195] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for detecting the hinge state of a foldable screen device, characterized in that, The foldable screen device includes a foldable display screen, a hinge stacked on a bendable portion of the foldable display screen, and at least one sensor for detecting the state of the hinge; the method includes: During the opening and closing action of the foldable display screen, sensor data collected by the at least one sensor is acquired; the sensor data includes at least the acoustic data of the hinge and / or the angle data of the hinge; the acoustic data originates from the sound sensor among the at least one sensor, and the angle data originates from the angle sensor among the at least one sensor; Based on the sensor data, the state detection result of the hinge is obtained.

2. The method according to claim 1, characterized in that, The process of acquiring sensor data collected by the at least one sensor during the opening and closing action of the foldable display screen includes: In response to a user's triggering of the hinge status detection function, sensor data collected by the at least one sensor is acquired during the opening and closing action of the foldable display screen; or, When the foldable display screen meets preset conditions, sensor data collected by at least one sensor is acquired during the opening and closing action of the foldable display screen; the preset conditions include the duration of use of the foldable display screen reaching a preset duration or the number of times the foldable display screen is opened and closed reaching a preset number of times.

3. The method according to claim 2, characterized in that, In response to a user's triggering of the hinge state detection function, during the opening and closing action of the foldable display screen, sensor data collected by the at least one sensor is acquired, including: In response to a user's triggering of the hinge status detection function, guidance information is displayed; the guidance information is used to guide the user to perform at least one opening and closing action on the foldable display screen. Sensor data collected by the at least one sensor is acquired during at least one opening and closing action performed by the user on the foldable display screen.

4. The method according to claim 2, characterized in that, When the foldable display screen meets preset conditions, the sensor data collected by the at least one sensor during the opening and closing action of the foldable display screen includes: When the foldable display screen meets preset conditions, historical sensor data collected by the at least one sensor is acquired; the historical sensor data is data acquired by the at least one sensor during multiple opening and closing actions of the foldable display screen before the foldable display screen meets the preset conditions; the historical sensor data is data continuously acquired by the at least one sensor or data acquired by the at least one sensor according to a preset sampling interval, the preset sampling interval including a preset time or a preset number of times.

5. The method according to any one of claims 1-4, characterized in that, After obtaining the state detection result of the hinge, the method further includes: The status detection result is displayed when the status detection result indicates that the damage level of the hinge is greater than a preset level, or when the health score of the hinge is less than a preset score.

6. The method according to any one of claims 1-4, characterized in that, After obtaining the state detection result of the hinge, the method further includes: The state detection results are saved in the log of the first application; the first application is used to provide hinge state detection function. In response to the user opening the first application, the status detection result is displayed; or... In response to the user's triggering of the hinge status detection function, the status detection result is displayed.

7. The method according to any one of claims 1-6, characterized in that, The step of obtaining the hinge state detection result based on the sensor data includes: The health score of the hinge is obtained based on the sensor data. The state detection result corresponding to the health score is obtained from the preset state mapping table; the state mapping table is used to represent the correspondence between different health scores of the hinge and different state detection results.

8. The method according to any one of claims 1-6, characterized in that, The step of obtaining the hinge state detection result based on the sensor data includes: Send the sensor data to the server; The system receives the hinge status detection result sent by the server; the hinge status detection result is the status detection result corresponding to the health score obtained by the server from a preset status mapping table after obtaining the health score of the hinge based on the sensor data.

9. The method according to any one of claims 1-8, characterized in that, The sensor data also includes at least one of the following: vibration data of the hinge, acceleration data of the hinge, and opening / closing time data of the hinge.

10. The method according to any one of claims 1-9, characterized in that, The condition detection result includes at least one of the following: damage level, damage type, and remaining service time of the hinge.

11. The method according to claim 5 or 6, characterized in that, The display of the state detection result also includes: Displays the health score of the hinge.

12. The method according to claim 5 or 6, characterized in that, The method further includes: Based on the status detection results, operation guidance information is displayed; the operation guidance information is used to prompt the user to perform status detection on the hinge again in another way, or to prompt the user to change their operating habits when using the foldable display screen.

13. The method according to claim 7, characterized in that, The step of obtaining the health score of the hinge based on the sensor data includes: The various analog time-series signals that serve as sensor data are converted into voltage time-series signals respectively; Multiple voltage time-series signals are divided into multiple windows by time-domain sliding window segmentation using the same time interval; the start and end points of the multiple windows are the same. Obtain the Mel frequency cepstral coefficients (MFCC) feature matrix corresponding to each window; The MFCC feature matrices corresponding to the multiple windows are fused to obtain new feature matrices. The health score of the hinge is obtained based on the new feature matrix.

14. A foldable screen device, characterized in that, The foldable screen device includes a foldable display screen, a hinge stacked with a bendable portion of the foldable display screen, and at least one sensor for detecting the hinge state; the foldable screen device further includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the foldable screen device to perform the hinge state detection method of the foldable screen device as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that, The method includes computer instructions that, when executed on a foldable screen device, cause the foldable screen device to perform the hinge state detection method for a foldable screen device as described in any one of claims 1-13.

16. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the hinge state detection method for a foldable screen device as described in any one of claims 1-13.

Images