Under-screen camera terminal device false touch reminding method and device

Abstract

The application provides a method and device for reminding of accidental touch of an under-screen camera terminal equipment. The method for reminding of accidental touch of the under-screen camera terminal equipment is applied to a terminal equipment, the terminal equipment comprises an under-screen camera, a screen of the terminal equipment comprises a first area screen covering the under-screen camera, and the method comprises: displaying a reminder of accidental touch on the screen when detecting that the first area screen has a possibility of being touched. The application can reduce the possibility and frequency of the part of the screen covering the camera being contaminated, and improve the clarity of the photograph.

Description

Technical Field

[0001] This application relates to under-display camera terminal technology, and more particularly to a method and apparatus for providing accidental touch reminders for under-display camera terminal devices. Background Technology

[0002] In recent years, the screen design trend of mobile terminals (smartphones, tablets, etc.) has been towards high screen ratios and even full-screen displays. In order to achieve the full-screen effect, the industry has developed a number of hidden front-facing camera design solutions, such as mechanical pop-up cameras, motorized pop-up cameras, and sliding cameras. However, the complex mechanical structures in these designs result in high design costs, short lifespans, and susceptibility to water ingress and dust accumulation, making them less than ideal full-screen solutions.

[0003] Related technologies propose an under-display camera (UDC or under-screencamera, USC) design, which hides the front-facing camera beneath the device's screen. The device's screen is divided into two parts. The first part, facing the front-facing camera, uses a transparent organic light-emitting diode (OLED) screen. When taking photos, this first part is transparent and does not obstruct the camera's viewfinder. When not taking photos, this first part functions as a regular display, showing the image normally along with the second part. The second part, encompassing all other areas of the screen, uses a standard OLED screen for normal display. This achieves a true full-screen display.

[0004] However, in terminal devices using the aforementioned UDC design, the first part of the screen is easily contaminated by fingerprints, sweat, stains, etc., which leads to a decrease in photo clarity. Summary of the Invention

[0005] This application provides a method and apparatus for providing accidental touch reminders for under-display camera terminal devices, so as to reduce the possibility and frequency of the screen covering the camera being contaminated and improve the clarity of photos.

[0006] In a first aspect, this application provides a method for providing accidental touch reminders for an under-display camera terminal device, which is applied to a terminal device including an under-display camera and a screen including a first area of ​​screen covering the under-display camera. The method for providing accidental touch reminders for the under-display camera terminal device includes: displaying an accidental touch reminder on the screen when it is detected that there is a possibility of the first area of ​​screen being touched.

[0007] In this embodiment, when the terminal device detects that the part of the screen covering the camera may be touched by the user's finger, it can provide a prompt to inform the user of the camera's location. This allows the user to operate with caution and avoid touching the part of the screen covering the camera as much as possible, thereby reducing the possibility and frequency of the screen covering the camera being contaminated and improving the clarity of the photos.

[0008] In one possible implementation, detecting the possibility that the first area of ​​the screen may be touched includes: obtaining a touchable area based on user operation, the touchable area being an area on the screen of the terminal device that can be touched by the user; determining that the first area of ​​the screen may be touched when the touchable area overlaps with the first area of ​​the screen; and determining that the first area of ​​the screen may not be touched when the touchable area does not overlap with the first area of ​​the screen.

[0009] By identifying the areas that may be touched based on the user's actual actions, the accuracy of accidental touch alerts can be improved.

[0010] In one possible implementation, obtaining the touchable area based on user operations includes: obtaining a swiping trajectory based on the user's touch operations on the terminal device's screen; and determining the touchable area based on the swiping trajectory. It should be noted that the swiping trajectory can be the trajectory generated by each of the user's operations. For example, if the user's operation is to swipe from left to right on the screen, then the swiping trajectory is a line from left to right. Or, if the user's operation is to swipe along a continuous curve on the screen, then the swiping trajectory is a curve.

[0011] In one possible implementation, the touch operation includes a swipe operation and / or a press operation; wherein the swipe operation includes a straight swipe operation in any direction and / or a curved swipe operation in any direction; the press operation includes a tap operation and / or a long press operation.

[0012] In one possible implementation, the touchable area is determined based on the sliding trajectory, including: using the sliding trajectory corresponding to the sliding operation as the center line and extending outwards by a set length on both sides to obtain the touchable area; or, using the sliding trajectory corresponding to the pressing operation as the center and the set length as the radius to obtain the touchable area.

[0013] In one possible implementation, obtaining the touchable area based on user operation includes: obtaining a hover point based on a user's hovering touch operation near the screen of the terminal device, the hovering touch operation being sensed by a capacitive sensor or a proximity sensor; and determining the touchable area based on the hover point.

[0014] In one possible implementation, determining the touchable area based on the hover point includes: taking the position on the screen of the terminal device corresponding to the hover point as the center and a set length as the radius to obtain the touchable area.

[0015] Considering the possibility that users might touch the part of the screen covering the under-screen camera during various operations, we improve the efficiency of accidental touch detection.

[0016] In one possible implementation, providing a notification includes: displaying the edge of the first area of ​​the screen in a manner distinct from other areas; or, displaying the first area of ​​the screen in a manner distinct from other areas; or, displaying the position on the screen of the terminal device corresponding to the edge of the under-display camera in a manner distinct from other areas; or, displaying the position on the screen of the terminal device corresponding to the under-display camera in a manner distinct from other areas; the manner of distinguishing from other areas includes highlighting or filling patterns.

[0017] In one possible implementation, providing a reminder also includes: indicating the location of the first area screen or the screen of the terminal device corresponding to the under-display camera using text on the terminal device's screen.

[0018] By reminding users of the location of the under-display camera in multiple ways, the likelihood and frequency of screen contamination on the part covering the camera can be reduced, improving photo clarity, while also allowing for a variety of reminder methods.

[0019] Secondly, this application provides a mis-touch reminder device for an under-display camera terminal device. The device is applied to a terminal device, which includes an under-display camera and a screen that includes a first area of ​​screen covering the under-display camera. The device includes a processing module for displaying a mis-touch reminder on the screen when the possibility of the first area of ​​screen being touched is detected.

[0020] In one possible implementation, the processing module is specifically used to obtain a touchable area based on user operation. The touchable area is an area on the screen of the terminal device that can be touched by the user. When the touchable area overlaps with a first area of ​​the screen, it is determined that the first area of ​​the screen is likely to be touched. When the touchable area does not overlap with the first area of ​​the screen, it is determined that the first area of ​​the screen is not likely to be touched.

[0021] In one possible implementation, the processing module is specifically used to obtain the swiping trajectory based on the user's touch operation on the screen of the terminal device; and to determine the touchable area based on the swiping trajectory.

[0022] In one possible implementation, the touch operation includes a swipe operation and / or a press operation; wherein the swipe operation includes a straight swipe operation in any direction and / or a curved swipe operation in any direction; the press operation includes a tap operation and / or a long press operation.

[0023] In one possible implementation, the processing module is specifically used to expand outward by a set length on both sides based on the sliding trajectory corresponding to the sliding operation as the center line to obtain a touchable area; or, based on the sliding trajectory corresponding to the pressing operation as the center and the set length as the radius, a touchable area is obtained.

[0024] In one possible implementation, the processing module is specifically used to obtain a hover point based on a user's hovering touch operation near the screen of the terminal device, the hovering touch operation being sensed by a capacitive sensor or a distance sensor; and to determine the touchable area based on the hover point.

[0025] In one possible implementation, the processing module is specifically used to obtain a touchable area with a set length as the radius and the position on the screen of the terminal device corresponding to the hover point as the center.

[0026] In one possible implementation, the processing module is specifically configured to display the edge of the first area of ​​the screen in a manner different from other areas; or, display the first area of ​​the screen in a manner different from other areas; or, display the position on the screen of the terminal device corresponding to the edge of the under-display camera in a manner different from other areas; or, display the position on the screen of the terminal device corresponding to the under-display camera in a manner different from other areas; the manner of being different from other areas includes highlighting or filling patterns.

[0027] In one possible implementation, the processing module is further configured to indicate the position of the first area screen or the position of the under-display camera on the screen of the terminal device using text.

[0028] Thirdly, this application provides a terminal device, comprising: one or more processors; a memory for storing one or more programs; and when the one or more programs are executed by the one or more processors, causing the one or more processors to implement the method as described in any of the first aspects above.

[0029] Fourthly, this application provides a computer-readable storage medium including a computer program that, when executed on a computer, causes the computer to perform the method described in any of the first aspects above.

[0030] Fifthly, this application provides a computer program that, when executed by a computer, performs the method described in any of the first aspects above. Attached Figure Description

[0031] Figure 1 An exemplary structural schematic diagram of the terminal device 100 is shown;

[0032] Figure 2 An exemplary front view diagram of the screen of a terminal device is shown;

[0033] Figure 3 An exemplary structural diagram of the first area screen is shown;

[0034] Figure 4 This is a flowchart illustrating an embodiment of the accidental touch reminder method for an under-display camera terminal device according to this application;

[0035] Figure 5a-10 Each of the above is an exemplary schematic diagram of a detection method;

[0036] Figure 11 An exemplary diagram is shown where a user's finger hovers above the screen;

[0037] Figure 12-15 An exemplary schematic diagram of each reminder method is shown. Detailed Implementation

[0038] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0039] The terms "first," "second," etc., used in the specification, embodiments, claims, and drawings of this application are for distinguishing purposes only and should not be construed as indicating or implying relative importance or order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, such as including a series of steps or units. A method, system, product, or apparatus is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or apparatuses.

[0040] It should be understood that in this application, "at least one (item)" means one or more, and "more than" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one (item) of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0041] The terminal device described in this application, also known as user equipment (UE), can be deployed on land, including indoors or outdoors, handheld or vehicle-mounted; it can also be deployed on water (such as on ships); and it can also be deployed in the air (such as on airplanes, balloons, and satellites). The terminal device can be a mobile phone, tablet computer, virtual reality (VR) device, augmented reality (AR) device, wireless device in a smart home, etc., and this application does not limit this. In this application, the aforementioned terminal device and the chip that can be installed in the aforementioned terminal device are collectively referred to as terminal device.

[0042] Figure 1 A schematic diagram of the terminal device 100 is shown.

[0043] Terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0044] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0045] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0046] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0047] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0048] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0049] Terminal device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0050] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0051] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the terminal device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0052] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when terminal device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0053] Video codecs are used to compress or decompress digital video. Terminal device 100 may support one or more video codecs. Thus, terminal device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0054] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in terminal devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0055] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0056] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of terminal device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of terminal device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.

[0057] Terminal device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0058] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0059] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or make hands-free calls through the speaker 170A.

[0060] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Terminal device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, terminal device 100 detects the intensity of the touch operation based on pressure sensor 180A. Terminal device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0061] The gyroscope sensor 180B can be used to determine the motion attitude of the terminal device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the terminal device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the terminal device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0062] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0063] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0064] The 180E accelerometer can detect the magnitude of acceleration of the terminal device 100 in various directions (typically three axes). When the terminal device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the attitude of the terminal device, and can be applied to applications such as landscape / portrait switching and pedometers.

[0065] A distance sensor 180F is used to measure distance. The terminal device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, the terminal device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0066] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The terminal device 100 emits infrared light outward through the LED. The terminal device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 may use the proximity sensor 180G to detect when a user holds the terminal device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and screen locking.

[0067] The ambient light sensor 180L is used to sense the ambient light intensity. The terminal device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touches.

[0068] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0069] Temperature sensor 180J is used to detect temperature. In some embodiments, terminal device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, terminal device 100 reduces the performance of the processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is below another threshold, terminal device 100 heats battery 142 to prevent abnormal shutdown of terminal device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, terminal device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0070] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of terminal device 100, in a different position than display screen 194.

[0071] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0072] Those skilled in the art will understand that terminal device 100 may include more than Figure 1 The number of fewer or more components shown Figure 1 The terminal device shown only includes components that are more relevant to the various implementations disclosed in this application.

[0073] exist Figure 1 The front-facing camera on the touchscreen 1092 of the terminal device shown adopts a UDC design to achieve a full-screen display. Figure 2 An exemplary front view diagram of a terminal device's screen is shown, such as... Figure 2 As shown, the front-facing camera is hidden beneath the screen of the terminal device. Based on this, the screen is divided into two areas. The first area, a transparent OLED screen, covers the front-facing camera. When taking a photo, this first area is transparent and does not obstruct the camera's viewfinder. When not taking a photo, this first area functions as a regular display, showing the image normally along with the second area. The second area is the entire screen excluding the first area; it uses a standard OLED screen for normal display.

[0074] Figure 2 A front view of a screen employing UDC is shown, with a side view of the first area of ​​the screen as follows. Figure 3 As shown, Figure 3An exemplary structural diagram of the first area screen is shown. The first area screen comprises three layers, arranged from the outside in: the outermost layer is a transparent anode, the middle layer uses a transparent organic light-emitting material, and the innermost layer is a transparent cathode. When the front-facing camera is not taking pictures, the transparent organic light-emitting material in the first area screen emits light normally, and the emitted light (OLED light) passes through the transparent cathode in the first area screen to reach the user's eyes, allowing the user to see the content displayed on the first area screen. When the front-facing camera is taking pictures, the transparent organic light-emitting material in the first area screen does not emit light, and external light can pass through the transparent cathode, transparent organic light-emitting material, and transparent anode in the first area screen and be projected onto the front-facing camera, thus enabling picture taking. It should be noted that... Figure 2 and Figure 3 This is merely an example of one type of terminal device. If the terminal device has multiple front-facing cameras, a separate camera can be placed above each of them, such as... Figure 3 The transparent OLED screen shown can also be used to set up a screen within a large area (covering all front-facing cameras) for all front-facing cameras. Figure 3 The transparent OLED screen shown. Figure 3 The transparent OLED screen shown can also adopt other structures. This application does not specifically limit it in this regard.

[0075] Figure 4 This is a flowchart illustrating an embodiment of the accidental touch reminder method for an under-display camera terminal device according to this application. Figure 4 As shown, the method in this embodiment can be applied to the above-mentioned... Figure 1 The terminal device shown has a screen that can be as follows: Figure 2 and Figure 3 The structure shown employs a UDC design scheme, enabling a full-screen display. The accidental touch notification method for this under-display camera terminal device may include:

[0076] Step 401: Detect whether the first area of ​​the screen is likely to be touched.

[0077] The first area screen can, for example, adopt... Figure 2 and Figure 3The diagram shows a transparent OLED screen on the terminal device. Because it uses a full-screen design, users need to input commands via touch. Therefore, any area of ​​the screen can be touched during use, such as clicking, swiping, or tapping. This can lead to contamination of the touched areas with sweat, dirt, or other contaminants from the user's hands. A contaminated screen can make the displayed interface unclear, especially if the first area is contaminated. Since the first area still covers the camera lens during photography, even if the screen itself becomes transparent, the contaminated screen acts like a contaminated camera lens, causing glare, blurriness, or even obstructions in the image.

[0078] Figure 5a and 5b An exemplary schematic diagram of the detection method is shown, such as... Figure 5a and 5b As shown, the top-left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. To open the drop-down menu at the top of the screen, the user can typically start by swiping down a certain distance L1 from a position at the top of the screen (corresponding to the horizontal coordinate x1 and the vertical coordinate y1, where x1∈(0,X) and y1 can be 0 or a value close to 0). Based on this operation, the terminal device can detect that the user's touch operation starts at coordinates (x1,y1) and ends at coordinates (x1,y1+L1), with the swipe trajectory being vertically downwards. The terminal device uses the sliding trajectory as a reference to define a range. Using the line connecting coordinates (x1, y1) and (x1, y1+L1) as the midline, it extends left and right by a set distance x (x can be based on the thickness of a human finger or the area of ​​a fingertip), resulting in a rectangular area. The four vertices of this rectangular area are (x1-x, y1), (x1+x, y1), (x1-x, y1+L1), and (x1+x, y1+L1). The terminal device then determines whether this rectangular area intersects with the first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If they intersect, it means that during the user's sliding operation, their finger likely swiped across the first area of ​​the screen; therefore, it can be considered that the first area of ​​the screen may have been touched and thus contaminated in this case.

[0079] Figure 6a and 6b An exemplary schematic diagram of the detection method is shown, such as... Figure 6a and 6bAs shown, the top-left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. To exit the current application, the user can typically start from a position on the left edge of the screen (corresponding to a horizontal coordinate of x2 and a vertical coordinate of y2, where x2 can be 0 or close to 0, and y2∈(0,Y)) and slide a certain distance L2 to the right. Based on this operation, the terminal device can detect that the user's touch operation starts at coordinates (x2,y2) and ends at coordinates (x2+L2,y2), with the sliding trajectory being horizontal to the right. The terminal device uses the sliding trajectory as a reference to define a range. Using the line connecting coordinates (x2, y2) and (x2+L2, y2) as the midline, it extends vertically by a predetermined distance y (the value of y can be based on the thickness of a human finger or the area of ​​a fingertip), resulting in a rectangular area. The four vertices of this rectangular area are (x2, y2-y), (x2, y2+y), (x2+L2, y2-y), and (x2+L2, y2+y). The terminal device then determines whether this rectangular area intersects with the first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If they intersect, it indicates that during the user's sliding operation, their finger likely swiped across the first area of ​​the screen. Therefore, it can be considered that the first area of ​​the screen may have been touched and thus contaminated in this case.

[0080] Figure 7a and 7b An exemplary schematic diagram of the detection method is shown, such as... Figure 7a and 7bAs shown, the top left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. When a user is viewing photos or selecting applications, to switch between the current photo or interface, they can typically start from a certain position on the right edge of the screen (corresponding to a horizontal coordinate of x3 and a vertical coordinate of y3, where x3∈(0,X) and y3∈(0,Y)) and slide a certain distance L3 to the left. Based on this operation, the terminal device can detect that the user's touch operation starts at coordinates (x3,y3) and ends at coordinates (x3-L3,y3), with the sliding trajectory being horizontal to the left. The terminal device uses the sliding trajectory as a reference to define a range. Using the line connecting coordinates (x3, y3) and (x3-L3, y3) as the midline, it extends vertically by a predetermined distance y (the value of y can be based on the thickness of a human finger or the area of ​​a fingertip), resulting in a rectangular area. The four vertices of this rectangular area are (x3, y3-y), (x3, y3+y), (x3-L3, y3-y), and (x3-L3, y3+y). The terminal device then determines whether this rectangular area intersects with the first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If they intersect, it indicates that during the user's sliding operation, their finger likely swiped across the first area of ​​the screen. Therefore, it can be considered that the first area of ​​the screen may have been touched and thus contaminated in this case.

[0081] Figure 8a and 8b An exemplary schematic diagram of the detection method is shown, such as... Figure 8a and 8bAs shown, the top-left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. When playing a game, the user drags the character across the screen, typically sliding in any direction. Starting from a certain position (corresponding to x4, y4, x4∈(0,X), y4∈(0,Y)), the user slides a certain distance L4 in any direction (e.g., downwards to the right), and then slides another distance L5 in any direction (e.g., to the right). Based on this operation, the terminal device can detect that the user's touch operation starts at coordinates (x4,y4), passes through coordinates (x41,y41), and ends at coordinates (x42,y42), with the sliding trajectory first downwards to the right and then to the right. The terminal device uses the sliding trajectory as a reference to define a range. Using the line connecting coordinates (x4, y4), (x41, y41), and (x42, y42) as the midline, it extends a predetermined distance z (the value of z can be based on the thickness of a human finger or the area of ​​a fingertip) to both sides, resulting in a strip-shaped area. The terminal device then determines whether this strip-shaped area intersects with the first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If they intersect, it indicates that during the user's sliding operation, their finger is likely to have swiped across the first area of ​​the screen. Therefore, it can be considered that the first area of ​​the screen may have been touched and thus contaminated in this case.

[0082] Figure 9a and 9b An exemplary schematic diagram of the detection method is shown, such as... Figure 9a and 9bAs shown, the top-left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. To open or delete an application, a user typically briefly presses or long-presses (clicks the control for more than a set duration) the application's icon. The application's location corresponds to coordinates (x5, y5). Based on this operation, the terminal device can detect that the user's touch operation is a brief press or long press on a circular, square, or irregular area centered at coordinates (x5, y5). The terminal device defines a range centered at coordinates (x5, y5), and obtains a circular area with a radius of a set distance r (r can be based on the area of ​​a human fingertip or the area of ​​a human finger pad). The terminal device then determines whether this circular area intersects with the first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If the two mentioned above intersect, it means that during the user's click operation, their finger is likely to touch the first area of ​​the screen. Therefore, it can be considered that the first area of ​​the screen may be touched and thus contaminated in this case.

[0083] It should be noted that the above content exemplifies several methods for detecting the possibility of the first area screen being touched, but this application does not specifically limit the specific implementation method, including the method for determining the above-mentioned range. In addition, the intersection between the rectangular area, strip area, and circular area obtained by the terminal device and the first area screen refers to whether the two areas overlap. The range and area of ​​this overlap are not limited. That is, as long as the two have an intersection (overlap), it is considered that the user's finger is likely to touch the first area screen during the corresponding operation.

[0084] Currently, common touchscreens only use mutual capacitance sensors for multi-touch detection. Touchscreens supporting hover touch employ two types of capacitive sensors: mutual capacitance sensors and self-capacitance sensors. Mutual capacitance sensors have a very small electric field and low signal strength, making them unable to detect very weak signals. Self-capacitance sensors, on the other hand, generate stronger signals than mutual capacitance sensors, enabling them to detect fingers at greater distances, up to 20mm. This means a self-capacitance sensor can detect a finger located 20mm above the screen. In touchscreens supporting hover touch, mutual capacitance sensors handle normal touch sensing, including multi-touch, while self-capacitance sensors detect fingers hovering above the screen. By setting a threshold for touch input, the terminal device can distinguish between hover touch and physical touch.

[0085] A proximity sensor, also known as a displacement sensor, is a type of sensor used to detect the distance between itself and an object. A touchscreen equipped with a proximity sensor can detect the distance between a finger hovering over the screen and the screen itself. If this distance is less than a set threshold, it indicates that the user is likely about to perform an operation on the touchscreen. By setting a distance threshold, the terminal device can distinguish between hovering touches and physical touches.

[0086] Figure 10 An exemplary schematic diagram of the detection method is shown, such as... Figure 10 As shown, the top left corner of the screen is taken as the origin (0,0). The positive x-axis extends to the right from the origin, with the horizontal coordinate ranging from 0 to X. The positive y-axis extends downwards from the origin, with the vertical coordinate ranging from 0 to Y. The terminal device provides a sensing function. When a user's finger approaches the screen of the terminal device at close range, based on the aforementioned hover touch technology or distance sensor, the terminal device can detect the position (hover point) of the finger on the screen. Figure 11 An exemplary diagram is shown where a user's finger hovers above the screen, such as... Figure 11 As shown, the user's right index finger hovers above a certain position on the screen of the terminal device, which can be called the hover point, with coordinates (x6, y6). The terminal device then draws a circular area with (x6, y6) as the center and a set distance r (r can be based on the area of ​​a human fingertip or the area of ​​a human finger pad) as the radius. The terminal device then determines whether this circular area intersects with the first area of ​​the screen, i.e., whether the aforementioned area covers the first area of ​​the screen. If the two intersect, it indicates that the user is likely to start operating the terminal device from the hover point, and the operation area may be near the hover point. Therefore, the user's finger is likely to touch the first area of ​​the screen, and it can be considered that the first area of ​​the screen may be touched and thus contaminated in this case.

[0087] It should be noted that the above description exemplifies a method for detecting the possibility of a first area screen being touched, but this application does not specifically limit the method for determining the above range. In addition, the intersection between the circular area obtained by the terminal device and the first area screen refers to whether the two areas overlap. The range and area of ​​this overlap are not limited. That is, as long as the two have an intersection (overlap), it is considered that the user's finger is likely to touch the first area screen during the operation after hovering.

[0088] A distance sensor, also known as a displacement sensor, is a type of sensor used to sense the distance between itself and an object. Using a distance sensor, a terminal device can detect the distance between a finger hovering over the screen and the screen itself. If this distance is less than a set threshold, it indicates that the user is likely to begin operating the touchscreen. The terminal device can determine a range centered on the finger's position on the screen (the hover point), for example, a circular area with a radius of a set distance r (where r can be based on the area of ​​a human fingertip or fingertip). The terminal device then determines whether this circular area intersects with a first area of ​​the screen, i.e., whether the aforementioned range covers the first area of ​​the screen. If they intersect, it means that the user is likely to start operating the terminal device from the hover point, and the operation area may be near the hover point. Therefore, the user's finger is likely to touch the first area of ​​the screen, and in this case, the first area of ​​the screen can be considered potentially touched and contaminated.

[0089] It should be noted that the above content exemplifies a method for detecting whether a first area of ​​the screen is likely to be touched, but this application does not specifically limit the method for determining the above range.

[0090] Step 402: When it is determined that there is a possibility that the first area of ​​the screen may be touched, a reminder is given.

[0091] As described in step 401, when the terminal device detects a possibility that the first area of ​​the screen may be touched, it can provide a reminder to inform the user which area of ​​the screen (i.e., the first area of ​​the screen) covers the camera, so that the user can operate with caution and avoid touching the first area of ​​the screen as much as possible. Here are some examples of reminders:

[0092] Figure 12 An exemplary schematic diagram of the reminder method is shown, such as... Figure 12 As shown, the terminal device can clearly define a first area of ​​the screen, such as a rectangle filled with diagonal lines. Figure 13 An exemplary schematic diagram of the reminder method is shown, such as... Figure 13 As shown, the terminal device can display the first area of ​​the screen with a color that is different from other areas on the screen, for example, by outlining the first area of ​​the screen with a red rectangle. Figure 14 An exemplary schematic diagram of the reminder method is shown, such as... Figure 14 As shown, the terminal device can clearly outline the location of the camera on the screen, for example, using a solid circular line. Users can then identify the area outlined in the image as the first screen region simply by seeing the displayed pattern. Figure 15 An exemplary schematic diagram of the reminder method is shown, such as... Figure 15As shown, the terminal device can outline the first area of ​​the screen with a rectangle filled with diagonal lines while simultaneously reminding the user with text, such as "This is the camera area, please do not touch." The user will then know that the outlined area is the first screen area simply by seeing the text displayed on the screen.

[0093] It should be noted that this application may also use other methods to remind the user of the position of the first area of ​​the screen, without making any specific limitations.

[0094] In this embodiment, when the terminal device detects that the part of the screen covering the camera may be touched by the user's finger, it can provide a prompt to inform the user of the camera's location. This allows the user to operate with caution and avoid touching the part of the screen covering the camera as much as possible, thereby reducing the possibility and frequency of the screen covering the camera being contaminated and improving the clarity of the photos.

[0095] Those skilled in the art will recognize that the method steps and units described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the steps and components of each embodiment have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0096] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be found in the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0097] In the embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the couplings or direct couplings or communication connections shown or discussed may be indirect couplings or communication connections through some interfaces, apparatuses, or units, or they may be electrical, mechanical, or other forms of connection.

[0098] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0099] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0100] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0101] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for false touch alerting of an under-screen camera terminal device, applied to a terminal device, the terminal device comprising an under-screen camera, a screen of the terminal device comprising a first area screen covering the under-screen camera, characterized in that, The method includes: When a possibility of accidental touch is detected in the first area of ​​the screen, a warning message is displayed on the screen. Among them, the touchable area is obtained according to the user's operation, and the touchable area is the area on the screen of the terminal device that can be touched by the user; When the touchable area and the first area screen overlap, it is determined that the first area screen is likely to be touched. The step of obtaining the touchable area based on user operation includes: The touchable area is obtained based on a touch operation or a hover touch operation, wherein the touch operation includes a swipe operation and / or a press operation.

2. The method of claim 1, wherein, The detection of the possibility that the first area of ​​the screen may be touched includes: When the touchable area and the first area screen do not overlap, it is determined that the first area screen is not likely to be touched.

3. The method of claim 2, wherein, The step of obtaining the touchable area based on user operation includes: The sliding trajectory is obtained based on the user's touch operation on the screen of the terminal device; The touchable area is determined based on the sliding trajectory.

4. The method of claim 3, wherein, The sliding operation includes linear sliding operations in any direction and / or curved sliding operations in any direction. The pressing operation includes a click operation and / or a long press operation.

5. The method of claim 4, wherein, Determining the touchable area based on the sliding trajectory includes: The touchable area is obtained by extending a predetermined length outwards from both sides based on the sliding trajectory corresponding to the sliding operation as the center line; or... The touchable area is obtained by taking the sliding trajectory corresponding to the pressing operation as the center and a set length as the radius.

6. The method of claim 2, wherein, The step of obtaining the touchable area based on user operation includes: The hover point is obtained based on the user's hovering touch operation near the screen of the terminal device, and the touchable area is determined based on the hover point.

7. The method of claim 6, wherein, Determining the touchable area based on the hover point includes: The touchable area is obtained by taking the position on the screen of the terminal device corresponding to the hover point as the center and a set length as the radius.

8. The method according to any one of claims 1 to 7, characterized in that, The method of displaying accidental touch alerts on the screen includes: Display the edge of the first area of ​​the screen in a way that distinguishes it from other areas; or, Display the first area of ​​the screen in a manner distinct from the other areas; or... The area on the screen of the terminal device corresponding to the edge of the under-display camera is displayed in a way that distinguishes it from other areas; or, The position of the under-display camera on the screen of the terminal device is displayed in a way that distinguishes it from other areas; The way to distinguish it from other areas includes highlighting or filling patterns.

9. The method of claim 8, wherein, The method of displaying accidental touch reminders on the screen also includes: The location of the first area screen or the position of the under-screen camera on the screen of the terminal device is indicated by text on the screen of the terminal device.

10. A terminal device, comprising: The terminal device includes an under-display camera, and the screen of the terminal device includes a first area of ​​screen covering the under-display camera. The terminal device also includes: a processor and a memory; The memory is used to store programs; When the program is executed by the processor, the processor is configured to display a touch warning on the screen when it detects that there is a possibility that the first area of ​​the screen may be touched. Specifically, the processor is used to obtain a touchable area based on user operations, wherein the touchable area is the area on the screen that can be touched by the user; When the touchable area and the first area screen overlap, it is determined that the first area screen is likely to be touched. Specifically, the processor is further configured to acquire the touchable area based on a touch operation or a hover touch operation, wherein the touch operation includes a sliding operation and / or a pressing operation.

11. The terminal device according to claim 10, characterized in that, The processor is specifically configured to determine the possibility that the first area screen has not been touched when the touchable area and the first area screen do not overlap.

12. The terminal device according to claim 11, characterized in that, The processor is specifically configured to obtain a sliding trajectory based on the user's touch operation on the screen; and determine the touchable area based on the sliding trajectory.

13. The terminal device according to claim 12, characterized in that, The sliding operation includes linear sliding operations in any direction and / or curved sliding operations in any direction. The pressing operation includes a click operation and / or a long press operation.

14. The terminal device according to claim 13, characterized in that, The processor is specifically configured to expand outward by a set length on both sides based on the sliding trajectory corresponding to the sliding operation as the center line to obtain the touchable area; or, based on the sliding trajectory corresponding to the pressing operation as the center and the set length as the radius, obtain the touchable area.

15. The terminal device according to claim 11, characterized in that, The processor is specifically configured to obtain a hovering point based on a user's hovering touch operation near the screen, the hovering touch operation being sensed by a capacitive sensor or a distance sensor; and to determine the touchable area based on the hovering point.

16. The terminal device according to claim 15, characterized in that, The processor is specifically used to obtain the touchable area with the position on the screen corresponding to the hover point as the center and a set length as the radius.

17. The terminal device according to any one of claims 10-16, characterized in that, The screen is specifically used to display the edge of the first area of ​​the screen in a manner that distinguishes it from other areas; or, to display the first area of ​​the screen in a manner that distinguishes it from other areas; or, to display the position corresponding to the edge of the under-display camera in a manner that distinguishes it from other areas; or, to display the position corresponding to the under-display camera in a manner that distinguishes it from other areas; the manner of distinguishing it from other areas includes highlighting or filling patterns.

18. The terminal device according to claim 17, characterized in that, The screen is also used to indicate the location of the first area screen or the location corresponding to the under-screen camera using text.

19. A computer-readable storage medium, characterized in that, Includes a computer program, which, when executed on a computer, causes the computer to perform the method of any one of claims 1-9.

Images