Display method and electronic device

Abstract

This application provides a display method and an electronic device. In this method, the electronic device can automatically assess vision parameters when a user is using a mobile phone, and evaluate the user's current visual acuity based on these parameters. Furthermore, it can display alarm information based on the vision assessment results. This automates the user's vision assessment process, ensuring that the entire detection and assessment process is imperceptible to the user, avoiding disruption to their use of the electronic device while providing timely reminders for healthy mobile phone use.

Description

Technical Field

[0001] This application relates to the field of terminals, and more particularly to a display method and an electronic device. Background Technology

[0002] With the development of terminal technology, terminals are becoming increasingly powerful, leading to a corresponding increase in the frequency and duration of user terminal use. This increased frequency and duration of terminal use may affect users' eyesight. Existing technologies, to protect users' eye health, typically remind users to pay attention to eye health when the distance between their eyes and the phone is detected to be too close. Alternatively, they provide vision self-testing applications for users to perform vision checks when needed. Summary of the Invention

[0003] This application provides a display method and an electronic device. In this method, the electronic device can automatically detect changes in the user's vision based on the user's usage status when using a mobile phone, and issue an alarm in a timely manner.

[0004] Firstly, this application provides a display method, comprising: acquiring vision assessment parameters during a user's use of an electronic device, the vision assessment parameters indicating the user's usage status while using the electronic device; acquiring a vision assessment result based on the vision assessment parameters, the vision assessment result indicating whether the user's vision is deteriorating; and displaying alarm information if the vision assessment result meets alarm conditions. Thus, this application, by detecting changes in the user's vision based on the user's usage status while using a mobile phone, improves the accuracy of vision detection and achieves automated vision detection. It can promptly alert the user in cases of vision deterioration to remind the user to use the mobile phone healthily, thereby improving the user experience.

[0005] In one possible implementation, the vision assessment parameters include at least one of the following: device parameters, environmental parameters, and user parameters; wherein the device parameters indicate the device type; the environmental parameters indicate the ambient light level; and the user parameters include posture information and distance information, whereby the posture information indicates the user's posture when using the electronic device, and the distance information indicates the distance between the user's face and the screen. Thus, this application automatically collects the vision assessment parameters when the user uses the mobile phone to complete the vision assessment, achieving automated detection without manual triggering by the user. The entire vision detection process is imperceptible to the user, avoiding any impact on the user experience.

[0006] In one possible implementation, obtaining a vision assessment result based on vision assessment parameters includes: using the vision assessment parameters as input to a vision assessment model to obtain a first vision value output by the vision assessment model; and obtaining a vision assessment result based on the first vision value. Thus, this application, through a pre-trained vision assessment model, can obtain the user's current vision value based on different vision assessment parameters. This ensures the accuracy of the detection results while achieving automatic detection. Different usage scenarios correspond to different vision assessment parameters. The vision assessment model, trained with full data, can estimate the user's current vision value for different vision assessment parameters, thereby enabling vision detection and assessment for users in various scenarios when using their mobile phones.

[0007] In one possible implementation, obtaining a vision assessment result based on a first visual acuity value includes: acquiring at least one visual acuity value detected within a predetermined time period and a vision assessment parameter corresponding to each visual acuity value; and acquiring a vision deterioration magnitude value based on the at least one visual acuity value, the vision assessment parameter corresponding to each visual acuity value, and the first visual acuity value. Thus, this application assesses the user's vision to obtain a user vision deterioration magnitude value, uses this value to assess whether the user's vision has declined, and issues a timely alert.

[0008] In one possible implementation, obtaining a visual acuity degradation magnitude value based on at least one visual acuity value, a visual acuity assessment parameter corresponding to each visual acuity value, and a first visual acuity value includes: correcting the first visual acuity value based on at least one visual acuity value and the visual acuity assessment parameter corresponding to each visual acuity value to obtain a second visual acuity value; and obtaining the visual acuity degradation magnitude value based on the at least one visual acuity value and the second visual acuity value. Thus, this application improves the accuracy of the assessment results by correcting the obtained visual acuity values.

[0009] In one possible implementation, the alarm condition is used to indicate that the user's vision deterioration exceeds a first value. This way, by setting a threshold, frequent alarms can be avoided, improving the user experience.

[0010] In one possible implementation, the alarm information is used to indicate to the user that their vision is deteriorating, and the alarm information is displayed, and includes at least one of the following: an alarm by sound or an alarm by vibration.

[0011] In one possible implementation, the method further includes: in response to a received user operation, obtaining visual acuity values ​​detected within a specified time period; based on the visual acuity values ​​detected within the specified time period, obtaining the corresponding visual acuity assessment result within the specified time period; and displaying the visual acuity assessment result. Thus, this application can provide a visual acuity query function that, in response to user needs, provides users with information on visual acuity changes within a specified time period to meet different user requirements for visual acuity testing functions.

[0012] Secondly, this application provides an electronic device, including: one or more processors, a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and when the computer programs are executed by the one or more processors, the electronic device performs the following steps: during the user's use of the electronic device, acquiring vision assessment parameters, the vision assessment parameters being used to indicate the user's usage status when using the electronic device; based on the vision assessment parameters, acquiring a vision assessment result, the vision assessment result being used to indicate whether the user's vision has deteriorated; and if the vision assessment result meets the alarm conditions, displaying alarm information.

[0013] In one possible implementation, the vision assessment parameters include at least one of the following: device parameters, environmental parameters, and user parameters; wherein the device parameters are used to indicate the device type; the environmental parameters are used to indicate the ambient light level; and the user parameters include posture information and distance information, wherein the posture information is used to indicate the user's posture when using the electronic device, and the distance information is used to indicate the distance between the user's face and the screen.

[0014] In one possible implementation, when a computer program is executed by one or more processors, the electronic device performs the following steps: taking vision assessment parameters as input to a vision assessment model, obtaining a first vision value output by the vision assessment model; and obtaining a vision assessment result based on the first vision value.

[0015] In one possible implementation, when a computer program is executed by one or more processors, the electronic device performs the following steps: acquiring at least one visual acuity value detected within a predetermined time and a visual acuity assessment parameter corresponding to each visual acuity value; and acquiring a visual acuity degradation magnitude value based on at least one visual acuity value, the visual acuity assessment parameter corresponding to each visual acuity value, and a first visual acuity value.

[0016] In one possible implementation, when the computer program is executed by one or more processors, the electronic device performs the following steps: correcting a first visual acuity value based on at least one visual acuity value and visual acuity assessment parameters corresponding to each visual acuity value to obtain a second visual acuity value; and obtaining a visual acuity degradation magnitude value based on at least one visual acuity value and the second visual acuity value.

[0017] In one possible implementation, the alarm condition is used to indicate that the user's visual impairment magnitude is greater than a first value.

[0018] In one possible implementation, when a computer program is executed by one or more processors, the electronic device performs the following steps: sounding an alarm or vibrating an alarm.

[0019] In one possible implementation, when a computer program is executed by one or more processors, the electronic device performs the following steps: in response to a received user operation, acquiring visual acuity values ​​detected within a specified time period; acquiring a corresponding visual acuity assessment result within the specified time period based on the visual acuity values ​​detected within the specified time period; and displaying the visual acuity assessment result.

[0020] Thirdly, this application provides a computer storage medium, characterized in that it includes computer instructions, which, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible implementation thereof.

[0021] Fourthly, this application provides a computer program product, characterized in that, when the computer program product is run on an electronic device, it causes the electronic device to perform the method described in the first aspect or any possible implementation of the first aspect.

[0022] Fifthly, embodiments of this application provide a chip including a processing circuit and transceiver pins. The transceiver pins and the processing circuit communicate with each other via an internal connection path. The processing circuit executes the method in the first aspect or any possible implementation of the first aspect to control the receiving pin to receive signals and to control the transmitting pin to transmit signals. Attached Figure Description

[0023] Figure 1 A schematic diagram of a communication system as an example is shown;

[0024] Figure 2 A schematic diagram of the hardware structure of an electronic device as an example;

[0025] Figure 3 A schematic diagram of the hardware structure of an electronic device as an example;

[0026] Figure 4 A schematic diagram of the software structure of an electronic device as an example;

[0027] Figure 5 This is a schematic diagram illustrating an exemplary vision testing method;

[0028] Figure 6 This is a schematic diagram illustrating the display method process as an example.

[0029] Figure 7 This is a schematic diagram of a user interface as an example.

[0030] Figure 8 This is a schematic diagram illustrating the process of obtaining vision assessment parameters;

[0031] Figure 9 This is an example of a module interaction diagram;

[0032] Figure 10 This is a schematic diagram illustrating an exemplary vision assessment process;

[0033] Figure 11 This is an example of a model training diagram;

[0034] Figure 12 This is an example diagram illustrating the interaction between a terminal and the cloud.

[0035] Figures 13A to 13D This is a schematic diagram of a user interface as an example.

[0036] Figure 14 The flowchart of the vision data query method is shown as an example.

[0037] Figures 15A-15C This is a schematic diagram of a user interface as an example.

[0038] Figure 16 This is a schematic diagram of a user interface as an example.

[0039] Figure 17 This is a schematic diagram of the device structure as an example. Detailed Implementation

[0040] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0041] Figure 1 This is a schematic diagram illustrating an exemplary communication system. Please refer to... Figure 1 The communication system includes, but is not limited to, a terminal 10 and a cloud 11. In this embodiment, the terminal 10 may be a mobile phone, tablet, computer, television, game console, wearable device (such as a smartwatch or smart bracelet), etc. In practical applications, the communication system may include multiple terminals. In this embodiment, only a mobile phone is used as an example for illustration, and the number and type of terminals are not limited.

[0042] For example, the cloud 11 may optionally be a cloud server cluster, which includes one or more cloud servers.

[0043] Figure 2 A schematic diagram of the structure of the electronic device 100 is shown. It should be understood that... Figure 2 The electronic device 100 shown is merely an example of an electronic device, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 2The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0044] Electronic device 100 may include: processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0045] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0046] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0047] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0048] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0049] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0050] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0051] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0052] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0053] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0054] In this embodiment of the application, the terminal can communicate with the cloud (i.e., data interaction) through the mobile communication module 150 and / or the wireless communication module 160.

[0055] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0056] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0057] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0058] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0059] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0060] like Figure 3 The diagram shows the position of camera 193 on a mobile phone when the electronic device 100 is a mobile phone. In this embodiment, the camera located on the side of the electronic device's display screen 194 can be referred to as a front-facing camera, such as... Figure 3 As shown. There can be one or more front-facing cameras; in this embodiment, we will use a mobile phone with two front-facing cameras as an example. It should be noted that... Figure 3 The layout of the cameras shown (e.g., horizontal and spaced) is merely illustrative and is not intended to limit the scope of this application.

[0061] For example, a camera located on the back cover of an electronic device can be called a rear camera. A rear camera may include, but is not limited to, wide-angle cameras, ultra-wide-angle cameras, panoramic cameras, etc., and this application does not impose any limitations on this.

[0062] In the embodiments of this application, among the multiple cameras included in the electronic device, there may be an always-on camera (AO camera) and a time-of-flight camera (TOF camera).

[0063] AO camera refers to a camera that is always on. Taking mobile phones as an example, AO camera generally refers to a low-power grayscale image camera, which can acquire low-resolution grayscale images.

[0064] A Time-of-Flight (TOF) camera is a type of camera that uses the principle of time-of-flight to measure distance. It calculates the distance between the target object and the camera by emitting a light pulse towards the target and measuring the time it takes for the light pulse to travel from emission to reflection. Optionally, a TOF camera can measure distance by emitting infrared light. In this case, the TOF camera can acquire an infrared (IR) image containing depth information.

[0065] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0066] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0067] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0068] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0069] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0070] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0071] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0072] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0073] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0074] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0075] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0076] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0077] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0078] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0079] In this embodiment, the electronic device may include an inertial measurement unit (IMU) (not shown in the figure) (also referred to as an IMU module). The IMU can be used to acquire the pose information of the electronic device (also referred to as IMU information, IMU pose information, or attitude information, etc., which are not limited in this application). For example, the IMU may include, but is not limited to, a gyroscope sensor 180B and an accelerometer sensor 180E. It can be understood that the pose information includes, but is not limited to, the parameters or data collected by the gyroscope sensor 180B and the accelerometer sensor 180E.

[0080] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0081] In the embodiments of this application, the distance between the face and the screen included in the user parameters described below can be obtained by a distance sensor or by an image captured by a camera (e.g., a TOF camera). This application does not limit the information.

[0082] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0083] The ambient light sensor 180L is used to sense ambient light brightness, that is, to collect ambient light parameters around the electronic device. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also be used in conjunction with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0084] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0085] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0086] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0087] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0088] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0089] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0090] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0091] Figure 4 This is a software structure block diagram of the electronic device 100 according to an embodiment of this application.

[0092] The layered architecture of the electronic device 100 divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided from top to bottom into the application layer, framework layer, hardware abstraction layer (HAL), and kernel layer. Figure 4 The layers shown are merely illustrative examples and are not intended to limit the scope of this application.

[0093] The application layer can include a series of application packages.

[0094] like Figure 4 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, and vision health.

[0095] For example, a vision health application can provide a vision health user interface for users to activate vision health detection functions, including but not limited to: user vision detection, vision health reminders, and query functions. Specific implementation details can be found in the embodiments below.

[0096] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes some predefined functions.

[0097] like Figure 4 As shown, the framework layer may include, but is not limited to: window manager, content provider, view system, vision analysis module, resource manager, notification manager, etc.

[0098] The vision analysis module can be used to store the cloud-trained models involved in the embodiments of this application, such as, but not limited to, vision assessment models (also known as vision prediction models, vision detection models, etc., which are not limited in this application). The vision analysis module can obtain vision assessment parameters (including device parameters, user parameters, and environmental parameters, etc.) and, based on the vision assessment model, assess the user's vision to obtain vision assessment results. Specific implementation details can be found in the embodiments below.

[0099] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0100] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0101] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0102] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0103] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0104] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0105] HAL (Hardware Interface) is an interface layer located between the operating system kernel and hardware circuitry, aiming to abstract hardware. It hides the hardware interface details of a specific platform, providing the operating system with a virtual hardware platform that is hardware-independent and portable across multiple platforms. HAL provides a standard interface to display device hardware functionality to a higher-level Java API framework (i.e., the framework layer). HAL contains multiple library modules, each implementing an interface for a specific type of hardware component. In this embodiment, HAL optionally includes a perception module. The perception module can implement AI recognition functions. For example, the perception module can perform face recognition on images captured by a camera to obtain recognition results. For example, it can identify facial image features or obtain the distance between the face and the screen based on AO (Area of ​​View) images, etc., which is not limited in this application.

[0106] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, and sensor drivers. In this embodiment, the sensor driver may include drivers corresponding to each sensor included in the electronic device, such as, but not limited to, ambient light sensor drivers and distance sensor drivers. Taking the ambient light sensor driver as an example, it can respond to instructions or directives from an upper-layer module (e.g., a vision analysis module) to transmit data collected (or detected) by the ambient light sensor to the upper-layer module (e.g., the vision analysis module).

[0107] Understandable, Figure 4 The components or modules shown in the framework layer and kernel layer do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than shown, or combine some components, or split some components, or have different component arrangements.

[0108] Currently, as terminals (also known as electronic devices) become increasingly functional, their usage frequency is gradually increasing. However, prolonged use of terminals may affect users' eyesight. To protect users' visual health (also known as eye health), some terminals provide vision testing functions to monitor users' visual acuity.

[0109] Figure 5 This is a schematic diagram illustrating an exemplary vision testing method. Please refer to... Figure 5In this example, the user can tap to enter the vision testing app to start the vision test. The phone screen displays the letter "E" for the standard vision test and directional arrows for touch. The user can interact with the phone via Bluetooth headset or touchscreen. The opening direction of the letter "E" on the phone screen continuously changes. Three consecutive correct answers will automatically advance to the next test level, and the letter "E" will become smaller. Three consecutive incorrect answers will automatically downgrade the test level, and the letter "E" will become larger. This cycle continues until the corresponding vision standard is reached, generating a corresponding vision report. However, this method relies on the user actively performing vision tests. If the user has not measured their vision for an extended period, this method cannot promptly remind them to protect their eye health.

[0110] This application provides a display method that can obtain vision assessment results based on vision assessment parameters and display alarm information according to the vision assessment results, so as to provide an automatic detection method that can automatically detect the user's vision and issue timely alarms to remind the user to pay attention to eye health.

[0111] Figure 6 For an illustrative example of the display method flowchart, please refer to... Figure 6 Specifically, including but not limited to the following steps:

[0112] S601, the terminal responds to the user's operation and activates the vision health function.

[0113] For example, a vision health application may provide a user interface through which users can operate to activate vision health functions.

[0114] Figure 7 For an illustrative user interface diagram, please refer to... Figure 7 (1) For example, users can click on the vision health option 701 in the settings interface. Figure 7 As shown in (2), in response to the user's click on the vision health option 701, the terminal displays the vision health application interface 702 (which can also be called the vision health settings interface, but this application does not limit it). The vision health application interface 702 includes, but is not limited to, some permission options, including but not limited to at least one of the following: enabling the vision health option 702-1, enabling the posture detection option 702-2, enabling the screen distance detection 702-3, enabling the light intensity detection 702-4, enabling the face image detection 702-5, enabling the vision warning function 702-6, etc.

[0115] For example, such as Figure 7 As shown in (2), the vision health function is currently off. That is, the terminal is not currently performing [functions]. Figure 6The subsequent process will not involve vision testing or issuing alerts. If the user clicks to enable the vision health option 702-1 to indicate that the vision health function is enabled, such as... Figure 7 As shown in (3), in response to the received user operation, the terminal displays the "Enable Vision Health" option 702-1 as enabled. The terminal will then activate the vision health function, i.e., execute... Figure 6 The subsequent steps.

[0116] In one possible implementation, such as Figure 7 As shown in (3), in response to the user's click to enable the vision health option 702-1, the terminal can enable other options by default, that is, the other options are also displayed as enabled (or activated). In this embodiment, enabling the posture detection option 702-2, enabling the screen distance detection option 702-3, enabling the light intensity detection option 702-4, enabling the face image detection option 702-5, and enabling the vision warning function 702-6 correspond to the posture detection permission, screen distance detection permission, light intensity detection permission, and vision warning function permission, respectively.

[0117] The posture detection permission is used to indicate whether vision health applications are allowed to obtain user posture information (or parameters).

[0118] Screen distance detection permission is used to indicate whether vision health applications are allowed to obtain screen distance, i.e., the distance information (or parameters) between the face and the screen.

[0119] Light intensity detection permission is used to indicate whether vision health applications are allowed to obtain ambient light intensity information (or parameters).

[0120] The face image detection permission is used to indicate whether the vision health application is allowed to obtain face image detection results. In this embodiment, the face image detection result may optionally be whether the user is wearing glasses.

[0121] The vision alert function permission (also known as the vision warning function permission) is used to indicate whether vision health applications are allowed to issue warnings.

[0122] This can be understood as follows: after a user clicks on an option to enable the corresponding permissions, the vision health application and vision analysis module can obtain the corresponding permissions to access the relevant information or parameters.

[0123] Let's take distance detection permission as an example. In one example, if a user enables this permission, that is, authorizes it, the vision analysis module can obtain the distance parameters between the face detected by the terminal and the screen. Specifically, after this permission is authorized, the vision analysis module can register with the sensor driver (or the sensor module in the HAL layer; specific implementations can refer to existing technologies, and this application is not limited thereto) to request the distance parameters collected by the distance sensor. In this way, the vision analysis module can obtain the distance parameters between the face and the screen collected by the distance sensor driver.

[0124] In another example, if the user has not enabled distance detection permission (i.e., has not authorized this permission), the vision analysis module will not have permission to obtain the distance parameters between the face detected by the terminal and the screen. Specifically, if the vision analysis module is not registered with the sensor driver, it does not have permission to obtain data collected by the distance sensor.

[0125] It should be noted that this example only illustrates the method of collecting the distance between the face and the screen using a distance sensor. In other embodiments, if the distance between the face and the screen is identified by a perception module, the vision analysis module needs to register with the perception module to obtain the distance between the face and the screen. In other words, in this embodiment, once the corresponding permissions are enabled, the vision analysis module can register with the corresponding module to obtain the corresponding permissions.

[0126] In another possible implementation, in response to a user clicking to enable the vision health option 702-1, the terminal can default to enabling the screen distance detection permission, meaning the screen distance detection option 702-3 will also be displayed as enabled. Other permissions can be manually enabled by the user. Optionally, in this embodiment, the vision health function (or vision health service) and the screen distance detection permission are enabled or disabled simultaneously by default. That is, if the user clicks to disable the screen distance detection option 702-3, the vision health option 702-1 may also be displayed as disabled.

[0127] In another possible implementation, granting all permissions allows the vision health application to access more information or parameters; that is, the vision assessment parameters mentioned below include a wider variety of parameters or information. This allows for more accurate vision values ​​to be obtained in the subsequent process of estimating the user's vision. Optionally, in this embodiment, if some permissions are not enabled, the terminal can display a prompt message to remind the user to grant more permissions. Figure 7 As shown in (4), if the vision health application detects that some permissions are not enabled, it can display prompt message 703 to prompt the user to enable more permissions in order to obtain more accurate detection results. The content and location of the prompt message are only illustrative examples and are not limited in this application.

[0128] S602, the terminal acquires vision assessment parameters.

[0129] For example, once the vision health service (or function) and related permissions are enabled, the vision health service (specifically, the vision analysis module) can obtain vision assessment parameters corresponding to the user when the user uses the mobile phone.

[0130] In the embodiments of this application, the vision assessment parameters include, but are not limited to, at least one of the following: device parameters (or information), user parameters (or information), environmental parameters (or information), etc.

[0131] For example, device parameters include, but are not limited to, device type information (or parameters); device type information (which may be denoted as (c) in this embodiment) is used to indicate the type of electronic device, such as a mobile phone, tablet, smartwatch, etc.

[0132] For example, user parameters include, but are not limited to: user posture information (or parameters), face-to-screen distance information (or parameters), and information on wearing glasses;

[0133] Among them, user posture information (e.g., denoted as (p)) indicates the user's posture when using the mobile phone, including but not limited to lying down, standing, sitting, etc. Face-to-screen distance information (e.g., denoted as (r)) indicates the distance between the user's face and the screen. Wearing glasses information (e.g., denoted as (g)) indicates whether the user is wearing glasses.

[0134] For example, environmental parameters include, but are not limited to, ambient light information (or parameters). Ambient light information (e.g., denoted as l) is used to indicate the ambient light intensity around an electronic device.

[0135] It should be noted that the embodiments of this application only use at least one of the following parameters for vision assessment, including but not limited to: user posture parameters, ambient light parameters, device type parameters, face-to-screen distance parameters, and glasses wearing parameters, as examples for illustration. In other embodiments, vision assessment parameters may include more parameters, such as user age parameters, user gender parameters, user blinking frequency parameters, etc., which are not limited in this application.

[0136] Figure 8 This is a schematic diagram illustrating the process of obtaining vision assessment parameters. This process only involves obtaining user and environmental parameters. As mentioned above, device parameters can be obtained from the system and will not be elaborated upon here. Please refer to... Figure 8 Specifically, including but not limited to the following steps:

[0137] S801 determines whether the user is to be tested.

[0138] In this embodiment, the vision health service may optionally be provided only to the user to be tested. The user to be tested can be one or more, and this application does not limit this. Optionally, the vision health application interface may also include a user identification option. If the user clicks this option, the vision health application responds to the received user operation by performing face recognition. Specifically, the camera captures a face image, the perception module obtains the face image, performs face feature recognition on the face image, and sends the recognized face features to the vision analysis module. The vision analysis module can record that the user corresponding to the face feature is the user to be tested.

[0139] For example, after the vision health service is initiated and begins detection, facial recognition results can be obtained from the perception module. Specifically, the vision analysis module can send a facial recognition request to the perception module. In response to this request, the perception module acquires images from the camera, performs facial recognition on the images, and reports the facial recognition results (including facial features) to the vision analysis module. Based on the acquired facial features, the vision analysis module can determine whether the current user is the user to be detected. In one example, if the user is the user to be detected, then execution continues to step S802. In another example, if the user is not the user to be detected, then the current round of detection ends.

[0140] In one possible implementation, the vision health service can obtain user operation information from the system to determine whether a user operation is currently occurring. That is, in this embodiment, the vision health service provides vision health detection services when a user is using a mobile phone. The vision health service can determine whether a user is using a mobile phone by detecting user operations.

[0141] For example, taking a touchscreen phone as an example, vision health services (specifically, a vision analysis module) can send data to the Input module. Figure 4 (Not shown in the diagram, but can be located in the frame layer or HAL layer; this application does not limit this) performs touch (touch) listener registration to listen for touch events. After the Input module detects a touch event, it sends the touch event to the vision analysis module to indicate that a touch operation on the screen has occurred. The vision analysis module can determine that the user is using the mobile phone and can initiate the vision detection process to perform vision detection, i.e., execute... Figure 8 The process in the process. Optionally, when the vision analysis module determines that the user is using a mobile phone, the mobile phone can be on the lock screen, the desktop, or any running foreground application interface; this application does not limit this.

[0142] Alternatively, in some instances, vision health services may also determine whether a user is using a mobile phone based on other methods, such as images captured by a camera (e.g., images that include the user's face) and user actions (e.g., detected touch actions).

[0143] In another possible implementation, the vision analysis module can be configured with a testing cycle. The testing cycle can be set according to actual needs, and this application does not impose any limitations. For example, taking a testing cycle of one day, the vision analysis module can perform a vision test once a day. Specifically, after the vision analysis module determines that the testing cycle has arrived, if it detects the user using a mobile phone within the testing cycle, it will begin execution. Figure 8 The process involves obtaining corresponding vision assessment parameters. Optionally, if the user does not use their phone during the testing period, the test can be performed again at the end of the next testing period. Optionally, the user's vision value usually does not change within a day; in this embodiment, the testing period is optionally set to one day, but this application does not limit this. For example, assuming the testing period is 2 hours, the vision analysis module can detect if the user is using their phone at the end of the testing period. If the user is using their phone, the subsequent testing process continues. If the user is not using their phone, the system can continuously detect whether the user is using their phone within the current testing period, and if the user is detected using their phone, the subsequent process continues. If the user is still not using their phone at the end of the current testing period, the testing continues in the next testing period.

[0144] Of course, in some instances, the vision analysis module can also perform the test in an event-triggered manner, meaning that the vision test process can be executed every time the user uses the phone (i.e., Figure 6 and Figure 8 This application does not limit the process (the procedures).

[0145] S802 determines whether screen distance detection permission is enabled.

[0146] For example, the terminal can determine whether to enable screen distance detection permission. As mentioned above, screen distance detection permission is used to indicate whether the vision health service is allowed to obtain screen distance, i.e., the distance information (or parameters) between the face and the screen.

[0147] In one example, if the vision health service enables screen distance detection permission, then S803 is executed.

[0148] In another example, if the vision health service does not have screen distance detection permission enabled, the detection process can be terminated in this embodiment. Of course, in some instances, S804 can continue to be executed, and this application does not limit this.

[0149] S803, obtains the distance parameters between the face and the screen.

[0150] Figure 9 The following is a schematic diagram illustrating the module interaction as an example. Please refer to it. Figure 9 The distance sensor can collect distance parameters according to the collection frequency and upload the collected distance parameters to the sensor driver (specifically, the distance sensor driver).

[0151] In one example, the perception module can determine the distance between a face and the screen based on distance parameters collected by a distance sensor.

[0152] In another example, the perception module can determine the distance between a face and the screen based on the face image captured by the camera and the distance parameters collected by the distance sensor.

[0153] In another example, the perception module can determine the distance between a face and the screen based on images captured by a TOF camera.

[0154] In another example, the perception module can also obtain the distance between the face and the screen based on other distance measurement devices or combinations of devices. For example, the distance measurement device can be a combination of a TOF camera, a microphone, and a speaker, which is not limited in this application.

[0155] Optionally, this application only uses the perception module to obtain the distance parameters between the face and the screen as an example for illustration in the embodiments of this application. This function can also be performed by the vision analysis module or other modules. This application does not limit it.

[0156] In one example, the vision analysis module can send a distance parameter request to the perception module when it needs to obtain distance parameters. The perception module can then transmit the most recently acquired distance parameter to the vision analysis module. Of course, in some instances, the perception module can also obtain the distance parameters between the face and the screen after receiving the distance parameter request and report them to the vision analysis module; this application does not impose any limitations on this.

[0157] In another example, the perception module reports the face and screen distance parameters to the vision analysis module each time it acquires them. Optionally, the detection period of the vision analysis module and the reporting period of the perception module can be the same or different. If the periods are different, or if the timing of the perception module's parameter reporting has not yet reached the detection period of the vision analysis module, the vision analysis module can cache the most recently acquired face and screen distance parameters and discard the previously cached face and screen distance parameters. When executing S803, i.e., within the detection period, the vision analysis module can acquire the most recently acquired distance parameter from the perception module as the face and screen distance parameter in the vision assessment parameters.

[0158] S804 determines whether light intensity detection permission is enabled.

[0159] For example, the terminal can determine whether to enable light intensity detection permission. As described above, light intensity detection permission is used to indicate whether the vision health service is allowed to obtain ambient light parameters.

[0160] In one example, if the vision health service has enabled light intensity detection permission, then S805 is executed.

[0161] In another example, if the vision health service does not have light intensity detection permission enabled, S806 can continue to be executed.

[0162] S805, obtain ambient light intensity parameters.

[0163] Still refer to Figure 9 The vision analysis module can acquire ambient light parameters collected by the ambient light sensor to indicate the ambient light brightness around the terminal.

[0164] Optionally, the vision analysis module may send an ambient light parameter request to the ambient light sensor driver to request the acquisition of ambient light parameters. In response to the request, the ambient light sensor driver reports the most recently acquired ambient light parameters to the vision analysis module.

[0165] Optionally, in some instances, the ambient light sensor driver may also report to the vision analysis module after acquiring each ambient light parameter. Optionally, the detection cycle of the vision analysis module and the reporting cycle of the ambient light sensor driver may be the same or different. When the cycles are different, or when it can be understood that the timing of the ambient light sensor driver reporting parameters has not yet reached the detection cycle of the vision analysis module, the processing flow of the perception module described above can be referred to, and will not be repeated here.

[0166] S806 determines whether attitude detection permission is enabled.

[0167] For example, the terminal can determine whether to enable posture detection permission. As described above, posture detection permission is used to indicate whether the vision health service is allowed to obtain the user's posture parameters.

[0168] In one example, if the vision health service has posture detection permission enabled, then S807 is executed.

[0169] In another example, if the vision health service does not have posture detection permission enabled, S808 can continue to be executed.

[0170] S807, obtain user posture parameters.

[0171] Still refer to Figure 9The vision analysis module can obtain user posture parameters, which are used to indicate the user's posture when using the mobile phone, including but not limited to: standing, sitting, lying down, etc.

[0172] Specifically, such as Figure 9 As shown, the IMU module collects attitude parameters according to the acquisition frequency. These attitude parameters can be understood as indicators of the electronic device's attitude. As mentioned above, the IMU module includes, but is not limited to, gyroscope sensors and accelerometers. Correspondingly, the attitude parameters include, but are not limited to, angle parameters collected by the gyroscope sensor and acceleration parameters collected by the accelerometer. Optionally, in some instances, the IMU module may also include a magnetic sensor. Correspondingly, the attitude parameters may also include data collected by the magnetic sensor. The IMU module transmits the attitude parameters to the sensor driver. The IMU driver reports the attitude parameters to the sensing module.

[0173] For example, the perception module determines the user's posture parameters based on the posture parameters. The way the vision analysis module obtains the user's posture parameters from the perception module can be similar to the interaction method of the face-to-screen distance parameters, which will not be elaborated here.

[0174] In one possible implementation, the perception module can also determine the user's posture based on images captured by the camera.

[0175] In another possible implementation, the perception module can also determine the user's posture based on images captured by the camera and data collected by the IMU module.

[0176] S808 determines whether face image detection permission is enabled.

[0177] For example, the terminal can determine whether to enable face image detection permission. As described above, face image detection permission is used to indicate whether the vision health service is allowed to obtain detection results (or recognition results) based on face images.

[0178] In one example, if the vision health service enables face image detection permission, then S809 is executed.

[0179] In another example, if the vision health service does not have face image detection permission enabled, the process continues to the next step, which in this process would be to end the current round of detection.

[0180] In one possible implementation, as described above, the terminal can detect whether the user is to be detected in S801. This step also requires enabling face image detection permission. If, during the execution of S801, it is determined that face image detection permission has been enabled, then S808 does not need to be executed again; this application does not impose any limitations on this.

[0181] S809, obtain the parameters of the glasses being worn.

[0182] Still refer to Figure 9 For example, the vision analysis module obtains the glasses wearing parameters to indicate whether the user is wearing glasses.

[0183] Specifically, the camera acquires images according to a set acquisition frequency. The camera transmits the acquired images to the camera driver. The camera driver then transmits the images to the perception module. The perception module identifies the images acquired by the camera and determines the parameters for wearing glasses, which are used to indicate whether the user is wearing glasses. The perception module reports the glasses-wearing parameters to the vision analysis module; the specific reporting method can be found above and will not be repeated here.

[0184] Optionally, the sensors (and cameras) in the terminal can collect data at corresponding acquisition frequencies, and the frequency at which the corresponding module (e.g., the sensor driver) reports to the vision analysis module can be set according to actual needs; this application does not impose any limitations. Optionally, the sensor driver can also report the corresponding parameter to the module it has registered with (e.g., the vision analysis module) after acquiring the parameter or data. After acquiring the data, if the detection cycle has arrived, the vision analysis module can execute the vision assessment process. If the detection cycle has not arrived, the acquired data can be discarded.

[0185] Optionally, as mentioned above, the vision health service may grant certain permissions in response to user actions. For example, regarding ambient light intensity permissions, if this permission is not enabled, the sensor driver will not send ambient light parameters to the vision analysis module. However, the ambient light sensor will still collect ambient light parameters according to its sampling frequency, and the sensor driver can report the acquired ambient light parameters to other modules registered with it.

[0186] In one possible implementation, Figure 8 The order of S802 to S809 in the embodiments is merely illustrative and is not intended to limit the scope of this application. In other words, the order in which the parameters are acquired is not limited in the embodiments of this application.

[0187] In another possible implementation, as described above, the vision assessment parameters may also include other types of parameters, such as user blinking parameters. Different parameters can be obtained in different ways and can be set according to actual needs; this application does not impose any limitations.

[0188] S603: The terminal obtains the first visual acuity value based on visual acuity assessment parameters.

[0189] For example, after the terminal obtains the vision assessment parameters, it can obtain the user's first vision value based on the vision assessment parameters.

[0190] Figure 10 For an illustrative diagram of the vision assessment process, please refer to... Figure 10Specifically, the terminal can pre-acquire and save the vision assessment model. After acquiring vision assessment parameters such as ambient light parameters (l), glasses wearing parameters (g), user posture parameters (p), face-to-screen distance parameters (r), and device type parameters (c), the terminal can use the acquired vision assessment parameters as model input and obtain the first vision value (which can be denoted as f(x)) output by the vision assessment model.

[0191] Optionally, the vision assessment model in this application embodiment is trained in the cloud via online or offline methods.

[0192] Figure 11 For an illustrative diagram of model training, please refer to... Figure 11 The cloud server (also known as the training device) acquires training data. The training data includes, but is not limited to, multiple sets of vision assessment parameters input by the operator (e.g., 1000 sets, which can be set according to actual needs; this application does not limit this). Each set of vision assessment parameters includes, but is not limited to, at least one of the following: device type parameters, ambient light parameters, user posture parameters, glasses wearing parameters, and distance between the face and the screen. The cloud server uses the training data as input to the vision assessment model to obtain the vision value output by the model. Based on the model's output vision value and the user-labeled value, the cloud server calculates the loss. Based on the loss, the vision assessment model is optimized. Specifically, this may involve updating the weight values ​​of each module in the vision assessment model. The cloud server repeats the above training process, i.e., iterates the vision assessment model until the training completion conditions are met. Training completion conditions include, but are not limited to, training duration reaching a threshold, training iterations reaching a threshold, or loss being less than a threshold, etc., which can be set according to actual needs; this application does not limit this.

[0193] Optionally, the vision assessment model can be a deep neural network. A deep neural network includes at least one neural layer, and each neural layer can correspond to at least one weight (e.g., a weight matrix). This can be understood as follows: during the training of the vision assessment model, the weight values ​​corresponding to the neural layers can be continuously updated so that the vision value output by the vision assessment model gradually approaches the calibrated label value, i.e., the loss becomes smaller and smaller.

[0194] In one possible implementation, as described above, the vision assessment parameters in this application embodiment may include, but are not limited to, at least one of the following: ambient light parameter (l), glasses wearing parameter (g), user posture parameter (p), face-to-screen distance parameter (r), and device type parameter (c). Accordingly, during actual training, the cloud server can train the model based on different parameter combinations, so that in practical applications, the vision assessment model can output corresponding vision values ​​based on different parameter combinations. For example, during training, the vision assessment parameters may include, but are not limited to, the face-to-screen distance parameter, device type parameter, and ambient light parameter. The cloud server can train the vision assessment model based on the above parameters.

[0195] In another possible implementation, the vision assessment model can be periodically trained in the cloud (e.g., using new data) to further optimize the model. Optimization may optionally involve updating the weight values ​​in the vision assessment model. The period can be set according to actual needs, for example, it could be one week; this application does not limit this.

[0196] For example, after training is complete in the cloud, the vision assessment model can be pushed to various terminals. Of course, in some instances, the terminal may also send a model request to the cloud to obtain the latest vision assessment model from the cloud.

[0197] The terminal receives the vision assessment model, which can be saved and maintained by the vision analysis module.

[0198] Optionally, such as Figure 6 As shown, the process in this application embodiment may include, but is not limited to: a vision testing process, a vision calibration process, and a vision assessment process. The vision testing process includes S601 to S603 as described above, to obtain the user's vision value.

[0199] The vision calibration process includes, but is not limited to, S605, which can be used to calibrate (or correct, adjust) the acquired vision values ​​of users in order to obtain more accurate vision test results.

[0200] The vision assessment process includes, but is not limited to, S607 to S609, which are used to assess vision values, obtain assessment results, and issue alarms.

[0201] In this embodiment, the vision calibration process is optional. It can be understood that in the vision assessment process, the terminal can directly perform vision assessment based on a first visual acuity value. Alternatively, the terminal can perform vision assessment based on a calibrated second visual acuity value; this application does not impose any limitations.

[0202] In this embodiment, the distance between a user's eyes and the screen during terminal use is correlated to some extent with the user's myopia degree. For example, a higher myopia degree results in a closer screen distance, and vice versa. This correlation is also influenced by environmental conditions (e.g., ambient light intensity) and the user's posture while using the terminal device. Accordingly, in this embodiment, the cloud can integrate these factors and the distance between the user's face and the screen to train the model. This allows the model to output, based on the aforementioned factors or parameters, the current user's state while using the phone—which can also be understood as the usage state or scenario—and estimate the user's visual acuity.

[0203] S604: The terminal obtains the user's historical vision data from the cloud.

[0204] For example, the terminal may obtain the user's historical vision data within a predetermined time period from the cloud, or the terminal may obtain a specified number (e.g., m) of the user's historical vision data from the cloud.

[0205] For example, the terminal can obtain at least one set of user historical vision data. Each set of user historical vision data includes, but is not limited to: visual acuity value and corresponding vision assessment parameters. Among them, the vision assessment parameters corresponding to the visual acuity value are the vision assessment parameters referenced when obtaining the visual acuity value.

[0206] Optionally, the predetermined duration can be set according to actual needs, such as 7 days; this application does not limit this. For example, if the vision health service generated 14 user historical vision data points in the previous 7 days at a frequency of 2 tests per day, then in this example, the terminal can obtain less than or equal to 14 data points. In some instances, if the number of days corresponding to the historical vision data stored in the cloud does not meet the predetermined duration, for example, only 2 days of historical vision data are stored, then all stored user historical vision data can be sent to the terminal. Optionally, in this example, user historical vision data within the predetermined duration can also be sampled. For example, the cloud stores 100 user historical vision data points corresponding to this user within 7 days. The cloud can sample the 100 user historical vision data points n times (the sampling frequency can be set according to actual needs; this application does not limit this), and send the sampled n user historical vision data points to the terminal.

[0207] Optionally, the specified quantity refers to the m historical vision data points corresponding to that user before the current time. Similarly, if the number of historical vision data points stored in the cloud is less than m, then all stored historical vision data points can be sent to the terminal.

[0208] In this embodiment, user historical vision data refers to the historical vision data corresponding to the same user. Of course, in some instances, it may also refer to the user historical vision data corresponding to the same terminal.

[0209] In one example, the cloud can use the user ID as an index to store the user's historical vision data. This can be understood as follows: when a user logs in to different terminals (such as tablets and mobile phones) using the same user ID, the data obtained by the terminal is the user's historical vision data corresponding to the same user ID used on different devices. Here, the user ID is the ID used by the user when logging into the terminal device. In this example, when the terminal executes S606, i.e., when sending vision data, it carries the user ID in the message it sends. Correspondingly, when storing the user's historical data, the cloud uses the user ID as an index to store the corresponding historical vision data.

[0210] Figure 12 This is an exemplary diagram illustrating the interaction between a terminal and the cloud. (Refer to...) Figure 12 For example, a terminal sends a request to the cloud to query historical vision data. The request may include, but is not limited to, the user ID.

[0211] In response to a received request to query historical vision data, the cloud retrieves the m most recent historical vision data points corresponding to the user ID. Each historical vision data point includes, but is not limited to, a vision value, vision assessment parameters corresponding to the vision value, and time information corresponding to the historical data. The time information can be the time the data was stored in the cloud or the time the data was generated by the terminal; this application does not limit this. Optionally, if the time information is the time the data was generated by the terminal, the terminal can also upload the time the data was generated simultaneously when executing S606, i.e., uploading vision data to the cloud. The term "most recent" can optionally refer to the m most recent historical vision data points stored in the cloud that are closest to the current time. Specifically, the cloud can determine the m most recently acquired historical vision data points by querying the storage time corresponding to each historical data point.

[0212] For example, refer to Figure 12 The terminal receives a response from the cloud requesting historical vision data, which includes historical vision data for m users. The terminal caches the historical vision data for m users. Optionally, the terminal executes... Figure 6 After the process, historical data in the cache can be cleared to save cache resources.

[0213] Table 1 shows the historical vision data of m users:

[0214] Table 1

[0215]

[0216]

[0217] Referring to Table 1, taking the example of the terminal obtaining m (or groups) of users' historical vision parameters, where the vision value is the result of the terminal's execution... Figure 6 The visual acuity value obtained through the process can be either the first visual acuity value described in the embodiments of this application or the second visual acuity value. Visual acuity assessment parameters are the parameters used when obtaining the corresponding visual acuity value, including but not limited to: ambient light parameters, user posture parameters, glasses wearing parameters, face-to-screen distance parameters, and device type parameters. The time information corresponding to each historical visual acuity data point is the time the data was stored in the cloud.

[0218] In another example, the cloud can use device identification information as an index to store the user's historical vision data. In this example, the device identification information can be a device ID, a device MAC address, etc., and this application does not limit this. In this example, when the terminal executes S606, i.e., when sending vision data, the message it sends carries the device identification information. Correspondingly, when storing the user's historical data, the cloud uses the device identification information as an index to store the corresponding user's historical vision data. For example, when executing S604, the terminal can carry the device identification information in its request to query historical vision data. The cloud can then use the device identification information to find the corresponding user's historical data and provide feedback.

[0219] Of course, in some instances, as mentioned above, there can be one or more users to be detected. When there are multiple users to be detected, the device ID and the facial features of the users to be detected can be used as indexes to store the corresponding historical user data. Accordingly, in this example, when the terminal executes S606, i.e., sends vision data, the message it sends carries device identification information and facial feature information. Correspondingly, when storing user historical data, the cloud uses the device identification information and facial feature information as indexes to store the corresponding user historical vision data. For example, when executing S604, the terminal can send a request to query historical vision data that includes device identification information and facial feature information. The cloud can then use the device identification information and facial feature information to find the corresponding user historical data and provide feedback.

[0220] S605, the terminal calibrates the first visual acuity value based on the user's historical visual acuity data to obtain the second visual acuity value.

[0221] For example, the terminal calibrates (or corrects, adjusts, or updates) the first visual acuity value based on the user's historical visual acuity data (which may be at least one set of user historical visual acuity data) obtained from the cloud, and obtains the second visual acuity value.

[0222] Specifically, the terminal can use formula (1) to perform a weighted average of the historical vision values ​​and the first vision value based on the vision values ​​in the historical vision data of each group of users (hereinafter referred to as historical vision values), as shown in Table 1, to obtain the second vision value corresponding to the current vision assessment parameters.

[0223]

[0224] Where, x i For the i-th visual acuity value, w i This represents the weight of the visual acuity assessment parameter corresponding to the i-th visual acuity value. It can be understood that different visual acuity assessment parameters correspond to different weight values. Where w... i Optionally, the data can be trained on a cloud server using full vision data (including different assessment parameters and vision values).

[0225] Optionally, the terminal can obtain w from the cloud. i In one example, the terminal can pre-fetch w i And stored locally. In another example, the terminal can retrieve w from the cloud before each S605 execution. i For example, the cloud can... i This application does not limit the scope of the data to be carried in the response to the query of historical vision data.

[0226] S606, the terminal uploads vision data to the cloud.

[0227] For example, after obtaining a visual acuity value (which could be a first value or a second value), the terminal uploads the visual acuity data to the cloud. This visual acuity data includes, but is not limited to, the visual acuity value and the visual acuity assessment parameters used to obtain that value. In this embodiment, the visual acuity value is described as a second visual acuity value. In other embodiments, if a calibration process is not required, the value uploaded by the terminal and stored in the cloud is the first visual acuity value, i.e., the uncorrected visual acuity value, which is not limited in this application.

[0228] Specifically, the terminal sends an upload instruction message to the cloud, which includes, but is not limited to, visual acuity values, visual acuity assessment parameters, and identification information. Optionally, it may also include time information, such as the time when the visual acuity values ​​were generated. The identification information may be a device ID, a user ID, a combination of a device ID and a user ID, or a combination of a device ID and facial feature information; this application does not impose any limitations on this.

[0229] The cloud receives the upload instruction message and saves the visual acuity value, visual acuity assessment parameters, identification information, and time information to the full user visual acuity database. The time information can be the time the visual acuity value was generated by the terminal or the time the visual acuity data was stored in the cloud; this application does not impose any limitation on this.

[0230] Specifically, the cloud can search and update lists based on identification information. For example, each user ID can correspond to one list. The cloud can search for the corresponding list based on the user ID and save the vision data to the list. The method by which the cloud saves historical vision data can be set according to actual needs, and this application does not limit it.

[0231] S607, the terminal obtains vision assessment results based on the second visual acuity value (or the first visual acuity value).

[0232] For example, the terminal can assess a first visual acuity value or a second visual acuity value and obtain a visual acuity assessment result. This visual acuity assessment result is used to indicate whether the user's vision has deteriorated (or declined).

[0233] This application uses the second visual acuity value assessment as an example for illustration. The assessment method for the first visual acuity value is the same, and will not be repeated here.

[0234] In one possible implementation, as described above, when the terminal executes S604, it acquires at least one set of the user's historical vision data, and all the acquired vision data are the most recently detected vision data. In this example, the terminal can calculate the user's vision degradation rate based on the vision values ​​(e.g., m values) in at least one set of user vision data and the currently acquired second vision value, according to formula (2).

[0235]

[0236] Where y is the second visual acuity value, y i Let d represent the i-th visual acuity value, and d represent the degree of visual acuity degradation. For example, the degree of visual acuity degradation obtained by the terminal can be understood as the degree (or magnitude) of the user's visual acuity degradation over a certain period of time, where the time period is from the earliest visual acuity value obtained in the historical visual acuity data to the current time.

[0237] In one example, the terminal can pre-set a range for the degree of visual impairment. If the degree of visual impairment exceeds this range, the visual assessment result indicates that the user's vision has deteriorated. Conversely, if the degree of visual impairment is within the range, the visual assessment result indicates that the user's vision has not deteriorated. "Not deteriorated" can be understood as the user's vision remaining unchanged, the user's vision improving, or the user's vision deteriorating, but to a minor degree. The range of visual impairment can be set by the user, a default value set by the terminal, or a value pushed to the terminal from the cloud; this application does not limit this.

[0238] In another possible implementation, the terminal can also set a visual range. For example, a visual range setting option can be provided in a vision health application interface. The terminal, responding to a received user action, can determine the corresponding visual range. Each time the terminal acquires a second visual value, it can compare it with the visual range. If the visual value is within the visual range, the user's vision can be considered normal, or it may show signs of deterioration, but the degree of deterioration is minor. The corresponding vision assessment result indicates that the user's vision has not deteriorated, or it can indicate that the user's vision is normal. If the visual value is less than the visual range, i.e., less than the minimum value of the visual range, it can be determined that the user's vision has deteriorated; that is, the vision assessment result indicates that the user's vision has deteriorated.

[0239] In another possible implementation, as described above, the user to be detected can be one or more, and the terminal can also set corresponding degradation ranges or visual acuity ranges for different users. For example, for children, the range set by the terminal (including degradation range and visual acuity range) can be set to a smaller value to detect changes in the child's vision in a timely manner. For adults, the terminal can set a larger range.

[0240] Optionally, if the above range value is set by the user, the terminal can also display suggested range values ​​during the user setting process for the user to choose from. The specific setting method and value range can be set according to actual needs, and this application does not limit them.

[0241] S608: The terminal determines whether an alarm needs to be issued based on the vision assessment results.

[0242] In one example, if the vision assessment results indicate that the user's vision is deteriorating, the terminal can issue an alarm, i.e., execute S609.

[0243] In another example, if the vision assessment result indicates that the user's vision has not deteriorated, the terminal takes no action. Optionally, the terminal can update the vision change icon displayed on the terminal based on the acquired vision value; a detailed description can be found in [reference needed]. Figure 13B .

[0244] In one possible implementation, after the terminal detects and obtains a vision value each time, it can evaluate the vision value to obtain the corresponding vision evaluation result and execute S608 to determine whether an alarm is needed.

[0245] In another possible implementation, after each visual acuity value is detected, the terminal evaluates that value to obtain a corresponding visual acuity assessment result. The terminal sets an alarm period, which can be greater than or equal to the visual acuity assessment period (in this example, the visual acuity assessment period is equal to the visual acuity detection period). At the end of the alarm period, the terminal can determine whether an alarm is needed based on the visual acuity assessment results obtained within that period. For example, if the percentage of visual acuity assessment results indicating visual deterioration within the period is 80%, an alarm is triggered to avoid frequent alarms that could disrupt user experience.

[0246] In another possible implementation, the terminal can set a vision assessment period, the duration of which can be longer than the vision detection period. At the trigger time of the vision assessment period, the terminal can perform a vision assessment based on multiple vision values ​​obtained within the period to determine whether the user's vision has deteriorated and obtain the corresponding vision assessment result.

[0247] In another possible implementation, the terminal can set an alarm interval. For example, if the terminal determines that the user's vision is deteriorating based on vision assessment results and an alarm is required, the terminal can detect the time of the last alarm. If the interval between the last alarm time and the current time is less than the alarm interval, no alarm can be triggered to avoid frequently disturbing the user. If the interval between the last alarm time and the current time is greater than or equal to the alarm interval, an alarm can be triggered.

[0248] S609, Terminal Alarm.

[0249] Specifically, if the terminal determines that an alarm is needed, it can execute an alarm operation.

[0250] Figure 13A For an illustrative user interface diagram, please refer to... Figure 13A In this scenario, the user is watching a video on their mobile phone. During viewing, the phone detects and assesses the user's vision, and the assessment result indicates that the user's vision is deteriorating. If the phone determines that an alert is needed, it displays an alert window 1301 on the video interface. The alert window includes alert information to inform the user of their current vision value and the degree of vision deterioration. The content of the alert information is only illustrative and is not limited in this application. Optionally, the user can click the "Go to View" option to view specific vision data and changes in vision.

[0251] Figure 13B For an illustrative user interface diagram, please refer to... Figure 13BThe mobile phone responds to the user's click on the "Go to View" option and displays a vision health interface. This vision health interface includes, but is not limited to: a vision change chart 1302, a vision change information window 1303, and a vision data query option 1304. The vision change chart 1302 includes a graph showing vision changes over only 7 days. Specifically, the terminal updates the content in the vision change chart 1302 each time it acquires a vision value. Of course, in some instances, the terminal may also update the chart based on the most recently detected vision value each time the vision health application interface is displayed; this application does not limit this.

[0252] It should be noted that, Figure 13B The charts in this application are merely illustrative examples. In actual applications, the terminal may display changes in the user's vision in other ways, and this application does not limit such methods.

[0253] For example, the vision change information window 1303 can display the user's vision value and prompt the user to use the mobile phone healthily, etc. It can be set according to actual needs, and this application does not limit it.

[0254] In one possible implementation, when the terminal determines that an alarm is needed, it can detect the type of application running in the foreground. The foreground application may be an instant messaging application or a game application, etc. (the specific type can be set by the user or by the terminal's default setting; this application does not limit this). The terminal can delay the alarm time to avoid disturbing the user.

[0255] In another possible implementation, the terminal can also issue an alarm when it is on the desktop and / or lock screen, so as to remind the user to pay attention to eye health in a timely manner while avoiding affecting the user experience.

[0256] Figure 13C For an illustrative user interface diagram, please refer to... Figure 13C For example, if the terminal detects that a user is currently making a video call and determines that an alarm needs to be issued, the terminal may delay the alarm time. The terminal may display the alarm window on the current interface (such as the lock screen or the desktop, which is not limited in this application) after the user exits the video call.

[0257] Figure 13D For an illustrative user interface diagram, please refer to... Figure 13D In scenarios where the terminal is a wearable device, the wearable device can display alarm information on the interface.

[0258] In one possible implementation, the terminal can also use sound or vibration to alert the user. This can be configured according to actual needs, and this application does not impose any limitations.

[0259] In another possible implementation, the terminal can automatically adjust the screen brightness or prompt the user to adjust their posture after determining that the user's vision has deteriorated based on the vision assessment results, so as to reduce the impact of the usage environment on the user's vision.

[0260] In summary, the display method provided in this application can automatically detect and assess a user's vision. It will also issue a timely alert if vision deterioration is detected, reminding the user to use their mobile phone responsibly.

[0261] In this embodiment of the application, the terminal may also provide a vision data query method so that users can query historical vision data within a specified time period.

[0262] Figure 14 For an exemplary flowchart of the vision data query method, please refer to... Figure 14 Specifically, including but not limited to the following steps:

[0263] S1401, the terminal responds to the user's operation and determines the query date.

[0264] like Figure 13B As shown, the vision health application interface may include a vision data query option 1304, which users can click to query historical vision data.

[0265] Figures 15A-15C This is a schematic diagram of a user interface as an example. For one example, please refer to... Figure 15A In response to the user's click on the vision data query option 1304, the terminal displays the query interface 1501. The query interface 1501 may include multiple time period options. The user can select any option and click the confirmation option to query the historical vision values ​​within that time period.

[0266] In another example, please refer to Figure 15B In response to the user's click on the vision data query option 1304, the terminal displays the query interface 1501. The query interface 1501 may include a calendar option, allowing the user to select a specific time period by clicking or swiping. The user clicks the confirmation option to query historical vision values ​​within that time period.

[0267] In another example, please refer to Figure 15C In response to the user's click on the vision data query option 1304, the terminal displays the query interface 1501. The query interface 1501 may include start time and end time options. The user can click on the time option and select the corresponding time from the drop-down menu. The user clicks the confirmation option to query the historical vision values ​​within that time period.

[0268] In this embodiment of the application, the historical vision values ​​queried by the user are all vision values ​​within multiple consecutive dates.

[0269] S1402, the terminal sends a query request to the cloud.

[0270] For example, in response to the user clicking the "OK" option, the terminal retrieves the specified time period to be queried. The terminal sends a query request to the cloud, which includes, but is not limited to, identification information and the specified time period. The identification information can be at least one of a device ID and a user ID; a detailed description can be found above and will not be repeated here.

[0271] S1403, the cloud sends a query response to the terminal.

[0272] For example, in response to a received query request, the cloud queries the full vision database for the vision value corresponding to the identification information (i.e., the historical vision value) based on the identification information, and obtains the historical vision value within the specified time period.

[0273] The cloud sends a query response to the terminal, which includes, but is not limited to: at least one historical visual acuity value within a specified time period and the time information corresponding to each historical visual acuity value (which may be the visual acuity value generation time or the storage time, and this application does not limit it).

[0274] S1404, the terminal displays changes in vision.

[0275] For example, the terminal receives a query response and obtains at least one historical visual acuity value and its corresponding time information. Based on the obtained historical visual acuity value and the corresponding time information, the terminal displays the changes in visual acuity on the interface.

[0276] Figure 16 For an illustrative user interface diagram, please refer to... Figure 16 The terminal can display the user's vision changes in the historical vision chart 1602 on the query results display interface 1601. This display method is only an illustrative example and can be set according to actual needs. For example, it can be a bar chart, a dynamic change chart, or a specific data list, etc., and this application does not limit it. Optionally, the query results display interface 1601 may also include, but is not limited to, vision result analysis information 1603, used to display the results of analyzing historical vision values ​​within a specified time period and / or suggestions for the user's healthy use of mobile phones. The specific content can be set according to actual needs, and this application does not limit it.

[0277] The above descriptions all use the interaction scenario between the terminal and the cloud as an example. In the embodiments of this application, the terminal can also save historical vision data (including the vision value detected each time and the vision assessment parameters used), that is, without interaction with the terminal, the terminal can retrieve the historical vision data or historical vision values ​​mentioned above from local storage when it needs to obtain them.

[0278] For example, in this scenario, the terminal can perform the vision calibration step in S605 and the vision assessment step in S607 based on locally stored historical vision data. Optionally, in this scenario, while saving each acquired vision data (including vision values ​​and vision assessment parameters) to the historical vision database, the terminal can also perform S606 to back up the vision data to the cloud to ensure data security and stability.

[0279] Figure 17 A schematic block diagram of an electronic device 1700 according to an embodiment of this application is shown. The electronic device may include a processor 1701 and a transceiver / transceiver pin 1702, and optionally, a memory 1703. The processor 1701 can be used to execute the steps performed by the electronic device or cloud server in the methods of the foregoing embodiments, and control the receive pin to receive signals, and control the transmit pin to transmit signals.

[0280] The various components of electronic device 1700 are coupled together via bus 1704, which includes a data bus, a power bus, a control bus, and a status signal bus. However, for clarity, all buses are labeled as bus system 1704 in the figure.

[0281] Optionally, the memory 1703 can be used for storage instructions in the foregoing method embodiments.

[0282] It should be understood that the electronic device 1700 according to the embodiments of this application may correspond to the electronic device in the methods of the foregoing embodiments, or it may correspond to the cloud server in the methods of the foregoing embodiments. Furthermore, the above and other management operations and / or functions of each element in the electronic device 1700 are respectively for implementing the corresponding steps of the foregoing methods, and for the sake of brevity, will not be described in detail here.

[0283] All relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0284] Based on the same technical concept, embodiments of this application also provide a computer-readable storage medium storing a computer program containing at least one piece of code that can be executed by a playback device to control the playback device to implement the above-described method embodiments.

[0285] Based on the same technical concept, this application also provides a computer program, which, when executed by a playback device, is used to implement the above-described method embodiments.

[0286] The program may be stored, in whole or in part, on a storage medium packaged with the processor, or in part or in whole on a memory not packaged with the processor.

[0287] Based on the same technical concept, embodiments of this application also provide a processor for implementing the above-described method embodiments. The processor may be a chip.

[0288] The steps of the methods or algorithms described in conjunction with the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, read-only optical discs (CD-ROMs), or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium.

[0289] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0290] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0291] The terms "first" and "second," etc., used in the specification and claims of this application are used to distinguish different objects, not to describe a specific order of objects. For example, "first target object" and "second target object," etc., are used to distinguish different target objects, not to describe a specific order of target objects.

[0292] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0293] In the description of the embodiments in this application, unless otherwise stated, "multiple" means two or more. For example, multiple processing units means two or more processing units; multiple systems means two or more systems.

[0294] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A display method, characterized in that, include: During the user's use of the electronic device, vision assessment parameters are acquired, which are used to indicate the user's usage status when using the electronic device. Based on the vision assessment parameters, a vision assessment result is obtained, which is used to indicate whether the user's vision has deteriorated. If the vision assessment results meet the alarm conditions, an alarm message will be displayed.

2. The method according to claim 1, characterized in that, The visual acuity assessment parameters include at least one of the following: Equipment parameters, environmental parameters, and user parameters; The device parameters are used to indicate the device type; the environmental parameters are used to indicate the ambient light level; the user parameters include posture information and distance information, wherein the posture information is used to indicate the user's posture when using the electronic device, and the distance information is used to indicate the distance between the user's face and the screen.

3. The method according to claim 1, characterized in that, The process of obtaining vision assessment results based on the vision assessment parameters includes: The visual acuity assessment parameters are used as input to the visual acuity assessment model to obtain the first visual acuity value output by the visual acuity assessment model. Based on the first visual acuity value, the visual acuity assessment result is obtained.

4. The method according to claim 3, characterized in that, The step of obtaining the vision assessment result based on the first visual acuity value includes: Obtain at least one visual acuity value that has been detected within a predetermined time period and the visual acuity assessment parameters corresponding to each visual acuity value; Based on the at least one visual acuity value, the visual acuity assessment parameters corresponding to each visual acuity value, and the first visual acuity value, a visual acuity degradation magnitude value is obtained.

5. The method according to claim 3, characterized in that, The step of obtaining the degree of visual impairment based on the at least one visual acuity value, the visual acuity assessment parameters corresponding to each visual acuity value, and the first visual acuity value includes: Based on the at least one visual acuity value and the visual acuity assessment parameters corresponding to each visual acuity value, the first visual acuity value is corrected to obtain the second visual acuity value; The visual acuity value is obtained based on the at least one visual acuity value and the second visual acuity value.

6. The method according to claim 4 or 5, characterized in that, The alarm condition is used to indicate that the user's visual impairment is greater than a first value.

7. The method according to any one of claims 1 to 5, characterized in that, The alarm information is used to indicate that the user's vision is deteriorating, and the displayed alarm information also includes at least one of the following: Alarms can be triggered by sound or vibration.

8. The method according to any one of claims 3 to 6, characterized in that, The method further includes: In response to a received user action, obtain the visual acuity value detected within a specified time period; Based on the visual acuity values ​​detected within the specified time period, obtain the corresponding visual acuity assessment results within the specified time period; The vision assessment results are displayed.

9. An electronic device, characterized in that, include: One or more processors or memories; and one or more computer programs, wherein the one or more computer programs are stored on the memory, and when the computer programs are executed by the one or more processors, cause the electronic device to perform the following steps: During the user's use of the electronic device, vision assessment parameters are acquired, which are used to indicate the user's usage status when using the electronic device. Based on the vision assessment parameters, a vision assessment result is obtained, which is used to indicate whether the user's vision has deteriorated. If the vision assessment results meet the alarm conditions, an alarm message will be displayed.

10. The electronic device according to claim 9, characterized in that, The visual acuity assessment parameters include at least one of the following: Equipment parameters, environmental parameters, and user parameters; The device parameters are used to indicate the device type; the environmental parameters are used to indicate the ambient light level; the user parameters include posture information and distance information, wherein the posture information is used to indicate the user's posture when using the electronic device, and the distance information is used to indicate the distance between the user's face and the screen.

11. The electronic device according to claim 9, characterized in that, When the computer program is executed by the one or more processors, the electronic device performs the following steps: The visual acuity assessment parameters are used as input to the visual acuity assessment model to obtain the first visual acuity value output by the visual acuity assessment model. Based on the first visual acuity value, the visual acuity assessment result is obtained.

12. The electronic device according to claim 11, characterized in that, When the computer program is executed by the one or more processors, the electronic device performs the following steps: Obtain at least one visual acuity value that has been detected within a predetermined time period and the visual acuity assessment parameters corresponding to each visual acuity value; Based on the at least one visual acuity value, the visual acuity assessment parameters corresponding to each visual acuity value, and the first visual acuity value, a visual acuity degradation magnitude value is obtained.

13. The electronic device according to claim 10, characterized in that, When the computer program is executed by the one or more processors, the electronic device performs the following steps: Based on the at least one visual acuity value and the visual acuity assessment parameters corresponding to each visual acuity value, the first visual acuity value is corrected to obtain the second visual acuity value; The visual acuity value is obtained based on the at least one visual acuity value and the second visual acuity value.

14. The electronic device according to claim 12 or 13, characterized in that, The alarm condition is used to indicate that the user's visual impairment is greater than a first value.

15. The electronic device according to any one of claims 9 to 14, characterized in that, When the computer program is executed by the one or more processors, the electronic device performs the following steps: Alarms can be triggered by sound or vibration.

16. The electronic device according to any one of claims 3 to 6, characterized in that, When the computer program is executed by the one or more processors, the electronic device performs the following steps: In response to a received user action, obtain the visual acuity value detected within a specified time period; Based on the visual acuity values ​​detected within the specified time period, obtain the corresponding visual acuity assessment results within the specified time period; The vision assessment results are displayed.

17. A computer storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-8.

18. A computer program product, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-8.

Images