Dynamic display intelligent watch based on multiple modes
By integrating multimodal data fusion and dynamic display adjustment technology on smart watches, the problem of poor display effect of traditional smart watches in different light and postures is solved, and clear and comfortable display effects and energy efficiency optimization are achieved.
Patent Information
- Application Number
- CN202510164619.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-14
- Publication Date
- 2025-04-25
AI Technical Summary
Traditional smart watches have poor display effects in different ambient light and user postures, making it difficult to see the screen content clearly or too dazzling, affecting the user's visual comfort and battery life.
Using a dynamic display smart watch based on multimodality, through the combination of data conversion unit, brightness threshold calculation unit, display area determination unit, content adaptation unit and display output unit, ambient light intensity and user attitude data are integrated in real time, the screen brightness threshold and display area are dynamically adjusted, and the displayed content is scaled and dynamically refreshed.
Under different ambient light and user postures, ensure clear and comfortable display effects, optimize energy efficiency performance, and improve user experience.
Smart Images

Figure CN119882390A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of smart watches, and in particular to a multi-modal dynamic display smart watch. Background Art
[0002] With the rapid development of smart wearable devices, smart watches, as an important member of them, are no longer just a tool for displaying time, but have integrated multiple sensors and functions, becoming an important assistant for users' daily life and health management. However, traditional smart watches often use a fixed display mode in terms of display content, and cannot make adaptive adjustments according to changes in ambient light and user posture, which to some extent limits the improvement of user experience.
[0003] In terms of ambient light, if the screen brightness of a smartwatch is fixed, the screen content may be difficult to see in a bright light environment, and may be too glaring in a dark light environment, affecting the user's visual comfort and battery life. Therefore, how to dynamically adjust the screen brightness according to changes in ambient light has become an important issue in smartwatch display technology.
[0004] In terms of user posture, smart watches are usually worn on the user's wrist, and the relative angle between the screen and the user's line of sight changes as the user moves and rotates. If the displayed content cannot be adaptively adjusted according to the user's posture, when the user tilts or rotates his wrist to view the screen, the information may be difficult to read due to improper scaling or positioning of the displayed content.
[0005] Therefore, it is necessary to provide a multi-modal dynamic display smart watch to solve the above technical problems. Summary of the invention
[0006] In order to solve the above technical problems, the present invention provides a multi-modal dynamic display smart watch, which can integrate ambient light intensity and user posture data in real time, dynamically adjust the brightness threshold and display area of the screen, and ensure that the display effect remains clear and comfortable under different ambient light and user postures through content adaptation and dynamic refresh mechanism, while optimizing energy efficiency performance and improving user experience.
[0007] The present invention provides a multi-modal dynamic display smart watch, comprising:
[0008] A data conversion unit, used to read the brightness data of the screen of the smart watch in real time, and convert the brightness data into a grayscale image, wherein the grayscale value of the grayscale image corresponds to the brightness value of the screen;
[0009] A brightness threshold calculation unit, configured to calculate a brightness threshold based on the light intensity and attitude monitoring data detected in real time by the smart watch, wherein the attitude monitoring data includes accelerometer data and gyroscope data;
[0010] A display area determination unit, configured to classify the pre-divided sub-areas in the screen according to the brightness threshold, and calculate the minimum enclosing rectangle of all the classified sub-areas to generate a rectangular display area;
[0011] A content adaptation unit, configured to scale the content to be displayed according to the first size of the screen and the second size of the display area;
[0012] The display output unit is used to display and output the content to be displayed after the scaling process in the display area.
[0013] Preferably, the data conversion unit includes:
[0014] A brightness data acquisition module, used for capturing pixel-level brightness distribution data of the screen in real time;
[0015] A brightness data mapping module, used to map the pixel-level brightness distribution data into a preset grayscale range;
[0016] The grayscale image generator is used to construct a two-dimensional grayscale image matrix according to the mapping result, in which the value of each matrix element corresponds to the brightness value of the corresponding position on the screen.
[0017] Preferably, the brightness threshold calculation unit includes:
[0018] A light intensity detection module, used to detect the light intensity of the surrounding environment of the smart watch in real time;
[0019] A posture data acquisition module, used to acquire the posture monitoring data of the smart watch in real time through an accelerometer and a gyroscope, wherein the posture monitoring data includes accelerometer data and gyroscope data, and is used to reflect the movement state and rotation state of the smart watch;
[0020] The threshold calculation module is used to calculate the brightness threshold by a preset formula based on the light intensity detected by the light intensity detection module and the posture monitoring data acquired by the posture data acquisition module.
[0021] Preferably, the preset formula is:
[0022] T=L·(1+α·W)
[0023] Where T represents the brightness threshold, L represents the light intensity of the environment, W represents the normalized weight value calculated based on the posture monitoring data, and α represents the adjustment coefficient, which is used to control the influence of the posture monitoring data on the brightness threshold.
[0024] Wherein, the calculation formula of the normalized weight value W is:
[0025] W=g(θ,φ)=max(0, cos(θ)·cos(φ)
[0026] Where θ represents the pitch angle between the screen normal and the user's line of sight, φ represents the horizontal angle between the screen normal and the user's line of sight, and g(·) represents the normalization function.
[0027] Preferably, the display area determining unit includes:
[0028] A sub-region division module, used to divide the screen into a plurality of evenly distributed sub-regions according to a preset rule, wherein each sub-region is composed of a number of pixels;
[0029] The average brightness calculation module is used to count the brightness values of all pixels in each sub-region and calculate the average brightness value of the sub-region;
[0030] A sub-region classification module is used to classify each sub-region according to the brightness threshold, and if the average brightness value of any sub-region is greater than or equal to the brightness threshold, it is classified as a standard display region; otherwise, it is classified as a non-standard display region;
[0031] The minimum enclosing rectangle module is used to calculate the minimum enclosing rectangle of all sub-areas belonging to the standard display area after classification processing, and generate a rectangular display area.
[0032] Preferably, the content adaptation unit includes:
[0033] A size ratio calculation module, used to calculate the ratio between the first size of the screen and the second size of the display area;
[0034] A scaling factor determination module, which determines a scaling factor required for scaling the content to be displayed based on the proportional relationship;
[0035] The content scaling processing module performs scaling processing on the content to be displayed using the scaling factor to ensure that the content to be displayed is displayed in a suitable size within the display area.
[0036] Preferably, the display output unit includes:
[0037] A content rendering module, used for rendering the content to be displayed after scaling processing into image data adapted to the display area;
[0038] A display driving module, used to transmit the rendered image data to the screen driving circuit of the smart watch so as to display and output it in the display area;
[0039] The dynamic refresh module is used to dynamically adjust the refresh frequency of the display area according to the real-time calculation results of the brightness threshold calculation unit and the display area determination unit to ensure that the display content can be updated in real time when the ambient light and the user's posture change.
[0040] Compared with the related art, the multi-modal dynamic display smart watch provided by the present invention has the following beneficial effects:
[0041] The present invention integrates multiple modules such as a data conversion unit, a brightness threshold calculation unit, a display area determination unit, a content adaptation unit and a display output unit, thereby realizing a comprehensive calculation of a brightness threshold according to ambient light intensity and user posture monitoring data, and then determining a display area and performing scaling processing on the display content, and finally dynamically displaying and outputting the processed content on the screen of a smart watch, ensuring clear display under different ambient light and user postures, while optimizing energy efficiency performance and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 A schematic structural diagram of a multi-modal dynamic display smart watch provided by the present invention. DETAILED DESCRIPTION
[0043] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only the parts related to the present invention, rather than all structures, are shown in the accompanying drawings. In addition, the embodiments of the present invention and the features in the embodiments may be combined with each other without conflict.
[0044] It should also be noted that, for ease of description, only the part relevant to the present invention but not all content is shown in the accompanying drawings. It should be mentioned before discussing exemplary embodiments in more detail that some exemplary embodiments are described as processing or methods depicted as flow charts. Although the flow chart describes each operation (or step) as sequential processing, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to methods, functions, procedures, subroutines, subprograms, etc.
[0045] The present invention proposes a multi-modal dynamic display smart watch, which aims to solve the problem that the existing smart watches have poor display effects under complex light environments and user posture changes. Figure 1 As shown, the smart watch includes a data conversion unit, a brightness threshold calculation unit, a display area determination unit, a content adaptation unit and a display output unit. Specifically, the data conversion unit captures the screen brightness data in real time and converts it into a grayscale image to provide basic data support for subsequent processing. The brightness threshold calculation unit dynamically calculates the brightness threshold in combination with the ambient light intensity and posture monitoring data, thereby realizing adaptive adjustment of the displayed content. The display area determination unit classifies the screen sub-areas based on the brightness threshold, and generates the optimal display area through the minimum enclosing rectangle algorithm to ensure the focus and visibility of the displayed content. The content adaptation unit accurately scales the displayed content according to the proportional relationship between the screen size and the display area to adapt to the dynamically changing display requirements. Finally, the display output unit is responsible for rendering and outputting the processed display content to the screen, while ensuring the real-time update of the displayed content through a dynamic refresh mechanism.
[0046] This technical solution is proposed to solve the problem of inconsistent display effects of traditional smart watches under different light conditions and user postures, and to improve user experience. Through multimodal data fusion (light intensity, posture monitoring data) and dynamic adjustment of display area and content adaptation strategy, the present invention can significantly improve the display quality and interactive experience of smart watches in various usage scenarios, especially in outdoor strong light or low light environment, and when the user moves or rotates the device quickly, ensuring that the displayed content is always clear and easy to read.
[0047] More specifically, as a key component of the present invention, the data conversion unit realizes the real-time conversion of screen brightness data into grayscale images through the cooperation of multiple modules. First, the brightness data acquisition module directly reads the brightness value of each pixel through the hardware interface of the smartwatch screen driving circuit, forming a two-dimensional brightness matrix consistent with the physical layout of the screen. Exemplarily, on an AMOLED screen with a resolution of 320×320, the module scans pixels at a dynamic sampling frequency of 60Hz to 120Hz, uses double-buffering technology to avoid data tearing, and stores the brightness values in a circular buffer.
[0048] Subsequently, the brightness data mapping module processes the original data and adaptively selects a mapping strategy according to the ambient light intensity: in a normal environment, a linear normalization algorithm is used to ensure that the grayscale values cover the full range of 0-255; in a strong light scenario (such as over 500 lux), a logarithmic mapping is enabled to retain high-brightness details, and at the same time, gamma correction (the γ value can be configured from 0.45 to 2.2) is supported to enhance the visibility of dark areas. Exemplarily, when the original brightness value of a certain pixel is 200, the grayscale value is increased to 220 after dynamic range compression. The grayscale image generator finally constructs the processed data into a two-dimensional matrix, performs smoothing and noise reduction through a 3×3 Gaussian filter, and sharpens the edge area using the Sobel operator. The entire process adopts a pipeline design, and each module completes data processing within 5ms, and reduces the CPU load by 30% through hardware acceleration.
[0049] In addition, the brightness data mapping module also has an exception handling mechanism. When a brightness value overflow is detected, it automatically uses historical data interpolation to repair, ensuring the continuity and stability of the output grayscale image. The bitmap format image generated by this unit is attached with timestamp and resolution metadata, providing high-precision input for subsequent dynamic adjustment of the display area, and significantly improving the display quality and energy efficiency performance of the smartwatch under complex lighting conditions.
[0050] The brightness threshold calculation unit is one of the core components of the present invention. Its main function is to calculate the brightness threshold suitable for the current usage scenario based on the ambient light intensity and posture monitoring data detected by the smartwatch in real time. This threshold is used to determine the display area and brightness adjustment strategy of the screen to ensure that users can obtain the best visual experience under different light conditions and postures. The brightness threshold calculation unit realizes the accurate calculation from ambient light and posture data to the brightness threshold through the collaborative work of multiple sub-modules.
[0051] Specifically, the brightness threshold calculation unit is composed of a light intensity detection module, a posture data acquisition module and a threshold calculation module, wherein the light intensity detection module is one of the basic modules of the brightness threshold calculation unit, and is responsible for real-time detection of the light intensity of the environment surrounding the smart watch. This module obtains the light intensity data of the current environment through the built-in light sensor (such as the ambient light sensor) of the smart watch. The light intensity detection module samples the ambient light data at a high frequency (for example, 10 times per second) to ensure that it can respond quickly to changes in lighting conditions. The detected light intensity data is represented in digital form (for example, 0 to 1000 lux) and serves as one of the important input parameters for brightness threshold calculation.
[0052] The attitude data acquisition module is another key module of the brightness threshold calculation unit, which is responsible for acquiring the attitude monitoring data of the smart watch in real time through the accelerometer and gyroscope. The attitude monitoring data includes accelerometer data and gyroscope data, which are used to reflect the movement state (such as acceleration) and rotation state (such as angular velocity) of the smart watch respectively. This module processes the raw data through sensor fusion algorithms (such as Kalman filtering) to calculate the attitude information of the smart watch in three-dimensional space, including pitch angle, roll angle and yaw angle. These attitude data are used to evaluate the angle between the user's line of sight and the normal direction of the screen, thereby providing an important basis for the calculation of the brightness threshold.
[0053] The threshold calculation module is the core module of the brightness threshold calculation unit. It is responsible for combining the output data of the light intensity detection module and the posture data acquisition module to calculate the brightness threshold through a preset formula.
[0054] Specifically, the calculation formula for the brightness threshold is:
[0055] T=L·(1+α·W)
[0056] Where T represents the brightness threshold, L represents the light intensity of the environment, W represents the normalized weight value calculated based on the posture monitoring data, and α represents the adjustment coefficient, which is used to control the influence of the posture monitoring data on the brightness threshold.
[0057] Wherein, the calculation formula of the normalized weight value W is:
[0058] W=g(θ,φ)=max(0, cos(θ)·cos(φ)
[0059] In the formula, θ represents the pitch angle between the screen normal direction and the user's line of sight, φ represents the horizontal angle between the screen normal direction and the user's line of sight, and g(·) represents the normalization function. Through this formula, the threshold calculation module can comprehensively consider the impact of ambient light and user posture on screen brightness and dynamically adjust the brightness threshold.
[0060] The brightness threshold calculation unit detects ambient light and user posture in real time, and can dynamically adjust the brightness threshold to ensure that the screen display content is clearly visible in different usage scenarios. Combining the data of the light sensor and the posture sensor, the threshold calculation module can accurately calculate the brightness threshold suitable for the current scene to improve the user experience. By dynamically adjusting the brightness threshold, the smart watch can reduce screen power consumption while ensuring the display effect and extend battery life.
[0061] The display area determination unit of the smart watch is one of the core parts of the present invention for realizing dynamic display optimization. Its design goal is to dynamically adjust the screen display area when the ambient light and user posture change, so as to improve the visibility, clarity and energy efficiency of the displayed content. In order to achieve this goal, the display area determination unit is subdivided into multiple sub-modules with clear functions, each of which has a specific task. It includes a sub-area division module, an average brightness calculation module, a sub-area classification module and a minimum enclosing rectangle module. These four modules are introduced one by one below.
[0062] The main task of the sub-area division module is to divide the screen into multiple evenly distributed sub-areas according to preset rules. This division method needs to take into account both computational efficiency and accuracy. Specifically, the screen is divided into several small rectangular areas of equal size, each of which consists of a fixed number of pixels. For example, assuming that the screen resolution is 1024×768, it can be divided into 32×24 sub-areas, each of which contains 32×32 pixels. This division method is not only convenient for subsequent processing, but also ensures that the statistical results of each sub-area are representative.
[0063] The rules for sub-region division can be flexibly adjusted according to actual needs. For example, on a high-resolution screen, the number of sub-regions can be increased to improve accuracy; on a low-resolution screen, the number of sub-regions can be reduced to reduce computational complexity. In addition, in order to adapt to different screen sizes and ratios, the sub-region division module supports dynamic configuration parameters, such as the width and height of the sub-region.
[0064] Through this precise sub-area division method, the module provides reliable basic data support for subsequent brightness statistics and classification processing.
[0065] The average brightness calculation module is responsible for counting the brightness values of all pixels in each sub-region and calculating the average brightness value of the sub-region. The specific steps are as follows:
[0066] Extract the brightness value of each pixel from the brightness data of the screen. These brightness values are usually represented in the form of grayscale images, where the grayscale value of each pixel ranges from 0 to 255, corresponding to complete darkness and complete brightness, respectively.
[0067] For each sub-region, the brightness values of all pixels therein are accumulated and then divided by the total number of pixels in the sub-region to obtain the average brightness value of the sub-region. For example, if a sub-region contains 1024 pixels and the sum of their brightness is 51200, the average brightness value of the sub-region is 51200 ÷ 1024 = 50.
[0068] In some cases, the screen may have pixels with abnormally high or low brightness (for example, due to screen damage or sensor noise). In order to ensure the accuracy of the calculation results, this module introduces an outlier filtering mechanism. For example, by setting a reasonable threshold range (such as [10,245]), pixel values outside this range can be regarded as outliers and excluded.
[0069] Through the above steps, the average brightness calculation module can accurately quantify the brightness characteristics of each sub-region, providing a key basis for subsequent classification processing.
[0070] After obtaining the average brightness value of each sub-region, the sub-region classification module starts to classify these sub-regions. The classification is based on the brightness threshold, which is calculated in real time by the brightness threshold calculation unit based on the ambient light intensity and user posture monitoring data.
[0071] The specific classification rules are as follows: if the average brightness value of a sub-area is greater than or equal to the brightness threshold, it is classified as a standard display area; otherwise, it is classified as a non-standard display area. The core of this classification method is to dynamically adjust the range of the display area so that only those sub-areas with high enough brightness are included in the final display area. In this way, the system can effectively avoid display problems caused by insufficient ambient light or changes in user posture.
[0072] To achieve this classification process, the module compares the average brightness value of each sub-region with the brightness threshold one by one. If the conditions are met, the sub-region is marked as a standard display region; otherwise, it is marked as a non-standard display region. At the same time, the module also records the location information of all standard display regions for subsequent minimum enclosing rectangle calculation.
[0073] After completing the sub-area classification, the task of the minimum enclosing rectangle module is to calculate a minimum rectangular shape that can completely cover all sub-areas marked as standard display areas. This process not only needs to ensure the integrity of the displayed content, but also needs to minimize the area of the rectangle to reduce screen power consumption and improve display efficiency.
[0074] The core goal of the minimum enclosing rectangle module is to determine a rectangular boundary through geometric algorithms that can contain all standard display areas while minimizing their area as much as possible. To this end, the module uses the following steps for calculation:
[0075] First, the sub-region location information of all sub-regions marked as standard display areas is obtained from the sub-region classification module. The location of each sub-region is defined by the coordinates of its upper left corner and lower right corner. The module integrates these coordinates into a two-dimensional point set for subsequent geometric calculations.
[0076] In order to simplify the computational complexity, a convex hull algorithm (including but not limited to Graham scanning method or Jarvis stepping method) is first applied to the boundary point set of all standard display areas to generate a minimum convex polygon containing all points. The vertex set of the convex hull provides the basis for subsequent calculations.
[0077] Based on the convex hull, the module uses the rotating calipers algorithm to find the minimum enclosing rectangle. The basic idea of the rotating calipers algorithm is to find the minimum rectangle that can cover all points by gradually rotating the edges of the convex hull. The specific steps are as follows:
[0078] Initialize a line parallel to one side of the convex hull and use it as one side of the rectangle.
[0079] Compute the other three sides of the rectangle so that it completely covers all the vertices of the convex hull.
[0080] Rotate the rectangle step by step, update the area of the rectangle each time it rotates, and record the parameters of the rectangle with the current minimum area.
[0081] After one rotation, the resulting rectangle is the minimum enclosing rectangle.
[0082] Due to the actual needs of screen display, the boundaries of the minimum enclosing rectangle need to be aligned to the pixel grid. Therefore, the calculation results need to be fine-tuned to ensure that the boundaries of the rectangle fall precisely on the pixel boundaries to avoid blurring or incomplete display content.
[0083] The content adaptation unit is an important component of the multi-modal dynamic display smartwatch in the present invention. Its core function is to intelligently scale and adapt the displayed content according to the difference between the original size of the smartwatch screen and the dynamically generated display area size, so as to ensure that the displayed content is presented in a clear, complete and user-friendly form in the dynamically changing display area. The unit realizes the full process optimization from size analysis to content adaptation through the collaborative work of multiple submodules, and finally achieves a balance between display effect and user experience.
[0084] Among them, the size ratio calculation module is responsible for accurately calculating the proportional relationship between the first size of the screen (i.e., the original resolution of the screen, such as 400×400 pixels) and the second size of the display area (i.e., the resolution of the dynamically generated display area, such as 300×300 pixels). The module first obtains the coordinates of the minimum enclosing rectangle of the display area, and calculates the width and height of the display area based on the coordinates of the rectangle vertices. Subsequently, the horizontal scale factor is obtained by dividing the width of the display area by the original width of the screen, and the vertical scale factor is obtained by dividing the height of the display area by the original height of the screen. To avoid deformation of the content, the module usually selects the smaller value of the horizontal and vertical scale factors as the reference ratio. For example, in "fill mode", the module will select a larger scale factor to ensure that the content completely covers the display area; in "adaptive mode", the integrity of the content is prioritized, allowing blank space at the edge of the display area.
[0085] The scaling factor determination module further determines the final scaling factor based on the proportional relationship output by the size ratio calculation module, combined with the type of displayed content (such as text, image or chart) and user personalized settings (such as font size preference). For text content, the module will prioritize text readability and automatically adjust the scaling factor by limiting the minimum font size threshold; for image content, an adaptive interpolation algorithm (including but not limited to bilinear interpolation or Lanczos algorithm) is used to balance the quality of the scaled image and processing efficiency.
[0086] The content scaling processing module is the execution end of the content adaptation unit, which uses the scaling factor to perform the actual scaling operation on the content to be displayed. The module first parses the original content, separates the scalable elements (such as icons, vector graphics) and the non-scalable elements (such as fixed borders, status bars), and adopts differentiated scaling strategies for different element types. For scalable elements, the module performs geometric transformations based on the scaling factor, and optimizes the edge jagged problems through anti-aliasing technology; for non-scalable elements, their positions are re-anchored to the preset reference points (such as the upper left corner or the center point) in the display area to ensure the consistency of the layout logic. After completing the initial scaling, the module will also perform visual verification of the overall content, such as detecting whether the text exceeds the boundary of the display area, whether the image is distorted due to the low scaling ratio, and make fine adjustments based on the verification results. For example, if it is detected that a certain paragraph of text has abnormal line breaks due to scaling, the module will automatically adjust the word spacing or line spacing to adapt to the display area.
[0087] The content adaptation unit achieves efficient adaptation of display content and dynamic display area through the above-mentioned layered processing mechanism. Its advantages are mainly reflected in three aspects:
[0088] Intelligent adaptation: By combining content type and user preferences, the scaling strategy is dynamically adjusted to avoid the degradation of display effects caused by a "one-size-fits-all" approach;
[0089] Real-time guarantee: Lightweight algorithms and parallel computing technology are used to ensure fast response when the screen display area changes frequently;
[0090] Multimodal compatibility: supports unified processing of multiple content forms such as text, images, and videos, adapting to the complex application scenarios of smart watches.
[0091] In practical applications, this unit can significantly improve user visibility in strong light environments (such as automatically magnifying key information) or interaction efficiency in motion (such as reducing non-essential content to focus on core data). At the same time, by reducing the rendering power consumption of invalid areas, it can also indirectly extend the battery life of the device.
[0092] In summary, the content adaptation unit and its submodules provide key technical support for the dynamic display function of smart watches through precise size analysis, dynamic scaling factor calculation and intelligent content processing, and ultimately achieve the coordinated optimization of display effect, energy efficiency and user experience.
[0093] The display output unit of a smartwatch is one of the core modules for dynamic display. Its main task is to adapt the processed content to be displayed to a certain display area and display it in real time through the screen driving circuit. To achieve this goal, the display output unit is further divided into multiple submodules, each of which has a specific function.
[0094] The content rendering module is responsible for converting the content to be displayed after scaling processing into image data that fits the display area. Specifically, the module receives the content scaling processing results from the content adaptation unit, and renders the image data at the pixel level in combination with the geometric information of the display area (such as position and size). During the rendering process, the module adjusts the image quality according to the resolution and grayscale characteristics of the screen to ensure the fineness and consistency of the final display effect. For example, when the display area is small but high-resolution content needs to be presented, the content rendering module will use anti-aliasing algorithms or super-resolution technology to avoid image distortion.
[0095] The function of the display driver module is to transmit the rendered image data to the screen driver circuit of the smart watch so that it can be actually presented on the screen. In order to improve transmission efficiency and reduce latency, the display driver module adopts an optimized data transmission protocol and hardware interface design. In addition, the module also supports compatibility with multiple screen types (such as OLED, LCD), ensuring that different models of smart watches can obtain a consistent display experience. In actual operation, the display driver module will work closely with the screen hardware to achieve efficient refresh of image data by precisely controlling voltage and current signals.
[0096] The dynamic refresh module dynamically adjusts the refresh frequency of the display area based on the real-time calculation results of the brightness threshold calculation unit and the display area determination unit. The specific working principle is as follows: First, the dynamic refresh module obtains the current ambient light intensity and user posture monitoring data from the brightness threshold calculation unit, and analyzes the change trend of these parameters; then, combined with the latest display area information provided by the display area determination unit, it evaluates whether the refresh frequency needs to be adjusted. If a significant change in ambient light or user posture is detected, the dynamic refresh module will immediately increase the refresh frequency to ensure real-time update of the displayed content; conversely, if the environment is relatively stable, the refresh frequency will be reduced to save energy. This adaptive refresh mechanism not only improves the user experience, but also effectively extends the battery life of smart watches.
[0097] In summary, the display output unit and its submodules work together to achieve full-process automation from content rendering to screen display. Compared with traditional technologies, the technical solution of the present invention has higher flexibility, lower power consumption and stronger environmental adaptability, providing strong support for the dynamic display function of smart watches.
[0098] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0099] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
[0100] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
Claims
1. A multi-modal dynamic display smart watch, characterized in that: include: A data conversion unit, used to read the brightness data of the screen of the smart watch in real time, and convert the brightness data into a grayscale image, wherein the grayscale value of the grayscale image corresponds to the brightness value of the screen; A brightness threshold calculation unit, configured to calculate a brightness threshold based on the light intensity and attitude monitoring data detected in real time by the smart watch, wherein the attitude monitoring data includes accelerometer data and gyroscope data; A display area determination unit, configured to classify the pre-divided sub-areas in the screen according to the brightness threshold, and calculate the minimum enclosing rectangle of all the classified sub-areas to generate a rectangular display area; A content adaptation unit, configured to scale the content to be displayed according to the first size of the screen and the second size of the display area; The display output unit is used to display and output the content to be displayed after the scaling process in the display area.
2. A multi-modal dynamic display smart watch according to claim 1, characterized in that: The data conversion unit comprises: A brightness data acquisition module, used for capturing pixel-level brightness distribution data of the screen in real time; A brightness data mapping module, used to map the pixel-level brightness distribution data into a preset grayscale range; The grayscale image generator is used to construct a two-dimensional grayscale image matrix according to the mapping result, in which the value of each matrix element corresponds to the brightness value of the corresponding position on the screen.
3. A multi-modal dynamic display smart watch according to claim 2, characterized in that: The brightness threshold calculation unit comprises: A light intensity detection module, used to detect the light intensity of the surrounding environment of the smart watch in real time; A posture data acquisition module, used to acquire the posture monitoring data of the smart watch in real time through an accelerometer and a gyroscope, wherein the posture monitoring data includes accelerometer data and gyroscope data, and is used to reflect the movement state and rotation state of the smart watch; The threshold calculation module is used to calculate the brightness threshold by a preset formula based on the light intensity detected by the light intensity detection module and the posture monitoring data acquired by the posture data acquisition module.
4. A multi-modal dynamic display smart watch according to claim 3, characterized in that: The preset formula is: T=L·(1+α·W) Where T represents the brightness threshold, L represents the light intensity of the environment, W represents the normalized weight value calculated based on the posture monitoring data, and α represents the adjustment coefficient, which is used to control the influence of the posture monitoring data on the brightness threshold. Wherein, the calculation formula of the normalized weight value W is: W=g(θ,φ)=max(0, cos(θ)·cos(φ)) Where θ represents the pitch angle between the screen normal and the user's line of sight, φ represents the horizontal angle between the screen normal and the user's line of sight, and g(·) represents the normalization function.
5. A multi-modal dynamic display smart watch according to claim 4, characterized in that: The display area determination unit comprises: A sub-region division module, used to divide the screen into a plurality of evenly distributed sub-regions according to a preset rule, wherein each sub-region is composed of a number of pixels; The average brightness calculation module is used to count the brightness values of all pixels in each sub-region and calculate the average brightness value of the sub-region; A sub-region classification module is used to classify each sub-region according to the brightness threshold, and if the average brightness value of any sub-region is greater than or equal to the brightness threshold, it is classified as a standard display region; otherwise, it is classified as a non-standard display region; The minimum enclosing rectangle module is used to calculate the minimum enclosing rectangle of all sub-areas belonging to the standard display area after classification processing, and generate a rectangular display area.
6. The multi-modal dynamic display smart watch according to claim 5, characterized in that: The content adaptation unit comprises: A size ratio calculation module, used to calculate the ratio between the first size of the screen and the second size of the display area; A scaling factor determination module, which determines a scaling factor required for scaling the content to be displayed based on the proportional relationship; The content scaling processing module performs scaling processing on the content to be displayed using the scaling factor to ensure that the content to be displayed is displayed in a suitable size within the display area.
7. The multi-modal dynamic display smart watch according to claim 6, characterized in that: The display output unit comprises: A content rendering module, used for rendering the content to be displayed after scaling processing into image data adapted to the display area; A display driving module, used to transmit the rendered image data to the screen driving circuit of the smart watch so as to display and output it in the display area; The dynamic refresh module is used to dynamically adjust the refresh frequency of the display area according to the real-time calculation results of the brightness threshold calculation unit and the display area determination unit to ensure that the display content can be updated in real time when the ambient light and the user's posture change.