Display apparatus and display method therefor

Abstract

Disclosed are a display apparatus and a display method therefor. The display apparatus comprises: a flexible display screen; a rolling mechanism, which is connected to one end of the flexible display screen and is used for rolling up the flexible display screen; a controller, which is used for generating a first control instruction; a driving mechanism, which is connected to the controller and the rolling mechanism and is used for driving, on the basis of the first control instruction, the rolling mechanism to rotate, so as to roll up or unroll the flexible display screen; a detection component, which is used for detecting unrolling extent information of the flexible display screen; and a processor, which is connected to the detection component and is used for adjusting, on the basis of the unrolling extent information of the flexible display screen, a display image of the flexible display screen to a target display image.

Description

A display device and its display method

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411548156.3, filed in China on October 31, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to the field of display device technology, and in particular to a display device and a display method thereof. Background Technology

[0004] In recent years, with the widespread application of flexible visualization devices in the display industry, their unique flexible bending characteristics have become a major development trend. These devices can achieve diverse adjustments in physical form to adapt to different usage scenarios. However, as the size of the screen structure changes, the display size of the user-visible interface also needs to be adjusted synchronously to ensure the continuity and comfort of the visual experience. Currently, a common solution is to stretch the displayed content to adapt to different screen sizes during the operation of the structure, so that the entire display screen remains in full-screen mode. While this method is simple, it has the following drawbacks:

[0005] First, due to the stretching of the displayed content, changes in screen size can cause image scaling and resolution changes, leading to image distortion. Second, current flexible display technologies typically only support fully unfolded and fully rolled-up operation states, but cannot perform any operations during size changes, which limits the functionality and operational possibilities of the device during sliding. Furthermore, when the flexible mechanism shrinks or unfolds, although the original display ratio can be maintained, unused black borders often appear at the display edges.

[0006] In summary, current flexible display devices suffer from poor display quality and image distortion when the screen size changes, thus reducing the user's overall visual experience. Summary of the Invention

[0007] This disclosure provides a display device and a display method thereof.

[0008] To address the aforementioned technical problems, the embodiments of this application provide the following aspects:

[0009] In a first aspect, embodiments of this application provide a display device, including:

[0010] Flexible display screen;

[0011] A winding mechanism, connected to one end of the flexible display screen, is used to wind up the flexible display screen;

[0012] The controller is used to generate the first control command;

[0013] A drive mechanism, connected to the controller and the winding mechanism, is used to drive the winding mechanism to rotate according to the first control command, so as to wind up or unwind the flexible display screen;

[0014] A detection component is used to detect the degree of unfolding of the flexible display screen;

[0015] The processor, connected to the detection component, is used to adjust the displayed image of the flexible display screen to the target display image based on the unfolding degree information of the flexible display screen.

[0016] Optionally, the resolution of the target display image is a first resolution, which is adapted to the visible display area of ​​the current flexible display screen.

[0017] Optionally, the driving mechanism includes a motor, and the detection component includes a magnetic sensor and a magnet;

[0018] The magnet is located on the coiling mechanism and is used to move in accordance with the operation of the coiling mechanism;

[0019] The magnetic sensor, located on the motor and connected to the processor, is used to sense the operation information of the magnet and generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor. The electrical signal is used to characterize the degree of unfolding of the flexible display screen.

[0020] Optional, also includes:

[0021] A support component, comprising a fixed housing, a motor platform, and a bracket, wherein the motor platform and the bracket are both mounted on the fixed housing;

[0022] The drive mechanism includes a motor, which is mounted on the motor platform;

[0023] The motor further includes: a motor shaft, which is disposed inside the motor and extends to the outside of the motor, and is used to rotate according to the operation of the motor;

[0024] The detection component includes a magnetic sensor and a magnet;

[0025] The magnet is located on the motor shaft and is used to rotate in accordance with the rotation of the electrode shaft;

[0026] The magnetic sensor, located on the support and connected to the processor, is used to sense the operation information of the magnet, generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor. The electrical signal is used to characterize the degree of unfolding of the flexible display screen.

[0027] Optional, also includes:

[0028] Support component, the support component including bracket;

[0029] The drive mechanism includes: a motor;

[0030] The detection component includes a light receiver and a light emitter, and the curling mechanism has an opening;

[0031] The light emitter, located on the bracket, is used to emit a light beam to the light receiver;

[0032] The light receiver, located on the motor, is used to receive the light beam when the opening in the curling mechanism is aligned with the light emitter and the light receiver, and to generate an electrical signal based on the change information of the light beam, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the degree of unfolding of the flexible display screen.

[0033] Secondly, embodiments of this application provide a display method for a flexible display device, applied to the flexible display device described in the first aspect, the method comprising:

[0034] According to the first control command, the winding mechanism is driven to rotate in order to wind up or unfold the flexible display screen;

[0035] Detect the degree of unfolding of the flexible display screen;

[0036] Based on the unfolding information of the flexible display screen, the displayed image on the flexible display screen is adjusted to the target display image.

[0037] Optionally, the resolution of the target display image is a first resolution, which is adapted to the visible display area of ​​the current flexible display screen.

[0038] Optionally, the first resolution is proportional to the display size of the visible display area of ​​the flexible display screen.

[0039] Optionally, adjusting the displayed image of the flexible display screen to the target display image includes:

[0040] The original image to be displayed on the flexible display screen is subjected to background segmentation processing to obtain the background area and foreground area of ​​the original image;

[0041] Adjust the resolution of the background region and the resolution of the foreground region respectively to obtain a background region and a foreground region with a first resolution;

[0042] The background and foreground regions of the first resolution are combined to obtain the target display image of the first resolution.

[0043] Optionally, adjusting the displayed image of the flexible display screen to the target display image includes:

[0044] The original image to be displayed on the flexible display screen is sent to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to the first resolution;

[0045] Receive the target display image with the first resolution sent by the cloud-based artificial intelligence server.

[0046] Optionally, adjusting the displayed image of the flexible display screen to the target display image includes:

[0047] Receive the user's second control command;

[0048] According to the second control command, the display image adjustment mode is adjusted to the first adjustment mode;

[0049] According to the first adjustment mode, the image displayed on the flexible display screen is adjusted to the target display image every preset time period.

[0050] Optionally, adjusting the displayed image of the flexible display screen to the target display image includes:

[0051] Based on user habits, at least one pre-stored display size of the visible display area of ​​the flexible display screen is determined;

[0052] Based on the preset display size, determine a first resolution that is compatible with the preset display size;

[0053] Receive third control commands;

[0054] According to the third control command, the display image adjustment mode is adjusted to the second adjustment mode;

[0055] According to the second adjustment mode, when the size of the current visible display area of ​​the flexible display screen is the preset display size, the display image of the flexible display screen is adjusted to the target display image.

[0056] Optionally, adjusting the displayed image of the flexible display screen to the target display image includes:

[0057] Receive the fourth control command;

[0058] According to the fourth control command, the display image adjustment mode will be adjusted to the third adjustment mode;

[0059] According to the third adjustment mode, the displayed image of the flexible display screen is adjusted to the target display image in real time.

[0060] Optionally, the first control command includes at least one of the following: voice command, touch command, gesture command, and button command. Attached Figure Description

[0061] Figure 1 is a structural block diagram of a display device provided in an embodiment of this application;

[0062] Figure 2A is a schematic diagram of the winding state of a flexible display screen provided in an embodiment of this application;

[0063] Figure 2B is a schematic diagram of the unfolded state of a flexible display screen provided in an embodiment of this application;

[0064] Figure 3A is a schematic diagram of the winding state of a flexible display screen provided in an embodiment of this application in a rolling manner;

[0065] Figure 3B is a schematic diagram of the unfolded state of a flexible display screen provided in the embodiment of this application in a roll-up manner;

[0066] Figure 4A is a schematic diagram of the winding state of a flexible display screen in a sliding state according to an embodiment of this application;

[0067] Figure 4B is a schematic diagram of the unfolded state of a flexible display screen in a sliding state according to an embodiment of this application;

[0068] Figure 5 is a schematic diagram of the module configuration of a display device provided in an embodiment of this application;

[0069] Figure 6 is a schematic diagram of a detection component arrangement provided in an embodiment of this application;

[0070] Figure 7 is a schematic diagram of another configuration of the detection component provided in an embodiment of this application;

[0071] Figure 8 is a schematic diagram of another way of setting up the detection component according to an embodiment of this application;

[0072] Figure 9 is a schematic diagram of another configuration of the detection component provided in an embodiment of this application;

[0073] Figure 10 is a flowchart illustrating the matching of the unfolded state of a flexible display screen and the resolution of its displayed image in a display device provided in an embodiment of this application.

[0074] Figure 11 is a flowchart of a display method of a display device provided in an embodiment of this application;

[0075] Figure 12 is a schematic diagram of adjusting a displayed image according to an embodiment of this application;

[0076] Figure 13 is a schematic diagram of a display image segmentation method provided in an embodiment of this application;

[0077] Figure 14 is a schematic diagram of an image adjustment method in a first image adjustment mode provided by an embodiment of this application;

[0078] Figure 15 is a schematic diagram of an image adjustment method displayed in a second adjustment mode according to an embodiment of this application;

[0079] Figure 16 is a schematic diagram of another adjustment method for displaying an image in the second adjustment mode provided by an embodiment of this application. Detailed Implementation

[0080] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0081] Figure 1 illustrates a display device 10 according to an embodiment of this application, as shown in Figure 1, comprising:

[0082] Flexible display screen 1;

[0083] The winding mechanism 2 is connected to one end of the flexible display screen 1 and is used to wind up the flexible display screen 1.

[0084] Controller 4 is used to generate the first control command;

[0085] The drive mechanism 3 is connected to the controller 4 and the winding mechanism 2, and is used to drive the winding mechanism 2 to rotate according to the first control command, so as to wind up or unwind the flexible display screen 1.

[0086] Detection component 5 is used to detect the degree of unfolding of the flexible display screen 1;

[0087] The processor 6, connected to the detection component 5, is used to adjust the displayed image of the flexible display screen 1 to a target display image based on the unfolding degree information of the flexible display screen 1. The target display image has a first resolution, which is adapted to the visible display area of ​​the current flexible display screen 1.

[0088] The flexible display screen 1 possesses characteristics that allow it to adapt to different display needs in terms of physical form. For example, it can be rolled up (as shown in Figure 2A) or unfolded (as shown in Figure 2B) by the rolling mechanism 2. The material of the flexible display screen 1 can be polymer materials such as CPI (Colorless Polyimide) or UTG (Ultra-Thin Glass).

[0089] The winding mechanism 2 is connected to one end of the flexible display screen 1 and is mainly used to control the winding state of the flexible display screen 1. When it is necessary to roll up or unroll the flexible display screen 1, the winding mechanism 2 will perform corresponding mechanical actions to achieve this change. The winding mechanism 2 can be a scroll as shown in Figures 3A, 3B, 4A, and 4B. Among them, Figures 3A and 3B show the winding and unrolling states of the flexible display screen 1 in the winding mode, while Figures 4A to 4B show the state in which the size of the visible display area of ​​the flexible display screen 1 gradually increases in the sliding state.

[0090] The controller 4 generates a first control command to instruct the drive mechanism 3 to drive the winding mechanism 2 to perform corresponding mechanical actions. The first control command is generated based on the user's actual needs to optimize the display effect. The first control command includes at least one of the following: voice command, touch command, gesture command, and button command. The first control command can instruct the flexible display screen 1 to perform unfolding, rewinding, or other related operations, such as turning off the power.

[0091] The drive mechanism 3 is responsible for converting the first control command issued by the controller 4 into an actual driving effect to drive the rotation of the winding mechanism 2. Whether it is winding or unwinding, the drive mechanism 3 can accurately execute the first control command of the controller 4 to ensure the smooth operation of the flexible display screen 1.

[0092] The detection component 5 is used to monitor the degree of unfolding of the flexible display screen 1. It can provide feedback information to inform the display device 10 of the current status of the flexible display screen 1, which is particularly important for subsequent image processing.

[0093] The processor 6 is connected to the detection component 5 and receives information about the unfolding degree of the flexible display screen 1. Based on this information, the processor 6 can adjust the resolution of the image displayed on the flexible display screen 1 to ensure that the displayed content can fit the current visible display area. For example, if the flexible display screen 1 unfolds further, a higher resolution will be needed to ensure display quality; conversely, when the flexible display screen 1 is rolled up, the resolution may need to be reduced to fit the visible area.

[0094] Therefore, the flexible display screen 1 can be efficiently controlled and optimized, so that it can always provide a clear and suitable visual experience in a dynamically changing state. This management mechanism not only improves the user experience, but also effectively extends the service life of the display screen.

[0095] As shown in Figure 5, the display device system shown in this embodiment can be composed of the following modules, wherein the control module includes a sound receiving circuit, a position detection circuit (equivalent to the detection component 5 mentioned above), a motor drive circuit, a motherboard, a storage module, a WIFI (Wireless Fidelity) transmission module, an AI (Artificial Intelligence) image processing module, and a sound recognition module.

[0096] The position detection circuit can be placed on the motor and uses magnetic sensors, optical sensors, or other methods to sense the position.

[0097] The voice recognition module performs signal processing on the input sound, including techniques such as Fourier transform and time-domain spectrogram analysis; it extracts features, such as linear predictive spectrum analysis; it applies acoustic models, such as hidden Markov models, Bayesian maximum likelihood estimation, and deep neural networks; and it performs natural language understanding through a decoder. Finally, the recognized command is sent to the motherboard, which is responsible for adjusting the overall device shape and display resolution. A typical voice recognition method involves the user speaking commands through a microphone. The voice recognition module converts the received sound signal into text information. The system analyzes the text information, identifying keywords such as "unfold," "close," and "power off." The motherboard uses these keywords to determine the specific operation the user wishes to perform, and finally, the motherboard executes the corresponding operation based on the determination result.

[0098] This system design not only enhances the interactivity and functionality of the display device but also enables it to operate efficiently in various environments and scenarios. For example, through the WIFI transmission module, the device can connect to a cloud server, where the algorithms in the motherboard's AI image processing module can be updated in real time, or the image resolution can be processed directly through the cloud server before being sent back to the motherboard, thus enhancing its processing capabilities and the diversity of processing methods.

[0099] It should be noted that the detection component 5 has the following three different settings.

[0100] In a first possible implementation, as shown in Figure 6, the drive mechanism 3 includes a motor, and the detection component 5 includes a magnetic sensor and a magnet.

[0101] A magnet is located on the winding mechanism 2 and is used to move along with the winding mechanism 2.

[0102] A magnetic sensor, located on the motor and connected to the processor 6, is used to sense the operation information of the magnet and generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor 6. The electrical signal is used to characterize the degree of unfolding of the flexible display screen 1.

[0103] In the second possible implementation, as shown in Figure 7 or Figure 8, the display device further includes a support component, which includes a fixed housing, a motor platform, and a bracket, both of which are mounted on the fixed housing.

[0104] Drive mechanism 3 includes: a motor, which is mounted on a motor platform;

[0105] The motor also includes: a motor shaft, which is installed inside the motor and extends to the outside of the motor, and is used to operate according to the operation of the motor;

[0106] Detection component 5 includes a magnetic sensor and a magnet;

[0107] The magnet, located on the motor shaft, is used to move in tandem with the electrode shaft.

[0108] A magnetic sensor, located on the support and connected to the processor 6, is used to sense the operation information of the magnet and generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor 6. The electrical signal is used to characterize the degree of unfolding of the flexible display screen 1.

[0109] In a third possible implementation, as shown in Figure 9, the display device further includes:

[0110] Support components, including brackets;

[0111] Drive mechanism 3 includes: a motor;

[0112] The detection component 5 includes a light receiver and a light emitter, and the curling mechanism 2 has an opening;

[0113] A light emitter, located on a bracket, is used to emit a light beam to a light receiver;

[0114] The light receiver, located on the motor, is used to receive the light beam when the opening in the winding mechanism 2 is aligned with the light emitter and the light receiver. It generates an electrical signal based on the change information of the light beam and sends the electrical signal to the processor 6. The electrical signal is used to characterize the degree of unfolding of the flexible display screen 1.

[0115] All three implementation methods aim to monitor the unfolding degree of the flexible display screen 1 through different sensing and detection mechanisms for real-time image adjustment and control. In the first implementation method, the magnet is located on the rolling mechanism 2 and rotates with its operation. Due to the large size of the rolling mechanism 2, there are many options for the size of the magnet on it, allowing for the selection of different sized magnets. The magnetic sensor is located on the motor and generates an electrical signal by sensing changes in the position of the magnet, which is then fed back to the processor 6. This electrical signal characterizes the unfolding degree of the flexible display screen 1. The second implementation method differs from the first in that the positions of the magnet and the magnetic sensor are different. The magnet is located on the motor shaft, while the magnetic sensor can be located on the bracket. Due to the smaller size of the motor shaft, a smaller magnet can be used, but the sensing principle is the same as in the first method. It should also be noted that in the first and second methods, weakly magnetic magnets can be selected to improve the stability, safety, and accuracy of the display device, while reducing interference with the surrounding environment, making the overall performance of the flexible display screen 1 more reliable. In the third implementation, the detection component 5 is a light emitter and a light receiver, which can determine the degree of unfolding of the flexible display screen 1 by relying on the on / off state of the light beam.

[0116] It should be noted that magnetic sensors may be more sensitive to environmental interference, such as electromagnetic interference, which could affect detection accuracy in certain environments. Optical sensors, on the other hand, are unaffected by electromagnetic interference but are more sensitive to ambient light conditions, requiring suitable lighting conditions in the working environment. Both types of sensors have their own advantages and disadvantages in terms of accuracy and reliability, and can be flexibly configured according to actual needs to meet the diverse requirements of users in different scenarios.

[0117] In summary, in the display device provided in this application embodiment (as shown in Figure 10), firstly, the user can issue voice commands (such as unfold or close), button commands (such as unfold or close), or touch commands (such as unfold or close) to the controller 4. The controller 4 generates a first control command, which is transmitted through the drive mechanism 3, thereby driving the connected winding mechanism 2. The winding mechanism 2 can precisely adjust the unfolding or retracting state of the flexible display screen 1. To ensure that the image quality can be adjusted according to the different unfolding states of the flexible display screen 1, the display device is also equipped with a detection component 5 (equivalent to the position sensor shown in Figure 10). The position sensor can monitor the unfolding state of the flexible display screen 1. The processor 6 can adjust the resolution of the displayed image based on the unfolding degree of the flexible display screen 1, and feed back the unfolding degree (whether it is unfolded or closed) to the user. This allows the processor 6 to adapt the resolution of the displayed image to the size of the visible display area of ​​the current display screen. In this way, the image distortion problem caused by direct stretching of the image during the size change of the visible display area of ​​the deformable display screen can be solved. This ensures that the flexible display screen 1 can display high-quality images that are adapted to the visible display area in different unfolding states. Whether it is fully unfolded or partially rolled up, the resolution of the displayed image will be optimized according to the actual size of the visible area to maintain clarity and realism, thereby improving the user's visual experience.

[0118] Figure 11 illustrates a display method for a display device according to an embodiment of the present application. The display method can be applied to the display device shown in Figure 1, and the method includes:

[0119] Step S101: Drive the winding mechanism to rotate according to the first control command to wind up or unwind the flexible display screen;

[0120] Step S102: Detect the degree of unfolding of the flexible display screen;

[0121] Step S103: Adjust the displayed image of the flexible display screen to the target display image based on the unfolding degree information of the flexible display screen.

[0122] The target display image has a first resolution, which is adapted to the visible display area of ​​the current flexible display screen 1 and is proportional to the display size of the visible display area of ​​the current flexible display screen 1. That is, as the flexible display screen unfolds, the display size of its visible display area gradually increases, and the first resolution also gradually increases.

[0123] It should be noted beforehand that in applications of the flexible display screen 1, such as sliding or rolling (as shown in Figures 3A, 3B, 4A, and 4B), the display area of ​​the deformable display screen is completely covered by the device, resulting in a display area that can be divided into a visible display area and an obscured display area (rolled-up area). Since the obscured display area is hidden inside the deformable display device, the user cannot see it during use. To save power, the obscured display area can be displayed as a black screen (black screen display). When the deformable display screen is in operation (unfolding or retracting), the sizes of both the visible and obscured display areas will change accordingly. When the deformable display screen is unfolded, the size of its original rolled-up area decreases, and the size of the visible display area increases. If the original display ratio is maintained at this time, black borders will appear at the edges of the displayed image (displayed content) in the visible display area. In order to maintain the full-screen display, related technologies usually stretch the display image. However, stretching can easily lead to an imbalance in the image ratio, resulting in image distortion and other problems, affecting the user's viewing experience. This problem can be solved by the method shown in Figure 11.

[0124] In step S101, the first control command includes at least one of the following: voice command, touch command, gesture command, and button command. The first control command can instruct the flexible display screen 1 to perform unfolding, rewinding, or other related operations, such as powering off. Referring to the structure of the display device shown in FIG1, the winding mechanism 2 can be driven to rotate according to the first control command to rewind or unfold the flexible display screen 1.

[0125] It should be noted that for traditional LCD (Liquid Crystal Display) displays, rigid materials such as hard glass covers can be used to protect the display screen. In contrast, flexible OLED (Organic Light-Emitting Diode) displays require flexible materials such as polymers like CPI and UTG. Flexible materials offer less protection for the display screen compared to rigid materials, posing a risk of product failure when users touch the display, especially when interacting with it using a stylus. Therefore, the display method described in this application increases the ways users can interact with the flexible display screen 1. In addition to touch display, physical buttons, voice recognition, and gesture recognition can be added, enhancing the diversity and flexibility of interaction methods, mitigating the risk of product failure, and improving the user experience.

[0126] In steps S102 and S103, the degree of unfolding of the flexible display screen 1 can be detected. This step involves sensors (such as light sensors and magnetic sensors) to detect the specific degree of unfolding of the flexible display screen 1, and automatically adjusts the resolution of the displayed image to a first resolution based on the degree of unfolding information, so as to ensure the adaptability of the image in different unfolding states and enable the image display effect to maintain the best quality in different states.

[0127] In summary, firstly, user commands can be quickly recognized and responded to, making operation intuitive and flexible; secondly, the unfolding or retracting of the flexible display screen 1 can be efficiently controlled, enabling effective visual display; and thirdly, by detecting the unfolding degree of the flexible display screen 1, accurate feedback on the screen status can be ensured, providing a reliable basis for subsequent image resolution adjustments. This dynamic adjustment helps optimize the display effect, ensuring that users can obtain a clear and suitable visual experience in different unfolding states of the flexible display screen 1, i.e., at different display sizes of the visible display area of ​​the flexible display screen 1.

[0128] In one possible implementation, adjusting the displayed image of the flexible display screen 1 to the target displayed image includes: performing background segmentation processing on the original image to be displayed on the flexible display screen 1 to obtain a background region and a foreground region of the original image; adjusting the resolution of the background region and the resolution of the foreground region respectively to obtain a background region and a foreground region of a first resolution; and combining the background region and the foreground region of the first resolution to obtain the target displayed image of the first resolution.

[0129] In one possible implementation, adjusting the displayed image of the flexible display screen 1 to the target displayed image includes: sending the original image to be displayed on the flexible display screen 1 to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to a first resolution; and receiving the target displayed image with the first resolution sent by the cloud-based artificial intelligence server.

[0130] It should be noted that, in order to achieve image resolution transformation, an artificial intelligence-based image generation scheme can be adopted. This scheme typically follows the following process: First, algorithms such as OpenCV and GrabCut are used to segment the background of the image. These algorithms analyze features such as color, brightness, and texture of the image to effectively extract the foreground and background. Next, techniques such as GAN (Generative Adversarial Networks), inpainting, and super-resolution are used to further improve the image resolution. These methods can expand the background and adjust it to a first resolution that is compatible with the size of the visible display area of ​​the current flexible display screen 1. Figure 12 illustrates a specific scenario of adjusting the display image resolution.

[0131] OpenCV is an open-source computer vision library that provides a wealth of image processing and computer vision functions.

[0132] GrabCut is an image segmentation algorithm that separates the foreground and background using user-defined tags and an image color model.

[0133] Generative Adversarial Networks (GANs) are machine learning models consisting of two neural networks (generator and discriminator). They generate new data samples through adversarial training and are commonly used for image generation and enhancement.

[0134] Inpainting is an image filling technique used to restore or repair missing parts of an image. It intelligently fills by utilizing information from surrounding pixels and is often used to remove blemishes from images.

[0135] Super-resolution is a technique used to generate high-resolution images from low-resolution images. Through reconstruction and enhancement processes, it improves the detail and sharpness of the image. Specifically, GANs generate high-quality images, while inpainting techniques fill in missing parts of the image, ensuring its integrity and naturalness. Simultaneously, super-resolution effectively enhances image details, allowing the image to remain sharp even when enlarged. Through this comprehensive process, high-quality image resolution transformation can be achieved, providing users with a superior visual experience.

[0136] It should be noted that Generative Adversarial Networks (GANs) for image generation are deep learning models and one of the most promising unsupervised learning methods on complex distributions in recent years. Generative Adversarial Networks for image generation produce good image outputs through game-like learning between a generative model and a discriminative model. It includes a generative model G (a neural network model) that generates an image G(z) based on received random information z; a discriminative model, also a neural network model, that judges the realism of an image; that is, given an input image x, it outputs D(x), representing the percentage of realism (i.e., the probability that the input image is a real image); and a loss function L (the loss function) that evaluates the difference between the model and reality. For the generative model, the loss function can be defined as: L G =H(1,D(G(z)), which represents the loss between the generated image and the real image; for the discriminative model, the loss function is defined as: L D =H(1,D(x))+H(0,D(G(z))), which represents the loss between the discriminative model's correct judgment of the real image (the difference between the output and the real situation) and its judgment of the generated image (the sum of the output and the fake situation). During training, the loss function is minimized by optimizing the objective, resulting in the following form: Where x represents a real image, z represents noise input to the generator model G, G(z) represents the image generated by the generator network, and D(*) represents the probability judgment of the discriminator network on the realism of the image. Through this training process, the generator model G and the discriminator model D continuously engage in a game, with G constantly improving the quality of the generated images, while D continuously improves its ability to distinguish between real and generated images. Ultimately, GAN achieves high-quality image generation through this adversarial training, demonstrating its powerful capabilities in the field of image generation.

[0137] The method described in this application embodiment can use an AI image generation algorithm to scale the original image (change the image resolution) and automatically generate a new image, thereby solving the image distortion problem caused by direct stretching of the image during the size transformation of the visible display area of ​​a deformable display screen in related technologies.

[0138] The following describes in detail how to adjust the image displayed on the flexible display screen 1 to the target display image under three different image adjustment modes, and the resolution of the target display image is the first resolution.

[0139] In one possible implementation, adjusting the displayed image of the flexible display screen 1 to the target displayed image includes: receiving a second control command from a user; adjusting the display image adjustment mode to a first adjustment mode according to the second control command; and adjusting the displayed image of the flexible display screen 1 to the target displayed image at preset time intervals according to the first adjustment mode.

[0140] The first adjustment mode, also known as the step-by-step adjustment mode, gradually adjusts the resolution of the displayed image at preset time intervals. The initial resolution is a variable representing the resolution of the displayed image that best matches the visible display area of ​​the flexible display screen 1 after each adjustment. In a specific application scenario, as shown in Figure 13, for the original image A, an AI image generation algorithm can first generate images B1 and B2 based on the maximum resolution of the original image A. Then, based on the processing speed, B1 and B2 are segmented, for example, B2 is segmented into B21 and B22... 2， B23, ..., B2 N N is the total number of slices in the B2 image, and the running distance is At time 1, x represents the width of image B2. On the graph, this represents a movement from the leftmost edge of the original image A to the leftmost edge. The image is then updated to a combination of B11 + A + B21 (B1 is updated similarly). The process continues at the next time step. When the distance is [distance], that is, the total running distance is [distance]. At that time, the image is updated to B12+A+B22, and so on until the final image motion distance x, at which point the image is updated to B1. N +A+B2 N Correspondingly, the flowchart for image generation is shown in Figure 14. It should be noted that the method shown in Figure 13 is only an example, that is, when the main content of the image is located in the middle and both the left and right sides can be expanded and loaded, in actual implementation, there may only be A1 or only B1, or the image may be recorded from the top or bottom. This application embodiment does not limit this.

[0141] Therefore, the displayed image of the flexible display screen 1 can be adjusted to the target display image at preset time intervals, that is, the resolution of the displayed image of the flexible display screen 1 can be adjusted to the first resolution without real-time adjustment. This avoids frequent scheduling of the AI ​​image generation algorithm and saves resources while ensuring user experience.

[0142] In one possible implementation, adjusting the displayed image of the flexible display screen 1 to the target displayed image includes: determining at least one preset display size of the visible display area of ​​the flexible display screen 1 according to user usage habits; determining a first resolution adapted to the preset display size according to the preset display size; receiving a third control instruction; adjusting the display image adjustment mode to a second adjustment mode according to the third control instruction; and adjusting the displayed image of the flexible display screen 1 to the target displayed image according to the second adjustment mode when the current size of the visible display area of ​​the flexible display screen 1 is the preset display size.

[0143] It should be noted that in the user habit adjustment mode, at least one user-preferred display size (i.e., a pre-stored display size) and its corresponding resolution can be pre-stored. Each time the flexible display screen 1 is used, if the size of the currently visible display area is detected to be the pre-stored display size, the resolution of the displayed image on the flexible display screen 1 is adjusted to the first resolution. In a specific application scenario, taking the image shown in Figure 13 as an example, the image generation flowcharts are shown in Figures 15 and 16. Figure 15 is the overall flowchart of image generation in the second adjustment mode, and Figure 16 is an exemplary flowchart when three pre-stored display sizes are available. Therefore, by pre-stored commonly used display sizes and resolutions, a more personalized user experience can be provided, ensuring a consistent visual experience for users across multiple uses. This is particularly useful in multi-scenario or multi-device environments. Furthermore, because the size and resolution information is pre-stored, the image resolution can be quickly adjusted without recalculating or processing each time, resulting in shorter image generation time, reduced latency, and improved response speed.

[0144] In one possible implementation, adjusting the displayed image of the flexible display screen 1 to the target displayed image includes: receiving a fourth control command; adjusting the display image adjustment mode to a third adjustment mode according to the fourth control command; and adjusting the displayed image of the flexible display screen 1 to the target displayed image in real time according to the third adjustment mode. Thus, through real-time adjustment, the flexible display screen 1 can better adapt to the user's immediate needs, providing a smoother and higher-quality visual experience.

[0145] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0146] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0147] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

[0148] The above description is only a preferred embodiment of this disclosure. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principles of this disclosure, and these improvements and modifications should also be considered within the scope of protection of this disclosure.

Claims

1. A display device, comprising: Flexible display screen; A winding mechanism, connected to one end of the flexible display screen, is used to wind up the flexible display screen; The controller is used to generate the first control command; A drive mechanism, connected to the controller and the winding mechanism, is used to drive the winding mechanism to rotate according to the first control command, so as to wind up or unwind the flexible display screen; A detection component is used to detect the degree of unfolding of the flexible display screen; The processor, connected to the detection component, is used to adjust the displayed image of the flexible display screen to the target display image based on the unfolding degree information of the flexible display screen.

2. The apparatus according to claim 1, wherein, The target display image has a first resolution, which is adapted to the visible display area of ​​the current flexible display screen.

3. The apparatus according to claim 1, wherein, The driving mechanism includes a motor, and the detection component includes a magnetic sensor and a magnet; The magnet is located on the coiling mechanism and is used to move in accordance with the operation of the coiling mechanism; The magnetic sensor, located on the motor and connected to the processor, is used to sense the operation information of the magnet and generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor. The electrical signal is used to characterize the degree of unfolding of the flexible display screen.

4. The apparatus according to claim 1, wherein, Also includes: A support component, comprising a fixed housing, a motor platform, and a bracket, wherein the motor platform and the bracket are both mounted on the fixed housing; The drive mechanism includes a motor, which is mounted on the motor platform; The motor further includes: a motor shaft, which is disposed inside the motor and extends to the outside of the motor, and is used to rotate according to the operation of the motor; The detection component includes a magnetic sensor and a magnet; The magnet is located on the motor shaft and is used to rotate in accordance with the rotation of the motor shaft; The magnetic sensor, located on the support and connected to the processor, is used to sense the operation information of the magnet, generate an electrical signal based on the operation information of the magnet, and send the electrical signal to the processor. The electrical signal is used to characterize the degree of unfolding of the flexible display screen.

5. The apparatus according to claim 1, wherein, Also includes: Support component, the support component including bracket; The drive mechanism includes: a motor; The detection component includes a light receiver and a light emitter, and the curling mechanism has an opening; The light emitter, located on the bracket, is used to emit a light beam to the light receiver; The light receiver, located on the motor, is used to receive the light beam when the opening in the curling mechanism is aligned with the light emitter and the light receiver, and to generate an electrical signal based on the change information of the light beam, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the degree of unfolding of the flexible display screen.

6. A display method for a display device, applied to a flexible display device as described in any one of claims 1-5, the method comprising: According to the first control command, the winding mechanism is driven to rotate in order to wind up or unfold the flexible display screen; Detect the degree of unfolding of the flexible display screen; Based on the unfolding information of the flexible display screen, the displayed image on the flexible display screen is adjusted to the target display image.

7. The method according to claim 6, wherein, The target display image has a first resolution, which is adapted to the visible display area of ​​the current flexible display screen.

8. The method according to claim 7, wherein, The first resolution is proportional to the display size of the visible display area of ​​the flexible display screen.

9. The method according to claim 7, wherein, Adjusting the displayed image of the flexible display screen to the target display image includes: The original image to be displayed on the flexible display screen is subjected to background segmentation processing to obtain the background area and foreground area of ​​the original image; Adjust the resolution of the background region and the resolution of the foreground region respectively to obtain a background region and a foreground region with a first resolution; The background and foreground regions of the first resolution are combined to obtain the target display image of the first resolution.

10. The method according to claim 7, wherein, Adjusting the displayed image of the flexible display screen to the target display image includes: The original image to be displayed on the flexible display screen is sent to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to the first resolution; Receive the target display image with the first resolution sent by the cloud-based artificial intelligence server.

11. The method according to any one of claims 7 to 10, wherein, Adjusting the displayed image of the flexible display screen to the target display image includes: Receive the user's second control command; According to the second control command, the display image adjustment mode is adjusted to the first adjustment mode; According to the first adjustment mode, the image displayed on the flexible display screen is adjusted to the target display image every preset time period.

12. The method according to any one of claims 7 to 10, wherein, Adjusting the displayed image of the flexible display screen to the target display image includes: Based on user habits, at least one pre-stored display size of the visible display area of ​​the flexible display screen is determined; Based on the preset display size, determine a first resolution that is compatible with the preset display size; Receive third control commands; According to the third control command, the display image adjustment mode is adjusted to the second adjustment mode; According to the second adjustment mode, when the size of the current visible display area of ​​the flexible display screen is the preset display size, the display image of the flexible display screen is adjusted to the target display image.

13. The method according to any one of claims 7 to 10, wherein, Adjusting the displayed image of the flexible display screen to the target display image includes: Receive the fourth control command; According to the fourth control command, the display image adjustment mode will be adjusted to the third adjustment mode; According to the third adjustment mode, the displayed image of the flexible display screen is adjusted to the target display image in real time.

14. The method according to claim 6, wherein, The first control command includes at least one of the following: voice command, touch command, gesture command, and button command.

Images