Display device and display method thereof

Abstract

The invention provides a display device and a display method thereof. The display device comprises a flexible display screen; the coiling mechanism is connected with one end of the flexible display screen and used for coiling the flexible display screen; the controller is used for generating a first control instruction; the driving mechanism is connected with the controller and the curling mechanism and used for driving the curling mechanism to rotate according to the first control instruction so as to wind or unwind the flexible display screen; the detection part is used for detecting the unfolding degree information of the flexible display screen; and the processor is connected with the detection component and is used for adjusting the display image of the flexible display screen into a target display image according to the unfolding degree information of the flexible display screen. Therefore, it can be guaranteed that the flexible display screen can display the target display image in different unfolding states, the display image can be optimized and adjusted according to the actual visible area, the clearness and authenticity of the display image are kept, and the visual experience of a user is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of display devices, and in particular, to a display device and a display method thereof. Background Art

[0002] In recent years, with the widespread application of flexible visualization devices in the display industry, their unique flexible bending characteristics have become a major development trend. These devices can achieve various adjustments in physical form to adapt to different usage scenarios. However, as the size of the screen mechanism changes, the display size of the user-visible interface also needs to be adjusted synchronously to ensure the continuity and comfort of the visual experience. At present, a common solution is to stretch the display content to adapt to different screen sizes during the operation of the mechanism, so that the entire display remains in full screen. Although this method is simple, it has the following disadvantages:

[0003] First, due to the stretching of the displayed content, when the screen size changes, the image proportions will be out of balance and the resolution will change, which will cause image distortion; second, the current flexible display technology usually only supports fully expanded and fully rolled operating states, but no operations can be performed during the size change process, which limits the functionality and operational possibilities of the device during the sliding process; in addition, when the size of the flexible mechanism shrinks or expands, although the original display ratio can be maintained, unused black borders often appear at the edge of the display.

[0004] In summary, current flexible display devices have the disadvantages of poor display effects and image distortion when the screen size changes, thereby reducing the overall visual experience of users. Summary of the invention

[0005] The embodiments of the present application provide a display device and a display method thereof to solve the technical problem that the current flexible display device has the disadvantages of poor display effect and image distortion when the screen size changes, thereby reducing the overall visual experience of the user.

[0006] To solve the above technical problems, the embodiments of the present application provide the following aspects:

[0007] In a first aspect, an embodiment of the present application provides a display device, including:

[0008] Flexible display screen;

[0009] A rolling mechanism connected to one end of the flexible display screen and used for rolling up the flexible display screen;

[0010] A controller, configured to generate a first control instruction;

[0011] a driving mechanism connected to the controller and the rolling mechanism, and configured to drive the rolling mechanism to rotate according to the first control instruction, so as to roll up or unfold the flexible display screen;

[0012] A detection component, used to detect the expansion degree information of the flexible display screen;

[0013] The processor is connected to the detection component and is used to adjust the display image of the flexible display screen to a target display image according to the expansion degree information of the flexible display screen.

[0014] Optionally, the resolution of the target display image is a first resolution, and the first resolution is adapted to a visible display area of ​​the current flexible display screen.

[0015] Optionally, the driving mechanism includes: a motor, and the detection component includes a magnetic sensor and a magnet;

[0016] The magnet is located on the curling mechanism and is used to operate along with the operation of the curling mechanism;

[0017] The magnetic sensor is located on the motor and connected to the processor, and is used to sense the operation information of the magnet, and generate an electrical signal according to the operation information of the magnet, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

[0018] Optionally, also include:

[0019] A supporting component, the supporting component comprising a fixed housing, a motor platform and a bracket, wherein the motor platform and the bracket are both arranged on the fixed housing;

[0020] The driving mechanism comprises: a motor, and the motor is arranged on the motor platform;

[0021] The motor further comprises: a motor shaft, the motor shaft being arranged through the interior of the motor and extending to the exterior of the motor, and being used to operate according to the operation of the motor;

[0022] The detection component includes a magnetic sensor and a magnet;

[0023] The magnet is located on the motor shaft and is used to rotate along with the rotation of the electrode shaft;

[0024] The magnetic sensor is located on the bracket and connected to the processor, and is used to sense the operation information of the magnet, and generate an electrical signal according to the operation information of the magnet, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

[0025] Optionally, also include:

[0026] A support component, the support component comprising a bracket;

[0027] The driving mechanism comprises: a motor;

[0028] The detection component includes a light receiver and a light transmitter, and an opening is provided in the curling mechanism;

[0029] The light transmitter is located on the bracket and is used to transmit a light beam to the light receiver;

[0030] The light receiver is located on the motor, and is used to receive the light beam when the opening in the curling mechanism moves to be in a straight line with the light emitter and the light receiver, and to generate an electrical signal based on the change information of the light beam, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

[0031] In a second aspect, an embodiment of the present application provides a display method of a flexible display device, which is applied to the flexible display device of the first aspect, and the method includes:

[0032] According to the first control instruction, the rolling mechanism is driven to rotate so as to roll up or unfold the flexible display screen;

[0033] Detecting the expansion degree information of the flexible display screen;

[0034] According to the expansion degree information of the flexible display screen, the display image of the flexible display screen is adjusted to a target display image.

[0035] Optionally, the resolution of the target display image is a first resolution, and the first resolution is adapted to a visible display area of ​​the current flexible display screen.

[0036] Optionally, the first resolution is proportional to a display size of a current visible display area of ​​the flexible display screen.

[0037] Optionally, adjusting the display image of the flexible display screen to a target display image includes:

[0038] Performing background segmentation processing on the original image to be displayed on the flexible display screen to obtain a background area and a foreground area of ​​the original image;

[0039] Respectively adjusting the resolution of the background area and the resolution of the foreground area to obtain a background area and a foreground area with a first resolution;

[0040] The background area and the foreground area of ​​the first resolution are combined to obtain the target display image of the first resolution.

[0041] Optionally, adjusting the display image of the flexible display screen to a target display image includes:

[0042] Sending the original image to be displayed on the flexible display screen to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to the first resolution;

[0043] Receive the target display image with the first resolution sent by the cloud-based artificial intelligence server.

[0044] Optionally, adjusting the display image of the flexible display screen to a target display image includes:

[0045] receiving a second control instruction from a user;

[0046] adjusting the display image adjustment mode to the first adjustment mode according to the second control instruction;

[0047] According to the first adjustment mode, the display image of the flexible display screen is adjusted to the target display image every preset time period.

[0048] Optionally, adjusting the display image of the flexible display screen to a target display image includes:

[0049] Determining at least one pre-stored display size of the visible display area of ​​the flexible display screen according to user usage habits;

[0050] Determining, according to the pre-stored display size, a first resolution adapted to the pre-stored display size;

[0051] receiving a third control instruction;

[0052] According to the third control instruction, the display image adjustment mode is adjusted to the second adjustment mode;

[0053] According to the second adjustment mode, when the current size of the visible display area of ​​the flexible display screen is the pre-stored display size, the display image of the flexible display screen is adjusted to the target display image.

[0054] Optionally, adjusting the display image of the flexible display screen to a target display image includes:

[0055] receiving a fourth control instruction;

[0056] According to the fourth control instruction, the display image adjustment mode is adjusted to the third adjustment mode;

[0057] According to the third adjustment mode, the display image of the flexible display screen is adjusted to the target display image in real time.

[0058] Optionally, the first control instruction includes at least one of the following: a voice instruction, a touch instruction, a gesture instruction, and a key instruction.

[0059] The method shown in the embodiment of the present application discloses: a controller first generates a first control instruction, and the first control instruction is transmitted through a driving mechanism, thereby driving a curling mechanism connected thereto, and the curling mechanism can accurately adjust the unfolding or rolling state of the flexible display screen; in order to ensure that the image quality can be adjusted according to the unfolding state of the flexible display screen, the display device is also equipped with a detection component, which can detect the unfolding degree of the flexible display screen, and the processor can adjust its display image to a target display image according to the unfolding degree information of the flexible display screen, so that it adapts to the size of the visible display area of ​​the current display screen, thereby solving the image distortion problem caused by direct stretching of the image during the size transformation of the visible display area of ​​the flexible display screen, ensuring that the flexible display screen can display high-quality target display images that are compatible with its visible display area in different unfolding states, whether in a fully unfolded state or a partially curled state, the displayed image will be optimized and adjusted according to the actual unfolding degree information of the flexible display screen, so as to maintain the clarity and authenticity of the displayed image and improve the user's visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0061] Figure 1 A structural block diagram of a display device provided in an embodiment of the present application;

[0062] Figure 2A A schematic diagram of a rolled-up state of a flexible display screen provided in an embodiment of the present application;

[0063] Figure 2B A schematic diagram of an unfolded state of a flexible display screen provided in an embodiment of the present application;

[0064] Figure 3A A schematic diagram of a rolled-up state of a flexible display screen provided in an embodiment of the present application;

[0065] Figure 3B A schematic diagram of an unfolded state of a flexible display screen in a rolled-up manner provided in an embodiment of the present application;

[0066] Figure 4A A schematic diagram of a rolled-up state of a flexible display screen in a sliding state provided in an embodiment of the present application;

[0067] Figure 4B A schematic diagram of an unfolded state of a flexible display screen in a sliding state provided in an embodiment of the present application;

[0068] Figure 5 A schematic diagram of a module structure of a display device provided in an embodiment of the present application;

[0069] Figure 6 A schematic diagram of a configuration method of a detection component provided in an embodiment of the present application;

[0070] Figure 7 A schematic diagram of another configuration of a detection component provided in an embodiment of the present application;

[0071] Figure 8 A schematic diagram of another configuration of a detection component provided in an embodiment of the present application;

[0072] Fig. 9 A schematic diagram of another configuration of a detection component provided in an embodiment of the present application;

[0073] Fig.10 A schematic diagram of a flow chart of matching the unfolded state of a flexible display screen and the resolution of an image displayed on the display screen in a display device provided in an embodiment of the present application;

[0074] Fig.11 A flow chart of a display method of a display device provided in an embodiment of the present application;

[0075] Fig.12 A schematic diagram of adjusting a displayed image provided in an embodiment of the present application;

[0076] Fig.13 A schematic diagram of a display image segmentation method provided in an embodiment of the present application;

[0077] Fig.14 A schematic diagram of an adjustment method for displaying an image in a first image adjustment mode provided in an embodiment of the present application;

[0078] Fig.15 A schematic diagram of an adjustment method for displaying an image in a second adjustment mode provided by an embodiment of the present application;

[0079] Fig.16 A schematic diagram of another adjustment method for displaying an image in a second adjustment mode provided in an embodiment of the present application. DETAILED DESCRIPTION

[0080] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0081] Figure 1 A display device 10 provided according to an embodiment of the present application is shown. Figure 1 As shown, including:

[0082] Flexible display screen 1;

[0083] A rolling mechanism 2, connected to one end of the flexible display screen 1, for rolling up the flexible display screen 1;

[0084] A controller 4, configured to generate a first control instruction;

[0085] The driving mechanism 3 is connected to the controller 4 and the rolling mechanism 2, and is used to drive the rolling mechanism 2 to rotate according to the first control instruction to roll up or unfold the flexible display screen 1;

[0086] A detection component 5, used to detect the expansion degree information of the flexible display screen 1;

[0087] The processor 6 is connected to the detection component 5 and is used to adjust the display image of the flexible display screen 1 to a target display image according to the expansion degree information of the flexible display screen 1. The resolution of the target display image is a first resolution, and the first resolution is adapted to the visible display area of ​​the current flexible display screen 1.

[0088] The characteristics of the flexible display screen 1 enable it to adapt to different display requirements in terms of physical form, such as rolling up (such as Figure 2A as shown) or expanded (as Figure 2B The material of the flexible display screen 1 can be a polymer material such as CPI (Colorless Polyimide, transparent polyimide) and UTG (Ultra-Thin Glass, ultra-thin glass).

[0089] The curling mechanism 2 is connected to one end of the flexible display screen 1 and is mainly used to control the curling state of the flexible display screen 1. When the flexible display screen 1 needs to be rolled up or unfolded, the curling mechanism 2 will perform corresponding mechanical actions to achieve this change. The curling mechanism 2 can be as follows: Figure 3A , 3B , 4A, 4B. Among them, Figure 3A and Figure 3B The flexible display screen 1 is shown in the rolled-up and unfolded states in the rolled-up mode. FIG. 4A to FIG. 4B It shows that the size of the visible display area of ​​the flexible display screen 1 gradually increases in the sliding state.

[0090] The controller 4 is used to generate a first control instruction to instruct the drive mechanism 3 to drive the curling mechanism 2 to perform a corresponding mechanical action. The first control instruction is generated based on the actual needs of the user to optimize the display effect. The first control instruction includes at least one of the following: a voice instruction, a touch instruction, a gesture instruction, and a key instruction. The first control instruction can instruct the flexible display screen 1 to unfold or rewind, or perform other related operations, such as shutting down.

[0091] The driving mechanism 3 is responsible for converting the first control instruction issued by the controller 4 into an actual driving effect to drive the rotation of the curling mechanism 2. Whether it is rolling up or unfolding, the driving mechanism 3 can accurately execute the first control instruction of the controller 4 to ensure the smooth operation of the flexible display screen 1.

[0092] The detection component 5 is used to monitor the expansion degree of the flexible display screen 1. It can provide feedback information to inform the display device 10 of the current state of the flexible display screen 1, which is particularly important for subsequent image processing.

[0093] The processor 6 is connected to the detection component 5 and receives the information of the degree of expansion of the flexible display screen 1. Based on this information, the processor 6 can adjust the resolution of the image displayed by the flexible display screen 1 to ensure that the displayed content can adapt to the current visible display area. For example, if the flexible display screen 1 is expanded more, a higher resolution will be required to ensure the display quality; conversely, when the flexible display screen 1 is curled, the resolution may need to be reduced to adapt to the visible area.

[0094] In this way, efficient control and optimized display of the flexible display screen 1 can be achieved, so that it can always provide a clear and appropriate visual experience under dynamically changing conditions. This management mechanism not only improves the user experience, but also effectively extends the service life of the display screen.

[0095] like Figure 5 As shown, the whole system of the display device shown in the embodiment of the present application can be composed of the following modules, wherein the control module includes a sound receiving circuit, a position detection circuit (equivalent to the above-mentioned detection component 5), a motor drive circuit, a main board, a storage module, a WIFI (Wireless Fidelity) transmission module, an AI (Artificial Intelligence) image processing module and a sound recognition module.

[0096] Among them, the position detection circuit can be placed on the motor and sensed by means of magnetic sensors, optical sensors, etc.

[0097] The voice recognition module can process the input sound, including Fourier transform and time domain spectrogram analysis; perform feature extraction, such as linear prediction spectrum analysis; apply acoustic models, such as hidden Markov model, Bayesian maximum likelihood estimation and deep neural network; perform natural language understanding through decoder, etc. Finally, the recognized command will be sent to the main board, which is responsible for the transformation of the shape of the whole machine and the display resolution. The typical voice recognition method is: the user speaks the command through the microphone, the voice recognition module converts the received sound signal into text information, the system analyzes the text information and identifies the keywords, such as "expand", "close", "shutdown", and the main board determines the specific operation the user wants to perform based on these keywords. Finally, the main board performs the corresponding operation based on the judgment result.

[0098] This design of the whole system not only improves the interactivity and functionality of the display device, but also enables the display device to operate efficiently in a variety of environments and scenarios. For example, through the WIFI transmission module, the device can access the cloud server, update the algorithm in the AI ​​image processing module of the mainboard in real time through the cloud server, or directly process the image resolution through the cloud server, and then transmit the processed image back to the mainboard, enhancing its processing capabilities and the diversity of processing methods.

[0099] It should be noted that the detection component 5 has the following three different configuration modes.

[0100] In the first possible implementation, Figure 6 As shown, the driving mechanism 3 includes: a motor, and the detection component 5 includes a magnetic sensor and a magnet;

[0101] A magnet, located on the curling mechanism 2, and adapted to follow the operation of the curling mechanism 2;

[0102] The magnetic sensor is located on the motor and connected to the processor 6. It is used to sense the operation information of the magnet and generate an electrical signal according to the operation information of the magnet and send the electrical signal to the processor 6. The electrical signal is used to characterize the expansion degree information of the flexible display screen 1.

[0103] In the second possible implementation, Figure 7 or Figure 8 As shown, the display device further includes: a supporting component, the supporting component includes a fixed housing, a motor platform and a bracket, and the motor platform and the bracket are both arranged on the fixed housing;

[0104] The driving mechanism 3 comprises: a motor, which is arranged on a motor platform;

[0105] The motor further includes: a motor shaft, the motor shaft being disposed through the interior of the motor and extending to the exterior of the motor, and being configured to operate in accordance with the operation of the motor;

[0106] The detection component 5 includes a magnetic sensor and a magnet;

[0107] A magnet, located on the motor shaft, is used to follow the operation of the electrode shaft;

[0108] The magnetic sensor is located on the bracket and connected to the processor 6. It is used to sense the operation information of the magnet and generate an electrical signal according to the operation information of the magnet and send the electrical signal to the processor 6, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen 1.

[0109] In a third possible implementation, if Fig. 9 As shown, the display device also includes:

[0110] A supporting component, the supporting component comprising a bracket;

[0111] The driving mechanism 3 comprises: a motor;

[0112] The detection component 5 includes a light receiver and a light transmitter, and an opening is provided in the curling mechanism 2;

[0113] A light transmitter, located on the bracket, for transmitting a light beam to the light receiver;

[0114] The optical receiver is located on the motor and is used to receive the light beam when the opening in the curling mechanism 2 is in a straight line with the light emitter and the light receiver, and generate an electrical signal according to the change information of the light beam, and send the electrical signal to the processor 6, wherein the electrical signal is used to characterize the expansion degree information of the flexible display 1.

[0115] All three implementations are intended to monitor the degree of expansion of the flexible display screen 1 through different sensing and detection mechanisms, so as to perform real-time image adjustment and control. In the first implementation, the magnet is located on the curling mechanism 2 and rotates with the operation of the curling mechanism 2. Since the size of the curling mechanism 2 is large, the size of the magnet located on the curling mechanism 2 is also more optional, and magnets of different sizes can be selected for setting. The magnetic sensor is located on the motor, and by sensing the position change of the magnet, an electrical signal is generated and fed back to the processor 6, and the electrical signal can characterize the degree of expansion of the flexible display screen 1. The difference between the second implementation and the first implementation is that the position setting of the magnet and the magnetic sensor is different. The magnet is set on the motor shaft, and the magnetic sensor can be set on the bracket. Since the size of the motor shaft is small, the magnet can be a smaller magnet, but its induction principle is the same as the first method. It should be noted that in the first and second methods, a weak magnetic magnet can be selected to improve the stability, safety and accuracy of the display device, while reducing interference with the surrounding environment, so that the performance of the entire flexible display screen 1 display device is more reliable. In the third implementation, the detection component 5 is a light emitter and a light receiver, and the degree of expansion of the flexible display screen 1 can be determined by the on-off state of the light beam.

[0116] It should be noted that magnetic sensors may be more sensitive to environmental interference, such as electromagnetic interference, so the accuracy of detection may be affected in some environments, while optical sensors are not affected by electromagnetic interference, but are more sensitive to ambient light conditions, so it is necessary to ensure that the working environment has appropriate light. Both have their own advantages and disadvantages in terms of accuracy and reliability, and can be flexibly set according to actual needs to meet the diverse needs of users in different scenarios.

[0117] In summary, in the display device provided in the embodiment of the present application (such as Fig.10 As shown in the figure, first, the user can send a voice command (such as unfolding or closing), a key command (such as unfolding or closing) or a touch command (such as unfolding or closing) to the controller 4, and the controller 4 generates a first control instruction, which is transmitted through the driving mechanism 3, thereby driving the curling mechanism 2 connected thereto, and the curling mechanism 2 can accurately adjust the unfolding or rolling state of the flexible display screen 1. In order to ensure that the image quality can be adjusted according to the unfolding state of the flexible display screen 1, the display device is also equipped with a detection component 5 (equivalent to Fig.10 The position sensor shown in the figure can monitor the degree of expansion of the flexible display screen 1 and feed back the degree of expansion (the state of being expanded or closed) to the user. The processor 6 can adjust the resolution of the displayed image according to the expansion degree information of the flexible display screen 1 to adapt it to the size of the visible display area of ​​the current display screen. In this way, the image distortion problem caused by direct stretching of the image during the size transformation of the visible display area of ​​the deformable display screen can be solved, and it is ensured that the flexible display screen 1 can display high-quality images that are adapted to the visible display area in different expansion states. Whether it is in a fully expanded state or a partially curled state, the resolution of the displayed image will be optimized according to the size of the actual visible area to maintain clarity and authenticity, thereby improving the user's visual experience.

[0118] Fig.11 A display method of a display device provided according to an embodiment of the present application is shown, and the display method can be applied to Figure 1 The display device shown, the method includes:

[0119] Step S101: according to a first control instruction, driving the rolling mechanism to rotate so as to roll up or unfold the flexible display screen;

[0120] Step S102, detecting the expansion degree information of the flexible display screen;

[0121] Step S103: adjusting the display image of the flexible display screen to a target display image according to the expansion degree information of the flexible display screen.

[0122] The resolution of the target display image is the first resolution, the first resolution is adapted to the visible display area of ​​the current flexible display screen 1, and the first resolution is proportional to the display size of the visible display area of ​​the current flexible display screen 1. That is, as the flexible display screen is unfolded, the display size of its visible display area gradually increases, and the first resolution also gradually increases.

[0123] It should be noted that, for the application of the flexible display screen 1, such as rolling, curling, etc. (such as Figure 3A , 3B , 4A, and 4B), the display area of ​​the deformable display screen is covered by the entire device, resulting in its display area being divided into: a visible display area and an obstructed display area (winding area). Since the obstructed display area is hidden in the body of the deformable display device, the user cannot see the obstructed display area during use. In order to save power consumption, the obstructed display area can be displayed as a black screen (black picture display). When the deformable display screen is in operation (unfolded or rolled up), the sizes of its visible display area and the obstructed display area will change accordingly. When the deformable display screen is unfolded, the size of its original winding area decreases, and the size of the visible display area increases. If the original display ratio is still maintained at this time, black edges will be generated at the edges of the display screen (displayed content) in the visible display area. In order to maintain the full-screen display of the display screen, in the related art, the display screen is usually stretched and transformed. However, the stretching transformation can easily lead to an imbalance in the proportions of the image, resulting in problems such as image deformation and distortion, which affects the user's viewing experience. This can be achieved by Fig.11 The approach shown solves this problem.

[0124] In step S101, the first control instruction includes at least one of the following: a voice instruction, a touch instruction, a gesture instruction, and a key instruction. The first control instruction can instruct the flexible display screen 1 to unfold or retract, or perform other related operations, such as shutting down. Figure 1 The structure of the display device shown can drive the rolling mechanism 2 to rotate according to the first control instruction to roll up or unfold the flexible display screen 1.

[0125] It should be noted that for traditional LCD (Liquid Crystal Display) displays, hard materials can be selected to protect the display screen, such as a hard glass cover. In contrast, flexible OLED (Organic Light-Emitting Diode) displays require the selection of flexible materials, such as polymer materials CPI, UTG, etc. Compared with hard materials, flexible materials have a lower ability to protect the display screen. When users touch the display screen, especially when using a stylus pen to interact with the display screen, there is a risk of product failure. On this basis, the display method shown in the embodiment of the present application can increase the user's interaction methods with the flexible display screen 1. On the basis of touch display, physical button switches, voice recognition functions, gesture recognition functions, etc. can be added to enhance the diversity and flexibility of the interaction methods, avoid the risk of product failure, and enhance the user experience.

[0126] In step S102 and step S103, the expansion degree information of the flexible display screen 1 can be detected. This step involves a sensor (such as a light sensor, a magnetic sensor) to detect the specific expansion degree of the flexible display screen 1, and automatically adjust the resolution of the displayed image to the first resolution based on the expansion degree information to ensure the adaptability of the image in different expansion states, so that the display effect of the image can maintain the best quality in different states.

[0127] In summary, first, the user's instructions can be quickly recognized and responded to, making the operation intuitive and flexible; next, the flexible display screen 1 can be efficiently controlled to unfold or retract, so that the visual display can be effectively implemented; and by detecting the unfolding degree of the flexible display screen 1, accurate feedback of the screen state can be ensured, providing a reliable basis for subsequent image resolution adjustment. This dynamic adjustment can help optimize the display effect and ensure that users can obtain a clear and appropriate visual experience in different unfolding states of the flexible display screen 1, that is, the visible display area of ​​the flexible display screen 1 is at different display sizes.

[0128] In one possible implementation, adjusting the display image of the flexible display screen 1 to a target display image includes: performing background segmentation processing on the original image to be displayed on the flexible display screen 1 to obtain a background area and a foreground area of ​​the original image; adjusting the resolution of the background area and the resolution of the foreground area respectively to obtain a background area and a foreground area of ​​a first resolution; and combining the background area and the foreground area of ​​the first resolution to obtain a target display image of the first resolution.

[0129] In one possible implementation, adjusting the display image of the flexible display screen 1 to a target display image includes: sending the original image to be displayed on the flexible display screen 1 to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to a first resolution; and receiving the target display image with a resolution of the first resolution sent by the cloud-based artificial intelligence server.

[0130] It should be noted that in order to achieve the transformation of image resolution, an artificial intelligence-based image generation solution can be used. The image generation solution usually follows the following process: First, use OpenCV, GrabCut and other algorithms to segment the image background. These algorithms analyze the image's color, brightness, texture and other features to effectively extract the foreground and background. Next, use GAN (Generative Adversarial Networks), Inpainting and Super-Resolution and other technologies to further improve the image resolution. These methods can expand the background and adjust it to a first resolution that matches the size of the visible display area of ​​the current flexible display 1. Fig.12 A specific scenario of adjusting the resolution of a displayed image is shown.

[0131] Among them, OpenCV is an open source computer vision library that provides rich image processing and computer vision functions.

[0132] GrabCut is an image segmentation algorithm that separates the foreground and background through user markings and image color models.

[0133] GAN generative adversarial network is a machine learning model consisting of two neural networks (generator and discriminator). It generates new data samples through adversarial training and is often used for image generation and enhancement.

[0134] Inpainting is an image filling technology used to restore or repair missing parts in an image. It intelligently fills in the missing parts by using surrounding pixel information and is often used to remove defects in images.

[0135] Super-Resolution is a super-resolution technology that is used to generate high-resolution images from low-resolution images, and improve the details and clarity of the image through reconstruction and enhancement processes. Specifically, GAN can generate high-quality images, while Inpainting technology is used to fill in the missing parts of the image to ensure the integrity and naturalness of the image. At the same time, super-resolution technology can effectively enhance image details so that the image remains clear when it is enlarged. Through the above comprehensive process, high-quality image resolution transformation can be achieved, providing users with a better visual experience.

[0136] It should be noted that the GAN for image generation is a deep learning model and one of the most promising methods for unsupervised learning on complex distributions in recent years. The generative adversarial network for image generation produces good image output through game learning between the generative model and the discriminative model. It includes a generative model G (Generative Model), which is a neural network model used to generate an image G(z) based on the received random information z; a discriminative model (Discriminative Model), which is also a neural network model, used to judge the true situation of the image, that is, input a picture x, output D(x), indicating the percentage of the picture's authenticity (that is, the probability that the input image is a real image); a loss function L (Loss Function), which is used to evaluate the loss between the model and the actual situation. For the generative model, the loss function can be defined as: L G =H(1,D(G(z)), which represents the loss between the generated image and the real image; for the discriminative model, the loss function is defined as: L D =H(1,D(x))+H(0,D(G(z))), which represents the loss between the correct judgment of the discriminant model for the real image (the difference between the output and the real situation) and the judgment of the generated image (the sum of the output and the false situation). During the training process, the loss function is minimized by optimizing the target, and the following form is obtained: Where x represents a real image, z represents the noise input to the generative model G, G(z) represents the image generated by the generative network, and D(*) represents the probability judgment of the discriminative network on the authenticity of the image. Through this training process, the generative model G and the discriminative model D continue to compete with each other, G continuously improves the quality of the generated images, and D also continuously improves its ability to judge the real and generated images. Ultimately, GAN generates high-quality images through this adversarial training, demonstrating its strong ability in the field of image generation.

[0137] The method shown in the embodiment of the present application can achieve a solution for scaling the original image (changing the resolution of the image) and automatically generating a new image through an AI image generation algorithm, so as to solve the image distortion problem caused by direct stretching of the image during the size transformation of the visible display area of ​​the deformable display screen in the related art.

[0138] The following specifically describes how to adjust the display image of the flexible display screen 1 to a target display image in three different image adjustment modes, and the resolution of the target display image is the first resolution.

[0139] In one possible implementation, adjusting the display image of the flexible display screen 1 to a target display image includes: receiving a second control instruction from a user; adjusting the display image adjustment mode to a first adjustment mode according to the second control instruction; and adjusting the display image of the flexible display screen 1 to a target display image every preset time period according to the first adjustment mode.

[0140] The first adjustment mode can also be called a step-by-step adjustment mode. In this adjustment mode, the resolution of the displayed image is gradually adjusted every preset time period. The first resolution is a variable, representing the resolution of the displayed image adapted to the visible display area of ​​the flexible display screen 1 after each adjustment. In a specific application scenario, such as Fig.13 As shown, for the original image A, the AI ​​image generation algorithm can be used to first generate images B1 and B2 according to the maximum resolution of the original image A, and then B1 and B2 can be cut according to the running speed, such as cutting B2 into B21 and B2. 2， B23, ..., B2 N , N is the total number of cuts of B2 image, when the running distance is When x is the width of the B2 image, the figure shows the movement from the left end of the original image A to the leftmost end, and the image is updated to the combination of B11+A+B21 (the same applies to B1). Run again at the next moment Distance, that is, the total running distance is When the image is updated to B12+A+B22, the image is updated to B12+A+B22, and so on until the final image movement distance x, the image is updated to B1 N +A+B2 N Correspondingly, the flowchart of image generation is as follows Fig.14 It should be noted that the method shown in 13 is only an exemplary description, that is, the main content of the picture is located in the middle, and both the left and right sides can be expanded and loaded. In actual implementation, only A1 or only B1 can be recorded, or the upper or lower end of the picture can be recorded, and the embodiment of the present application does not limit this.

[0141] Therefore, the display image of the flexible display screen 1 can be adjusted to the target display image at every preset time period, that is, the resolution of the display image of the flexible display screen 1 can be adjusted to the first resolution without real-time adjustment, thereby avoiding frequent scheduling of the AI ​​image generation algorithm and saving resources while ensuring user experience.

[0142] In one possible implementation, adjusting the display image of the flexible display screen 1 to a target display image includes: determining at least one pre-stored display size of a visible display area of ​​the flexible display screen 1 according to user usage habits; determining a first resolution adapted to the pre-stored display size according to the pre-stored display size; receiving a third control instruction; adjusting the display image adjustment mode to a second adjustment mode according to the third control instruction; according to the second adjustment mode, when the size of the current visible display area of ​​the flexible display screen 1 is the pre-stored display size, adjusting the display image of the flexible display screen 1 to the target display image.

[0143] It should be noted that, in the user habit adjustment mode, at least one size that the user is accustomed to using, that is, the pre-stored display size, can be pre-stored, and the resolution corresponding to it can also be pre-stored, and each time it is used, if it is detected that the size of the current visible display area of ​​the flexible display screen 1 is the pre-stored display size, the resolution of the display image of the flexible display screen 1 is adjusted to the first resolution, and in a specific application scenario, it is still based on Fig.13 Taking the picture shown in the figure as an example, the flowchart of picture generation is as follows Fig.15 and Fig.16 As shown, Fig.15 This is the overall flow chart of picture generation in the second adjustment mode. Fig.16 This is an exemplary flow chart for pre-storing three display sizes. Thus, by pre-storing the display sizes and resolutions commonly used by users, a more personalized user experience can be provided, which can ensure that users have a consistent visual experience in multiple uses, which is particularly useful in multi-scene use or multi-device environments. In addition, since there is already pre-stored size and resolution information, the image resolution can be quickly adjusted without recalculating or processing each time, and the image generation time is shorter, thereby reducing delays and improving response speed.

[0144] In a possible implementation, adjusting the display image of the flexible display screen 1 to the target display image includes: receiving a fourth control instruction; adjusting the display image adjustment mode to the third adjustment mode according to the fourth control instruction; and adjusting the display image of the flexible display screen 1 to the target display image in real time according to the third adjustment mode. Thus, by adjusting the mode in real time, the flexible display screen 1 can better meet the immediate needs of the user and provide a smoother and higher-quality visual experience.

[0145] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0146] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0147] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A display device, characterized in that: include: Flexible display screen; A rolling mechanism connected to one end of the flexible display screen and used for rolling up the flexible display screen; A controller, configured to generate a first control instruction; a driving mechanism connected to the controller and the rolling mechanism, and configured to drive the rolling mechanism to rotate according to the first control instruction, so as to roll up or unfold the flexible display screen; A detection component, used to detect the expansion degree information of the flexible display screen; The processor is connected to the detection component and is used to adjust the display image of the flexible display screen to a target display image according to the expansion degree information of the flexible display screen.

2. The device according to claim 1, characterized in that The resolution of the target display image is a first resolution, and the first resolution is adapted to a visible display area of ​​the current flexible display screen.

3. The device according to claim 1, characterized in that The driving mechanism comprises: a motor, and the detection component comprises a magnetic sensor and a magnet; The magnet is located on the curling mechanism and is used to operate along with the operation of the curling mechanism; The magnetic sensor is located on the motor and connected to the processor, and is used to sense the operation information of the magnet, and generate an electrical signal according to the operation information of the magnet, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

4. The device according to claim 1, characterized in that Also includes: A supporting component, the supporting component comprising a fixed housing, a motor platform and a bracket, wherein the motor platform and the bracket are both arranged on the fixed housing; The driving mechanism comprises: a motor, which is arranged on the motor platform; The motor further comprises: a motor shaft, the motor shaft being arranged through the interior of the motor and extending to the exterior of the motor, and being used to operate according to the operation of the motor; The detection component includes a magnetic sensor and a magnet; The magnet is located on the motor shaft and is used to rotate along with the rotation of the motor shaft; The magnetic sensor is located on the bracket and connected to the processor, and is used to sense the operation information of the magnet, and generate an electrical signal according to the operation information of the magnet, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

5. The device according to claim 1, characterized in that Also includes: A support component, the support component comprising a bracket; The driving mechanism comprises: a motor; The detection component includes a light receiver and a light transmitter, and an opening is provided in the curling mechanism; The light transmitter is located on the bracket and is used to transmit a light beam to the light receiver; The light receiver is located on the motor, and is used to receive the light beam when the opening in the curling mechanism moves to be in a straight line with the light emitter and the light receiver, and to generate an electrical signal based on the change information of the light beam, and send the electrical signal to the processor, wherein the electrical signal is used to characterize the expansion degree information of the flexible display screen.

6. A display method of a display device, characterized in that: Applied to the flexible display device according to any one of claims 1 to 5, the method comprises: According to the first control instruction, the rolling mechanism is driven to rotate so as to roll up or unfold the flexible display screen; Detecting the expansion degree information of the flexible display screen; According to the expansion degree information of the flexible display screen, the display image of the flexible display screen is adjusted to a target display image.

7. The method according to claim 6, characterized in that The resolution of the target display image is a first resolution, and the first resolution is adapted to a visible display area of ​​the current flexible display screen.

8. The method according to claim 7, characterized in that The first resolution is proportional to the display size of the current visible display area of ​​the flexible display screen.

9. The method according to claim 7, characterized in that: Adjusting the display image of the flexible display screen to a target display image includes: Performing background segmentation processing on the original image to be displayed on the flexible display screen to obtain a background area and a foreground area of ​​the original image; Respectively adjusting the resolution of the background area and the resolution of the foreground area to obtain a background area and a foreground area with a first resolution; The background area and the foreground area of ​​the first resolution are combined to obtain the target display image of the first resolution.

10. The method according to claim 7, characterized in that Adjusting the display image of the flexible display screen to a target display image includes: Sending the original image to be displayed on the flexible display screen to a cloud-based artificial intelligence server, wherein the cloud-based artificial intelligence server is used to adjust the resolution of the original image to the first resolution; Receive the target display image with the first resolution sent by the cloud-based artificial intelligence server.

11. The method according to any one of claims 7 to 10, characterized in that Adjusting the display image of the flexible display screen to a target display image includes: receiving a second control instruction from a user; adjusting the display image adjustment mode to the first adjustment mode according to the second control instruction; According to the first adjustment mode, the display image of the flexible display screen is adjusted to the target display image every preset time period.

12. The method according to any one of claims 7 to 10, characterized in that Adjusting the display image of the flexible display screen to a target display image includes: Determining at least one pre-stored display size of the visible display area of ​​the flexible display screen according to user usage habits; Determining, according to the pre-stored display size, a first resolution adapted to the pre-stored display size; receiving a third control instruction; According to the third control instruction, the display image adjustment mode is adjusted to the second adjustment mode; According to the second adjustment mode, when the current size of the visible display area of ​​the flexible display screen is the pre-stored display size, the display image of the flexible display screen is adjusted to the target display image.

13. The method according to any one of claims 7 to 10, characterized in that Adjusting the display image of the flexible display screen to a target display image includes: receiving a fourth control instruction; According to the fourth control instruction, the display image adjustment mode is adjusted to the third adjustment mode; According to the third adjustment mode, the display image of the flexible display screen is adjusted to the target display image in real time.

14. The method according to claim 6, characterized in that The first control instruction includes at least one of the following: a voice instruction, a touch instruction, a gesture instruction, and a key instruction.

Images