Image presentation method and display device

Abstract

The invention provides an image presentation method and a display device. The method comprises the following steps: defining a visible area in a display interface of the foldable display through a first application program interface; detecting an entity state of the foldable display; in response to the fact that the entity state of the foldable display is a folded state, dividing the visible area into a first sub-visible area and a second sub-visible area; the first desktop image and the second desktop image are respectively presented in the first sub-visual area and the second sub-visual area through the second application program interface, and one of the first desktop image and the second desktop image comprises a toolbar image; and the presentation position of the toolbar image in the first sub-visual area or the second sub-visual area is variable. Therefore, the operation experience of a user for the foldable display can be improved.

Description

Technical Field

[0001] The present invention relates to an image display technology, and in particular to an image presentation method and a display device. Background Art

[0002] With the advancement of technology, display devices with foldable displays (such as smartphones or laptops) have appeared on the market. However, under the common Microsoft Windows operating system (OS) or Apple iOS architecture, the layout and presentation of desktop images presented by any type of display are fixed, and cannot be customized for the foldable characteristics of the display. Therefore, in some cases, it may cause trouble for users when operating the foldable display. Summary of the invention

[0003] The present invention provides an image presentation method and a display device, which can improve the user's operating experience for a foldable display.

[0004] An embodiment of the present invention provides an image presentation method, which is used for a display device. The display device includes a foldable display. The image presentation method includes: defining a visible area in the display interface of the foldable display through a first application interface; detecting the physical state of the foldable display; in response to the physical state of the foldable display being a folded state, dividing the visible area into a first sub-visible area and a second sub-visible area; and presenting a first desktop image and a second desktop image in the first sub-visible area and the second sub-visible area respectively through a second application interface, wherein one of the first desktop image and the second desktop image includes a toolbar image, and the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is variable.

[0005] An embodiment of the present invention further provides a display device, which includes a foldable display and a processor. The processor is connected to the foldable display. The processor is used to: define a visible area in the display interface of the foldable display through a first application interface; detect the physical state of the foldable display; in response to the physical state of the foldable display being a folded state, divide the visible area into a first sub-visible area and a second sub-visible area; and present a first desktop image and a second desktop image in the first sub-visible area and the second sub-visible area respectively through a second application interface, wherein one of the first desktop image and the second desktop image includes a toolbar image, and the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is variable.

[0006] Based on the above, a visual area can be defined in the display interface of the foldable display through a first application interface. After detecting that the physical state of the foldable display is a folded state, the visual area can be divided into a first sub-visible area and a second sub-visible area. Thereafter, the first desktop image and the second desktop image can be presented in the first sub-visible area and the second sub-visible area respectively through a second application interface. In particular, one of the first desktop image and the second desktop image may include a toolbar image, and the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is variable. Therefore, compared with the traditional layout and presentation method of the desktop image presented by the display, which are fixed, the image presentation method and display device proposed in the present invention can effectively improve the user's operating experience for the foldable display. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a functional block diagram of a display device according to an embodiment of the present invention;

[0008] Figure 2A is a schematic diagram showing that the physical state of the foldable display according to an embodiment of the present invention is a non-folded state;

[0009] Figure 2B and Figure 2C is a schematic diagram showing that the physical state of the foldable display is a folded state according to an embodiment of the present invention;

[0010] Figure 3A is a schematic diagram showing an original desktop image and a toolbar image according to an embodiment of the present invention;

[0011] FIG. 3B to FIG. 3D is a schematic diagram showing a first desktop image, a second desktop image and a toolbar image according to an embodiment of the present invention;

[0012] Figure 4A is a schematic diagram showing how to present an application image in an original visual area according to an embodiment of the present invention;

[0013] Figure 4B is a schematic diagram showing how to present an application image in a sub-visual area according to an embodiment of the present invention;

[0014] Figure 5 is a flowchart of an image presenting method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0015] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0016] Figure 1 is a functional block diagram of a display device according to an embodiment of the present invention. Figure 1 The display device 10 may include various electronic devices with display functions, such as a smart phone, a tablet computer, a notebook computer, an e-reader, or a game console.

[0017] The display device 10 may include a foldable display 11, a storage circuit 12, an input / output (IO) device 13, and a processor 14. The foldable display 11 is used to display images and has a folding function. For example, the foldable display 11 may include a plasma display, a liquid crystal display (LCD), a thin film transistor (TFT) liquid crystal display, a light emitting diode (LED) display, or an organic light emitting diode (OLED) display. It should be noted that the display type of the foldable display 11 is not limited thereto.

[0018] The storage circuit 12 is used to store data. For example, the storage circuit 12 may include a volatile storage circuit and a non-volatile storage circuit. The volatile storage circuit is used to store data volatilely. For example, the volatile storage circuit may include a random access memory (RAM) or a similar volatile storage medium. The non-volatile storage circuit is used to store data non-volatilely. For example, the non-volatile storage circuit may include a read-only memory (ROM), a solid state disk (SSD), a traditional hard disk drive (HDD) or a similar non-volatile storage medium. It should be noted that the type of the storage circuit 12 is not limited thereto.

[0019] The input / output device 13 is used to receive input signals or send output signals. For example, the input / output device 13 may include a physical keyboard, a touch panel, a mouse, a network interface card and / or a speaker. It should be noted that the type of the input / output device 13 is not limited thereto.

[0020] The processor 14 is connected to the foldable display 11, the storage circuit 12, and the input / output device 13. The processor 14 can be used to be responsible for the overall or partial operation of the display device 10. For example, the processor 14 can be a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSP), programmable controllers, application specific integrated circuits (ASIC), programmable logic devices (PLD), or other similar devices or combinations of these devices.

[0021] In one embodiment, the storage circuit 12 stores application programming interfaces (APIs) 101 and 102. In one embodiment, the application programming interface 101 is also referred to as a first application programming interface, and / or the application programming interface 102 is also referred to as a second application programming interface. The processor 14 can control the foldable display 11 through the application programming interfaces 101 and 102.

[0022] In one embodiment, the application program interface 101 is used to define one or more visible areas in the display interface of the foldable display 11. Each visible area may cover a portion of the display area in the display interface of the foldable display 11. In addition, the resolution of each visible area may be expressed as N pixels×M pixels. For example, the application program interface 101 may include OpenXRAPI, but the type of the application program interface 101 is not limited thereto.

[0023] In one embodiment, the application program interface 102 is used to control the image to be presented in the visual area. For example, the application program interface 102 may include Intel Display Pipes MPO API, and the type of the application program interface 102 is not limited thereto.

[0024] In one embodiment, the processor 14 may detect the physical state of the foldable display 11. For example, the physical state of the foldable display 11 may include a folded state and a non-folded state (also referred to as a flat state). For example, when the foldable display 11 is folded, the physical state of the foldable display 11 is the folded state. In addition, when the foldable display 11 is not folded, the physical state of the foldable display 11 is the non-folded state.

[0025] In one embodiment, in response to the physical state of the foldable display 11 being the unfolded state, the processor 14 may define a visible area (also referred to as an original visible area) in the display interface of the foldable display 11 through the application program interface 101. For example, the original visible area may cover the entire display area of ​​the display interface of the foldable display 11. Then, the processor 14 may present the desktop image (also referred to as the original desktop image) in the original visible area through the application program interface 102.

[0026] In one embodiment, in response to the physical state of the foldable display 11 being a folded state, the processor 14 may divide the original visible area into multiple visible areas (also referred to as sub-visible areas) through the application program interface 101. For example, these sub-visible areas may include a first sub-visible area and a second sub-visible area. For example, the first sub-visible area and the second sub-visible area may respectively cover a portion of the display area of ​​the display interface of the foldable display 11, and the first sub-visible area and the second sub-visible area do not overlap with each other. In addition, the resolution of the first sub-visible area may be greater than, less than, or equal to the resolution of the second sub-visible area. Then, the processor 14 may present multiple desktop images in these sub-visible areas respectively through the application program interface 102. In one embodiment, the desktop image presented in the first sub-visible area is also referred to as the first desktop image, and / or the desktop image presented in the second sub-visible area is also referred to as the second desktop image.

[0027] In one embodiment, assuming that the resolution of the display interface of the foldable display 11 is 2560×1920, the resolution of the original visible area can be 2560×1920, the resolution of the first sub-visible area can be 2560×1440, and the resolution of the second sub-visible area can be 2560×480. It should be noted that the resolution of the original visible area and each sub-visible area can be adjusted according to practical needs, and the present invention is not limited. In one embodiment, the number of the original visible area and the sub-visible area can also be adjusted according to practical needs, and the present invention is not limited.

[0028] In one embodiment, one of the first desktop image and the second desktop image includes a toolbar image. In particular, the presentation position of the toolbar image in the first sub-visual area or the second sub-visual area is variable. For example, at a certain time point (also referred to as the first time point), the toolbar image may be presented at a certain position in the first sub-visual area (also referred to as the first position). At another time point (also referred to as the second time point), the toolbar image may be presented at a certain position in the second sub-visual area (also referred to as the second position). In addition, both the first position and the second position may be dynamically determined or adjusted by the user.

[0029] In one embodiment, the processor 14 may obtain the toolbar configuration information. For example, the processor 14 may read the toolbar configuration information from the storage circuit 12. The toolbar configuration information may carry information (e.g., coordinate information) of the presentation position of the toolbar image in the first sub-visible area and / or the second sub-visible area. In response to the physical state of the foldable display 11 being the folded state, the processor 14 may present the toolbar image in the first sub-visible area or the second sub-visible area according to the toolbar configuration information. In one embodiment, the toolbar image may also be presented in the first sub-visible area and the second sub-visible area at the same time.

[0030] In one embodiment, the processor 14 may receive a user operation via the input / output interface 13. The processor 14 may update the toolbar configuration information according to the user operation to adjust the presentation position of the toolbar image in the first sub-visual area and / or the second sub-visual area. For example, it is assumed that the original toolbar configuration information defines the first position where the toolbar image is presented in the first sub-visual area. After the toolbar configuration information is updated according to the user operation, the updated toolbar configuration information may adjust the first position or change the toolbar image to a second position in the second sub-visual area.

[0031] In one embodiment, the toolbar configuration information may also carry information (e.g., coordinate information) of the presentation position of the toolbar image in the original visible area. In response to the physical state of the foldable display 11 being the unfolded state, the processor 14 may present the toolbar image in the original visible area according to the toolbar configuration information.

[0032] In one embodiment, the processor 14 may present at least one button (also referred to as a virtual button) in the toolbar image. Each virtual button is used to start an application (also referred to as a target application). In one embodiment, the toolbar configuration information may also carry configuration information of the virtual button. The processor 14 may present the virtual button in the toolbar image according to the toolbar configuration information. In one embodiment, the processor 14 may also update the toolbar configuration information according to the user operation to adjust the configuration information of the virtual button, such as changing the total number, type and / or order of the virtual buttons presented in the toolbar image.

[0033] Traditionally, due to the restrictions of the operating system, when the foldable display 11 is in the folded state, the toolbar image can only be presented at a fixed position, which is not very convenient to use. In one embodiment, by running the application program interfaces 101 and 102, the processor 14 can customize one or more visual areas (such as the original visual area and multiple sub-visual areas) in the display interface of the foldable display 11 and customize the images presented in the visual areas, thereby improving the flexibility of system operation. In addition, through the dynamically updateable toolbar configuration information, the processor 14 can control the toolbar image to be presented at any position in any visual area according to the user's needs, thereby effectively improving the user experience.

[0034] Figure 2A is a schematic diagram showing that the physical state of the foldable display according to an embodiment of the present invention is a non-folded state. Figure 1 and Figure 2A , assuming that the display device 10 includes a display device 20, and the foldable display 11 includes a foldable display 21. The foldable display 21 may present an image through a display interface 22. In one embodiment, the display device 20 may further include a physical keyboard 23. For example, the physical keyboard 23 may belong to Figure 1 Alternatively, in one embodiment, the display device 20 may not have a physical keyboard 23.

[0035] In one embodiment, in response to the physical state of the foldable display 21 being the unfolded state (eg, Figure 2A As shown in FIG. 1 , the processor 14 may define a visible area 210 (ie, an original visible area) in the display interface 22 of the foldable display 21 through the application program interface 101. For example, the visible area 210 may cover the entire display area of ​​the display interface 22.

[0036] Figure 2B and Figure 2C is a schematic diagram showing that the physical state of the foldable display according to an embodiment of the present invention is a folded state. Figure 1 , Figure 2B and Figure 2C In one embodiment, in response to the physical state of the foldable display 21 being the folded state, the processor 14 may define visible areas 211 and 212 in the display interface 22 of the foldable display 21 through the application program interface 101. It should be noted that one of the visible areas 211 and 212 may be a first sub-visible area, and the other of the visible areas 211 and 212 may be a second sub-visible area.

[0037] In one embodiment, the visible areas 211 and 212 are distinguished by a virtual dividing line 201 in the display interface 22. For example, when the physical state of the foldable display 21 is the folded state, the display area on one side of the virtual dividing line 201 in the display interface 22 can be defined as the visible area 211, and the display area on the other side of the virtual dividing line 201 in the display interface 22 can be defined as the visible area 212. In addition, the virtual dividing line 201 can be located at the folded position of the foldable display 21 (such as Figure 2B and Figure 2C shown).

[0038] In one embodiment, when the physical state of the foldable display 21 is the folded state, the foldable display 21 may be in the folded state folded inwards (eg, Figure 2B ) or folded outward (as shown Figure 2C In one embodiment, the foldable display 21 can support two folding states: folding inwards and folding outwards. Alternatively, in one embodiment, the foldable display 21 can also support only one of the folding states: folding inwards and folding outwards, and the present invention is not limited thereto.

[0039] In one embodiment, when the foldable display 21 is in a folded state (eg, Figure 2B ), the image presentation direction of the image in the viewing area 211 is the same as the image presentation direction of the image in the viewing area 212. However, when the foldable display 21 is in the outwardly folded state (as shown in FIG. Figure 2C As shown), the image presentation direction of the image in the viewing area 211 will be changed (eg, turned upside down), so that users located on both sides of the display device 20 can view the images presented in the viewing areas 211 and 212 respectively.

[0040] Figure 3A is a schematic diagram showing an original desktop image and a toolbar image according to an embodiment of the present invention. Figure 3A In one embodiment, when the physical state of the foldable display 21 is the unfolded state, the desktop image A (i.e., the original desktop image) may be presented in the visible area 210 (i.e., the original visible area). At the same time, the toolbar image 31 may be presented at a position 301 in the visible area 210. For example, virtual buttons 311 to 314 may be presented in the toolbar image 31. The virtual buttons 311 to 314 are respectively used to start corresponding applications (i.e., target applications).

[0041] FIG. 3B to FIG. 3D is a schematic diagram showing a first desktop image, a second desktop image and a toolbar image according to an embodiment of the present invention. Figure 3BIn one embodiment, at a certain time point, when the physical state of the foldable display 21 is the folded state folded inward, the desktop image A1 (i.e., the first desktop image) and the desktop image A2 (i.e., the second desktop image) can be respectively presented in the visible area 211 (i.e., the first sub-visible area) and the visible area 212 (i.e., the second sub-visible area). At the same time, the toolbar image 31 can be presented at the position 302 in the visible area 212.

[0042] Please refer to Figure 3C and Figure 3D In one embodiment, at another time point, when the physical state of the foldable display 21 is a folded state folded outward, the desktop image A3 (ie, the first desktop image) and the desktop image A2 can be presented in the visible areas 211 and 212 respectively. It should be noted that Figure 3D The image presentation direction of the desktop image A3 can be Figure 3B The image presentation direction of the desktop image A1 in the image is opposite (e.g., upside down). At the same time, the toolbar image 31 can be presented at the position 302 in the visual area 212 or the position 303 in the visual area 211. Alternatively, in one embodiment, the toolbar image 31 can also be presented at the positions 302 and 303 at the same time, and the present invention is not limited thereto. In one embodiment, one of the positions 301-303 can be the first position, and another of the positions 301-303 can be the second position.

[0043] It should be noted that the toolbar image 31 is FIG. 3A to FIG. 3D The presentation position of the virtual buttons 311 to 314 in the toolbar image 31 can be adjusted according to the toolbar configuration information and practical needs, such as moving up or down, or can be changed to the left or right side of any visible area, etc., and the present invention is not limited. In addition, the configuration of the virtual buttons 311 to 314 in the toolbar image 31 can also be adjusted according to practical needs, and more useful information (such as Figure 1 The power information or network connection information of the display device 10, etc.) can also be presented in the toolbar image 31, and the present invention is not limited thereto.

[0044] Back to Figure 1 In one embodiment, when the physical state of the foldable display 11 is the unfolded state, the processor 14 may present the target image in the original visible area through the application program interface 102. For example, the target image may include an application program image. Compared with the desktop image, the application program image may present the execution screen of the application program currently running in the foreground of the processor 14.

[0045] In one embodiment, in response to the physical state of the foldable display 11 being the folded state, the processor 14 may completely present the target image in a certain sub-visible area (e.g., the first sub-visible area or the second sub-visible area) through the application program interface 102. In one embodiment, in response to the physical state of the foldable display 11 being the folded state, the processor 14 may also dynamically adjust the display parameters (e.g., resolution) of the target image to meet the display requirement of completely presenting the target image in the first sub-visible area or the second sub-visible area.

[0046] Figure 4A is a schematic diagram showing how to present an application image in an original visual area according to an embodiment of the present invention. Figure 4A In one embodiment, when the physical state of the foldable display 21 is the unfolded state, the application image B can be presented in the visible area 210 (ie, the original visible area). For example, the application image B can be completely presented in the visible area 210.

[0047] Figure 4B is a schematic diagram showing how to present an application image in a sub-visual area according to an embodiment of the present invention. Figure 4B In one embodiment, when the physical state of the foldable display 21 is the folded state, the application image B can be switched to be presented in the visible area 211 (ie, the first sub-visible area).

[0048] In one embodiment, according to the size and / or resolution of the visible area 211, the display parameters (e.g., resolution) of the application image B may be dynamically adjusted to meet the display requirement of fully presenting the application image B in the visible area 211. In addition, while the application image B is presented in the visible area 211, the desktop image A2 (i.e., the second desktop image) or other application images may be presented in the visible area 212 (i.e., the second sub-visible area).

[0049] It should be noted that in Figure 4B In another embodiment, when the physical state of the foldable display 11 is the folded state, the application image B can also be switched to be presented in the visible area 212 (i.e., the second sub-visible area). At the same time, the display parameters (e.g., resolution) of the application image B can be dynamically adjusted according to the size and / or resolution of the visible area 212.

[0050] Figure 5 is a flow chart of an image presentation method according to an embodiment of the present invention. Figure 5In step S501, a visual area is defined in the display interface of the foldable display through the first application interface. In step S502, the physical state of the foldable display is detected. In step S503, it is determined whether the physical state of the foldable display is a folded state. If the physical state of the foldable display is a folded state, in step S504, the visual area is divided into a first sub-visible area and a second sub-visible area. In step S505, the first desktop image and the second desktop image are presented in the first sub-visible area and the second sub-visible area respectively through the second application interface. It should be noted that one of the first desktop image and the second desktop image includes a toolbar image, and the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is variable. However, if step S503 is judged as no, it can return to step S501. In addition, after step S505, step S502 can be repeatedly executed.

[0051] However, Figure 5 The steps in the above are described in detail, so I will not repeat them here. It is worth noting that Figure 5 Each step in the above process can be implemented as multiple program codes or circuits, and the present invention is not limited thereto. Figure 5 The method can be used in conjunction with the above exemplary embodiments or can be used alone, and the present invention is not limited thereto.

[0052] In summary, by running the first application program interface (e.g., OpenXR API) and the second application program interface (e.g., Intel Display Pipes MPO API), the image presentation method and display device proposed by the present invention can define one or more visual areas (e.g., the original visual area and multiple sub-visual areas) in the display interface of the foldable display and customize the image presented in the visual area, thereby improving the flexibility of system operation. In addition, through the dynamically updateable toolbar configuration information, the toolbar image can also be presented at any position in any visual area according to the user's needs, thereby effectively improving the user experience.

[0053] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An image presentation method, characterized in that: For a display device, wherein the display device comprises a foldable display, and the image presentation method comprises: defining a visible area in a display interface of the foldable display through a first application program interface; detecting a physical state of the foldable display; In response to the physical state of the foldable display being a folded state, dividing the visible area into a first sub-visible area and a second sub-visible area; and The first desktop image and the second desktop image are presented in the first sub-visible area and the second sub-visible area respectively through the second application program interface, One of the first desktop image and the second desktop image includes a toolbar image, and a presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is changeable.

2. The image presentation method according to claim 1, wherein the step of presenting the first desktop image and the second desktop image in the first sub-visual area and the second sub-visual area respectively through the second application program interface comprises: Get toolbar configuration information; as well as The toolbar image is presented in the first sub-visible area or the second sub-visible area according to the toolbar configuration information.

3. The image presentation method according to claim 2, further comprising: Receive user operations; as well as The toolbar configuration information is updated according to the user operation to adjust the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area.

4. The image presentation method according to claim 1, further comprising: At least one virtual button is presented in the toolbar image, wherein each virtual button is used to activate a target application.

5. The image presentation method according to claim 1, further comprising: When the physical state of the foldable display is a non-folded state, presenting a target image in the visible area through the second application program interface; as well as In response to the physical state of the foldable display being the folded state, the target image is completely presented in the first sub-visual area or the second sub-visual area through the second application program interface.

6. A display device, characterized in that: include: Foldable displays; as well as a processor connected to the foldable display, The processor is used to: defining a visible area in a display interface of the foldable display through a first application program interface; detecting a physical state of the foldable display; In response to the physical state of the foldable display being a folded state, dividing the visible area into a first sub-visible area and a second sub-visible area; as well as The first desktop image and the second desktop image are presented in the first sub-visible area and the second sub-visible area respectively through the second application program interface, One of the first desktop image and the second desktop image includes a toolbar image, and a presentation position of the toolbar image in the first sub-visible area or the second sub-visible area is changeable.

7. The display device according to claim 6, wherein the operation of the processor presenting the first desktop image and the second desktop image in the first sub-visible area and the second sub-visible area respectively through the second application program interface comprises: Get toolbar configuration information; as well as The toolbar image is presented in the first sub-visible area or the second sub-visible area according to the toolbar configuration information.

8. The display device according to claim 7, wherein the processor is further configured to: Receive user actions; and The toolbar configuration information is updated according to the user operation to adjust the presentation position of the toolbar image in the first sub-visible area or the second sub-visible area.

9. The display device according to claim 6, wherein the processor is further configured to: At least one virtual button is presented in the toolbar image, wherein each virtual button is used to activate a target application.

10. The display device according to claim 6, wherein the processor is further configured to: When the physical state of the foldable display is a non-folded state, presenting a target image in the visible area through the second application program interface; and In response to the physical state of the foldable display being the folded state, the target image is completely presented in the first sub-visual area or the second sub-visual area through the second application program interface.

Images