Image display method, device, storage medium and electronic device
By obtaining the user's line of sight angle and matching the displayed image, the problem of three-dimensional effects changing with the perspective angle in the prior art is solved, and the user experience is improved.
Patent Information
- Application Number
- CN202111124261.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-24
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2041-09-24
AI Technical Summary
In the prior art, the three-dimensional effect of the image cannot change with the user's perspective, resulting in inconsistent effects when viewed by the user at different angles.
By obtaining the current line of sight angle of the user's human eye with respect to the display area, a target display image matching the line of sight angle is determined, and the image is displayed on the display area, including the overlay of background, foreground and special effect images, adjusting the display depth to form a three-dimensional effect.
The image display effect changes with the change of sightlines, improving the user's three-dimensional experience.
Smart Images

Figure CN113870213B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of image technology, and in particular, to an image display method, device, storage medium, and electronic device. Background Art
[0002] Currently, creating a 3D effect on a flat surface typically involves occluding the original image with an occluding image, creating a visual difference and producing the 3D effect. However, in related technologies, the image content does not change with the user's viewing angle, and the 3D effect is stronger when the user views the image from the front than when the user views it from the side. Summary of the Invention
[0003] The present disclosure aims to provide an image display method, apparatus, storage medium, and electronic device to display images with a three-dimensional effect.
[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an image display method, comprising:
[0005] Get the current viewing angle of the user's eyes relative to the display area;
[0006] Determining, according to the current sight line angle, a target display image that matches the current sight line angle, wherein the image content of the target display image is a sub-image in the original image that matches the current sight line angle;
[0007] The target display image is displayed on the display area.
[0008] In some embodiments, the display area includes a first display layer and a second display layer, the second display layer being superimposed on the first display layer;
[0009] Displaying the target display image on the display area includes:
[0010] A background image is displayed in the first display layer, and a foreground image is displayed in the second display layer, so that the background image and the foreground image are superimposed to form a three-dimensional effect.
[0011] In some embodiments, the method further comprises:
[0012] Acquiring the distance between the human eye and the display area;
[0013] adjusting the display depth of the background image according to the distance to obtain an adjusted background image;
[0014] The displaying of the background image in the first display layer and the displaying of the foreground image in the second display layer include:
[0015] The adjusted background image is displayed in the first display layer, and the foreground image is displayed in the second display layer.
[0016] In some embodiments, the display area further includes a special effect layer, and the special effect layer is located between the first display layer and the second display layer; the method further includes:
[0017] A special effect image is displayed in the special effect layer so that the foreground image, the background image and the special effect image are superimposed to form a three-dimensional effect.
[0018] In some embodiments, determining, based on the current sight line angle, a target display image that matches the current sight line angle includes:
[0019] Determining a target display image that matches the current sight line angle according to the current sight line angle and in combination with a mapping relationship between the sight line angle and a sub-image in the original image;
[0020] The mapping relationship includes that each different viewing angle corresponds to a sub-image of the original image at the viewing angle.
[0021] In some embodiments, obtaining the current sight angle of the user's eyes relative to the display area includes:
[0022] photographing the user through a camera device to obtain a photographed image;
[0023] Obtaining first position information of the user's eyes relative to the camera device based on the position information and depth information of the user's eyes in the captured image;
[0024] Based on the relative position relationship between the camera device and the display area and in combination with the first position information, the current sight angle of the human eye relative to the display area is obtained.
[0025] In some embodiments, obtaining the current sight angle of the human eye relative to the display area based on the relative positional relationship between the camera device and the display area in combination with the first position information includes:
[0026] When the display area is a projection area of a projection device, obtaining second position information of the human eye relative to the projection device based on a relative positional relationship between the camera device and the projection device in combination with the first position information;
[0027] A current sight angle of the human eye relative to the display area is obtained according to the second position information and a positional relationship between the projection device and the projected plane.
[0028] According to a second aspect of an embodiment of the present disclosure, there is provided an image display device, including:
[0029] An acquisition module configured to acquire a current sight angle of the user's eyes relative to the display area;
[0030] an image module configured to determine, based on the current sight line angle, a target display image that matches the current sight line angle, wherein the image content of the target display image is a sub-image in the original image that matches the current sight line angle;
[0031] The display module is configured to display the target display image on the display area.
[0032] According to a third aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the method described in the first aspect of the present disclosure are implemented.
[0033] According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic device, including:
[0034] a memory having a computer program stored thereon;
[0035] A processor is used to execute the computer program in the memory to implement the steps of the method described in the first aspect of the present disclosure.
[0036] Through the above technical solution, by obtaining the current viewing angle of the user's eyes relative to the display area and displaying the corresponding target display image on the display area according to the current viewing angle, sub-images of the original image at different viewing angles can be displayed as the user's viewing angle changes, creating a three-dimensional display effect, thereby improving the user experience when using the display device.
[0037] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following detailed description, they are used to explain the present disclosure but do not constitute a limitation of the present disclosure. In the accompanying drawings:
[0039] Figure 1 is a flowchart of an image display method provided according to an exemplary embodiment of the present disclosure;
[0040] Figure 2 is a schematic diagram of a sight line angle provided according to an exemplary embodiment of the present disclosure;
[0041] Figure 3is a schematic diagram of a sight line angle provided according to another exemplary embodiment of the present disclosure;
[0042] Figure 4 is a schematic diagram of a flow chart for determining a current sight angle according to an exemplary embodiment of the present disclosure;
[0043] Figure 5 is a schematic diagram of a background image and a foreground image provided according to an exemplary embodiment of the present disclosure;
[0044] Figure 6 is a schematic diagram of a first display layer and a second display layer superimposed to form a three-dimensional effect according to an exemplary embodiment of the present disclosure;
[0045] Figure 7 is a structural diagram of an image display device proposed according to an exemplary embodiment of the present disclosure;
[0046] Figure 8 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION
[0047] The following describes the specific embodiments of the present disclosure in detail with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present disclosure and are not intended to limit the present disclosure.
[0048] Figure 1 FIG. 1 is a flow chart of an image display method according to an exemplary embodiment of the present disclosure. Figure 1 As shown, an embodiment of the present disclosure provides an image display method, which can be applied to an electronic device, wherein the electronic device can be a device with an image display function such as a projection device or a display screen. The image display method can include the following steps.
[0049] In step 110 , the current sight angle of the user's eyes relative to the display area is obtained.
[0050] Here, the display area refers to the area formed by the electronic device for displaying images. When the electronic device is a display screen, the display area may refer to the image display area of the display screen. When the electronic device is a projection device, the display area may refer to the image display area formed by the projection device on the projected plane (wall / screen).
[0051] Figure 2 Schematic diagram of the sight angle provided according to an exemplary embodiment of the present disclosure. Figure 2As shown, the current sight angle may refer to the angle between the line connecting the user's eyes and the center point of the display area and the horizontal line at the current moment. This angle reflects changes in the user's field of view. The sight angle of the user's eyes relative to the display area is related to the user's spatial position. When the user's position changes, the user's current sight angle changes, thereby causing a change in the user's field of view.
[0052] Figure 3 FIG. 1 is a schematic diagram of a sight angle provided according to another exemplary embodiment of the present disclosure. Figure 3 As shown, point L is the user's eye, and plane JKMN is the display area. The current sight angle may refer to the angle between the line connecting the user's eye and each vertex of the display area and the display area. For example, Figure 3 , the current sight angle includes the angle between vector LN and display area JKMN, the angle between vector LM and display area JKMN, the angle between vector LK and display area JKMN, and the angle between vector LJ and display area JKMN. It should be understood that vectors LN, LM, LK, and LJ constitute the field of view of the user's eyes. When the position of the user's eyes changes, the field of view also changes.
[0053] It is worth mentioning that Figure 3 The rectangular shape of the display area JKMN is only used to illustrate the current viewing angle and does not limit the shape of the display area. For example, the shape of the display area can be square, circular, triangular or other regular or irregular shapes.
[0054] Figure 4 FIG. 1 is a flow chart of determining the current sight angle according to an exemplary embodiment of the present disclosure. Figure 4 As shown, in some embodiments, in step 110, obtaining the current sight angle of the user's eyes relative to the display area may include the following steps.
[0055] In step 111 , the user is photographed by a camera device to obtain a photographed image.
[0056] Here, the camera device may be a camera mounted on the electronic device. For example, when the electronic device is a display screen, the camera device may be a camera mounted on the display screen. Of course, the camera device may not be mounted on the electronic device. For example, when the electronic device is a projection device, the camera device may be mounted near the display area to track the user's eyes.
[0057] In step 112, first position information of the user's eyes relative to the camera device is obtained based on the position information and depth information of the user's eyes in the captured image.
[0058] Here, after acquiring the captured image, the captured image can be used as input to a trained neural network model to obtain position information and depth information of the user's eyes in the captured image. The neural network model can be obtained by training a machine learning model based on training samples annotated with the position and depth information of the eyes. Of course, in some embodiments, the user can also be photographed using a binocular camera, and then target detection can be performed on the captured image to determine the first position information of the user's eyes relative to the camera device.
[0059] In step 113, based on the relative position relationship between the camera device and the display area and combined with the first position information, the current sight angle of the human eye relative to the display area is obtained.
[0060] Here, since the positions of the camera device and the display area are fixed in space, after obtaining the first position information, the first position information of the user's eye can be converted into the position of the user's eye relative to the display area based on the relative position relationship between the camera device and the display area, and then the current viewing angle of the user's eye relative to the display area can be determined based on this position.
[0061] When the display area is a display screen, the electronic device can use spatial positioning technology to obtain the positional relationship between the display screen and the camera device. For example, the spatial positions of the display screen and the camera device can be obtained using WiFi positioning technology. When the display area is a projection area formed by a projection device, the position of the projection device can be first determined. Then, based on the position of the projected plane (wall / screen) and the position of the projection device, the position of the display area can be determined, thereby determining the relative positional relationship between the camera device and the display area.
[0062] In some embodiments, when the display area is the projection area of a projection device, second position information of the user's eye relative to the projection device can be obtained based on the relative positional relationship between the camera and the projection device, combined with the first position information. The current viewing angle of the user's eye relative to the display area is then obtained based on this second position information and the positional relationship between the projection device and the projected surface.
[0063] Here, the second position information refers to the position of the user's eyes in the reference coordinate system where the projection device is located. In this reference coordinate system, based on the positional relationship between the projection device and the projected plane, the position of the projection area projected by the projection device on the projected plane is obtained, thereby determining the current viewing angle of the user's eyes relative to the display area in the reference coordinate system.
[0064] In some embodiments, the projection device may measure the projected plane based on a time-of-flight sensor provided on the projection device, thereby determining the relative positional relationship between the projected plane and the projection device.
[0065] In step 120, a target display image matching the current sight line angle is determined according to the current sight line angle, wherein the image content of the target display image is a sub-image in the original image matching the current sight line angle.
[0066] Here, different viewing angles may correspond to different display images. After obtaining the current viewing angle, the corresponding target display image may be determined based on the current viewing angle. The target display image determined based on the current viewing angle is a sub-image on the original image that matches the current viewing angle.
[0067] It should be understood that the current viewing angle of the user's eyes relative to the display area corresponds to the current visual range of the area visible through the display area. In the original image, each sub-image corresponds to the image content visible through the display area at a given viewing angle. When the current viewing angle of the user's eyes relative to the display area changes, the corresponding target display image will also change.
[0068] In some embodiments, a target display image matching the current viewing angle can be determined based on the current viewing angle and the mapping relationship between the viewing angle and the sub-image in the original image; wherein the mapping relationship includes each different viewing angle corresponding to a sub-image of the original image at that viewing angle.
[0069] Here, for the original image, images of the target object (including scenery, people, and objects, etc.) contained in the original image can be captured at different sight angles to obtain multiple sub-images, and then the corresponding sight angle is matched for each sub-image, and a mapping relationship between the sight angle and the sub-image is established. After obtaining the current sight angle of the human eye relative to the display area, the corresponding sub-image can be searched in the mapping relationship based on the current sight angle to obtain the target display image. In other embodiments, the original image can be a panoramic image. For example, a panoramic image containing the target object can be captured, and then corresponding sight angles can be matched for different sub-image areas of the panoramic image. After determining the current sight angle of the user's eye relative to the display area, the corresponding sub-image can be determined in the panoramic image based on the current sight angle, and the sub-image is determined as the target display image. It should be understood that each different sight angle corresponds to an original sub-image at that sight angle. This can be understood as, in a large-scale image containing the target object, the position of the user's field of view in the large-scale image is determined based on the current sight angle, and the image at that position is the sub-image that matches the current sight angle.
[0070] It should be understood that at the current viewing angle Figure 2 When the angle between the line connecting the user's eyes and the center point of the display area and the horizontal line is shown, the position of the field of view in the large-scale image can be determined based on the preset field of view and the angle, thereby determining the target display image. The preset field of view can be the visual range of different groups of people statistically analyzed.
[0071] The current viewing angle is Figure 3 In the case of the angles between the vectors LN, LM, LK and LJ and the display area shown, the surface JKMN can be used as the user's field of view. Combined with the angles between the vectors LN, LM, LK and LJ and the display area, the position of the user's field of view in the large-size image can be determined, thereby determining the target display image.
[0072] In step 130 , a target display image is displayed on the display area.
[0073] Here, after determining the target display image, the target display image is displayed on the display area. Specifically, when the display area is a display screen, the target display image is directly displayed on the display screen. When the display area is an image display area projected by a projection device, the projection device is controlled to project the target display image so that the target display image is displayed on the display area.
[0074] It should be understood that the image display method provided by the embodiments of the present disclosure can detect the current viewing angle of the user's eyes relative to the display area in real time, and then display different target display images based on the current viewing angle, thereby creating the effect that the image viewed by the user on the display area is a three-dimensional image. For example, if the display area is understood as a window and the original image is understood as the scenery outside the window, the angle of the same scenery that the user can see through the window will be different for different viewing angles, thereby creating a three-dimensional effect.
[0075] Therefore, by obtaining the current viewing angle of the user's eyes relative to the display area and displaying the corresponding target display image on the display area according to the current viewing angle, sub-images of the original image at different viewing angles can be displayed as the user's viewing angle changes, creating a three-dimensional display effect to improve the user experience when using the display device.
[0076] In some embodiments, the display area may include a first display layer and a second display layer, wherein the second display layer is superimposed on the first display layer. In step 130, displaying the target display image on the display area may include:
[0077] The background image is displayed in the first display layer, and the foreground image is displayed in the second display layer, so that the background image and the foreground image are superimposed to form a three-dimensional effect.
[0078] Here, the first display layer and the second display layer can each be understood as an independent video player. The target display image displayed on the first display layer is the background image, and the target display image displayed on the second display layer is the foreground image. The background image and the foreground image are superimposed to create a three-dimensional effect. The foreground image can be fixed or changed with the current viewing angle. For example, the corresponding foreground image can be determined based on the current viewing angle.
[0079] Figure 5 Schematic diagram of a background image and a foreground image provided according to an exemplary embodiment of the present disclosure. Figure 5 As shown, in Figure 5 In part (a), the background image is the first scene image at the first sight angle, and the foreground image is the first foreground image, which is the window. The window and the first scene image are superimposed to form a three-dimensional effect. Figure 5In part (b), the background image is a second scene image at a second viewing angle, and the foreground image is a second foreground image, which is a window. When the position of the user's eyes changes, the viewing angle relative to the display area changes from the first viewing angle to the second viewing angle, causing the scene image in the background image to change from the first scene image to the second scene image. In this case, the second foreground image can be the first foreground image. That is, when the viewing angle of the user's eyes relative to the display area changes, the scene image outside the window changes with the change in viewing angle, creating a dynamic three-dimensional effect.
[0080] It is worth noting that in actual application scenarios, the display area may include not only the first display layer and the second display layer, but also at least three display layers. For each display layer, different display images can be designed according to the positional relationship of the display layer in at least three display layers to achieve a better three-dimensional display effect.
[0081] Below, combined with the attached Figure 6 The principle of how the first display layer and the second display layer present a three-dimensional effect is described in detail.
[0082] Figure 6 FIG. 1 is a schematic diagram of a first display layer and a second display layer superimposed to form a three-dimensional effect according to an exemplary embodiment of the present disclosure. Figure 6 As shown, surface ZBVX is the original image, surface GHIJ is the first display layer, and surface CDEF is the second display layer. Point A is the position of the human eye. When point A changes, the visible area formed by the intersection of the ray formed by point A and points C, D, E, and F with the first display layer GHIJ will be located at a different position on the original image ZBVX, resulting in a different sub-image. Because the first and second display layers are on the same plane, the background image changes. Therefore, by tracking the user's eyes, the image content displayed on the first display layer can be adjusted in real time according to the user's line of sight, so that a 3D effect can be presented regardless of the user's viewing angle.
[0083] In some embodiments, the image display method can also obtain the distance between the user's eyes and the display area, adjust the display depth of the background image according to the distance, obtain the adjusted background image, and display the adjusted background image in the first display layer and the foreground image in the second display layer.
[0084] Here, based on the principle that objects appear larger when they are closer than they are smaller, the size of the background image seen by the user will also vary depending on the distance between the user's eyes and the display area. This is especially true for objects that are closer to the background image, as the distance between the user and the display area has a greater impact on the image. Display depth can be understood as the depth of field of the target object within the background image. The closer the distance between the user's eyes and the display area, the shallower the depth of field of the target object within the background image. The farther the distance between the user's eyes and the display area, the deeper the depth of field of the target object within the background image.
[0085] It should be understood that adjusting the display depth of the background image according to the distance between the human eye and the display area can be adjusting the display depth differently according to the depth of each target object in the background image. For example, for the target object in the background image that is within the first depth range, the display depth is adjusted to the first display depth, and the target object that is within the second depth range is adjusted to the second display depth. The first depth range is smaller than the second depth range, and the first display depth is greater than the display depth. That is, the principle of display depth adjustment can be to make a large-scale adjustment for the target object in a closer depth range, and to make a smaller adjustment or no adjustment for the target object in a farther depth range. For example, in Figure 6 In the example, when point A approaches the display area CDEF, the background image of the first display layer in the display area CDEF is magnified, but the foreground image remains unchanged, presenting an effect that the user is approaching the foreground image.
[0086] Therefore, by adjusting the display depth of the background image according to the distance between the user's eyes and the display area, the image displayed in the display area can be changed according to the distance position of the user to display a better three-dimensional effect.
[0087] In some embodiments, the display area may further include a special effects layer located between the first display layer and the second display layer. When the first display layer displays the background image and the second display layer displays the foreground image, a special effects image may be displayed in the special effects layer so that the background display image, the foreground image, and the special effects image are superimposed to form a three-dimensional effect.
[0088] Here, the special effect image can be an image determined based on the scene of the background image and the foreground image to enhance the three-dimensional effect. For example, when the background image is a landscape image and the foreground image is a window, the special effect image can be a special effect image such as rain, snow, or fog produced based on the scene.
[0089] It should be understood that special effect images can also be determined based on the current viewing angle, with different special effect images displayed for different current viewing angles. The principle of determining special effect images based on the current viewing angle is the same as the principle of determining the target display image based on the current viewing angle, and will not be explained in detail here.
[0090] Thus, by displaying the special effect image in the special effect layer, the background image, the foreground image and the special effect image are superimposed to form a better three-dimensional effect.
[0091] Figure 7 FIG. 1 is a schematic structural diagram of an image display device according to an exemplary embodiment of the present disclosure. Figure 7 As shown, the image display device proposed in the present disclosure may include:
[0092] An acquisition module 601 is configured to acquire a current sight angle of the user's eyes relative to the display area;
[0093] An image module 602 is configured to determine, based on the current sight line angle, a target display image that matches the current sight line angle, wherein the image content of the target display image is a sub-image in the original image that matches the current sight line angle;
[0094] The display module 603 is configured to display the target display image on the display area.
[0095] In some embodiments, the display area includes a first display layer and a second display layer, the second display layer being superimposed on the first display layer;
[0096] The display module 603 includes:
[0097] The first display unit is configured to display a background image in the first display layer and a foreground image in the second display layer, so that the background image and the foreground image are superimposed to form a three-dimensional effect.
[0098] In some embodiments, the apparatus further comprises:
[0099] a distance module configured to obtain a distance between a human eye and a display area;
[0100] an adjusting module configured to adjust a display depth of the background image according to the distance to obtain an adjusted background image;
[0101] The first display unit is specifically configured to: display the adjusted background image in the first display layer, and display the foreground image in the second display layer.
[0102] In some embodiments, the display area further includes a special effect layer, and the special effect layer is located between the first display layer and the second display layer; the device further includes:
[0103] The second display unit is configured to display a special effect image in the special effect layer, so that the foreground image, the background image and the special effect image are superimposed to form a three-dimensional effect.
[0104] In some embodiments, the image module 602 is specifically configured to: determine a target display image that matches the current sight line angle based on the current sight line angle and a mapping relationship between the sight line angle and the sub-image in the original image;
[0105] The mapping relationship includes that each different viewing angle corresponds to a sub-image of the original image at the viewing angle.
[0106] In some embodiments, the acquisition module 601 includes:
[0107] A shooting unit configured to shoot a user through a camera device and obtain a shot image;
[0108] a first position determination unit configured to obtain first position information of the user's eyes relative to the camera device based on position information and depth information of the user's eyes in the captured image;
[0109] The first angle determination unit is configured to obtain a current sight angle of the human eye relative to the display area based on a relative position relationship between the camera device and the display area in combination with the first position information.
[0110] In some embodiments, the angle determination unit includes:
[0111] a second position determination unit configured to obtain second position information of the human eye relative to the projection device based on a relative position relationship between the camera device and the projection device and in combination with the first position information when the display area is a projection area of the projection device;
[0112] The second angle determining unit is configured to obtain a current sight angle of the human eye relative to the display area according to the second position information and a positional relationship between the projection device and the projected plane.
[0113] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0114] Figure 8 FIG. 1 is a block diagram of an electronic device according to an exemplary embodiment. Figure 8 As shown, the electronic device 700 may include: a processor 701 , a memory 702 , and may further include one or more of a multimedia component 703 , an input / output (I / O) interface 704 , and a communication component 705 .
[0115] The processor 701 is used to control the overall operation of the electronic device 700 to complete all or part of the steps in the above-mentioned image display method. The memory 702 is used to store various types of data to support the operation of the electronic device 700. For example, these data may include instructions for any application or method operating on the electronic device 700, as well as application-related data, such as display images, mapping relationships, etc. The memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The multimedia component 703 may include a screen and an audio component. The screen may be, for example, a touch screen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in the memory 702 or sent through the communication component 705. The audio component also includes at least one speaker for outputting audio signals. The I / O interface 704 provides an interface between the processor 701 and other interface modules, and the above-mentioned other interface modules may be a keyboard, a mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 705 is used for wired or wireless communication between the electronic device 700 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, is not limited here. Therefore, the corresponding communication component 705 may include: a Wi-Fi module, a Bluetooth module, an NFC module, etc.
[0116] In an exemplary embodiment, the electronic device 700 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-mentioned image display method.
[0117] In another exemplary embodiment, a computer-readable storage medium including program instructions is further provided. When the program instructions are executed by a processor, the steps of the above-described image display method are implemented. For example, the computer-readable storage medium may be the aforementioned memory 702 including the program instructions. The program instructions may be executed by the processor 701 of the electronic device 700 to implement the above-described image display method.
[0118] In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program executable by a programmable device, and has a code portion for executing the above-mentioned image display method when executed by the programmable device.
[0119] The preferred embodiments of the present disclosure are described in detail above in conjunction with the accompanying drawings. However, the present disclosure is not limited to the specific details of the above embodiments. Within the technical concept of the present disclosure, various simple modifications can be made to the technical solutions of the present disclosure, and these simple modifications all fall within the scope of protection of the present disclosure.
[0120] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any appropriate manner without contradiction. In order to avoid unnecessary repetition, the present disclosure will not further describe various possible combinations.
[0121] In addition, the various embodiments of the present disclosure may be arbitrarily combined, and as long as they do not violate the concept of the present disclosure, they should also be regarded as the contents disclosed by the present disclosure.
Claims
1. An image display method, characterized in that: include: Get the current viewing angle of the user's eyes relative to the display area; Determining, according to the current sight line angle, a target display image that matches the current sight line angle, wherein the image content of the target display image is a sub-image in the original image that matches the current sight line angle; displaying the target display image on the display area; The display area includes a first display layer and a second display layer, wherein the second display layer is superimposed on the first display layer; Displaying the target display image on the display area includes: Displaying a background image in the first display layer and a foreground image in the second display layer so that the background image and the foreground image are superimposed to form a three-dimensional effect; The method further comprises: Acquiring the distance between the human eye and the display area; The display depth of the background image is adjusted according to the distance to obtain an adjusted background image; wherein, in the adjusted background image, the display depth of the target object within the first depth range is greater than the display depth of the target object within the second depth range, and the first depth range is smaller than the second depth range.
2. The image display method according to claim 1, wherein: The displaying of the background image in the first display layer and the displaying of the foreground image in the second display layer include: The adjusted background image is displayed in the first display layer, and the foreground image is displayed in the second display layer.
3. The image display method according to claim 1, wherein: The display area further includes a special effect layer, and the special effect layer is located between the first display layer and the second display layer; the method further includes: A special effect image is displayed in the special effect layer so that the foreground image, the background image and the special effect image are superimposed to form a three-dimensional effect.
4. The image display method according to claim 1, wherein: Determining, according to the current sight line angle, a target display image that matches the current sight line angle, including: Determining a target display image that matches the current sight line angle according to the current sight line angle and in combination with a mapping relationship between the sight line angle and a sub-image in the original image; The mapping relationship includes that each different viewing angle corresponds to a sub-image of the original image at the viewing angle.
5. The image display method according to any one of claims 1 to 4, characterized in that: The obtaining of the current sight angle of the user's eyes relative to the display area includes: photographing the user through a camera device to obtain a photographed image; Obtaining first position information of the user's eyes relative to the camera device based on the position information and depth information of the user's eyes in the captured image; Based on the relative position relationship between the camera device and the display area and in combination with the first position information, the current sight angle of the human eye relative to the display area is obtained.
6. The image display method according to claim 5, wherein: The obtaining, based on the relative positional relationship between the camera device and the display area and in combination with the first position information, of a current sight angle of the human eye relative to the display area includes: When the display area is a projection area of a projection device, obtaining second position information of the human eye relative to the projection device based on a relative positional relationship between the camera device and the projection device in combination with the first position information; A current sight angle of the human eye relative to the display area is obtained according to the second position information and a positional relationship between the projection device and the projected plane.
7. An image display device, characterized in that: include: An acquisition module configured to acquire a current sight angle of the user's eyes relative to the display area; an image module configured to determine, based on the current sight line angle, a target display image that matches the current sight line angle, wherein the image content of the target display image is a sub-image in the original image that matches the current sight line angle; a display module configured to display the target display image on the display area; The display area includes a first display layer and a second display layer, wherein the second display layer is superimposed on the first display layer; The display module includes: a first display unit configured to display a background image in the first display layer and a foreground image in the second display layer, so that the background image and the foreground image are superimposed to form a three-dimensional effect; The device further comprises: a distance module, configured to obtain the distance between the human eye and the display area; An adjustment module is configured to adjust the display depth of the background image according to the distance to obtain an adjusted background image; wherein, in the adjusted background image, the display depth of the target object within the first depth range is greater than the display depth of the target object within the second depth range, and the first depth range is smaller than the second depth range.
8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
9. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, configured to execute the computer program in the memory to implement the steps of the method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Display device for displaying pictures at different angles based on visual angle of viewer
CN101950550A
Virtual reality display device, display equipment and display method
CN107682686A