Naked eye 3D display adjustment method and electronic equipment

Abstract

The invention provides a naked eye 3D display adjustment method and electronic equipment. The naked-eye 3D display adjustment method comprises the steps of performing semantic analysis on a naked-eye 3D image in response to received adjustment operation for a naked-eye 3D display window, and determining a depth semantic analysis result; determining target position information of the naked eye 3D display window based on the adjustment operation; based on the deep semantic analysis result and the target position information, directional backlight array control information and the naked-eye 3D image are adjusted, and the directional backlight array control information is used for achieving naked-eye 3D display of the naked-eye 3D image; and displaying the adjusted naked eye 3D image based on the adjusted directional backlight array control information.

Description

Technical Field

[0001] The present disclosure relates to the technical field of naked-eye 3D display, and in particular to a naked-eye 3D display adjustment method and an electronic device. Background Art

[0002] With the rapid development of display technology, 3D display technology has been widely used in entertainment, education, medical and other fields. Among them, naked-eye 3D display technology aims to provide users with the experience of watching 3D images or videos without wearing equipment, and is gradually becoming a new development trend.

[0003] However, the related naked-eye 3D display solutions still have certain limitations. For example, during the process of adjusting the naked-eye 3D display content, the naked-eye 3D visual experience of the viewer will be reduced. Summary of the invention

[0004] One aspect of the present disclosure provides a naked-eye 3D display adjustment method, comprising: in response to receiving an adjustment operation for a naked-eye 3D display window, performing semantic analysis on a naked-eye 3D image to determine a depth semantic analysis result; based on the adjustment operation, determining target position information of the naked-eye 3D display window; based on the depth semantic analysis result and the target position information, adjusting directional backlight array control information and the naked-eye 3D image, the directional backlight array control information being used to realize the naked-eye 3D display of the naked-eye 3D image; based on the adjusted directional backlight array control information, displaying the adjusted naked-eye 3D image.

[0005] Optionally, the operation type of the adjustment operation includes a translation operation or a zoom operation.

[0006] Optionally, in response to receiving an adjustment operation for a naked-eye 3D display window, performing semantic analysis on the naked-eye 3D image, and determining a depth semantic analysis result includes: in response to receiving the adjustment operation, acquiring the naked-eye 3D image in the naked-eye 3D display window; based on a depth semantic analysis model, performing feature extraction on the naked-eye 3D image to obtain depth features; and determining a depth semantic analysis result based on the depth features.

[0007] Optionally, based on the adjustment operation, determining the target position information of the naked-eye 3D display window includes: analyzing the adjustment operation based on the current position information of the naked-eye 3D display window to determine the adjustment speed of the adjustment operation; and determining the target position information of the naked-eye 3D display window according to the current position information, the adjustment speed and the time interval of backlight refresh.

[0008] Optionally, based on the current position information of the autostereoscopic 3D display window, analyzing the adjustment operation to determine the adjustment speed of the adjustment operation includes: determining multiple historical position information of the autostereoscopic 3D display window based on multiple historical backlight refresh times; analyzing the adjustment operation according to the current position information and the multiple historical position information to determine the adjustment speed of the adjustment operation.

[0009] Optionally, based on the depth semantic analysis result and the target position information, adjusting the directional backlight array control information and the autostereoscopic 3D image includes: determining the in-screen and out-screen regions and the zero-plane region in the autostereoscopic 3D image according to the depth semantic analysis result; determining the adjustment type of the adjustment operation and determining the newly added autostereoscopic 3D display region according to the current position information and the target position information of the autostereoscopic 3D display window; adjusting the directional backlight array control information based on the zero-plane region and the newly added autostereoscopic 3D display region; adjusting the autostereoscopic 3D image based on the adjustment type.

[0010] Optionally, determining the adjustment type of the adjustment operation and determining the newly added autostereoscopic 3D display region according to the current position information and the target position information of the autostereoscopic 3D display window includes: determining the adjustment type according to the difference between the target position information and the current position information; determining the non-overlapping region of the target position information relative to the current position information as the newly added autostereoscopic 3D region.

[0011] Optionally, the directional backlight array control information includes the position information of the 3D mode region and the enabling time of the 3D mode region; adjusting the directional backlight array control information based on the zero-plane region and the newly added autostereoscopic 3D display region includes: determining the width of the zero-plane region based on the inner boundary of the zero-plane region and the outer boundary of the autostereoscopic 3D display window; determining the position information of the target 3D mode region based on the newly added autostereoscopic 3D display region and the width of the zero-plane region; and determining the enabling time of the target 3D mode region before the next backlight refresh time.

[0012] Optionally, the adjustment type includes a translation operation or a scaling operation. Adjusting the autostereoscopic 3D image based on the adjustment type includes: obtaining the original autostereoscopic 3D image to be displayed, the original autostereoscopic 3D image including a first-view original image and a second-view original image, and there is an initial baseline length between the first-view original image and the second-view original image; in the case where the adjustment operation is a scaling operation, determining the target baseline length based on the scaling multiple of the scaling operation and the initial baseline length; determining the target parallax based on the target baseline length; generating a first-view generated image and a second-view generated image based on the first-view original image and the second-view original image according to the target parallax.

[0013] Another aspect of the present disclosure provides an electronic device, including a naked-eye 3D display, the naked-eye 3D display including a directional backlight array, the directional backlight array being used for naked-eye 3D display; at least one processor, the at least one processor being used to execute the following method: in response to receiving an adjustment operation for a naked-eye 3D display window, performing semantic analysis on a naked-eye 3D image and determining a depth semantic analysis result; based on the adjustment operation, determining target position information of the naked-eye 3D display window; based on the depth semantic analysis result and the target position information, adjusting directional backlight array control information and the naked-eye 3D image, the directional backlight array control information being used to realize naked-eye 3D display of the naked-eye 3D image; based on the adjusted directional backlight array control information, displaying the adjusted naked-eye 3D image.

[0014] Another aspect of the present disclosure provides a non-volatile storage medium storing computer executable instructions, wherein the instructions are used to implement any of the above methods when executed.

[0015] Another aspect of the present disclosure provides a computer program, which includes computer executable instructions, and the instructions are used to implement any of the above methods when executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] For a more complete understanding of the present disclosure and its advantages, reference will now be made to the following description taken in conjunction with the accompanying drawings, in which:

[0017] Figure 1 The naked eye 3D display principle according to an embodiment of the present disclosure is schematically shown;

[0018] Figure 2 The application scenarios of the naked-eye 3D display adjustment method and the electronic device according to the embodiments of the present disclosure are schematically shown;

[0019] Figure 3 A flowchart of a naked-eye 3D display adjustment method according to an embodiment of the present disclosure is schematically shown;

[0020] Figure 4A A schematic diagram schematically shows an operation of adjusting a naked-eye 3D display window according to an embodiment of the present disclosure;

[0021] Figure 4B A schematic diagram schematically shows an operation of adjusting a naked-eye 3D display window according to another embodiment of the present disclosure;

[0022] Figure 5 Schematically shows a naked eye 3D image according to an embodiment of the present disclosure;

[0023] Fig. 6A Schematically illustrates the zero plane area width according to one embodiment of the present disclosure;

[0024] Figure 6B Schematically illustrates a target 3D mode area according to an embodiment of the present disclosure;

[0025] Figure 6C Schematically illustrates a target 3D mode area according to another embodiment of the present disclosure;

[0026] Figure 7 The left and right eye images before and after adjustment according to an embodiment of the present disclosure are exemplarily shown; and

[0027] Figure 8 A block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0028] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0029] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0030] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0031] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0032] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0033] Some block diagrams and / or flow charts are shown in the accompanying drawings. It should be understood that some blocks or combinations thereof in the block diagrams and / or flow charts may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that these instructions, when executed by the processor, may create a device for implementing the functions / operations described in these block diagrams and / or flow charts.

[0034] Therefore, the technology of the present disclosure can be implemented in the form of hardware and / or software (including firmware, microcode, etc.). In addition, the technology of the present disclosure can take the form of a computer program product on a computer-readable medium storing instructions, which can be used by an instruction execution system or in combination with an instruction execution system. In the context of the present disclosure, a computer-readable medium can be any medium that can contain, store, transmit, propagate, or transmit instructions. For example, a computer-readable medium can include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, device, or propagation medium. Specific examples of computer-readable media include: magnetic storage devices, such as magnetic tape or hard disk (HDD); optical storage devices, such as compact disk (CD-ROM); memory, such as random access memory (RAM) or flash memory; and / or wired / wireless communication links.

[0035] With the rapid development of display technology, 3D display technology has been widely used in entertainment, education, medical and other fields. Among them, naked-eye 3D display technology aims to provide users with the experience of watching 3D images or videos without wearing equipment, and is gradually becoming a new development trend.

[0036] According to one embodiment of the present disclosure, naked-eye 3D display can be achieved based on directional backlight technology. By simulating the binocular parallax principle of the human eye and utilizing a directional backlight array and a high refresh rate display screen, the left-eye image and the right-eye image with parallax can be accurately projected to the left and right eyes of the viewer, respectively, and a stereoscopic visual effect can be achieved through brain fusion.

[0037] Figure 1The naked-eye 3D display principle according to an embodiment of the present disclosure is schematically illustrated.

[0038] like Figure 1 As shown, the naked eye 3D display system may include, for example, a directional backlight array 110 and a display panel 120. The directional backlight array 110 can modulate the light beam into a directional light to ensure that the light can be accurately projected to the designated area, so that the directional backlight array 110 can make the left eye image P1 enter the viewer's left eye E1 and the right eye image P2 enter the viewer's right eye E2. Based on the principle of binocular parallax, when the viewer's left eye E1 and right eye E2 respectively receive the left eye image P1 and the right eye image P2 with parallax, the brain can judge the spatial depth of the object by fusing the two images with parallax, thereby forming stereoscopic vision.

[0039] In one embodiment, the naked eye 3D display system can control the left eye image P1 to accurately enter the viewer's left eye E1 and the right eye image P2 to accurately enter the viewer's right eye E2 by switching the left eye image P1 and the right eye image P2 at a high rate, and alternately activating the left eye directional function and the right eye directional function of the directional backlight array 110 at a high rate. For example, when the left eye image P1 is played, the directional backlight unit corresponding to the left eye viewing area is turned on, and the directional backlight unit corresponding to the right eye viewing area is turned off, then the viewer's left eye E1 sees the left eye image P1. For example, when the right eye image P2 is played, the directional backlight unit corresponding to the right eye viewing area is turned on, and the directional backlight unit corresponding to the left eye viewing area is turned off, then the viewer's right eye E2 sees the right eye image P2. By alternately turning on and off the directional backlight unit (similar to refreshing the directional backlight array by flashing), it can be ensured that the viewer's left eye E1 and right eye E2 alternately receive the left eye image P1 and the right eye image P2 displayed on the display screen panel 120. Using the principle of persistence of vision, the brain can fuse the left eye image P1 and the right eye image P2 to produce stereoscopic vision.

[0040] For example, Figure 1 As shown, the directional backlight array 110 may include, for example, a plurality of independently controllable directional backlight units 110a, and each directional backlight unit 110a may include, for example, a backlight unit and an optical modulation component. The backlight unit may be, for example, at least one of a point light source and a surface light source, and the optical modulation component may include, for example, a lens and a diffusion film.

[0041] It should be noted that the naked-eye 3D display system can be implemented based on any naked-eye 3D display technology principle, for example, it can be implemented through technical principles such as directional backlight technology, parallax barrier technology, light field display technology, and multi-view display technology. The embodiments of the present disclosure do not specifically limit the naked-eye 3D display principle and the hardware structure for implementing the naked-eye 3D display principle.

[0042] According to an embodiment of the present disclosure, naked-eye 3D display content can be windowed. For example, 3D content can be displayed through a 3D content display area (e.g., a naked-eye 3D display window), and 2D content can be displayed through a 2D content display area, thereby achieving the same-screen display of 3D content and 2D content. It is understandable that the display control information corresponding to the aforementioned 3D content display area and 2D content display area is significantly different.

[0043] In implementing the inventive concept of the present disclosure, the inventors found that during the process of adjusting the naked-eye 3D display window by translation, scaling, etc., the adjustment operation may affect the position, size, etc. of the naked-eye 3D display window, which may cause the naked-eye 3D display effect to be lost or inaccurate during the adjustment process, thereby causing the viewer's naked-eye 3D visual experience to be reduced. In this context, how to maintain the viewer's naked-eye 3D visual experience during the adjustment operation of the naked-eye 3D display window is an urgent problem to be solved.

[0044] The disclosed embodiment provides a naked-eye 3D display adjustment method and electronic device. The method includes: in response to receiving an adjustment operation for a naked-eye 3D display window, performing semantic analysis on a naked-eye 3D image and determining a depth semantic analysis result; based on the adjustment operation, determining target position information of the naked-eye 3D display window; based on the depth semantic analysis result and the target position information, adjusting directional backlight array control information and the naked-eye 3D image, the directional backlight array control information is used to realize the naked-eye 3D display of the naked-eye 3D image; based on the adjusted directional backlight array control information, displaying the adjusted naked-eye 3D image.

[0045] Figure 2 The application scenarios of the naked-eye 3D display adjustment method and electronic device according to the embodiments of the present disclosure are schematically illustrated.

[0046] like Figure 2As shown, the application scenario according to the embodiment of the present disclosure may include an electronic device 200. The electronic device 200 may be any electronic device capable of realizing naked-eye 3D display, for example, the electronic device 200 may include but is not limited to a display, a smart phone, a netbook, a tablet computer, a handwriting tablet, a smart watch, a smart bracelet, a phone watch, a smart camera, a PDA, a car computer, a personal computer (PC), a personal digital assistant (PDA), a portable multimedia player (PMP), (augmented reality, AR) / virtual reality (VR) equipment, a smart TV, a projection device or a somatosensory game console in a human-computer interaction scene, etc. Alternatively, the electronic device 200 may also be an electronic device of other types or structures capable of realizing naked-eye 3D display, which is not specifically limited here.

[0047] According to an embodiment of the present disclosure, the electronic device 200 can display a naked-eye 3D image in the naked-eye 3D display window 201 based on directional backlight technology. The naked-eye 3D image may include a left-eye image and a right-eye image, and there is parallax between the left-eye image and the right-eye image.

[0048] According to an embodiment of the present disclosure, for the same object A, if its x-axis coordinate in the left eye image is x1 and its x-axis coordinate in the right eye image is x2, the disparity between the left eye image and the right eye image can be understood as the difference Δx between x1 and x2. Based on the principle of binocular disparity, the disparity Δx is proportional to the depth of feature A. It can be understood that if the size of the left eye image and the right eye image changes (such as zooming in / out), the disparity Δx also changes, resulting in a change in the depth of object A.

[0049] As an example, the electronic device 200 may include a directional backlight array, which may include a plurality of independently controllable directional backlight units. The directional backlight array may be compatible with a 3D display mode and a 2D display mode. For example, in a 3D display mode, the directional backlight array may modulate directional light for 3D display. For example, in a 2D display mode, the directional backlight array may provide uniform background light for 2D display.

[0050] According to an embodiment of the present disclosure, the electronic device 200 can display 3D content through a 3D content display area (e.g., a naked-eye 3D display window) and display 2D content through a 2D content display area, thereby realizing the same-screen display of 3D content and 2D content. For example, the directional backlight unit arranged corresponding to the 3D content display area can be placed in a 3D display mode, and the directional backlight unit arranged corresponding to the 2D content display area can be placed in a 2D display mode.

[0051] like Figure 2 As shown, the electronic device 200 may display a naked-eye 3D display window 201. The electronic device 200 may display 3D content through the naked-eye 3D display window 201 and display 2D content through the 2D content display area 202, thereby realizing the same-screen display of 3D content and 2D content. As just one example, the naked-eye 3D display window 201 may be, for example, an image viewer window, and the 2D content display area 202 may be, for example, a browser page. The user may watch the naked-eye 3D image through the image viewer window while watching the 2D image in the browser page, thereby realizing the same-screen display of the naked-eye 3D image and the 2D image.

[0052] In one embodiment, the directional backlight array may include a 3D mode area arranged corresponding to the naked eye 3D display window 201, and a 2D mode area arranged corresponding to the 2D content display area 202. For each directional backlight unit in the 2D mode area, uniform illumination can be maintained to achieve a 2D display effect. For each directional backlight unit in the 3D mode area, the directional backlight array can be refreshed based on a preset flashing frequency, and in conjunction with a display panel with a high refresh rate, the left eye image and the right eye image can be alternately entered into the viewer's left eye and right eye at high speed, respectively, to achieve a naked eye 3D display effect.

[0053] According to an embodiment of the present disclosure, the user can adjust the naked-eye 3D display window 201, for example, the user can translate or zoom the naked-eye 3D display window 201. Exemplarily, the user can translate or zoom the naked-eye 3D display window through touch operation, mouse operation, keyboard operation, gesture operation, etc., which is not specifically limited here.

[0054] As an example, the user can perform a translation operation on the naked-eye 3D display window 201. When the movement speed is greater than the preset refresh rate of the directional backlight unit, if the 3D mode area of ​​the directional backlight array cannot be adjusted in time, part of the content in the naked-eye 3D display window 201 will lose the 3D display effect during the movement.

[0055] As another example, the user can perform a zoom operation on the naked-eye 3D display window 201. When the size of the naked-eye 3D display window 201 changes, if the size of the naked-eye 3D image in the naked-eye 3D display window 201 is simply changed in proportion, the parallax of the left-eye image and the right-eye image will change significantly. For example, when the naked-eye 3D display window 201 is enlarged, the parallax of the left-eye image and the right-eye image becomes significantly larger, which may cause dizziness to the user. For example, when the naked-eye 3D display window 201 is reduced, the parallax of the left-eye image and the right-eye image becomes significantly smaller, which may cause the naked-eye 3D display effect to be unclear.

[0056] Figure 3 The flowchart of the naked-eye 3D display adjustment method according to an embodiment of the present disclosure is schematically shown.

[0057] Specifically, Figure 3 As shown, the method 300 includes operations S310 to S340.

[0058] In operation S310 , in response to receiving an adjustment operation for a naked-eye 3D display window, a semantic analysis is performed on the naked-eye 3D image to determine a depth semantic analysis result.

[0059] In operation S320, target position information of the naked-eye 3D display window is determined based on the adjustment operation.

[0060] In operation S330, based on the depth semantic analysis result and the target position information, the directional backlight array control information and the naked-eye 3D image are adjusted, and the directional backlight array control information is used to implement the naked-eye 3D display of the naked-eye 3D image.

[0061] In operation S340, the adjusted naked-eye 3D image is displayed based on the adjusted directional backlight array control information.

[0062] According to an embodiment of the present disclosure, a naked-eye 3D image may be displayed in the naked-eye 3D display window. In response to receiving an adjustment operation of the user on the naked-eye 3D display window, a semantic analysis may be performed on the naked-eye 3D image to determine a depth semantic analysis result. The depth semantic analysis result may be used to determine depth semantic information of the naked-eye 3D image.

[0063] According to an embodiment of the present disclosure, the position information of the naked-eye 3D display window may include the window boundary coordinates of the naked-eye 3D display window, and the window position and window size may be determined based on the window boundary coordinates. Exemplarily, the naked-eye 3D display window may be a rectangle, and the window boundary coordinates of the naked-eye 3D display window may be written as [(Xa, Ya): (Xb, Yb)]. Wherein, (Xa, Ya) is the coordinate of the upper left corner of the window, and (Xb, Yb) is the coordinate of the lower right corner of the window. For example, based on the window boundary coordinates [(Xa, Ya), (Xb, Yb)], the coordinates of the upper right corner of the window may be determined to be (Xb, Ya), and the coordinates of the lower left corner of the window may be (Xa, Yb), so that the window position may be determined. For example, based on the window boundary coordinates [(Xa, Ya), (Xb, Yb)], the window width can be determined as |Xb-Xa| and the window height can be determined as |Yb-Ya|, so the window size can be determined as |Xb-Xa|*|Yb-Ya|.

[0064] According to an embodiment of the present disclosure, the target position information of the naked-eye 3D display window can be determined based on the adjustment operation. The target position information can be understood as the position information of the naked-eye 3D display window at the next backlight refresh time, and the target position information can characterize the window position and window size of the naked-eye 3D display window at the next backlight refresh time. The target position information can be used to determine the changes in the position and size of the naked-eye 3D display window during the adjustment process.

[0065] It is understandable that when adjusting the naked-eye 3D display window, the position, size, etc. of the naked-eye 3D display window may change. Since the 3D mode area of ​​the directional backlight array corresponds to the naked-eye 3D display window, and the naked-eye 3D image is displayed in the naked-eye 3D display window, it is necessary to synchronously adjust the directional backlight array control information and the naked-eye 3D image to maintain the accuracy and stability of the 3D display effect during the adjustment process.

[0066] According to the embodiments of the present disclosure, the directional backlight array control information and the naked-eye 3D image can be adjusted based on the depth semantic analysis results and the target position information. By combining the depth semantic analysis results and the target position information, the changes in the position and size of the naked-eye 3D display window and the depth semantic information of the naked-eye 3D image can be fully considered, so that the directional backlight array control information and the naked-eye 3D image can be adjusted more accurately to ensure the accuracy and visual comfort of the 3D display effect during the adjustment process.

[0067] For example, the control information related to the 3D mode area of ​​the directional backlight array can be adjusted to ensure that the left eye image and the right eye image can accurately alternately enter the left eye and the right eye of the viewer during the adjustment process. For example, the display position, image size, image content, etc. of the naked eye 3D display image can be adjusted to ensure the 3D display effect of the naked eye 3D image during the adjustment process.

[0068] According to the embodiments of the present disclosure, the adjusted naked-eye 3D image can be displayed in the naked-eye 3D display window based on the adjusted directional backlight array control information. By displaying the adjusted naked-eye 3D image based on the adjusted directional backlight array control information, it is possible to effectively prevent the 3D display effect from being lost or inaccurate during the adjustment process, maintain the accuracy, stability and continuity of the 3D display effect during the adjustment process, and thus ensure that the viewer has a relatively good 3D visual experience during the adjustment process.

[0069] According to the embodiments of the present disclosure, the depth semantic analysis result can be determined by performing semantic analysis on the naked-eye 3D image, and the target position information of the naked-eye 3D window can be determined based on the adjustment operation, so that the directional backlight array control information and the naked-eye 3D image can be adaptively and timely adjusted according to the depth semantic analysis result and the target position information, and the adjusted naked-eye 3D image can be displayed based on the adjusted directional backlight array control information, so as to maintain the accuracy, stability and continuity of the 3D display effect during the adjustment process, thereby ensuring that the viewer has a better naked-eye 3D visual experience.

[0070] According to an embodiment of the present disclosure, the operation type of the adjustment operation includes a translation operation or a zoom operation.

[0071] Figure 4A The following is a schematic diagram of adjusting a naked-eye 3D display window according to an embodiment of the present disclosure.

[0072] According to one embodiment of the present disclosure, Figure 4A As shown, the naked-eye 3D display window can be translated, and the position information of the naked-eye 3D display window changes from the current position information 401a to the target position information 402a. The translation operation will cause the naked-eye 3D display window to change in position.

[0073] Figure 4B A schematic diagram schematically shows an adjustment operation on a naked-eye 3D display window according to another embodiment of the present disclosure.

[0074] According to another embodiment of the present disclosure, Figure 4BAs shown, the naked-eye 3D display window can be scaled, and the position information of the naked-eye 3D display window changes from the current position information 401b to the target position information 402b. The scaling operation will cause the naked-eye 3D display window to change in position and size.

[0075] According to an embodiment of the present disclosure, in response to receiving an adjustment operation for a naked-eye 3D display window, a semantic analysis is performed on a naked-eye 3D image, and determining a depth semantic analysis result includes: in response to receiving the adjustment operation, obtaining a naked-eye 3D image in the naked-eye 3D display window; based on a depth semantic analysis model, performing feature extraction on the naked-eye 3D image to obtain depth features; and determining a depth semantic analysis result based on the depth features.

[0076] According to an embodiment of the present disclosure, in response to receiving an adjustment operation, a naked-eye 3D image in a naked-eye 3D display window can be obtained. Exemplarily, the naked-eye 3D image may include at least one of a left-eye image and a right-eye image. The adjustment operation may be triggered by an operation including but not limited to a mouse operation, a keyboard operation, a gesture operation, or by any other operation, which is not limited here. The naked-eye 3D image may be obtained by a method including but not limited to a window screenshot, a media file acquisition, or by any other acquisition method, which is not limited here.

[0077] According to an embodiment of the present disclosure, feature extraction can be performed on a naked-eye 3D image based on a depth semantic analysis model to obtain a depth feature. Among them, the depth feature can characterize the depth value of each pixel in the naked-eye 3D image, and the depth value of the pixel can reflect the distance of the pixel from the observer. For example, a depth semantic analysis model can be used to generate a depth map based on the naked-eye 3D image to extract the depth value of each pixel. On this basis, the depth semantic analysis result can be determined based on the depth map. Exemplarily, the depth semantic information can characterize whether the pixel has a stereoscopic display effect.

[0078] As just an example, the deep semantic analysis model may be selected as a monocular depth estimation model (Monocular Depth Estimation, MDE). The embodiments of the present disclosure do not specifically limit the model structure of the deep semantic analysis model.

[0079] According to an embodiment of the present disclosure, determining the target position information of the naked-eye 3D display window based on the adjustment operation includes: analyzing the adjustment operation based on the current position information of the naked-eye 3D display window to determine the adjustment speed of the adjustment operation; and determining the target position information of the naked-eye 3D display window based on the current position information, the adjustment speed and the time interval for backlight refresh.

[0080] According to an embodiment of the present disclosure, the current position information of the naked-eye 3D display window can be understood as the position information of the naked-eye 3D display window at the current backlight refresh time. The current position information can characterize the window position and window size of the naked-eye 3D display window at the current backlight refresh time. The adjustment operation can be analyzed based on the current position information to determine the adjustment speed of the adjustment operation.

[0081] According to the embodiment of the present disclosure, the time interval of backlight refresh can be understood as the time interval of flashing of the directional backlight array. The target position information can be determined according to the current position information, the adjustment speed and the time interval of backlight refresh.

[0082] As an example, when a naked-eye 3D display window is panned, the moving distance of the naked-eye 3D display window can be determined according to the adjustment speed and the time interval of backlight refresh. The moving distance can be decomposed in the horizontal direction and the vertical direction to determine the horizontal displacement and the vertical displacement. The target position information can be determined according to the current position information, the horizontal displacement and the vertical displacement.

[0083] As another example, in the case of performing a zoom operation on a naked-eye 3D display window, the width change value and the height change value of the naked-eye 3D display window can be determined according to the adjustment speed and the time interval of backlight refresh. The target position information can be determined according to the current position information, the width change value and the height change value. The zoom center and the zoom multiple of the zoom operation can be determined according to the current position information and the target position information.

[0084] According to an embodiment of the present disclosure, based on the current position information of the naked-eye 3D display window, the adjustment operation is analyzed, and determining the adjustment speed of the adjustment operation includes: based on multiple historical backlight refresh moments, determining multiple historical position information of the naked-eye 3D display window; based on the current position information and multiple historical position information, analyzing the adjustment operation to determine the adjustment speed of the adjustment operation.

[0085] According to an embodiment of the present disclosure, multiple historical position information of the naked-eye 3D display window can be determined based on multiple historical backlight refresh moments during the adjustment process. The adjustment speed of the adjustment operation can be determined based on the current position information and the multiple historical position information.

[0086] As an example, the current backlight refresh time may be time t, the next backlight refresh time may be time t+1, and the multiple historical backlight refresh times may include time t-3, time t-2, and time t-1. The multiple historical location information and the current location information may include P t-3 , P t-2 , P t-1 and P tBased on multiple historical position information and current position information, the speeds at time t-3, time t-2, and time t-1 can be calculated as V t-3 、V t-2 and V t-1 , the adjustment speed Vt of the current backlight refresh time (time t) can be determined based on the adjustment speeds of multiple historical backlight times. Exemplarily, the speed at time t can be determined based on a linear fitting method.

[0087] Optionally, multiple historical position information and current position information can be input into the deep learning model to obtain the adjustment speed V at the current backlight refresh time (time t) t .

[0088] According to an embodiment of the present disclosure, adjusting the directional backlight array control information and the naked-eye 3D image based on the depth semantic analysis result and the target position information includes: determining the entry and exit screen areas and the zero plane area in the naked-eye 3D image according to the depth semantic analysis result; determining the adjustment type of the adjustment operation and determining a newly added naked-eye 3D display area according to the current position information and the target position information of the naked-eye 3D display window; adjusting the directional backlight array control information based on the zero plane area and the newly added naked-eye 3D display area; and adjusting the naked-eye 3D image based on the adjustment type.

[0089] According to an embodiment of the present disclosure, the depth value of each pixel in the naked eye 3D image can reflect whether the pixel is located in an out-of-screen display effect, an in-screen display effect, or no stereoscopic display effect. If the depth value is zero, there is no stereoscopic display effect; if the depth value is smaller (negative value), the out-of-screen intensity is greater; if the depth value is larger (positive value), the in-screen intensity is greater.

[0090] According to an embodiment of the present disclosure, the screen entry and exit area and the zero plane area in the naked eye 3D image can be determined according to the depth semantic analysis result. The screen entry and exit area can be understood as the area with screen entry and exit intensity in the naked eye 3D image, and the zero plane area can be understood as the area without stereoscopic display effect in the naked eye 3D image.

[0091] Figure 5 A naked-eye 3D image according to an embodiment of the present disclosure is schematically shown.

[0092] like Figure 5As shown, the pixels in the entry and exit screen area 501 have an entry and exit screen intensity, and the pixels in the zero plane area 502 are in the zero plane. In one example, the naked-eye 3D display window can be, for example, a video player window, and the naked-eye 3D image 500 can be an image displayed in the video player window. What is displayed in the entry and exit screen area 501 can be, for example, a naked-eye 3D video, and the naked-eye 3D video has an entry and exit screen intensity. What is displayed in the zero plane area 502 can include, for example, but is not limited to, content without a stereoscopic display effect, such as a function bar of a video player and a black border of a video. It can be understood that in the process of adjusting the naked-eye 3D display window, it is necessary to ensure that the pixels in the entry and exit screen area 501 can be accurately and stably displayed in 3D, so as to ensure the accuracy of the 3D display effect and the visual comfort during the adjustment process.

[0093] According to an embodiment of the present disclosure, the operation type of the adjustment operation can be determined according to the current position information and the target position information. Exemplarily, according to the current position information and the target position information, the changes in the window position and the window size of the naked eye 3D display window can be determined, so that the operation type of the adjustment operation can be determined. Among them, the operation type can include a translation operation or a zoom operation.

[0094] According to an embodiment of the present disclosure, a newly added naked-eye 3D display area can be determined according to the current position information and the target position information, wherein the newly added naked-eye 3D display area can be understood as a newly added naked-eye 3D display area of ​​the target position information relative to the current position information.

[0095] Exemplarily, control information related to the 3D mode area of ​​the directional backlight array can be adjusted based on the zero plane area and the newly added naked-eye 3D display area to ensure that the backlight corresponding to the newly added naked-eye 3D display area can be accurately projected to the left and right eyes of the viewer.

[0096] According to an embodiment of the present disclosure, the naked-eye 3D image can be adjusted based on the adjustment type. As an example, when the naked-eye 3D display window is panned, the display position of the naked-eye 3D image needs to be adjusted to keep the naked-eye 3D display image and the naked-eye 3D display window moving synchronously. As another example, when the naked-eye 3D display window is zoomed, the display position, image size and image content of the naked-eye 3D image need to be adjusted to keep the naked-eye 3D image and the naked-eye 3D display window adapted, and the image parallax is controlled within a reasonable range.

[0097] According to an embodiment of the present disclosure, determining the adjustment type of the adjustment operation according to the current position information and the target position information of the naked-eye 3D display window, and determining a newly added naked-eye 3D display area includes: determining the adjustment type according to the difference between the target position information and the current position information; and determining the non-overlapping area of ​​the target position information relative to the current position information as a newly added naked-eye 3D area.

[0098] According to an embodiment of the present disclosure, the adjustment type can be determined according to the difference between the target position information and the current position information. The difference between the target position information and the current position information can indicate the change of the naked eye 3D display window in the window position and the window size. Exemplarily, if the window size remains unchanged and only the window position changes, the adjustment type can be determined to be a translation operation. If both the window size and the window position change, the adjustment type can be determined to be a zoom operation.

[0099] According to an embodiment of the present disclosure, a non-overlapping area of ​​the target position information relative to the current position information can be determined as a newly added naked eye 3D area. For example, the overlapping area can be determined based on the intersection of the target position information and the current position information. The non-overlapping area can be determined based on the target position information and the overlapping area, and the non-overlapping area is the newly added naked eye 3D display area.

[0100] According to an embodiment of the present disclosure, the directional backlight array control information includes the position information of the 3D mode area and the activation time of the 3D mode area; based on the zero plane area and the newly added naked-eye 3D display area, adjusting the directional backlight array control information includes: determining the zero plane area width based on the inner boundary of the zero plane area and the outer boundary of the naked-eye 3D display window; determining the position information of the target 3D mode area based on the newly added naked-eye 3D display area and the zero plane area width; and determining the activation time of the newly added 3D mode area to be before the next backlight refresh time.

[0101] According to an embodiment of the present disclosure, the control information of the directional backlight array may include position information of the 3D mode area and an activation time of the 3D mode area.

[0102] According to an embodiment of the present disclosure, the position information of the 3D mode area may include the coordinates of the directional backlight unit at the boundary of the 3D mode area, and the directional backlight unit that needs to enable the 3D display mode can be determined based on the position information of the 3D mode area. The position information of the 3D mode area corresponds to the window boundary coordinates of the naked-eye 3D display window. For example, the first 3D mode area of ​​the directional backlight array can be determined based on the current position information of the naked-eye 3D display window. For example, the second 3D mode area of ​​the directional backlight array can be determined based on the target position information of the naked-eye 3D display window. Further, the overlapping 3D mode area can be determined based on the first 3D mode area and the second 3D mode area. The overlapping 3D mode area can be subtracted from the second 3D mode area to obtain a newly added 3D mode area of ​​the directional backlight array. The newly added 3D mode area corresponds to the newly added naked-eye 3D display area mentioned above.

[0103] According to the embodiments of the present disclosure, the activation time of the 3D mode area can be understood as the time when the display mode of each directional backlight unit in the 3D mode area is adjusted to the 3D display mode activation. For example, the 3D display mode of each directional backlight unit in the S1 area can be activated at time t1, and the 3D display mode of each directional backlight unit in the S2 area can be activated at time t2.

[0104] According to an embodiment of the present disclosure, the width of the zero plane area can be determined based on the inner boundary of the zero plane area and the outer boundary of the naked eye 3D display window. The width of the zero plane area can characterize the distance between the zero plane display portion and the edge of the naked eye 3D display window. During the adjustment process, the width of the zero plane area remains unchanged.

[0105] Fig. 6A The zero plane area width according to one embodiment of the present disclosure is schematically illustrated.

[0106] like Fig. 6A As shown, the zero plane area width may be determined according to the inner boundary 602a of the zero plane area and the outer boundary 601a of the naked eye 3D display window. For example, the zero plane area width may include a first width D1, a second width D2, a third width D3 and a fourth width D4.

[0107] According to an embodiment of the present disclosure, the naked-eye 3D display window corresponds to the 3D mode area of ​​the directional backlight array, and the naked-eye 3D image is displayed in the naked-eye 3D display window, so the naked-eye 3D image corresponds to the 3D mode area of ​​the directional backlight array.

[0108] According to an embodiment of the present disclosure, the 3D mode area may include a first sub-area corresponding to the entry and exit screen area, and a second sub-area corresponding to the zero plane area, wherein the directional backlight units in the first sub-area and the second sub-area both enable the 3D display mode.

[0109] It is understandable that in the process of adjusting the naked-eye 3D display window, it is necessary to ensure that the 3D display mode of each directional backlight unit in the first sub-area is enabled to ensure that the 3D visual effect of the screen entry and exit area can be displayed normally. In the case of adjusting the naked-eye 3D display window, the position information of the naked-eye 3D display window has changed, and the corresponding first sub-area of ​​the directional backlight array also needs to be updated synchronously. If the adjustment speed of the naked-eye 3D display window is too fast, the directional backlight unit in the corresponding first sub-area cannot enable the 3D display mode in time, and the 3D display effect of part of the content in the naked-eye 3D image will be lost.

[0110] According to an embodiment of the present disclosure, the target 3D mode area may be understood as an area in the target first sub-area corresponding to the next backlight refresh moment in which the 3D display mode is not enabled at the current backlight refresh moment.

[0111] In one embodiment, the first 3D mode area may include a current first sub-area corresponding to the entry and exit screen area, and a current second sub-area corresponding to the zero plane area. The second 3D mode area may include a target first sub-area corresponding to the entry and exit screen area, and a target second sub-area corresponding to the zero plane area. During the adjustment process, if the target first sub-area exceeds the range of the first 3D mode area, the exceeding part may be determined as the target 3D mode area. In order to ensure the 3D display effect of the entry and exit screen area, the target 3D mode area may be enabled in advance, that is, the directional backlight unit in the target 3D mode area may be enabled in advance to enable the 3D display mode. It should be noted that if the target first sub-area does not exceed the range of the first 3D mode area, no advance processing is required.

[0112] According to an embodiment of the present disclosure, the position information of the target 3D mode area can be determined based on the newly added naked eye 3D display area and the width of the zero plane area. Exemplarily, the newly added 3D mode area can be determined based on the newly added naked eye 3D display area. In the case where the target first sub-area exceeds the range of the first 3D mode area, the zero plane area width can be correspondingly subtracted from the newly added 3D mode area to obtain the target 3D mode area, so that the position information of the target 3D mode area can be determined.

[0113] Figure 6B The diagram schematically shows a newly added 3D mode area according to an embodiment of the present disclosure.

[0114] like Figure 6BAs shown, in the directional backlight array 600b, the current position information of the naked eye 3D display window corresponds to the first 3D mode area 601b. At the current backlight refresh moment, the 3D display mode of each directional backlight unit within the first 3D mode area 601b is enabled, and the 3D display mode of each directional backlight unit outside the first 3D mode area 601b is not enabled.

[0115] like Figure 6B As shown, in the directional backlight array 600b, the target position information of the naked eye 3D display window corresponds to the second 3D mode area 602b. At the next backlight refresh moment, the 3D display mode of each directional backlight unit in the second 3D mode area 602b needs to be enabled.

[0116] like Figure 6B As shown, the first 3D mode area 601b may include a current first sub-area 603b corresponding to the entry and exit screen area, and a current second sub-area 604b corresponding to the zero plane area. The second 3D mode area 602b may include a target first sub-area 603b´ corresponding to the entry and exit screen area, and a target second sub-area 604b´ corresponding to the zero plane area. It can be understood that the target 3D mode area 605b is within the target first sub-area 603a´ of the second 3D mode area 602b, and the directional backlight unit within the target 3D mode area 605b is not enabled in the 3D display mode.

[0117] According to an embodiment of the present disclosure, the activation time of the target 3D mode area 605b can be determined to be before the next backlight refresh time, that is, each directional backlight unit in the target 3D mode area 605b activates the 3D display mode before the next backlight refresh time.

[0118] Figure 6C A newly added 3D mode area according to another embodiment of the present disclosure is schematically shown.

[0119] like Figure 6C As shown, in the directional backlight array 600c, the current position information of the naked eye 3D display window corresponds to the first 3D mode area 601c. At the current backlight refresh moment, the 3D display mode of each directional backlight unit within the first 3D mode area 601c is enabled, and the 3D display mode of each directional backlight unit outside the first 3D mode area 601c is not enabled.

[0120] like Figure 6C As shown, in the directional backlight array 600c, the target position information of the naked eye 3D display window corresponds to the second 3D mode area 602c. At the next backlight refresh moment, the 3D display mode of each directional backlight unit in the second 3D mode area 602c needs to be enabled.

[0121] like Figure 6C As shown, the first 3D mode area 601c may include a current first sub-area 603c corresponding to the entry and exit screen area, and a current second sub-area 604c corresponding to the zero plane area. The second 3D mode area 602c may include a target first sub-area 603c' corresponding to the entry and exit screen area, and a target second sub-area 604c' corresponding to the zero plane area. It can be understood that the target 3D mode area 605c is within the target first sub-area 603c' of the second 3D mode area 602c, and the directional backlight unit within the target 3D mode area 605c is not enabled.

[0122] According to an embodiment of the present disclosure, the activation time of the target 3D mode area 605c can be determined to be before the next backlight refresh time, that is, each directional backlight unit in the target 3D mode area 605c activates the 3D display mode before the next backlight refresh time.

[0123] According to the embodiments of the present disclosure, by enabling the 3D display mode of the directional backlight unit in the target 3D mode area in advance, it is possible to effectively avoid the situation where the directional backlight unit in the target 3D mode area cannot enable the 3D display mode in time due to too fast an adjustment speed. This can maintain the accuracy, stability and continuity of the 3D display effect during the adjustment process, thereby ensuring that the viewer has a better 3D visual experience during the adjustment process.

[0124] According to an embodiment of the present disclosure, the adjustment type includes a translation operation or a zoom operation. Based on the adjustment type, adjusting the naked-eye 3D image includes: acquiring an original naked-eye 3D image to be displayed, the original naked-eye 3D image includes a first-perspective original image and a second-perspective original image, and there is an initial baseline length between the first-perspective original image and the second-perspective original image; when the adjustment operation is a zoom operation, determining a target baseline length based on a zoom multiple of the zoom operation and the initial baseline length; determining a target parallax based on the target baseline length; and generating a first-perspective generated image and a second-perspective generated image based on the first-perspective original image and the second-perspective original image according to the target parallax.

[0125] According to an embodiment of the present disclosure, when the naked-eye 3D display window is translated, since the window size of the naked-eye 3D display window remains unchanged during the movement and only the window position changes, only the display position of the naked-eye 3D image needs to be adjusted.

[0126] According to another embodiment of the present disclosure, when a zoom operation is performed on a naked-eye 3D display window, since the window size and window position of the naked-eye 3D display window change during the movement, it is necessary to adjust the display position and image size of the naked-eye 3D image. In addition, in order to ensure that the image parallax is within a reasonable range during the adjustment process, it is also necessary to adjust the image content of the naked-eye 3D image. For the sake of visual comfort and 3D display effect, when the viewer zooms in / out the naked-eye 3D display window, the visual experience presented to the viewer should be that the object becomes larger / smaller with the operation, but the position of the object from the viewer will not change significantly with the zoom operation, which requires adjusting the image content of the naked-eye 3D image to make the degree of change in the depth of the object felt by the viewer during the adjustment process smaller.

[0127] According to one embodiment of the present disclosure, the first viewing angle may correspond to the left eye of the viewer, for example, and the second viewing angle may correspond to the right eye of the viewer, for example.

[0128] According to an embodiment of the present disclosure, the original naked eye 3D image to be displayed includes a left eye original image and a right eye original image, and there is an initial baseline length between the left eye original image and the right eye original image. The left eye image may correspond to a left camera, the right eye image may correspond to a right camera, and the initial baseline length may be understood as the distance between the optical center of the left camera and the optical center of the right camera.

[0129] According to the embodiments of the present disclosure, the left-eye original image and the right-eye original image can be converted into physical sizes according to the size of the display panel. For an object in the image, the real depth of the object can be determined based on the binocular parallax principle, the original parallax between the converted left-eye original image and the right-eye original image, and the initial baseline length.

[0130] According to the embodiments of the present disclosure, a suitable target baseline length may be determined based on the real depth and zoom factor of the object, and then the target parallax may be determined according to the target baseline length.

[0131] Exemplarily, the target baseline length may be determined based on the following formula:

[0132]

[0133] Where B is the target baseline length, Dn is the real depth of the object, P2 is the maximum positive parallax that the display panel can display, P1 is the maximum negative parallax that the display panel can display, k is the zoom factor, and f is the camera focal length. For the same content acquisition scene, Dn and f are constants, and for the same display panel, P2-P1 is a constant.

[0134] As an example, if the target baseline length is less than the initial baseline length, the target viewpoint may be determined by viewpoint interpolation. If the target baseline length is greater than the initial baseline length, the target viewpoint may be determined by viewpoint extrapolation. The target viewpoint may be understood as the target left camera position and the target right camera position corresponding to the target baseline length.

[0135] According to an embodiment of the present disclosure, the target disparity can be determined according to the target viewpoint and the real depth of the object. According to the target disparity, the left eye generated image and the right eye generated image can be generated based on the left eye original image and the right eye original image. Exemplarily, the left eye generated image and the right eye generated image can be generated by, for example, 3D Gaussian splash reconstruction technology, diffusion model, optical flow interpolation technology, etc., which are not limited here.

[0136] Figure 7 The left and right eye images before and after adjustment according to an embodiment of the present disclosure are exemplarily shown.

[0137] like Figure 7 As shown, when the viewer zooms in on the naked-eye 3D display window, an adjusted left-eye generated image and a right-eye generated image can be generated based on the left-eye original image and the right-eye original image according to the target parallax, so as to present the viewer with a visual experience in which the object becomes larger with the operation, but the position of the object from the viewer does not change significantly with the zoom operation.

[0138] According to the embodiments of the present disclosure, the real depth of the object can be determined based on the original naked-eye 3D image, so that the appropriate target parallax can be determined based on the real depth of the object and the zoom factor. By regenerating the left-eye image and the right-eye image based on the target parallax, the depth change of the object felt by the viewer during the adjustment process can be small, so that the viewer can have a better 3D visual experience when zooming in / out the naked-eye 3D display window.

[0139] Figure 8 A block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown.

[0140] like Figure 8 As shown, the electronic device 800 may include a naked eye 3D display and at least one processor. The naked eye 3D display includes a directional backlight array, and the directional backlight array is used for naked eye 3D display. The at least one processor is used to execute the following method:

[0141] In response to receiving an adjustment operation for a naked-eye 3D display window, a semantic analysis is performed on the naked-eye 3D image to determine a depth semantic analysis result; based on the adjustment operation, target position information of the naked-eye 3D display window is determined; based on the depth semantic analysis result and the target position information, the directional backlight array control information and the naked-eye 3D image are adjusted, and the directional backlight array control information is used to realize the naked-eye 3D display of the naked-eye 3D image; based on the adjusted directional backlight array control information, the adjusted naked-eye 3D image is displayed. Based on this, the electronic device 800 can implement the naked-eye 3D display adjustment method as described above.

[0142] As just one example, the naked eye 3D display may be a naked eye 3D display based on directional backlight technology. For example, the naked eye 3D display may include a directional backlight array and a display panel, and the directional backlight array may include a backlight unit array, a lens array, a diffusion film layer, etc. Optionally, the naked eye 3D display may also be a display based on other naked eye 3D display technologies, which are not specifically limited here.

[0143] Exemplarily, the processor may include, for example, a general-purpose microprocessor, an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor may also include an onboard memory for cache purposes. The processor 510 may be a single processing unit or multiple processing units for performing different actions of the method flow for adjusting naked-eye 3D display as described above.

[0144] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0145] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0146] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0147] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0148] A computer system may include a client and a server. The client and the server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises through computer programs running on respective computers and having a client-server relationship to each other. The server may be a cloud server, a server in a distributed system, or a server combined with a blockchain.

[0149] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of this disclosure can be achieved, and there is no limitation here.

[0150] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0151] Although the present disclosure has been shown and described with reference to specific exemplary embodiments of the present disclosure, it should be understood by those skilled in the art that various changes in form and details may be made to the present disclosure without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents. Therefore, the scope of the present disclosure should not be limited to the above-mentioned embodiments, but should be determined not only by the appended claims, but also by the equivalents of the appended claims.

Claims

1. A naked eye 3D display adjustment method, comprising: In response to receiving an adjustment operation for the naked-eye 3D display window, performing semantic analysis on the naked-eye 3D image to determine a depth semantic analysis result; Based on the adjustment operation, determining target position information of the naked-eye 3D display window; Based on the depth semantic analysis result and the target position information, adjusting directional backlight array control information and the naked-eye 3D image, the directional backlight array control information being used to realize naked-eye 3D display of the naked-eye 3D image; Based on the adjusted directional backlight array control information, the adjusted naked-eye 3D image is displayed.

2. The method according to claim 1, wherein: The operation type of the adjustment operation includes a translation operation or a zoom operation.

3. The method according to claim 1, wherein: In response to receiving the adjustment operation for the naked-eye 3D display window, performing semantic analysis on the naked-eye 3D image and determining the depth semantic analysis result includes: In response to receiving the adjustment operation, acquiring the naked-eye 3D image in the naked-eye 3D display window; Based on the depth semantic analysis model, feature extraction is performed on the naked eye 3D image to obtain depth features; Based on the depth feature, the depth semantic analysis result is determined.

4. The method according to claim 1, wherein: The determining, based on the adjustment operation, target position information of the naked-eye 3D display window comprises: Analyzing the adjustment operation based on the current position information of the naked-eye 3D display window to determine an adjustment speed of the adjustment operation; The target position information of the naked-eye 3D display window is determined according to the current position information, the adjustment speed and the time interval of backlight refresh.

5. The method according to claim 4, wherein: The analyzing the adjustment operation based on the current position information of the naked-eye 3D display window to determine the adjustment speed of the adjustment operation includes: Based on multiple historical backlight refresh moments, determining multiple historical position information of the naked-eye 3D display window; The adjustment operation is analyzed according to the current position information and the plurality of historical position information to determine an adjustment speed of the adjustment operation.

6. The method according to claim 1, wherein: The adjusting the directional backlight array control information and the naked-eye 3D image based on the depth semantic analysis result and the target position information comprises: Determining, according to the depth semantic analysis result, an entry / exit screen area and a zero plane area in the naked eye 3D image; Determining the adjustment type of the adjustment operation and determining a newly added naked-eye 3D display area according to the current position information of the naked-eye 3D display window and the target position information; Adjusting the directional backlight array control information based on the zero plane area and the newly added naked-eye 3D display area; Based on the adjustment type, the naked-eye 3D image is adjusted.

7. The method according to claim 6, wherein: The determining, according to the current position information of the naked-eye 3D display window and the target position information, the adjustment type of the adjustment operation and the determining of a newly added naked-eye 3D display area include: determining the adjustment type according to a difference between the target position information and the current position information; A non-overlapping area of ​​the target position information relative to the current position information is determined as the newly added naked-eye 3D area.

8. The method according to claim 6, wherein: The directional backlight array control information includes position information of the 3D mode area and activation time of the 3D mode area; and adjusting the directional backlight array control information based on the zero plane area and the newly added naked eye 3D display area includes: Determine a zero plane area width based on an inner boundary of the zero plane area and an outer boundary of the naked-eye 3D display window; Determining position information of a target 3D mode area based on the newly added naked-eye 3D display area and the width of the zero plane area; and The activation time of the target 3D mode area is determined to be before the next backlight refresh time.

9. The method according to claim 6, wherein: The adjustment type includes a translation operation or a zoom operation, and adjusting the naked-eye 3D image based on the adjustment type includes: Acquire an original naked-eye 3D image to be displayed, wherein the original naked-eye 3D image includes a first-viewing angle original image and a second-viewing angle original image, and an initial baseline length exists between the first-viewing angle original image and the second-viewing angle original image; In the case where the adjustment operation is a zoom operation, determining a target baseline length based on a zoom factor of the zoom operation and the initial baseline length; determining a target disparity based on the target baseline length; According to the target disparity, a first-perspective generated image and a second-perspective generated image are generated based on the first-perspective original image and the second-perspective original image.

10. An electronic device, comprising: A naked-eye 3D display, the naked-eye 3D display comprising a directional backlight array, the directional backlight array being used for naked-eye 3D display; At least one processor, the at least one processor is configured to execute the following method: In response to receiving an adjustment operation for the naked-eye 3D display window, performing semantic analysis on the naked-eye 3D image to determine a depth semantic analysis result; Based on the adjustment operation, determining target position information of the naked-eye 3D display window; Based on the depth semantic analysis result and the target position information, adjusting directional backlight array control information and the naked-eye 3D image, the directional backlight array control information being used to realize naked-eye 3D display of the naked-eye 3D image; Based on the adjusted directional backlight array control information, the adjusted naked-eye 3D image is displayed.

Images