A naked eye 3D display control method, device and electronic equipment
Patent Information
- Application Number
- CN202310147812.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-21
- Publication Date
- 2026-10-27
- Estimated Expiration
- 2043-02-21
AI Technical Summary
但目前的裸眼3D显示效果仍然不够理想
[0037]经由上述的技术方案可知,本申请实施例公开了一种裸眼3D显示控制方法及、装置及电子设备,方法包括:获得显示屏的运动信息;基于所述运动信息确定所述显示屏的位姿信息;基于所述位姿信息确定虚拟对象的显示方式和显示位置;控制以所述显示方式在所述显示位置上输出所述虚拟对象的虚拟图像。上述方案在显示屏运动时,能够确定出显示屏的位姿信息,并跟随位姿信息的变化动态的调整虚拟对象的显示参数,使得观看者的3D观感更加真实逼真,提升用户观看体验。
Smart Images

Figure CN116193099B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of 3D display technology, and more specifically, to a naked-eye 3D display control method, device and electronic device. Background Technology
[0002] Naked-eye 3D displays can create in-screen or out-of-screen display effects by adjusting the positive and negative parallax of the binocular parallax images. In the in-screen display effect, the 3D scene perceived by the human eye appears behind the screen; in the out-of-screen display effect, the 3D scene perceived by the human eye appears in front of the screen, such as... Figure 1 As shown. However, the current naked-eye 3D display effect is still not ideal. Summary of the Invention
[0003] In view of the above, this application provides the following technical solution:
[0004] A glasses-free 3D display control method, comprising:
[0005] Obtain motion information from the display screen;
[0006] The pose information of the display screen is determined based on the motion information;
[0007] The display method and display position of the virtual object are determined based on the pose information;
[0008] The system controls the output of a virtual image of the virtual object at the display location in the specified display manner.
[0009] Optionally, determining the display mode and display position of the virtual object based on the pose information includes:
[0010] The display mode and display position of the virtual object are determined based on the change data of the display screen's pose information in the previous cycle and the pose information in the current cycle.
[0011] Optionally, determining the display mode and display position of the virtual object based on the pose information includes:
[0012] The display mode and display position of the virtual object are determined based on the display position of the virtual object in the previous cycle and the pose information.
[0013] Optionally, before determining the display mode and display position of the virtual object based on the pose information, the method further includes:
[0014] Obtain the eye position of the first user in front of the display screen;
[0015] Determining the display mode and display position of the virtual object based on the pose information includes:
[0016] The display method and display position of the virtual object are determined based on the eye position and the pose information.
[0017] Optionally, determining the display method and display position of the virtual object based on the eye position and the pose information includes:
[0018] Based on the eye position and the pose information, determine the relative position change information of the display screen relative to the eye;
[0019] The display method and display position of the virtual object are determined based on the relative position change information.
[0020] Optionally, determining the display mode and display position of the virtual object based on the pose information includes:
[0021] The display position of the virtual object is determined based on the eye position and the rendering effect of the preset virtual object;
[0022] The display method of the virtual object is determined based on the display position and the pose information.
[0023] Optionally, the display mode includes out-of-screen display and in-screen display, and the control outputs the virtual image of the virtual object at the display position in the display mode, including:
[0024] When the distance between the spatial presentation position corresponding to the display position and the eye position is greater than the distance between the display screen and the spatial presentation position corresponding to the display position, the virtual image of the virtual object is output at the display position using an in-screen display method.
[0025] When the distance between the spatial presentation position corresponding to the display position and the eye position is less than the distance between the display screen and the spatial presentation position corresponding to the display position, the virtual image of the virtual object is output at the display position using an off-screen display method.
[0026] Optionally, obtaining the motion information of the display screen includes:
[0027] Motion information of the display screen is obtained based on sensors inside the display screen, including but not limited to at least one of the following: an accelerometer, a displacement sensor, and an image sensor.
[0028] This application also discloses a glasses-free 3D display control device, comprising:
[0029] The information acquisition module is used to acquire motion information from the display screen;
[0030] The pose determination module is used to determine the pose information of the display screen based on the motion information;
[0031] The display determination module is used to determine the display mode and display position of the virtual object based on the pose information;
[0032] The display output module is used to control the output of the virtual image of the virtual object at the display position in the display manner.
[0033] Furthermore, this application also discloses an electronic device, including:
[0034] processor;
[0035] Memory for storing executable program instructions of the processor;
[0036] The executable program instructions include: obtaining motion information of the display screen; determining the pose information of the display screen based on the motion information; determining the display mode and display position of the virtual object based on the pose information; and controlling the output of the virtual image of the virtual object at the display position in the display mode.
[0037] As can be seen from the above technical solutions, this application discloses a naked-eye 3D display control method, device, and electronic device. The method includes: obtaining motion information of the display screen; determining the pose information of the display screen based on the motion information; determining the display mode and display position of a virtual object based on the pose information; and controlling the output of a virtual image of the virtual object at the display position in the specified display mode. The above solution can determine the pose information of the display screen when it moves, and dynamically adjust the display parameters of the virtual object according to the changes in the pose information, making the 3D viewing experience more realistic and enhancing the user's viewing experience. Attached Figure Description
[0038] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.
[0039] Figure 1 This is a schematic diagram illustrating the naked-eye 3D display principle disclosed in an embodiment of this application;
[0040] Figure 2 This is a flowchart of a naked-eye 3D display control method disclosed in the application embodiment;
[0041] Figure 3 This is a diagram illustrating the viewing effect of the display screen before and after moving in a traditional solution.
[0042] Figure 4 This is a schematic diagram illustrating the viewing effect of the display screen before and after the screen is moved according to this application.
[0043] Figure 5 This is a schematic diagram illustrating the positional relationship between a display screen and a user's movement, as disclosed in an embodiment of this application.
[0044] Figure 6 This is a schematic diagram illustrating the positional relationship between the display screen and the user's movement, as disclosed in another embodiment of this application.
[0045] Figure 7 This is a flowchart of another glasses-free 3D display control method disclosed in an embodiment of this application;
[0046] Figure 8 This is a flowchart of determining virtual object display parameters disclosed in an embodiment of this application;
[0047] Figure 9 This is another flowchart for determining virtual object display parameters disclosed in an embodiment of this application;
[0048] Figure 10 This is a schematic diagram of the structure of a naked-eye 3D display control device disclosed in an embodiment of this application;
[0049] Figure 11 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. Detailed Implementation
[0050] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0051] The embodiments of this application can be applied to electronic devices with naked-eye 3D display function. This application does not limit the product form of the electronic device, which may include but is not limited to smartphones, tablets, wearable devices, personal computers (PCs), netbooks, etc., and can be selected according to application requirements.
[0052] Figure 2 This is a flowchart illustrating a glasses-free 3D display control method disclosed in an embodiment of the application. See also... Figure 2 As shown, the naked-eye 3D display control method may include:
[0053] Step 201: Obtain motion information from the display screen.
[0054] The display screen is a glasses-free 3D display screen. During extended viewing, users may experience fatigue or adjust the screen's position or orientation for comfort. To provide a more realistic and natural visual experience, the display needs to dynamically adjust its movement, requiring the acquisition of motion information.
[0055] In practice, motion information of the display screen can be obtained through sensors installed inside the screen to ensure the accuracy of the detected motion information and provide reliable and accurate basic data for subsequent processing. The sensors installed inside the display screen may include, but are not limited to, at least one of the following: an accelerometer, a displacement sensor, and an image sensor. The image sensor can be positioned above the display screen, which not only facilitates daily use but also provides a wider field of view, enabling algorithmic applications of the acquired images and accurate determination of the display screen's motion information.
[0056] Step 202: Determine the pose information of the display screen based on the motion information.
[0057] The motion data represents data detected by sensors during the movement of the display screen. However, this motion information alone cannot directly determine the screen's pose. Algorithms are needed to process and calculate this sensor data to determine the screen's pose information. Different processing algorithms are used for data collected by different types of sensors, but the final result is always the screen's pose information.
[0058] After obtaining the pose information of the display screen in the current cycle, and combining it with the pose information of the display screen in the previous cycle, it is possible to determine the pose change information of the display screen, that is, to determine in which direction the display screen has moved and how far in the current cycle, thereby determining how the display mode and display position of the virtual object should be adjusted.
[0059] Step 203: Determine the display method and display position of the virtual object based on the pose information.
[0060] In this embodiment, the display method may include, but is not limited to, off-screen display and on-screen display. The display position represents the display position of the virtual object relative to the display screen, not the spatial presentation position of the virtual object. For example, the display position may be 50 cm inside the display screen, or 20 cm outside the display screen.
[0061] In traditional solutions, the display method and position of virtual scenes on a naked-eye 3D display screen are fixed. That is, the virtual scene is bound to the display screen; changes in the screen's position do not alter the display method or position of virtual objects. Therefore, when the screen's pose changes, the virtual scene moves with it. For example, if the screen is likened to a window in three-dimensional space, during window movement, the displayed virtual objects or scenes can only be presented at a fixed position on one side of the screen. Figure 3 The diagram illustrates the viewing effect before and after the traditional display screen moves; however, this doesn't provide a realistic viewing experience and fails to convey the natural feel of 3D. Therefore, this solution dynamically adjusts the display method and position of virtual objects or scenes based on the display screen's pose information. For example, if the display screen is metaphorically considered a window in three-dimensional space, the spatial position of the virtual object remains largely unchanged as the window moves away from the viewer. Only when the window moves backward, allowing the virtual object to "pass through" the window, will the virtual object originally behind the window move to the front, changing the display method from in-screen display to out-of-screen display. Figure 4 The image shown is a schematic diagram illustrating the viewing effect of the display screen before and after the screen is moved according to this application.
[0062] Step 204: Control the output of the virtual image of the virtual object at the display position in the specified display manner.
[0063] Once the display method and position of the virtual object are determined, the virtual object can be directly controlled to be output at the determined display position. This allows for dynamic adjustment of the naked-eye 3D display's entry and exit display methods, as well as changes in the display position, following the screen's movement. Although the virtual object's display position and method may change during screen movement, the virtual object's spatial presentation remains constant, giving the user the impression that only the screen is moving, making the entire process more natural and realistic.
[0064] It should be noted that, in order to ensure the smooth and continuous display of naked-eye 3D content, the implementation cycle of each of the above steps should not be too long, such as 0.2 seconds. The specific timeframe can be determined based on a comprehensive consideration of device performance and application scenario requirements. Furthermore, in all the examples of display screen movement in this document, the movement distance of the display screen in adjacent cycles is relatively large, and does not represent that the display screen can move such a large distance within a single cycle in actual applications. If it could actually move tens of centimeters within a single cycle, the display effect of the virtual object would appear jerky and discontinuous. The examples given are only to facilitate the reader's understanding of the implementation principle of this application's solution in conjunction with the corresponding accompanying drawings.
[0065] The naked-eye 3D display control method described in this embodiment can determine the position and pose information of the display screen when the screen moves, and dynamically adjust the display parameters of the virtual object according to the changes in the position and pose information. Overall, the presentation effect is linked with the movement information of the screen, making the 3D viewing experience of the viewer more realistic and natural, and improving the user viewing experience.
[0066] In the above embodiments, the determination of the display method and display position of the virtual object based on the pose information has different implementations, which will be described in turn below.
[0067] In one implementation, determining the display mode and display position of the virtual object based on the pose information may include: determining the display mode and display position of the virtual object based on the change data of the pose information of the display screen in the previous cycle and the pose information in the current cycle.
[0068] In this implementation, the display mode and position of the virtual object are determined solely based on the changes in the virtual object's front-to-back pose information. The overall principle is to maintain the virtual object's spatial position and size unchanged. Under this principle, if the display screen only moves in the front-to-back direction, the user will only perceive the screen's front-to-back movement during the movement, while the observed virtual object's position in space remains unchanged.
[0069] For example, if the display screen was in the first position in the previous cycle, and the display screen was detected to have moved 10cm closer to the user in this cycle, then the actual spatial position of the virtual object remains unchanged, but it has moved 10cm away from the viewer relative to the display screen, and is now in the second position. Figure 5 This is a schematic diagram illustrating the positional relationship between the display screen and the user's movement, as disclosed in the embodiments of this application. Figure 5 In the scene shown, the display screen is in an out-of-screen mode before it moves, and the distance between the display screen and the virtual object is 30cm. After the display screen moves, it is still in an out-of-screen mode, but the distance between the display screen and the virtual object is reduced to 20cm. During this process, the spatial position of the virtual object does not change, only the position of the display screen changes.
[0070] In this embodiment, the influence of other factors such as the viewer and the virtual object is not considered. The display method and display position of the virtual object are determined only based on the position difference data before and after the display screen is moved. The overall data processing volume is small and the response is fast, making it suitable for applications with high requirements for response speed.
[0071] In another implementation, determining the display mode and display position of the virtual object based on the pose information may include: determining the display mode and display position of the virtual object based on the display position of the virtual object in the previous cycle and the pose information.
[0072] The overall principle in this implementation can also be to keep the spatial display position and size of the virtual object unchanged, but the specific implementation method differs from the previous implementation. Specifically, in this embodiment, based on the display position of the virtual object in the previous cycle, its spatial presentation position can be determined through coordinate system transformation. After determining the latest pose information in the current cycle, the display mode and display position of the virtual object can be determined based on the spatial presentation position.
[0073] For example, if the virtual object was displayed in the in-screen mode in the previous cycle, and its display position was 10cm away from the display screen; the world coordinates of the display screen are known, and the spatial presentation position of the virtual object can be determined after coordinate system transformation; then the display screen moves, and the actual movement trajectory may be that it moves 25cm closer to the user side. Based on the latest pose information of this cycle and the relative relationship with the spatial presentation position, it can be determined that the display mode of the virtual object changes to out-of-screen display, and the display position is 15cm away from the display screen. Figure 6 This is a schematic diagram illustrating the positional relationship between the display screen and the user's movement, as disclosed in another embodiment of this application. Figure 6 The scenario shown corresponds to the example above. Before and after the screen moves, the display method of the virtual object changes from in-screen display to out-of-screen display, and the display position also changes from 10cm inside the screen to 15cm outside the screen.
[0074] This application combines the display position and pose information of the virtual object in the previous period to determine the display mode and display position of the virtual object in the current period. The algorithm processing is slightly more complex than the previous implementation that simply determines the corresponding data based on pose information, but the result is also more accurate. In practical applications, an appropriate method can be selected to determine the display mode and display position of the virtual object according to the needs of the scenario.
[0075] Figure 7 This is a flowchart illustrating another glasses-free 3D display control method disclosed in an embodiment of this application. (In conjunction with...) Figure 7 As shown, the naked-eye 3D display control method may include:
[0076] Step 701: Obtain motion information from the display screen.
[0077] Step 702: Determine the pose information of the display screen based on the motion information.
[0078] Step 703: Obtain the eye position of the first user in front of the display screen.
[0079] Generally, the movement of a display screen during use includes movement away from the viewer and movement towards the viewer. Therefore, this application embodiment also includes a step of obtaining the eye position of the first user in front of the display screen. After the eye position of the first user is determined, the distance between the eye position and the display screen can be obtained, which can then be applied to the determination of the virtual object display method and display position.
[0080] Specifically, an image of the first user's head can first be captured by a camera mounted on the display screen. Then, the position of the user's eyes, or the distance between the user's eyes and the display screen, can be determined based on an image recognition algorithm. The image recognition algorithm can determine the distance and orientation of the user's eyes from the display screen. The position of the user's eyes can be determined based on the known position of the display screen after determining the distance and orientation of the user's eyes; alternatively, an eye-tracking algorithm can be used to locate the spatial position of the user's eyes.
[0081] Step 704: Determine the display method and display position of the virtual object based on the eye position and the pose information.
[0082] In this embodiment, not only is the movement of the display screen considered, but also the movement of the user. For example, if a user feels eye and body fatigue while viewing a glasses-free 3D display, they will lean back against the chair and pull the display screen forward or push it backward. This approach, combining eye position and pose information to determine the display method and position of virtual objects, provides a more comprehensive consideration and is applicable to various application scenarios.
[0083] The specific method for determining the display method and position of virtual objects based on eye position and pose information will be described in detail in later embodiments, and will not be elaborated on here.
[0084] Step 705: Control the output of the virtual image of the virtual object at the display position in the display mode.
[0085] The naked-eye 3D display control method described in this application takes into account the user's eye movement scenario and combines it with the movement of the display screen to comprehensively determine the display mode and display position of virtual objects. The overall processing result is more user-friendly and can provide users with a realistic and natural 3D display effect in a variety of application scenarios.
[0086] Figure 8 This is a flowchart illustrating the determination of virtual object display parameters, as disclosed in an embodiment of this application. (In conjunction with...) Figure 8 As shown, in one implementation, the determination of the display method and display position of the virtual object based on the eye position and the pose information in the above embodiments may include:
[0087] Step 801: Determine the relative position change information of the display screen relative to the eyes based on the eye position and the pose information.
[0088] In this embodiment, the user's eye position and the specific direction and distance of the display screen's movement are not considered; only the relative positional changes between the two in the previous and current cycles are taken into account. The display method and position of the virtual object are determined based on the user's eye position and the relative position between the display screen and the user's eye position.
[0089] Step 802: Determine the display method and display position of the virtual object based on the relative position change information.
[0090] If the distance between the two objects increases, the virtual object's display position moves closer to the user relative to the screen; if the distance between the two objects decreases, the virtual object's display position moves further away from the user relative to the screen.
[0091] For example, if the display screen was 50cm away from the user's eyes before the movement and 70cm away from the user's eyes after the movement, the display mode and position of the virtual object are determined without considering how the display screen moved or how the user's eyes moved. The display mode and position of the virtual object in this period are determined only based on the relative position change information and the display position of the virtual object in the previous period.
[0092] Figure 9 This is another flowchart for determining virtual object display parameters disclosed in an embodiment of this application. (In conjunction with...) Figure 9 As shown, in another implementation, determining the display method and display position of the virtual object based on the eye position and the pose information may include:
[0093] Step 901: Determine the spatial presentation position of the virtual object based on the eye position and the preset presentation effect of the virtual object.
[0094] In this embodiment, the movement of the display screen and the user's eyes is not considered as a whole. Only after determining the user's eye position, the display position of the virtual object is determined based on the rendering effect of the virtual object preset in the system. For example, if the system presets the rendering effect of the virtual object to include the distance between the virtual object and the user's eyes as a first distance, then the spatial rendering position of the virtual object can be determined once the user's eye position is determined. Once the spatial rendering position of the virtual object and the pose information of the display screen are determined, the display method and display position of the virtual object can be further determined.
[0095] Step 902: Determine the display method and display position of the virtual object based on the spatial presentation position and the pose information.
[0096] In one example, the system pre-sets the distance between the virtual object and the user's eyes to be 2 meters. Given the user's eye position, the spatial presentation position of the virtual object can be determined. If the distance between the display screen and the user's eyes is 1.5 meters, then the virtual object's display mode can be determined as in-screen display, with a display position 0.5 meters within the screen. Of course, this example is only used to help readers understand the specific implementation of this embodiment and does not constitute a fixed limitation on the processing solution of this embodiment.
[0097] This embodiment determines the display method and position of the virtual object, and refers to the display effect of the virtual object preset in the system. This ensures that no matter how the user's eyes and / or the display screen move, the user's viewing effect can be kept in a basically stable state, thus ensuring the user's comfort when using the naked-eye 3D display screen.
[0098] In the foregoing embodiments, the display mode includes out-of-screen display and in-screen display. The control of outputting the virtual image of the virtual object at the display position in the display mode may include: when the distance between the spatial presentation position corresponding to the display position and the eye position is greater than the distance between the display screen and the spatial presentation position corresponding to the display position, controlling the output of the virtual image of the virtual object at the display position using the in-screen display mode; when the distance between the spatial presentation position corresponding to the display position and the eye position is less than the distance between the display screen and the spatial presentation position corresponding to the display position, controlling the output of the virtual image of the virtual object at the display position using the out-of-screen display mode.
[0099] In other words, when the distance between the spatial presentation position of the virtual object and the user's eyes is greater than the distance between the spatial presentation position and the display screen, the display screen is located between the spatial presentation position and the user's eyes. Therefore, the virtual image can only be displayed using an in-screen display method, so that the virtual object seen by the user is farther away from the display screen. Conversely, when the distance between the spatial presentation position of the virtual object and the user's eyes is less than the distance between the spatial presentation position and the display screen, the display screen is located between the spatial presentation position and the user's eyes. Therefore, the virtual image can only be displayed using an out-of-screen display method, so that the virtual object seen by the user is closer to the display screen.
[0100] Furthermore, in practical applications, there may be multiple users in front of the naked-eye 3D display. In this case, it is necessary to identify the first user from among the multiple users and perform subsequent judgment and processing based on the first user's eye position to determine the display method and position of the virtual object. Specifically, the identification of the first user from multiple users can employ various selection strategies, such as identifying the user in the optimal viewing area in front of the display as the first user, or selecting an authorized user from among the multiple users based on pre-stored images of authorized users. This application does not impose a fixed limitation on the method of determining the first user.
[0101] This application's solution can determine the position and pose information of the display screen when the screen moves, and dynamically adjust the display parameters of the virtual object according to the changes in position and pose information, making the 3D viewing experience more realistic and lifelike for the viewer, and improving the user's viewing experience.
[0102] For the foregoing method embodiments, in order to simplify the description, they are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0103] The methods described in the above-disclosed embodiments of this application are detailed in terms of the methods. The methods of this application can be implemented by various forms of apparatus. Therefore, this application also discloses an apparatus. Specific embodiments are given below for detailed description.
[0104] Figure 10 This is a schematic diagram of the structure of a naked-eye 3D display control device disclosed in an embodiment of this application.
[0105] See Figure 10 As shown, the naked-eye 3D display control device 100 may include:
[0106] The information acquisition module 1001 is used to acquire motion information of the display screen.
[0107] The pose determination module 1002 is used to determine the pose information of the display screen based on the motion information.
[0108] The display determination module 1003 is used to determine the display mode and display position of the virtual object based on the pose information.
[0109] Display output module 1004 is used to control the output of the virtual image of the virtual object at the display position in the display mode.
[0110] The naked-eye 3D display control device described in this embodiment can determine the position and pose information of the display screen when the screen moves, and dynamically adjust the display parameters of the virtual object according to the changes in the position and pose information, so that the 3D viewing experience of the viewer is more realistic and lifelike, and the user viewing experience is improved.
[0111] In one implementation, the display determination module can be used to: determine the display mode and display position of the virtual object based on the change data of the pose information of the display screen in the previous cycle and the pose information in the current cycle.
[0112] In one implementation, the display determination module can be used to: determine the display mode and display position of the virtual object based on the display position of the virtual object in the previous cycle and the pose information.
[0113] In one implementation, the naked-eye 3D display control device may further include: an eye determination module, used to obtain the eye position of a first user in front of the display screen; then the display determination module can be specifically used to: determine the display mode and display position of the virtual object based on the eye position and the pose information.
[0114] In one implementation, the display determination module can be used to: determine the relative position change information of the display screen relative to the eyes based on the eye position and the pose information; and determine the display mode and display position of the virtual object based on the relative position change information of the display position of the virtual object in the previous period.
[0115] In one implementation, the display determination module can be used to: determine the spatial presentation position of the virtual object based on the eye position and the preset presentation effect of the virtual object; and determine the display mode and display position of the virtual object based on the spatial presentation position and the pose information.
[0116] In one implementation, the display method includes out-of-screen display and in-screen display. Specifically, the display output module can be used to: when the distance between the spatial presentation position corresponding to the display position and the eye position is greater than the distance between the display screen and the spatial presentation position corresponding to the display position, control the output of the virtual image of the virtual object at the display position using the in-screen display method; when the distance between the spatial presentation position corresponding to the display position and the eye position is less than the distance between the display screen and the spatial presentation position corresponding to the display position, control the output of the virtual image of the virtual object at the display position using the out-of-screen display method.
[0117] In one implementation, the information acquisition module can be used to: acquire motion information of the display screen based on sensors inside the display screen, including but not limited to at least one of the following: an acceleration sensor, a displacement sensor, and an image sensor.
[0118] The specific implementation of the above-mentioned naked-eye 3D display control device and its various modules can be found in the corresponding sections of the method embodiments, and will not be repeated here.
[0119] Any of the naked-eye 3D display control devices described in the above embodiments includes a processor and a memory. The information acquisition module, pose determination module, display determination module, display output module, eye determination module, etc. in the above embodiments are all stored as program modules in the memory, and the processor executes the above program modules stored in the memory to realize the corresponding functions.
[0120] The processor contains a kernel, which retrieves the corresponding program modules from memory. One or more kernels can be configured, and the processing of backtracking data can be achieved by adjusting kernel parameters.
[0121] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.
[0122] In an exemplary embodiment, a computer-readable storage medium is also provided, which can be directly loaded into the internal memory of a computer, and contains software code. After being loaded and executed by the computer, the computer program can implement the steps shown in any embodiment of the naked-eye 3D display control method described above.
[0123] In an exemplary embodiment, a computer program product is also provided, which can be directly loaded into the internal memory of a computer and contains software code. After being loaded and executed by the computer, the computer program can implement the steps shown in any embodiment of the naked-eye 3D display control method described above.
[0124] Furthermore, embodiments of this application provide an electronic device. Figure 11 This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of this application. See also... Figure 11 As shown, the electronic device 110 includes at least one processor 1101, at least one memory 1102 connected to the processor, and a bus 1103; wherein the processor and the memory communicate with each other through the bus; the processor is used to call program instructions in the memory to execute the above-mentioned naked-eye 3D display control method.
[0125] The executable program instructions include: obtaining motion information of the display screen; determining the pose information of the display screen based on the motion information; determining the display mode and display position of the virtual object based on the pose information; and controlling the output of the virtual image of the virtual object at the display position in the display mode.
[0126] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.
[0127] It should also be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0128] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
[0129] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for controlling glasses-free 3D display, comprising: Obtain motion information from the display screen; The pose information of the display screen is determined based on the motion information; Obtain the eye position of the first user in front of the display screen; The spatial presentation position of the virtual object is determined based on the eye position and the presentation effect of the preset virtual object; the presentation effect includes the spatial positional relationship of the virtual object relative to the first user's eye, and the spatial positional relationship includes at least the first distance between the virtual object and the first user's eye; Based on the changes in the spatial presentation position and the pose information, the display mode and display position of the virtual object relative to the display screen are determined to maintain the spatial presentation position of the virtual object unchanged; The system controls the output of a virtual image of the virtual object at the display location in the specified display manner.
2. The naked-eye 3D display control method according to claim 1, wherein determining the display mode and display position of the virtual object relative to the display screen based on the change data of the pose information, includes: The display mode and display position of the virtual object relative to the display screen are determined based on the change data of the pose information of the display screen in the previous cycle and the pose information in the current cycle.
3. The naked-eye 3D display control method according to claim 1, wherein determining the display mode and display position of the virtual object relative to the display screen based on the change data of the pose information, includes: The display mode and position of the virtual object relative to the display screen are determined based on the display position of the virtual object in the previous cycle and the change data of the pose information.
4. The naked-eye 3D display control method according to claim 1, based on the change data of the spatial presentation position and the pose information, determines the display mode and display position of the virtual object relative to the display screen, including: Based on the eye position and the pose information, determine the relative position change information of the display screen relative to the eye; The display method and display position of the virtual object relative to the display screen are determined based on the spatial presentation position and the relative position change information.
5. The naked-eye 3D display control method according to claim 1, wherein the display mode includes out-of-screen display and in-screen display, and the control outputs the virtual image of the virtual object at the display position in the display mode, comprising: When the distance between the spatial presentation position corresponding to the display position and the eye position is greater than the distance between the display screen and the spatial presentation position corresponding to the display position, the virtual image of the virtual object is output at the display position using an in-screen display method. When the distance between the spatial presentation position corresponding to the display position and the eye position is less than the distance between the display screen and the spatial presentation position corresponding to the display position, the virtual image of the virtual object is output at the display position using an off-screen display method.
6. The naked-eye 3D display control method according to claim 1, wherein obtaining the motion information of the display screen includes: Motion information of the display screen is obtained based on sensors inside the display screen, including but not limited to at least one of the following: an accelerometer, a displacement sensor, and an image sensor.
7. A glasses-free 3D display control device, comprising: The information acquisition module is used to acquire motion information from the display screen; The pose determination module is used to determine the pose information of the display screen based on the motion information; An eye positioning module is used to obtain the eye position of a first user in front of the display screen; The display determination module is used to determine the spatial presentation position of the virtual object based on the eye position and the preset presentation effect of the virtual object, and to determine the display mode and display position of the virtual object relative to the display screen based on the spatial presentation position and the change data of the pose information, so as to maintain the spatial presentation position of the virtual object unchanged. The presentation effect includes the spatial positional relationship between the virtual object and the first user's eye, and the spatial positional relationship includes at least a first distance between the virtual object and the first user's eye; The display output module is used to control the output of the virtual image of the virtual object at the display position in the display manner.
8. An electronic device, comprising: processor; Memory for storing executable program instructions of the processor; The executable program instructions include: obtaining motion information of the display screen; determining the pose information of the display screen based on the motion information; obtaining the eye position of a first user in front of the display screen; determining the spatial presentation position of the virtual object based on the eye position and a preset presentation effect of the virtual object; determining the display mode and display position of the virtual object relative to the display screen based on the spatial presentation position and the change data of the pose information, so as to maintain the spatial presentation position of the virtual object unchanged; and controlling the output of the virtual image of the virtual object at the display position in the display mode. The presentation effect includes the spatial positional relationship between the virtual object and the first user's eyes, and the spatial positional relationship includes at least a first distance between the virtual object and the first user's eyes.
Citation Information
Patent Citations
Stereoscopic imaging system and method thereof
US20130222363A1