Method for Dynamically Displaying a Three-Dimensional Image Object in a Stereoscopic Display Device, a Dynamic Stereoscopic Display Device, and a Computer Program Product

By rotating the display panel in a stereoscopic display device and sensing the position or movement of external real-world objects in combination with sensors, dynamically redirecting the display orientation of the three-dimensional image objects, the problem of insufficient dynamic display and interactivity in the stereoscopic display device is solved, and a highly interactive user experience and flexible multiple human-computer interaction modes are realized.

CN115812173BActive Publication Date: 2025-07-18BOE TECHNOLOGY GROUP CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180001224.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-20
Publication Date
2025-07-18
Estimated Expiration
2041-05-20

AI Technical Summary

Technical Problem

Existing stereoscopic display devices are difficult to achieve real-time interaction between dynamic display of three-dimensional image objects and external real-world objects, and lack flexibility and high interactive operation.

Method used

By rotating the display panel around the axis, combining sensors to sense the position or movement of external real-world objects, dynamically redirecting the display orientation of the three-dimensional image object, multiple sensors and processors work together to realize the real-time redirection of the three-dimensional image object associated with the position or movement of external real-world objects.

Benefits of technology

Provides a highly interactive user experience, allowing the stereo display device to interact with a single or multiple moving or stationary viewers, enhancing the user's interactive operation flexibility and real-time response capabilities with the display device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115812173B_ABST
    Figure CN115812173B_ABST
Patent Text Reader

Abstract

A method for dynamically displaying a three-dimensional image object in a TRIC display device in vivo is provided. The method includes: rotating a display panel (DP) about an axis (AX) to display a volumetric three-dimensional image; displaying a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system in a volumetric display area (DV); sensing the position or movement of an external real-world object within a sensing area (SZ); and displaying a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system in the volumetric display area (DV). The second three-dimensional image object is obtained by reorienting the first three-dimensional image object from an initial orientation to a target orientation; the reorientation is associated with the position or movement of the external real-world object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to display technology, and more particularly, to a method for dynamically displaying three-dimensional image objects in a stereoscopic display device, a dynamic stereoscopic display device, and a computer program product. Background Art

[0002] Contrary to the planar images in traditional display screens, a stereoscopic display device provides a visual representation of image objects in a physical three-dimensional space. In a stereoscopic display device, a viewer can view an image from multiple directions. Summary of the Invention

[0003] In one aspect, the present disclosure provides a method for dynamically displaying three-dimensional image objects in a stereoscopic display device, including: rotating a display panel around an axis to display a stereoscopic three-dimensional image; displaying a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system in the stereoscopic display area; sensing the position or movement of an external real-world object in a sensing area; and displaying a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system in the stereoscopic display area; wherein, the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and the redirection is related to the position or movement of the external real-world object.

[0004] Optionally, the method further includes: simultaneously detecting a plurality of real-world objects in the sensing area; and designating one of the plurality of real-world objects as the external real-world object; wherein, the redirection of the three-dimensional image object is not related to the position or movement of real-world objects other than the external real-world object.

[0005] Optionally, designating one of the plurality of real-world objects as the external real-world object includes at least one of the following: when sound signals are respectively detected from the plurality of real-world objects, selecting one or more objects having a sound intensity within a target intensity range from the plurality of real-world objects; when relative distances from the plurality of real-world objects to the stereoscopic display device are detected, selecting one or more objects having a relative distance within a target distance range from the plurality of real-world objects; or when relative heights of the plurality of real-world objects with respect to the stereoscopic display device are detected, selecting one or more objects having a relative height within a target height range from the plurality of real-world objects.

[0006] Optionally, in the process of designating one of the plurality of real-world objects as the external real-world object, selecting one or more objects with sound signals having a sound intensity within a target intensity range has a higher priority than selecting one or more objects with a relative distance within a target distance range, and selecting one or more objects with a relative distance within a target distance range has a higher priority than selecting one or more objects with a relative height within a target height range.

[0007] Optionally, the target intensity range is equal to or greater than 50 decibels; the target distance range is equal to or less than 1 meter; and the target height range is equal to or less than the relative height corresponding to the middle part of the stereoscopic display device.

[0008] Optionally, after sensing the position or movement of the external real-world object in the sensing area and before displaying the second three-dimensional image of the three-dimensional image object, the method further includes turning off the image display on the display panel for a pause period.

[0009] Optionally, sensing the position or movement of the external real-world object in the sensing area includes sensing the external real-world object entering the sensing area from outside the sensing area through a plurality of sensors; the method further includes: determining a first phase angle, the initial orientation being along a direction outward from the axis at the first phase angle; determining a second phase angle, the target orientation being along a direction from the axis to the external real-world object at the second phase angle; and when determining that the first phase angle and the second phase angle are different from each other, displaying the second three-dimensional image of the second three-dimensional image object such that the target orientation is along a direction outward from the axis at the second phase angle.

[0010] Optionally, the method further includes, after sensing that the external real-world object enters the sensing area from outside the sensing area and before displaying the second three-dimensional image of the three-dimensional image object, turning off the image display on the display panel for a pause period.

[0011] Optionally, sensing the position or movement of the external real-world object in the sensing area includes periodically sensing the movement of the external real-world object through a plurality of sensors; wherein, the method further includes: in the stereoscopic display area, sequentially displaying N three-dimensional images of the three-dimensional image object respectively according to coordinates in N image coordinate systems, N≥2; wherein, the N three-dimensional images are respectively oriented along N orientations, and the N orientations are respectively along directions from the axis to the position of the external real-world object at N time points.

[0012] Optionally, the method further includes, after displaying the n-th three-dimensional image of the three-dimensional image object and before displaying the (n + 1)-th three-dimensional image of the three-dimensional image object, turning off the image display on the display panel for a pause period, where 1 ≤ n ≤ N.

[0013] Optionally, the pause period is determined according to the following formula:

[0014]

[0015] where t represents the pause period, f represents the frequency at which the display panel rotates about the axis, and v represents the angular velocity of the movement of the external real-world object relative to the axis.

[0016] Optionally, the external real-world object is a controller including one or more gesture sensors, the controller being configured to sense the gestures of a user holding the controller; and the redirection of the three-dimensional image object follows the redirection of the controller.

[0017] Optionally, the method further includes: sequentially detecting N controller orientations at N time points respectively; and sequentially displaying N three-dimensional images of the three-dimensional image object in the stereoscopic display area respectively, where N ≥ 2; wherein the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object follows the redirection from the n-th controller orientation to the (n + 1)-th controller orientation, where 1 ≤ n ≤ N.

[0018] Optionally, the method further includes determining whether the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves both a rotation about the X-axis and a rotation about the Y-axis relative to the reference three-dimensional image of the three-dimensional image object; wherein the voxel data for displaying the reference three-dimensional image of the three-dimensional image object is stored in a cache.

[0019] Optionally, when determining that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves both a rotation about the X-axis and a rotation about the Y-axis relative to the reference three-dimensional image of the three-dimensional image object, the method further includes: generating, by a processor, voxel data for displaying the (n + 1)-th three-dimensional image of the three-dimensional image object without obtaining the voxel data for displaying the reference three-dimensional image of the three-dimensional image object.

[0020] Optionally, when it is determined that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object only involves one of the rotation about the X-axis and the rotation about the Y-axis with respect to the reference three-dimensional image of the three-dimensional image object, the method further includes: obtaining, from the cache, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object, the voxel data including data for a reference set of voxels respectively; and reassigning the corresponding voxel data for the corresponding reference voxels in the voxel data to reassigned voxels; wherein, the reassigned voxels are redirected with respect to the corresponding reference voxels as the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object.

[0021] Optionally, the method further includes turning off the image display on the display panel for a pause period after displaying the n-th three-dimensional image of the three-dimensional image object and before displaying the (n + 1)-th three-dimensional image of the three-dimensional image object, where 1 ≤ n ≤ N.

[0022] Optionally, displaying the first three-dimensional image of the three-dimensional image object includes displaying a plurality of first cross-sectional images on the display panel at a plurality of phase angles respectively as the display panel rotates about the axis; and displaying the second three-dimensional image of the three-dimensional image object includes displaying a plurality of second cross-sectional images on the display panel at the plurality of phase angles respectively as the display panel rotates about the axis.

[0023] In another aspect, the present disclosure provides a dynamic stereoscopic display device, including: a display panel configured to rotate about an axis to display a stereoscopic three-dimensional image; one or more sensors configured to sense the position or movement of an external real-world object in a sensing area; a memory; one or more processors; wherein, the memory and the one or more processors are connected to each other; and the memory stores computer-executable instructions for controlling the one or more processors to perform the following operations: causing a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system to be displayed in the stereoscopic display area; and causing a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system to be displayed in the stereoscopic display area; wherein, the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and the redirection is related to the position or movement of the external real-world object.

[0024] In another aspect, the present disclosure provides a computer program product comprising a non-transitory tangible computer-readable medium having computer-readable instructions thereon, the computer-readable instructions being executable by a processor to cause the processor to perform: causing a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system to be displayed in a stereoscopic display area of a stereoscopic display device; and causing a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system to be displayed in the stereoscopic display area; wherein the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and the redirection is related to the position or movement of an external real-world object. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] According to various disclosed embodiments, the following drawings are merely examples for illustrative purposes and are not intended to limit the scope of the present invention.

[0026] Figure 1A is a schematic diagram showing the structure of a stereoscopic display device according to some embodiments of the present disclosure.

[0027] Figure 1B shows a stereoscopic display area formed by rotating a display panel of a stereoscopic display device according to some embodiments of the present disclosure.

[0028] Figure 1C shows a sensing area of a stereoscopic display device according to some embodiments of the present disclosure.

[0029] Figure 2A shows multiple sectional images displayed on a display panel at multiple phase angles respectively as a display plane rotates about an axis in a stereoscopic display device according to some embodiments of the present disclosure.

[0030] Figure 2B shows multiple phase angles according to some embodiments of the present disclosure.

[0031] Figure 3 is a flowchart showing a method for dynamically displaying a three-dimensional image object in a stereoscopic display device according to some embodiments of the present disclosure.

[0032] Figure 4A shows the redirection of a three-dimensional image object displayed in a stereoscopic display device according to some embodiments of the present disclosure.

[0033] Figure 4B shows corresponding to Figure 4A the phase angles of the first orientation and the second orientation.

[0034] Figure 5A and Figure 5BShows a three-dimensional image of a three-dimensional image object being displayed in a stereoscopic display area according to different coordinates in different image coordinate systems in some embodiments of the present disclosure.

[0035] Figure 6 Shows a method for dynamically displaying a three-dimensional image object in a stereoscopic display device when an external real-world object moves in some embodiments of the present disclosure.

[0036] Figure 7 Shows a method for detecting the relative height of multiple real-world objects with respect to a stereoscopic display device in some embodiments of the present disclosure.

[0037] Figure 8 Is a flowchart showing a method for dynamically displaying a three-dimensional image object in a stereoscopic display device in some embodiments of the present disclosure.

[0038] Figure 9 Shows the redirection of a three-dimensional image object displayed in a stereoscopic display device in some embodiments of the present disclosure.

[0039] Figure 10 Is a block diagram of a dynamic stereoscopic display device in some embodiments of the present disclosure. Detailed Description

[0040] The present disclosure will now be described more specifically with reference to the following embodiments. It should be noted that the following description of some embodiments presented herein is for illustrative and descriptive purposes only. It is not exhaustive or limited to the exact forms disclosed.

[0041] The present disclosure particularly provides a method for dynamically displaying a three-dimensional image object in a stereoscopic display device, a dynamic stereoscopic display device, and a computer program product, which substantially eliminates one or more problems caused by the limitations and disadvantages of the prior art. In one aspect, the present disclosure provides a method for dynamically displaying a three-dimensional image object in a stereoscopic display device. In some embodiments, the method includes: rotating a display panel about an axis to display a stereoscopic three-dimensional image; in the stereoscopic display area, displaying a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system; sensing the position or movement of an external real-world object in a sensing area; and in the stereoscopic display area, displaying a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system. Optionally, the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation. Optionally, the redirection is related to the position or movement of the external real-world object.

[0042] As used herein, the term "display panel" refers to a display panel or medium that is configured to display an image when receiving light projected from a light modulator. When the display panel is a display panel, the display panel itself emits light and displays an image. Examples of display panels include liquid crystal display panels, organic light-emitting diode display panels, micro light-emitting diode (micro-LED) display panels, micro light-emitting diode (mini-LED) display panels, and the like. Optionally, the display panel is transparent to display a three-dimensional image object. When the display panel is a medium configured to display an image when receiving light projected from a light modulator, the light panel itself does not necessarily emit light, but relies on the light modulator to display an image. Optionally, when the display panel is a medium configured to display an image when receiving light projected from a light modulator, the stereoscopic display device may further include a light modulator configured to project multiple depth planes of an image onto the medium.

[0043] As used herein, the term "stereoscopic display" refers to a device, method, and system for presenting a three-dimensional image to a user in a manner that the three-dimensional image is presented realistically as having an actual physical depth. For example, a stereoscopic display device is operable to serve as a device for visually presenting a three-dimensional image in a three-dimensional space. The stereoscopic display device and method according to the present disclosure enable dynamic display of a three-dimensional image object.

[0044] Figure 1A is a schematic diagram showing the structure of a stereoscopic display device according to some embodiments of the present disclosure. Refer to Figure 1A , in some embodiments, the stereoscopic display device includes a display panel DP configured to rotate about an axis AX to display a stereoscopic three-dimensional image. Figure 1B shows a stereoscopic display area formed by rotating the display panel of the stereoscopic display device according to some embodiments of the present disclosure. Refer to Figure 1B , the stereoscopic display area DV formed by rotating the display panel is a cylindrical volume. Refer to Figure 1A , the rotation of the display panel DP can be driven by a motor MT. In some embodiments, the stereoscopic display device further includes a printed circuit board assembly PCBA, which may also include one or more integrated circuits or be configured to be connected to one or more integrated circuits. The printed circuit board assembly PCBA or the integrated circuit may also include one or more processors and a memory. The memory and the one or more processors are connected to each other. The memory stores computer-executable instructions for controlling the one or more processors to execute various tasks.

[0045] In some embodiments, the stereoscopic display device further includes one or more sensors SR. Figure 1AOne or more sensors SR are shown on the base of the stereoscopic display device and are evenly distributed around the periphery of the base. One or more sensors SR can be disposed at various suitable positions to sense various suitable signals (including the position or movement of external real-world objects). Figure 1C Shows the sensing area of the stereoscopic display device in some embodiments according to the present disclosure. Figure 1C Shows a plan view along the axis AX of the stereoscopic display device. In one example, the sensing area SZ can be defined by the limit of the signals detectable by one or more sensors SR. Alternatively, the sensing area SZ can be predefined by a range set by the user.

[0046] In one example, one or more sensors SR are configured to detect the position or movement of a human viewer (i.e., in some embodiments, the external real-world object is a human viewer). The number of one or more sensors SR can be determined in any suitable manner. For example, the number of one or more sensors SR can be determined by the number required to detect viewers present at any angle in the sensing area SZ. In one example, the sensing ranges of two adjacent sensors overlap each other, or are spaced apart by a distance less than the width of the viewer, to ensure detection of the viewer at any position within the sensing area SZ.

[0047] Examples of suitable sensors include one or any combination of an infrared sensor, an infrared temperature sensor, a pyroelectric sensor, a camera, a sound sensor, a geomagnetic sensor, an angular velocity sensor, a gyroscope, etc.

[0048] Figure 2A Shows multiple cross-sectional images respectively displayed on the display panel at multiple phase angles as the display plane rotates around the axis in the stereoscopic display device in some embodiments according to the present disclosure. Figure 2B Shows multiple phase angles in some embodiments according to the present disclosure. Refer to Figure 2A and Figure 2B , in some embodiments, the display panel in the stereoscopic display device is configured to rotate around the axis AX, and at multiple phase angles respectively, the display panel is configured to display multiple cross-sectional images SI respectively. The display panel can be configured to display any suitable number of cross-sectional images SI at any suitable number of phase angles respectively. Figure 2B Shows a total of 16 phase angles (denoted as 1, 2, 3,......, 16). In one example, the number of phase angles and the number of cross-sectional images of each volume frame are 180. The smallest display element in the stereoscopic display area is a voxel VX, as Figure 2AAs shown. As used herein, the term "voxel" refers to an element that defines a point in three-dimensional space. The voxel VX in the present disclosure corresponds to a three-dimensional pixel and represents the smallest volume element unit to which an image display value (e.g., intensity, color, etc.) is assigned. Voxels are combined to visually represent a three-dimensional image object.

[0049] Figure 3 is a flowchart showing a method for dynamically displaying a three-dimensional image object in a stereoscopic display device according to some embodiments of the present disclosure. Referring to Figure 3 , in some embodiments, the method includes: rotating a display panel around an axis to display a stereoscopic three-dimensional image; displaying a first three-dimensional image of a three-dimensional image object in a stereoscopic display area according to a first coordinate in a first image coordinate system; sensing the position or movement of an external real-world object in a sensing area; and displaying a second three-dimensional image of the three-dimensional image object in the stereoscopic display area according to a second coordinate in a second image coordinate system. The three-dimensional image object in the second image coordinate system is obtained by redirecting the three-dimensional image object in the first image coordinate system from an initial orientation to a target orientation. Optionally, the redirection is related to the position or movement of the external real-world object.

[0050] Various suitable real-world objects can be used as the external real-world object according to the present disclosure. In one example, the external real-world object is a viewer of the stereoscopic display device. In another example, the external real-world object is a body part (e.g., head, eyes, torso) of the viewer of the stereoscopic display device. In another example, the external real-world object is any (living or non-living) object entering the sensing area. In another example, the external real-world object is a controller such as a remote control for controlling image display in the stereoscopic display device.

[0051] Figure 4A shows the redirection of a three-dimensional image object displayed in a stereoscopic display device according to some embodiments of the present disclosure. Referring to Figure 4A , the three-dimensional image object displayed in the stereoscopic display device is a model airplane. In a first orientation, the line connecting the tail and the head of the model airplane is aligned with the first orientation. In a second orientation, the line connecting the tail and the head of the model airplane is not aligned with the second orientation. Figure 4B shows corresponding to Figure 4A the phase angles of the first orientation and the second orientation in

[0052] Figure 5A and Figure 5B show that according to some embodiments of the present disclosure, three-dimensional images of a three-dimensional image object are displayed in a stereoscopic display area according to different coordinates in different image coordinate systems respectively. As Figure 5A shown, a first three-dimensional image of a three-dimensional image object is displayed according to a first coordinate in a first image coordinate system in the stereoscopic display area. AsFigure 5B As shown, a second three-dimensional image of a three-dimensional image object is displayed according to second coordinates in a second image coordinate system in a stereoscopic display area. As described above (e.g., see Figure 2A ), a three-dimensional image of a three-dimensional image object is displayed by displaying a plurality of cross-sectional images on a display panel at a plurality of phase angles respectively as the display plane rotates about an axis. Thus, in some embodiments, the method includes: displaying a first three-dimensional image of a three-dimensional image object (including displaying a plurality of first cross-sectional images on a display panel at a plurality of phase angles respectively as the display plane rotates about an axis); and displaying a second three-dimensional image of a three-dimensional image object (including displaying a plurality of second cross-sectional images on a display panel at a plurality of phase angles respectively as the display plane rotates about an axis). The three-dimensional image object in the first three-dimensional image is oriented along an initial orientation. The three-dimensional image object in the second three-dimensional image is oriented along a target orientation. The three-dimensional image object in the second image coordinate system is obtained by redirecting the three-dimensional image object in the first image coordinate system from the initial orientation to the target orientation.

[0053] In the present disclosure, the redirection of the three-dimensional image object is related to the position or movement of an external real-world object. In some embodiments, sensing the position or movement of an external real-world object in a sensing area includes sensing an external real-world object that enters the sensing area from outside the sensing area through a plurality of sensors. In one example, before an external real-world object (e.g., a viewer) appears in the sensing area, the three-dimensional image object in the first three-dimensional image is oriented along an initial orientation. In another example, after an external real-world object (e.g., a viewer) enters the sensing area, the three-dimensional image object in the second three-dimensional image is oriented along a target orientation. In one example, the external real-world object can be sensed by one or more infrared sensors.

[0054] Referring to Figure 4B , in some embodiments, the method includes determining a first phase angle at which the initial orientation is along a direction outward from axis AX; determining a second phase angle at which the target orientation is along a direction from axis AX to the external real-world object. In one example, the first phase angle and the second phase angle are the same, and no redirection of the three-dimensional image object is required. In another example, as Figure 4B shown, the first phase angle and the second phase angle are different from each other. In some embodiments, when it is determined that the first phase angle and the second phase angle are different from each other, the method further includes displaying a second three-dimensional image of the three-dimensional image object according to the second coordinates in the second image coordinate system such that the target orientation is along a direction outward from the axis at the second phase angle. After the three-dimensional image object is redirected, the viewer can view the three-dimensional image object from an orientation of interest (e.g., viewing the head of a model airplane).

[0055] In some embodiments, after sensing the position or movement of an external real-world object within the sensing area and before displaying a second three-dimensional image of the three-dimensional image object, the method further includes turning off the image display on the display panel for a pausing period before refreshing the display panel. For example, after sensing that an external real-world object has entered the sensing area from outside the sensing area and before displaying a second three-dimensional image of the three-dimensional image object, the method further includes turning off the image display on the display panel for a pausing period.

[0056] In some embodiments, according to determine the pausing period.

[0057] In some embodiments, t represents the pausing period, f represents the frequency of rotation of the display panel about an axis, and n represents the angular difference between a first phase angle and a second phase angle. At the end of the pausing period, the display panel refreshes and displays a second three-dimensional image of the three-dimensional image object according to the second coordinates in the second image coordinate system such that the target orientation is along a direction outward from the axis at the second phase angle.

[0058] In some embodiments, the external real-world object is a moving object, for example, moving around at least a portion of the periphery of the stereoscopic display device. Thus, in some embodiments, sensing the position or movement of the external real-world object within the sensing area includes periodically sensing the movement of the external real-world object via a plurality of sensors. For example, the movement of the external real-world object can be sensed periodically at fixed time intervals.

[0059] In some embodiments, the method further includes sequentially displaying N three-dimensional images of the three-dimensional image object according to coordinates in N image coordinate systems, respectively, within the stereoscopic display area, where N≥2. Optionally, the N three-dimensional images are respectively oriented along N orientations, and the N orientations are respectively along directions from the axis to the positions of the external real object at N time points. Figure 6 Illustrates a method for dynamically displaying a three-dimensional image object in a stereoscopic display device when an external real-world object moves according to some embodiments of the present disclosure. Referring to Figure 6 , in one example, N phase angles (from the 1st phase angle to the Nth phase angle) are respectively aligned with N orientations of the three-dimensional image object in the N three-dimensional images (e.g., the tail-to-head orientation of the model airplane in FIG. 4). The movement of the external real-world object is represented in Figure 6 . When the external real-world object moves, the three-dimensional image object is periodically redirected such that the orientation of interest (e.g., the tail-to-head orientation of the model airplane in FIG. 4) can always be visible to the external real-world object (e.g., the viewer).

[0060] As described above, in some embodiments, the method further includes turning off the image display on the display panel for a pause period before refreshing the display panel. For example, after displaying the nth three-dimensional image object and before displaying the (n + 1)th three-dimensional image object, the image display on the display panel is turned off for a pause period, where 1 ≤ n ≤ N. Refer to Figure 6 , the nth phase angle and the (n + 1)th phase angle respectively correspond to the nth orientation and the (n + 1)th orientation of the three-dimensional image object in the nth three-dimensional image and the (n + 1)th three-dimensional image.

[0061] In some embodiments, according to determine the pause period.

[0062] In some embodiments, t represents the pause period, f represents the frequency of rotation of the display panel around the axis, and v represents the angular velocity of the movement of the external real-world object relative to the axis. At the end of the pause period, the display panel refreshes and displays the (n + 1)th three-dimensional image object according to the coordinates in the (n + 1)th image coordinate system, such that the target orientation is along the direction outward from the axis at the second phase angle.

[0063] In some embodiments, multiple real-world objects coexist in the sensing area. Therefore, in some embodiments, the method includes selecting one of the multiple real-world objects present in the sensing area as the external real-world object, and the redirection of the three-dimensional image object is related to the position or movement of the external real-world object. In some embodiments, the method further includes simultaneously detecting multiple real-world objects in the sensing area; and designating one of the multiple real-world objects as the external real-world object. The redirection of the three-dimensional image object is related to the position or movement of the external real-world object. The redirection of the three-dimensional image object is independent of the position or movement of real-world objects other than the external real-world object.

[0064] In some embodiments, designating one of the multiple real-world objects as the external real-world object includes, when sound signals are detected from the multiple real-world objects respectively, selecting one or more objects having sound signals with sound intensities within the target intensity range from the multiple real-world objects. For example, generally, normal human speech has a sound intensity in the range of 40 decibels to 60 decibels. In one example, at least one of the detected sound signals has a sound intensity greater than 60 decibels, and the method includes excluding real-world objects having sound signals with sound intensities less than 50 decibels. In another example, the target intensity range is equal to or greater than 50 decibels. Only those real-world objects (e.g., viewers) having sound signals with sound intensities equal to or greater than 50 decibels are selected as objects having sound signals with sound intensities within the target intensity range.

[0065] In some embodiments, designating one of a plurality of real-world objects as an external real-world object includes, when the relative distances from the plurality of real-world objects to the stereoscopic display device are respectively detected, selecting one or more objects having a relative distance within a target distance range from the plurality of real-world objects. In one example, a plurality of infrared sensors disposed on the same horizontal plane (e.g., on the base of the stereoscopic display device) are configured to respectively detect the relative distances from the plurality of real-world objects to the stereoscopic display device. In another example, the target distance range is defined as 1 meter. Only those real-world objects (e.g., viewers) having a relative distance equal to or less than 1 meter are selected as objects having a relative distance within the target distance range.

[0066] In some embodiments, designating one of a plurality of real-world objects as an external real-world object includes, when the relative heights of the plurality of real-world objects relative to the stereoscopic display device are detected, selecting one or more objects having a relative height within a target height range from the plurality of real-world objects. Figure 7 A method of detecting the relative height of a plurality of real-world objects relative to a stereoscopic display device in some embodiments according to the present disclosure is shown. Referring to Figure 7 , a plurality of infrared sensors are configured to emit infrared radiation at different angles (e.g., with an angular difference of 30 degrees) respectively. The target distance range is defined as 1 meter. As Figure 7 shown, the infrared sensors do not detect any objects above the middle part of the stereoscopic display device VDA, but only detect one or more objects (e.g., viewers) at or below the relative height corresponding to the middle part of the stereoscopic display device VDA. The target height range can be defined as the relative height corresponding to the middle part of the stereoscopic display device VDA. The detected viewers can be selected as objects having a relative height within the target height range.

[0067] In some embodiments, designating one of a plurality of real-world objects as an external real-world object includes a combination of at least two of the following: (1) when sound signals are respectively detected from the plurality of real-world objects, selecting one or more objects having a sound signal with a sound intensity within a target intensity range from the plurality of real-world objects; (2) when the relative distances from the plurality of real-world objects to the stereoscopic display device are detected, selecting one or more objects having a relative distance within a target distance range from the plurality of real-world objects; or (3) when the relative heights of the plurality of real-world objects relative to the stereoscopic display device are detected, selecting one or more objects having a relative height within a target height range from the plurality of real-world objects.

[0068] In some embodiments, designating one of a plurality of real-world objects as an external real-world object includes the following combination: (1) when sound signals from the plurality of real-world objects are respectively detected, selecting one or more objects having sound signals with sound intensities within a target intensity range from the plurality of real-world objects; (2) when relative distances from the plurality of real-world objects to the stereoscopic display device are detected, selecting one or more objects having relative distances within a target distance range from the plurality of real-world objects; and (3) when relative heights of the plurality of real-world objects with respect to the stereoscopic display device are detected, selecting one or more objects having relative heights within a target height range from the plurality of real-world objects. Optionally, in the process of designating one of the plurality of real-world objects as an external real-world object, selecting one or more objects having sound signals with sound intensities within a target intensity range has a higher priority than selecting one or more objects having relative distances within a target distance range, and selecting one or more objects having relative distances within a target distance range has a higher priority than selecting one or more objects having relative heights within a target height range.

[0069] In some embodiments, the external real-world object is a gesture sensing controller having one or more gesture sensors. The gesture sensing controller is configured to sense gestures of a user holding the controller. Accordingly, the step of sensing the position or movement of the external real-world object within the sensing area includes sensing the movement of the gesture sensing controller (e.g., via one or more gesture sensors in the gesture sensing controller). Optionally, the redirection of the three-dimensional image object follows the redirection of the gesture sensing controller.

[0070] Figure 8 is a flowchart showing a method for dynamically displaying a three-dimensional image object in a stereoscopic display device according to some embodiments of the present disclosure. Refer to Figure 8 , in some embodiments, the method includes sequentially detecting N controller orientations at N time points respectively; and sequentially displaying N three-dimensional images of the three-dimensional image object in the stereoscopic display area, where N≥2.

[0071] In some embodiments, the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object follows the redirection from the nth controller orientation to the (n + 1)th controller orientation, where 1≤n≤N. Figure 9 shows the redirection of a three-dimensional image object displayed in a stereoscopic display device according to some embodiments of the present disclosure. Refer to Figure 9 , when the gesture sensing controller GC is redirected (e.g., rotated about the X axis), the three-dimensional image object is redirected accordingly in the same manner (e.g., also rotated about the X axis).

[0072] In some embodiments, the method further includes determining whether a redirection from the n-th 3D image of the 3D image object to the (n + 1)-th 3D image of the 3D image object involves both a rotation about the X-axis and a rotation about the Y-axis with respect to a reference 3D image of the 3D image object. Optionally, voxel data for displaying the reference 3D image of the 3D image object is stored in a cache. As used herein, the Z-axis is parallel to the axis AX about which the display panel rotates, and the X-axis and the Y-axis are the other two axes with respect to the Z-axis.

[0073] When it is determined that the redirection from the n-th 3D image of the 3D image object to the (n + 1)-th 3D image of the 3D image object involves both a rotation about the X-axis and a rotation about the Y-axis with respect to a reference 3D image of the 3D image object, in some embodiments, the method further includes generating, by a processor, voxel data for displaying the (n + 1)-th 3D image of the 3D image object without obtaining voxel data for displaying the reference 3D image of the 3D image object (thus regenerating the voxel data). In a specific example, generating voxel data for displaying the (n + 1)-th 3D image of the 3D image object includes calculating the number of cross-sectional images for displaying the (n + 1)-th 3D image of the 3D image object. In some embodiments, the method further includes performing voxelization, voxel homogenization, and voxel point cloud compression to output data of the number of cross-sectional images.

[0074] When it is determined that the redirection from the n-th 3D image of the 3D image object to the (n + 1)-th 3D image of the 3D image object involves only one of a rotation about the X-axis and a rotation about the Y-axis with respect to a reference 3D image of the 3D image object, in some embodiments, the method further includes obtaining, from the cache, voxel data for displaying the reference 3D image of the 3D image object, the voxel data including data for a reference set of voxels respectively; and reassigning the respective voxel data of the corresponding reference voxels in the voxel data to the reassigned voxels. The reassigned voxels are redirected with respect to the corresponding reference voxels as the redirection from the n-th 3D image of the 3D image object to the (n + 1)-th 3D image of the 3D image object.

[0075] In some embodiments, the method further includes, after displaying the n-th 3D image of the 3D image object and before displaying the (n + 1)-th 3D image of the 3D image object, turning off image display on the display panel during a pause period, where 1 ≤ n ≤ N.

[0076] In some embodiments, according to determine the pause period.

[0077] In some embodiments, t represents a pause period, f represents the frequency at which the display panel rotates about an axis, and n represents the angular difference between the n-th phase angle aligned with the n-th orientation of the three-dimensional image object in the n-th three-dimensional image and the (n + 1)-th phase angle aligned with the (n + 1)-th orientation of the three-dimensional image object in the (n + 1)-th three-dimensional image. At the end of the pause period, the display panel refreshes and displays the (n + 1)-th three-dimensional image of the three-dimensional image object according to the coordinates in the (n + 1)-th image coordinate system, such that the target orientation is along the direction outward from the axis at the (n + 1)-th phase angle.

[0078] The method for dynamically displaying a three-dimensional image object in a stereoscopic display device according to the present disclosure provides a highly interactive user experience for viewers of the stereoscopic display device. Compared with other display methods, the present method allows for multiple human-computer interaction modes for three-dimensional stereoscopic display, regardless of whether the viewer is stationary or moving, or whether there is a single viewer or multiple viewers. In addition, the present method also enables the viewer to directly interact with the display or indirectly interact with the display through a controller. The flexibility and highly interactive operation provided by the present method greatly enhance the user experience when viewing a stereoscopic display device.

[0079] In another aspect, the present disclosure provides a dynamic stereoscopic display device. In some embodiments, the dynamic stereoscopic display device includes: a display panel configured to rotate about an axis to display a stereoscopic three-dimensional image; one or more sensors configured to sense the position or movement of an external real-world object in a sensing area; a memory; and one or more processors. The memory and the one or more processors are connected to each other.

[0080] Figure 10 is a block diagram of a dynamic stereoscopic display device according to some embodiments of the present disclosure. Referring to Figure 10 , in some embodiments, the dynamic stereoscopic display device 1000 may include any suitable type of TV, such as, a plasma TV, a liquid crystal display (LCD) TV, a touchscreen TV, a projection TV, a non-smart TV, a smart TV, etc. The dynamic stereoscopic display device 1000 may also include other computing systems, such as, a personal computer (PC), a tablet or laptop computer, or a smartphone, etc. In addition, the dynamic stereoscopic display device 1000 may be any suitable content presentation device capable of presenting suitable content. And a user can interact with the dynamic stereoscopic display device 1000 to perform operations of interest.

[0081] As Figure 10 shown, the dynamic stereoscopic display device 1000 may include a processor 1002, a storage medium 1004, a display 1006, a communication module 1008, a database 1010, and a peripheral device 1012. Certain devices may be omitted and other devices may be included to better describe the relevant embodiments.

[0082] The processor 1002 may include any suitable one or more processors. The processor 1002 may include multiple cores for multi-threading or parallel processing. The processor 1002 may execute a sequence of computer program instructions to perform various processes. The storage medium 1004 may include memory modules (such as, ROM, RAM, flash memory modules) and mass storage (such as, CD-ROM and hard disks), etc. The storage medium 1004 may store computer programs to implement various processes when the computer programs are executed by the processor 1002. For example, the storage medium 1004 may store computer programs to implement various algorithms when the computer programs are executed by the processor 1002.

[0083] Further, the communication module 1008 may include certain network interface devices configured to establish connections through communication networks (such as, TV cable networks, wireless networks, the Internet). The database 1010 may include one or more databases configured to store certain data and perform certain operations on the stored certain data, such as database searches.

[0084] The display 1006 may provide information to the user. The display 1006 may include any suitable type of computer display device or electronic device display, such as, LCD or OLED-based devices. The peripheral device 1012 may include various sensors or other I / O devices, such as, keyboards or mice.

[0085] Those of ordinary skill in the art will understand that all or some of the steps in the methods disclosed above, and the functional modules / units in systems and devices, can be implemented as software, firmware, hardware, and their appropriate combinations. In the hardware implementation, the division between the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be executed by several physical components in cooperation. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or can be implemented as hardware, or can be implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable storage medium, which can include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. The computer storage medium includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that a communication medium typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0086] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of devices, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a part of code that contains at least one executable instruction for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks can occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0087] In some embodiments, the memory stores computer-executable instructions for controlling one or more processors to cause a first three-dimensional image of a three-dimensional image object according to a first coordinate in a first image coordinate system to be displayed in the stereoscopic display area; and to cause a second three-dimensional image of a three-dimensional image object according to a second coordinate in a second image coordinate system to be displayed in the stereoscopic display area. Optionally, the three-dimensional image object according to the second coordinate in the second image coordinate system is redirected from an initial orientation to a target orientation relative to the three-dimensional image object according to the first coordinate in the first image coordinate system. Optionally, the redirection of the three-dimensional image object is related to the position or movement of the external real-world object.

[0088] In some embodiments, the memory further stores computer-executable instructions for controlling one or more processors to cause the image display on the display panel to be turned off during a pause period after one or more sensors sense the position or movement of an external real-world object within the sensing area and before causing the second three-dimensional image of the three-dimensional image object to be displayed.

[0089] In some embodiments, the memory further stores computer-executable instructions for controlling the one or more processors to cause a plurality of first cross-sectional images to be displayed on the display panel at a plurality of phase angles respectively as the display panel rotates about the axis, thereby causing the first three-dimensional image of the three-dimensional image object to be displayed; and to cause a plurality of second cross-sectional images to be displayed on the display panel at the plurality of phase angles respectively as the display panel rotates about the axis, thereby causing the second three-dimensional image of the three-dimensional image object to be displayed.

[0090] In some embodiments, the dynamic stereoscopic display device further includes a plurality of sensors configured to sense an external real-world object entering the sensing area from outside the sensing area. The memory further stores computer-executable instructions for controlling the one or more processors to determine a first phase angle at which the initial orientation is along a direction outward from the axis; determine a second phase angle at which the target orientation is along a direction from the axis to the external real-world object; and when it is determined that the first phase angle and the second phase angle are different from each other, cause the second three-dimensional image of the three-dimensional image object according to the second coordinate in the second image coordinate system to be displayed such that the target orientation is along a direction outward from the axis at the second phase angle.

[0091] In some embodiments, the memory further stores computer-executable instructions for controlling one or more processors to turn off the image display on the display panel during a pause period after the plurality of sensors sense that the external real-world object has entered the sensing area from outside the sensing area and before the second three-dimensional image for displaying the three-dimensional image object is caused to be displayed.

[0092] In some embodiments, according to the pause period is determined.

[0093] In some embodiments, t represents the pause period, f represents the frequency at which the display panel rotates about an axis, and n represents the angular difference between a first phase angle and a second phase angle.

[0094] In some embodiments, the autostereoscopic display device further includes a plurality of sensors configured to periodically sense the movement of the external real-world object. The memory further stores computer-executable instructions for controlling one or more processors to sequentially display N three-dimensional images of the three-dimensional image object according to coordinates in N image coordinate systems respectively in the stereoscopic display area, where N≥2. Optionally, the N three-dimensional images are respectively oriented along N orientations, and the N orientations are respectively in the direction from the axis to the position of the external real-world object at N time points.

[0095] In some embodiments, the memory further stores computer-executable instructions for controlling one or more processors to turn off the image display on the display panel during a pause period after the nth three-dimensional image of the three-dimensional image object is caused to be displayed and before the (n + 1)th three-dimensional image of the three-dimensional image object is caused to be displayed, where 1≤n≤N.

[0096] In some embodiments, according to the pause period is determined.

[0097] In some embodiments, t represents the pause period, f represents the frequency at which the display panel rotates about the axis, and v represents the angular velocity of the movement of the external real-world object relative to the axis.

[0098] In some embodiments, one or more sensors are configured to simultaneously detect a plurality of real-world objects in the sensing area. The memory further stores computer-executable instructions for controlling the one or more processors to designate one of the plurality of real-world objects as the external real-world object. Optionally, the redirection of the three-dimensional image object is not related to the position or movement of real-world objects other than the external real-world object.

[0099] In some embodiments, the memory also stores computer-executable instructions for controlling one or more processors to perform at least one of the following: when sound signals are respectively detected from the plurality of real-world objects, selecting one or more objects having sound signals with sound intensity within a target intensity range from the plurality of real-world objects; when relative distances from the plurality of real-world objects to the stereoscopic display device are detected, selecting one or more objects having relative distances within a target distance range from the plurality of real-world objects; or when relative heights of the plurality of real-world objects relative to the stereoscopic display device are detected, selecting one or more objects having relative heights within a target height range from the plurality of real-world objects.

[0100] In some embodiments, the external real-world object is a human viewer.

[0101] In some embodiments, the dynamic stereoscopic display device further includes a gesture sensing controller having one or more gesture sensors; the external real-world object is the gesture sensing controller. Optionally, the redirection of the three-dimensional image object complies with the redirection of the gesture sensing controller.

[0102] In some embodiments, one or more gesture sensors are configured to sequentially detect N controller orientations at N time points respectively; the memory also stores computer-executable instructions for controlling one or more processors to sequentially display N three-dimensional images of the three-dimensional image object in the stereoscopic display area respectively, where N≥2. Optionally, the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object complies with the redirection from the nth controller orientation to the (n + 1)th controller orientation, where 1≤n≤N.

[0103] In some embodiments, the memory also stores computer-executable instructions for controlling the one or more processors to determine whether the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object involves both a rotation about the X axis and a rotation about the Y axis relative to a reference three-dimensional image of the three-dimensional image object. Optionally, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object is stored in a cache.

[0104] In some embodiments, the memory further stores computer-executable instructions for controlling the one or more processors to generate voxel data for displaying the (n+1)th three-dimensional image of the three-dimensional image object without obtaining the voxel data for displaying the reference three-dimensional image of the three-dimensional image object when it is determined that the redirection from the nth three-dimensional image to the (n+1)th three-dimensional image of the three-dimensional image object involves both a rotation about the X-axis and a rotation about the Y-axis with respect to the reference three-dimensional image of the three-dimensional image object.

[0105] In some embodiments, the memory further stores computer-executable instructions for controlling the one or more processors to obtain, from the cache, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object, the voxel data including data for a respective reference set of voxels; and reassign the respective voxel data for the respective reference voxels in the voxel data to reassigned voxels when it is determined that the redirection from the nth three-dimensional image to the (n+1)th three-dimensional image of the three-dimensional image object involves only one of the rotation about the X-axis and the rotation about the Y-axis with respect to the reference three-dimensional image of the three-dimensional image object. Optionally, the reassigned voxels are redirected relative to the respective reference voxels as the redirection from the nth three-dimensional image to the (n+1)th three-dimensional image of the three-dimensional image object.

[0106] In some embodiments, the memory further stores computer-executable instructions for controlling the one or more processors to cause the image display on the display panel to be turned off for a pause period after displaying the nth three-dimensional image of the three-dimensional image object and before displaying the (n+1)th three-dimensional image of the three-dimensional image object, where 1≤n≤N.

[0107] The dynamic stereoscopic display device according to the present disclosure provides a highly interactive user experience for viewers of the stereoscopic display device. Compared with other display devices, the present dynamic stereoscopic display device enables multiple human-computer interaction modes for three-dimensional stereoscopic display, whether the viewer is stationary or moving, or whether there is a single viewer or multiple viewers. In addition, the present dynamic stereoscopic display device also enables the viewer to directly interact with the display or indirectly interact with the display through a controller. The flexibility and highly interactive operation provided by the present dynamic stereoscopic display device greatly enhance the user experience when viewing the stereoscopic display device.

[0108] In another aspect, the present disclosure provides a computer program product. The computer program product includes a non-transitory tangible computer-readable medium having computer-readable instructions thereon. In some embodiments, the computer-readable instructions are executable by a processor to cause the processor to perform: causing, in the stereoscopic display device, in a stereoscopic display area, a first three-dimensional image of a three-dimensional image object according to a first coordinate in a first image coordinate system to be displayed; and causing a second three-dimensional image of a three-dimensional image object according to a second coordinate in a second image coordinate system to be displayed in the stereoscopic display area. Optionally, the three-dimensional image object according to the second coordinate in the second image coordinate system is redirected from an initial orientation to a target orientation relative to the three-dimensional image object according to the first coordinate in the first image coordinate system. Optionally, the redirection of the three-dimensional image object is related to the position or movement of the external real-world object.

[0109] In some embodiments, the computer-readable instructions are further executable by the processor to cause the processor to perform: causing the image display on the display panel to be turned off during a pause period after one or more sensors sense the position or movement of an external real-world object within a sensing area and before the dynamic stereoscopic display device displays the second three-dimensional image of the three-dimensional image object.

[0110] In some embodiments, the computer-readable instructions are further executable by the processor to cause the processor to perform: causing a plurality of first cross-sectional images to be displayed on the display panel at a plurality of phase angles respectively as the display panel rotates about the axis, thereby causing the first three-dimensional image of the three-dimensional image object to be displayed; and causing a plurality of second cross-sectional images to be displayed on the display panel at the plurality of phase angles respectively as the display panel rotates about the axis, thereby causing the second three-dimensional image of the three-dimensional image object to be displayed.

[0111] In some embodiments, the dynamic stereoscopic display device further includes a plurality of sensors configured to sense an external real-world object entering the sensing area from outside the sensing area. The computer-readable instructions are further executable by the processor to cause the processor to perform: determining a first phase angle at which the initial orientation is along a direction outward from the axis; determining a second phase angle at which the target orientation is along a direction from the axis to the external real-world object; and when it is determined that the first phase angle and the second phase angle are different from each other, causing the second three-dimensional image of the three-dimensional image object according to the second coordinate in the second image coordinate system to be displayed such that the target orientation is along a direction outward from the axis at the second phase angle.

[0112] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: after the plurality of sensors sense that the external real-world object enters the sensing area from outside the sensing area and before the second three-dimensional image that displays the three-dimensional image object, cause the image display on the display panel to be turned off during a pause period.

[0113] In some embodiments, according to Determine the pause period.

[0114] In some embodiments, t represents the pause period, f represents the frequency at which the display panel rotates about an axis, and n represents the angular difference between a first phase angle and a second phase angle.

[0115] In some embodiments, the autostereoscopic display device further includes a plurality of sensors configured to periodically sense the movement of the external real-world object. The computer-readable instructions may further be executed by a processor to cause the processor to perform: in the autostereoscopic display area, sequentially display N three-dimensional images of the three-dimensional image object respectively according to coordinates in N image coordinate systems, N≥2. Optionally, the N three-dimensional images are respectively oriented along N orientations, and the N orientations are respectively in the direction from the axis to the position of the external real-world object at N time points.

[0116] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: after causing the nth three-dimensional image of the three-dimensional image object to be displayed and before causing the (n + 1)th three-dimensional image of the three-dimensional image object to be displayed, cause the image display on the display panel to be turned off during a pause period, 1≤n≤N.

[0117] In some embodiments, according to Determine the pause period.

[0118] In some embodiments, t represents the pause period, f represents the frequency at which the display panel rotates about the axis, and v represents the angular velocity of the movement of the external real-world object relative to the axis.

[0119] In some embodiments, one or more sensors are configured to simultaneously detect a plurality of real-world objects in the sensing area. The computer-readable instructions may further be executed by a processor to cause the processor to perform: designate one of the plurality of real-world objects as the external real-world object. Optionally, the redirection of the three-dimensional image object is not related to the position or movement of real-world objects other than the external real-world object.

[0120] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform at least one of the following: when sound signals are respectively detected from the plurality of real-world objects, select one or more objects having sound signals with sound intensity within a target intensity range from the plurality of real-world objects; when relative distances from the plurality of real-world objects to the stereoscopic display device are detected, select one or more objects having relative distances within a target distance range from the plurality of real-world objects; or when relative heights of the plurality of real-world objects relative to the stereoscopic display device are detected, select one or more objects having relative heights within a target height range from the plurality of real-world objects.

[0121] In some embodiments, the external real-world object is a human viewer.

[0122] In some embodiments, the dynamic stereoscopic display device further includes a gesture sensing controller having one or more gesture sensors; the external real-world object is the gesture sensing controller. Optionally, the redirection of the three-dimensional image object complies with the redirection of the gesture sensing controller.

[0123] In some embodiments, one or more gesture sensors are configured to sequentially detect N controller orientations at N time points respectively; the computer-readable instructions may further be executed by a processor to cause the processor to perform: in the stereoscopic display area, sequentially cause N three-dimensional images of the three-dimensional image object to be displayed, where N≥2. Optionally, the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object complies with the redirection from the nth controller orientation to the (n + 1)th controller orientation, where 1≤n≤N.

[0124] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: determine whether the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object involves both a rotation about the X axis and a rotation about the Y axis relative to a reference three-dimensional image of the three-dimensional image object. Optionally, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object is stored in a cache.

[0125] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: when determining that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves both a rotation about the X-axis and a rotation about the Y-axis with respect to the reference three-dimensional image of the three-dimensional image object, generating voxel data for displaying the (n + 1)-th three-dimensional image of the three-dimensional image object without obtaining the voxel data for displaying the reference three-dimensional image of the three-dimensional image object.

[0126] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: when determining that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves only one of the rotation about the X-axis and the rotation about the Y-axis with respect to the reference three-dimensional image of the three-dimensional image object, obtaining, from the cache, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object, the voxel data including data for a respective reference set of voxels; and reassigning the respective voxel data for the respective reference voxels in the voxel data to reassigned voxels. Optionally, the reassigned voxels are redirected with respect to the respective reference voxels as the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object.

[0127] In some embodiments, the computer-readable instructions may further be executed by a processor to cause the processor to perform: after causing the n-th three-dimensional image of the three-dimensional image object to be displayed and before causing the (n + 1)-th three-dimensional image of the three-dimensional image object to be displayed, causing the image display on the display panel to be turned off for a pause period, where 1 ≤ n ≤ N.

[0128] The various illustrative operations described in connection with the configurations disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. These operations can be implemented or performed with a general-purpose processor, a digital signal processor (DSP), an ASIC or ASSP, an FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to produce the configurations disclosed herein. For example, such a configuration can be implemented at least in part as hardwired circuitry, a circuit configuration fabricated into an application-specific integrated circuit, or a firmware program loaded into non-volatile storage, or a software program loaded from or loaded to a data storage medium as machine-readable code, such code being instructions executable by an array of logic elements such as a general-purpose processor or other digital signal processing unit. The general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Software modules may reside in a non-transitory storage medium (e.g., RAM (random access memory), ROM (read-only memory), non-volatile RAM (NVRAM) such as flash RAM, erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM)), registers, a hard disk, a removable disk, or a CD-ROM); or in any other form of storage medium known in the art. The illustrative storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral with the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

[0129] The foregoing description of the embodiments of the present invention has been presented for purposes of illustration and description. It is not exhaustive and is not intended to limit the present invention to the precise forms or exemplary embodiments disclosed. Thus, the foregoing description should be considered illustrative rather than restrictive. Obviously, many modifications and variations will be apparent to those skilled in the art. The embodiments were chosen and described in order to explain the principles of the present invention and its best mode of practical application, so that others skilled in the art can understand the various embodiments of the present invention and the various modifications suitable for the particular use or implementation contemplated. The scope of the present invention is intended to be defined by the appended claims and their equivalents, where all terms are meant in their broadest reasonable sense unless otherwise stated. Thus, terms such as "the invention," "the present invention," etc. do not necessarily limit the scope of the claims to a particular embodiment, and the reference to exemplary embodiments of the present invention does not imply a limitation of the present invention and should not be construed as such. The present invention is limited only by the spirit and scope of the appended claims. In addition, these claims may refer to the use of "first," "second," etc., followed by a noun or element. These terms should be understood as nomenclature and should not be construed as limiting the number of elements modified by these nomenclatures unless a specific number has been given. Any advantages and benefits described may not apply to all embodiments of the present invention. It should be understood that those skilled in the art may make changes to the described embodiments without departing from the scope of the present invention as defined by the appended claims. Furthermore, no element or component in this disclosure is intended to be dedicated to the public, whether or not the element or component is expressly recited in the appended claims.

Claims

1. A method for dynamically displaying a three-dimensional image object in a stereoscopic display device, comprising: Rotating a display panel about an axis to display a stereoscopic three-dimensional image; Displaying a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system in the stereoscopic three-dimensional image; Sensing the position or movement of an external real-world object in a sensing area; Wherein, sensing the position or movement of the external real-world object in the sensing area includes: sensing the external real-world object entering the sensing area from outside the sensing area through a plurality of sensors; Displaying a second three-dimensional image of a second three-dimensional image object according to a second coordinate in a second image coordinate system in the stereoscopic three-dimensional image; Wherein, the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and The redirection is related to the position or movement of the external real-world object; The method further includes: Determining a first phase angle, the initial orientation being along a direction outward from the axis at the first phase angle; Determining a second phase angle, the target orientation being along a direction from the axis to the external real-world object at the second phase angle; and When it is determined that the first phase angle and the second phase angle are different from each other, displaying the second three-dimensional image of the second three-dimensional image object such that the target orientation is along a direction outward from the axis at the second phase angle; Further including, after sensing that the external real-world object enters the sensing area from outside the sensing area and before displaying the second three-dimensional image of the three-dimensional image object, turning off the image display on the display panel for a pause period.

2. The method according to claim 1, further comprising: Simultaneously detecting a plurality of real-world objects in the sensing area; And Designating one of the plurality of real-world objects as the external real-world object; Wherein, the redirection of the three-dimensional image object is not related to the position or movement of real-world objects other than the external real-world object.

3. The method according to claim 2, wherein Designating one of the plurality of real-world objects as the external real-world object includes at least one of the following: When sound signals are respectively detected from the plurality of real-world objects, selecting one or more objects having a sound signal with a sound intensity within a target intensity range from the plurality of real-world objects; When the relative distances from the plurality of real-world objects to the stereoscopic display device are detected, selecting one or more objects having a relative distance within a target distance range from the plurality of real-world objects; Or When the relative heights of the plurality of real-world objects with respect to the stereoscopic display device are detected, selecting one or more objects having a relative height within a target height range from the plurality of real-world objects.

4. The method according to claim 3, wherein, In the process of designating one of the multiple real-world objects as the external real-world object, selecting one or more objects with sound signals having a sound intensity within a target intensity range has a higher priority than selecting one or more objects with a relative distance within a target distance range, and selecting one or more objects with a relative distance within a target distance range has a higher priority than selecting one or more objects with a relative height within a target height range.

5. The method according to claim 3 or 4, wherein The target intensity range is equal to or greater than 50 decibels; The target distance range is equal to or less than 1 meter; and The target height range is equal to or less than the relative height corresponding to the middle part of the stereoscopic display device.

6. The method according to claim 1, after sensing the position or movement of the external real-world object within the sensing area and before displaying a second three-dimensional image of the three-dimensional image object, the method further includes turning off the image display on the display panel for a pause period.

7. The method according to claim 1, wherein, Sensing the position or movement of the external real-world object within the sensing area includes periodically sensing the movement of the external real-world object through a plurality of sensors; Wherein, the method further includes: in the stereoscopic three-dimensional image, sequentially displaying N three-dimensional images of the three-dimensional image object respectively according to coordinates in N image coordinate systems, N≥2; Wherein, the N three-dimensional images are respectively oriented along N orientations, and the N orientations are respectively in the direction from the axis to the position of the external real-world object at N time points.

8. The method according to claim 7, further includes turning off the image display on the display panel for a pause period after displaying the nth three-dimensional image of the three-dimensional image object and before displaying the (n + 1)th three-dimensional image of the three-dimensional image object, 1≤n≤N.

9. The method according to claim 8, wherein The pause period is determined according to the following formula: wherein, t represents the pause period, f representing the frequency at which the display panel rotates about the axis, v The angular velocity representing the movement of the external real-world object relative to the axis.

10. The method according to claim 1, wherein, The external real-world object is a controller including one or more gesture sensors, and the controller is configured to sense the gestures of a user holding the controller; and The redirection of the three-dimensional image object complies with the redirection of the controller.

11. The method according to claim 10, further includes: Sequentially detecting N controller orientations at N time points respectively; And Sequentially displaying N three-dimensional images of the three-dimensional image object in the stereoscopic three-dimensional image respectively, N≥2; Wherein, the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object complies with the redirection from the nth controller orientation to the (n + 1)th controller orientation, 1≤n≤N.

12. The method according to claim 11, further includes determining whether the redirection from the nth three-dimensional image of the three-dimensional image object to the (n + 1)th three-dimensional image of the three-dimensional image object involves both a rotation around the X axis and a rotation around the Y axis with respect to a reference three-dimensional image of the three-dimensional image object; Among them, Voxel data for displaying a reference three-dimensional image of the three-dimensional image object is stored in a cache.

13. The method according to claim 12, when it is determined that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves both a rotation about the X axis and a rotation about the Y axis with respect to the reference three-dimensional image of the three-dimensional image object, the method further comprises: generating, by a processor, voxel data for displaying the (n + 1)-th three-dimensional image of the three-dimensional image object without obtaining the voxel data for displaying the reference three-dimensional image of the three-dimensional image object.

14. The method according to claim 13, when it is determined that the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object involves only one of the rotation about the X axis and the rotation about the Y axis with respect to the reference three-dimensional image of the three-dimensional image object, the method further comprises: obtaining, from the cache, the voxel data for displaying the reference three-dimensional image of the three-dimensional image object, the voxel data including data for a reference set of voxels respectively; and reassigning the corresponding voxel data for the corresponding reference voxels in the voxel data to reassigned voxels; wherein the reassigned voxels are redirected with respect to the corresponding reference voxels as the redirection from the n-th three-dimensional image of the three-dimensional image object to the (n + 1)-th three-dimensional image of the three-dimensional image object.

15. The method according to claim 11, further comprising turning off the image display on the display panel for a pause period after displaying the n-th three-dimensional image of the three-dimensional image object and before displaying the (n + 1)-th three-dimensional image of the three-dimensional image object, 1 ≤ n ≤ N.

16. The method according to claim 1, wherein, Displaying the first three-dimensional image of the three-dimensional image object includes displaying a plurality of first cross-sectional images on the display panel at a plurality of phase angles respectively as the display panel rotates about the axis; and Displaying the second three-dimensional image of the three-dimensional image object includes displaying a plurality of second cross-sectional images on the display panel at the plurality of phase angles respectively as the display panel rotates about the axis.

17. A dynamic stereoscopic display device, comprising: a display panel configured to rotate about an axis to display a stereoscopic three-dimensional image; one or more sensors configured to sense the position or movement of an external real-world object within a sensing area; wherein sensing the position or movement of the external real-world object within the sensing area includes: sensing the external real-world object entering the interior of the sensing area from outside the sensing area by means of the plurality of sensors; a memory; one or more processors; wherein the memory and the one or more processors are connected to each other; and the memory stores computer-executable instructions for controlling the one or more processors to perform the following operations: causing a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system to be displayed in the stereoscopic three-dimensional image; and Cause a second three-dimensional image of a second three-dimensional image object according to a second coordinate in the second image coordinate system to be displayed in the stereoscopic three-dimensional image; wherein the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and the redirection is related to the position or movement of the external real-world object; Determine a first phase angle, with the initial orientation along a direction outward from the axis at the first phase angle; Determine a second phase angle, with the target orientation along a direction from the axis to the external real-world object at the second phase angle; and When it is determined that the first phase angle and the second phase angle are different from each other, cause the second three-dimensional image of the three-dimensional image object according to the second coordinate in the second image coordinate system to be displayed, such that the target orientation is along a direction outward from the axis at the second phase angle; After a plurality of the sensors sense that the external real-world object enters the sensing area from outside the sensing area and before causing the second three-dimensional image of the three-dimensional image object to be displayed, cause the image display on the display panel to be turned off during a pause period.

18. A computer program product, comprising a non-transitory tangible computer-readable medium having computer-readable instructions thereon, the computer-readable instructions being executable by a processor to cause the processor to perform: In a stereoscopic display device, a first three-dimensional image of a first three-dimensional image object according to a first coordinate in a first image coordinate system is displayed in a stereoscopic three-dimensional image; and Cause a second three-dimensional image of a second three-dimensional image object according to a second coordinate in the second image coordinate system to be displayed in the stereoscopic three-dimensional image; wherein, the second three-dimensional image object is obtained by redirecting the first three-dimensional image object from an initial orientation to a target orientation; and the redirection is related to the position or movement of an external real-world object; The stereoscopic display device further includes a display panel and one or more sensors, the display panel being configured to rotate around an axis to display a stereoscopic three-dimensional image, and the sensors being configured to sense an external real-world object entering the sensing area from outside the sensing area; Determine a first phase angle, with the initial orientation along a direction outward from the axis at the first phase angle; Determine a second phase angle, with the target orientation along a direction from the axis to the external real-world object at the second phase angle; and When it is determined that the first phase angle and the second phase angle are different from each other, cause the second three-dimensional image of the three-dimensional image object according to the second coordinate in the second image coordinate system to be displayed, such that the target orientation is along a direction outward from the axis at the second phase angle; After a plurality of the sensors sense that the external real-world object enters the sensing area from outside the sensing area and before causing the second three-dimensional image of the three-dimensional image object to be displayed, cause the image display on the display panel to be turned off during a pause period.

Citation Information

Patent Citations

  • Physically interactive manifestation of a volumetric space

    CN106687914A

  • Information display system

    JP2013105084A