Image display method and device

Abstract

The present application provides an image display method and device, the method comprising: obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, the first user being located on one side of the first display surface of the transparent holographic display screen; determining, in combination with the input operation, a motion trajectory of the virtual interactive object after the current moment, a first appearance morphological feature of the virtual interactive object relative to the human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to the human eye position of a second user, the second user being located on one side of the second display surface of the transparent holographic display screen; displaying a virtual interactive object having a motion trajectory and a first appearance morphological feature to the first display surface of the transparent holographic display screen; and displaying a virtual interactive object having a motion trajectory and a second appearance morphological feature to the second display surface of the transparent holographic display screen. The solution of the present application can make the presented virtual scene more closely fit the real scene.

Description

Technical Field

[0001] The present application relates to the field of display technology, and more specifically, to an image display method and device. Background Art

[0002] The application scenarios of technologies such as mixed reality are increasing.

[0003] In mixed reality and other scenarios, virtual objects and real objects exist at the same time, and different users see the same virtual scene. However, in many business scenarios, it may be desirable to present different virtual scenes to users in different locations, so that users in different locations can see virtual scenes that are more in line with the real scene. Summary of the invention

[0004] The present application provides an image display method and device.

[0005] Among them, an image display method includes:

[0006] Obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, wherein the first user is located on one side of the first display surface of the transparent holographic display screen;

[0007] In combination with the input operation, determining a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, the second user being located on a side of a second display surface of the transparent holographic display screen;

[0008] Displaying the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen;

[0009] The virtual interactive object having the motion trajectory and the second appearance morphological feature is displayed on the second display surface of the transparent holographic display screen.

[0010] In a possible implementation, the determining, in combination with the input operation, a motion trajectory of the virtual interactive object after the current moment, a first appearance morphological feature of the virtual interactive object relative to the eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to the eye position of the second user includes:

[0011] In combination with the input operation, determining a motion trajectory of the virtual interactive object after a current moment;

[0012] Determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after a current moment, where the first size is a size of the virtual interactive object relative to a human eye position of the first user;

[0013] Determine, in combination with the motion trajectory, a second size change feature corresponding to a second size of the virtual interactive object after a current moment, where the second size is a size of the virtual interactive object relative to a human eye position of the second user;

[0014] The farther the distance of the virtual interactive object is from the user's eye position, the larger the size of the virtual interactive object is relative to the user's eye, and the user is any one of the first user and the second user.

[0015] In another possible implementation, the determining, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, further includes:

[0016] Determine, in combination with the motion trajectory, a first color change feature of a first color that the virtual interactive object needs to present after a current moment, the first color being a color that the virtual interactive object needs to present relative to a human eye position of the first user;

[0017] Determine, in combination with the motion trajectory, a second color change feature of a second color that the virtual interactive object needs to present after a current moment, the second color being a color that the virtual interactive object needs to present relative to a human eye position of the second user;

[0018] The farther the virtual interactive object is from the position of the user's eyes, the lighter the color of the virtual interactive object needs to be.

[0019] In yet another possible implementation, a first display surface of the transparent holographic display screen is superimposed with a first diffraction grating, and a second display surface of the transparent holographic display screen is superimposed with a second diffraction grating;

[0020] The method further comprises:

[0021] Controlling the second diffraction grating to block the first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is not visible on the second display surface;

[0022] The first diffraction grating is controlled to block the second image light corresponding to the virtual interactive object having the motion trajectory and the second appearance morphological feature, so that the virtual interactive object having the motion trajectory and the second appearance morphological feature is not visible on the first display surface.

[0023] In yet another possible implementation, displaying the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen includes:

[0024] Projecting the virtual interactive object having the motion trajectory and the first appearance morphological feature onto the first display surface of the holographic transparent display screen through at least one first projection light source, wherein the first projection light source is arranged in the holographic transparent display screen, or is facing the holographic transparent display screen;

[0025] The controlling the second diffraction grating to shield the first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature comprises:

[0026] A first electrical control signal is output to the second diffraction grating, wherein the first electrical control signal is used to control a first sub-grating area in the second diffraction grating within a light projection area of ​​the first projection light source to be in a light-proof state.

[0027] In yet another possible implementation, displaying the virtual interactive object having the motion trajectory and the second appearance morphological feature on the second display surface of the transparent holographic display screen includes:

[0028] Projecting the virtual interactive object having the motion track and the second appearance morphological feature onto the second display surface of the holographic transparent display screen through at least one second projection light source, wherein the second projection light source is arranged in the holographic transparent display screen, or is facing the holographic transparent display screen;

[0029] The controlling the first diffraction grating to shield the second image light corresponding to the virtual interactive object having the motion trajectory and the second appearance morphological feature comprises:

[0030] A second electrical control signal is output to the first diffraction grating, wherein the second electrical control signal is used to control a second sub-grating area in the first diffraction grating within a light projection area of ​​the second projection light source to be in a light-proof state.

[0031] Among them, an image display device includes:

[0032] an operation obtaining unit, configured to obtain an input operation of a first user on a virtual interactive object displayed on a first display surface of the transparent holographic display screen, wherein the first user is located at one side of the first display surface of the transparent holographic display screen;

[0033] a feature determination unit, configured to determine, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, the second user being located on a side of a second display surface of the transparent holographic display screen;

[0034] A first display control unit, configured to display the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen;

[0035] The second display control unit is used to display the virtual interactive object having the motion trajectory and the second appearance morphological feature on the second display surface of the transparent holographic display screen.

[0036] In a possible implementation, the feature determination unit includes:

[0037] A trajectory determination unit, configured to determine a motion trajectory of the virtual interactive object after a current moment in combination with the input operation;

[0038] A first size determining unit, configured to determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after a current moment, wherein the first size is a size of the virtual interactive object relative to a human eye position of the first user;

[0039] A second size determination unit, configured to determine, in combination with the motion trajectory, a second size change feature corresponding to a second size of the virtual interactive object after a current moment, wherein the second size is a size of the virtual interactive object relative to a human eye position of the second user;

[0040] The farther the distance of the virtual interactive object is from the user's eye position, the larger the size of the virtual interactive object is relative to the user's eye, and the user is any one of the first user and the second user.

[0041] In yet another possible implementation, the feature determination unit further includes:

[0042] A first color determination unit, configured to determine, in combination with the motion trajectory, a first color change feature of a first color that the virtual interactive object needs to present after a current moment, wherein the first color is a color that the virtual interactive object needs to present relative to a human eye position of the first user;

[0043] A second color determination unit, configured to determine, in combination with the motion trajectory, a second color change feature of a second color that the virtual interactive object needs to present after a current moment, the second color being the color that the virtual interactive object needs to present relative to the human eye position of the second user;

[0044] The farther the virtual interactive object is from the position of the user's eyes, the lighter the color of the virtual interactive object needs to be.

[0045] In yet another possible implementation, a first display surface of the transparent holographic display screen is superimposed with a first diffraction grating, and a second display surface of the transparent holographic display screen is superimposed with a second diffraction grating;

[0046] The device also includes:

[0047] a first grating control unit, configured to control the second diffraction grating to block a first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is not visible on the second display surface;

[0048] The second grating control unit is used to control the first diffraction grating to block the second image light corresponding to the virtual interactive object with the motion trajectory and the second appearance morphological characteristics, so that the virtual interactive object with the motion trajectory and the second appearance morphological characteristics is invisible on the first display surface.

[0049] It can be seen from the above scheme that the display screen in the image projection method of the present application is a transparent holographic display screen, and there is a first user on one side of the first display surface of the holographic transparent display screen, and there is a second user on the second display surface of the holographic transparent display screen. In this scenario, after obtaining the input operation of the first user on the virtual interactive object displayed on the first display surface, the motion trajectory of the virtual interactive object after the current moment, the first appearance of the virtual interactive object relative to the human eye position of the first user, and the second appearance morphological characteristics of the virtual interactive object relative to the human eye position of the second user will be determined according to the input operation. Since in a real scene, after an object is operated, the motion trajectory of the object is fixed, but if the relative positions of different users and the object are different, the appearance of the object seen by different users will also be different. Based on this, the present application outputs virtual interactive objects with the same motion trajectory but different appearances to the two display surfaces of the holographic projection display screen, respectively, so that users on both sides of the holographic transparent display screen can see a virtual scene effect that is more in line with the object change characteristics in the real scene, so that the presented virtual scene is more in line with the real scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0051] Figure 1 A schematic diagram of a composition architecture of an image projection system provided in an embodiment of the present application;

[0052] Figure 2 A schematic diagram of a flow chart of an image display method provided in an embodiment of the present application;

[0053] Figure 3 A schematic diagram of another process flow of the image display method provided in the embodiment of the present application;

[0054] Figure 4 A schematic diagram showing a mixed reality scenario to which the present application is applicable;

[0055] Figure 5 Another schematic diagram showing a mixed reality scenario to which the present application is applicable;

[0056] Figure 6 Another schematic diagram of a process of the image display method provided by the present application is shown;

[0057] Figure 7 Another schematic diagram of a process of the image display method provided by the present application is shown;

[0058] Figure 8 Another schematic diagram of a process of the image display method provided by the present application is shown;

[0059] Fig. 9 A schematic diagram of the composition architecture of an electronic device provided in an embodiment of the present application.

[0060] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims and the above drawings are used to distinguish similar parts, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated herein. DETAILED DESCRIPTION

[0061] The solution of the present application can be applied to scenarios such as mixed reality or augmented reality, so as to present virtual scene images that are more in line with the real scene to users in different locations.

[0062] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0063] To facilitate understanding, the image projection system and application scenarios to which the solution of the present application is applicable are briefly introduced first.

[0064] like Figure 1 As shown, it shows an image projection system of the present application. Figure 1 In the embodiment, the image projection system includes: a control device 101 and a transparent holographic display screen 102.

[0065] The transparent holographic display screen 102 is connected to the control device 101 .

[0066] Of course, in order to realize image projection, the transparent holographic display screen may be provided with multiple projection light sources, such as the projection light source may be an organic light emitting semiconductor (OLED) in the transparent holographic display screen, and the image may be projected onto the transparent holographic display screen through the OLED light points. Alternatively, the image projection system may further include multiple projection light sources facing different display surfaces of the transparent holographic display screen.

[0067] There may be one or more control devices in the image projection system. When there are multiple control devices, the multiple control devices may form a cluster or a distributed system.

[0068] In the present application, the transparent holographic screen has two display surfaces, which may be two display planes of the transparent holographic display screen, and both display planes may display virtual scene images respectively. Figure 1 As shown, the transparent holographic display screen is a flat display screen, and both sides of the flat display screen are display surfaces. For the convenience of distinction, one display surface of the transparent holographic display screen is called a first display surface, and the other display surface is called a second display surface.

[0069] In the present application, a first user may be located on the first display surface of the transparent holographic display screen, and a second user may be located on the second display surface of the transparent holographic display screen. Figure 1 As shown, a user on the first display surface side 103 of the transparent holographic display screen is preparing to operate a virtual object displayed on the first display surface of the transparent holographic display screen, while a user on the second display surface side 104 of the transparent holographic display screen is waiting for the virtual object to approach him / her.

[0070] On this basis, users on both sides of the transparent holographic display screen can interact with virtual objects in the virtual scene presented by the transparent holographic display screen, so that users on different sides can interact with the same object. Figure 1 In the mixed reality scene, users on both sides of the transparent holographic display can tap the sphere in the virtual scene, thereby realizing the experience effect of different real people interacting based on the same sphere in the mixed reality scene.

[0071] In an optional manner, in order to more accurately and comprehensively capture the input actions or eye positions of each user in the mixed reality or augmented reality scene where the image projection system is located, the image projection system in the present application may also include one or both of an image acquisition device and an eye tracking device. Figure 1 In the description, an example is taken in which the image projection system includes both the image acquisition device 103 and the human eye tracking device 104 .

[0072] For example, the eye positioning data used to locate the user's eye position can be collected by an image acquisition device or an eye tracking device, and the eye positioning data can be reported to the control device. For example, the eye tracking device can obtain data used to locate the eye position based on infrared positioning technology, etc., and there is no limitation on this.

[0073] Correspondingly, the control device can determine the user's eye position based on the user's eye positioning data.

[0074] The image acquisition device can also acquire the user image of the user and report it to the control device. Accordingly, the control device can analyze the user's input content based on the user image, such as the specific content of the input instruction or input operation, etc.

[0075] Based on the above content, the image display method of the present application is introduced below in conjunction with a flowchart.

[0076] like Figure 2 As shown, it shows a flow chart of the image display method provided by the present application. The method is applied to a control device in an image projection system.

[0077] The method in this embodiment may include:

[0078] S201, obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen.

[0079] The first user is located at a first display surface side of the transparent holographic display screen.

[0080] The virtual interactive object is a virtual object in a virtual scene presented in a transparent holographic display screen that can be operated by a user. For example, the virtual interactive object can be an object in a virtual scene that can be played by a user in a simulated real scene, or a virtual object such as a virtual object created in a virtual scene that can be operated by a user, etc., without limitation.

[0081] The input operation can be sensed by a touch sensing unit on the transparent holographic display screen, or at least one user operation sensing device such as an image acquisition device is provided in the image projection system, and on this basis, the user's input operation is determined based on the user behavior sensed by the user operation sensing device. This application does not limit the specific method of obtaining the input operation.

[0082] It can be understood that, for the sake of convenience in distinguishing, one display surface of the transparent holographic display screen is referred to as the second display surface, and the other display surface is referred to as the second display surface. Therefore, the first display surface here can be any display surface of the transparent holographic display screen. Accordingly, in practical applications, the scenario in which a user on one side of any display surface of the transparent holographic display screen performs an input operation on a virtual interactive object on the display surface that the user is facing is applicable to this embodiment.

[0083] S202, combining the input operation, determining a motion trajectory of the virtual interactive object after the current moment, a first appearance morphological feature of the virtual interactive object relative to the eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to the eye position of the second user.

[0084] The second user is located at a side of the second display surface of the transparent holographic display screen.

[0085] The motion trajectory of the virtual interactive object after the current moment may be a trajectory change formed by motion positions at multiple moments after the current moment.

[0086] The motion trajectory can be comprehensively determined by combining parameters such as the force and direction of the input operation on the virtual interactive object.

[0087] In one implementation, in order to more accurately determine the motion trajectory of the virtual interactive object after the current moment, the present application may also combine the input operation and the current motion state of the virtual interactive object to determine the motion trajectory of the virtual interactive object after the current moment. For example, the motion trajectory of the virtual interactive object after the current moment may be determined by combining the current motion speed and motion direction of the virtual interactive object, as well as the force magnitude and force direction of the input operation.

[0088] The appearance features of a virtual interactive object refer to the appearance features of the virtual interactive object. For example, the appearance features of a virtual interactive object may include the size, color, and shape changes of the virtual interactive object, etc., which are visible to the naked eye of the user.

[0089] It is understandable that in real scenes, when the relative positions of the same object such as an item and the user's eyes are different, the appearance of the object seen by the user will also be different.

[0090] For example, when an object such as an item or a person is far away from the user, the user sees the volume or size of the object as small, while when an object such as an item or a task is close to the user, the user sees the volume or size of the object as large.

[0091] For another example, for the same object in a real scene, when the relative direction or angle between the user and the object is different, the shape, appearance and pattern of the object's external structure that the user can see will be different. For example, for a Rubik's Cube, when the user faces a certain face of the Rubik's Cube, he can see the blocks and their colors on that face; and when a certain edge of the Rubik's Cube faces the user, the user can see the blocks and their colors on the two adjacent faces of the edge.

[0092] In order to enable users to see object presentation effects that are consistent with those in real scenes through virtual scenes, the present application combines input operations to determine the motion trajectory of the virtual object after the current moment, and combines the eye positions of users on different sides of the transparent holographic display screen to determine the appearance that the virtual object needs to present relative to the user's eye position after the current moment.

[0093] Based on this, since the eye positions of users on different sides of the transparent holographic display screen are different, the present application determines that the appearance of the virtual object to be presented after the current moment will be different based on the eye positions of users on different sides.

[0094] The appearance characteristics of the virtual interactive object relative to the user's eye position can be understood as the changing characteristics of the appearance of the virtual interactive object at different times from the user's eye position.

[0095] In one possible implementation, considering that the relative position of the virtual interactive object relative to the user's eye position is related to the motion trajectory of the virtual interactive object, the present application can also determine the first appearance morphological features of the virtual interactive object relative to the eye position of the first user, and the second appearance morphological features of the virtual interactive object relative to the eye position of the second user, in combination with the motion trajectory of the virtual interactive object.

[0096] Among them, the user's eye position can be determined based on the eye positioning data used to locate the user's eyes tracked by an image acquisition device or an eye tracker. There can be many specific methods, and this application does not impose any restrictions on this.

[0097] S203, displaying the virtual interactive object having a motion trajectory and a first appearance morphological feature on a first display surface of the transparent holographic display screen.

[0098] For example, on the basis that the virtual interactive object already exists, the virtual interactive object is controlled to maintain the motion trajectory, and the first appearance morphology feature of its attribute is adjusted. For example, the motion position corresponding to the virtual interactive object at different time points after the current moment is determined according to the motion trajectory, and the first appearance morphology of the virtual interactive object at different time points after the current moment is determined based on the first appearance morphology feature. On this basis, the virtual exchange object at the corresponding motion position and with the corresponding appearance morphology at each time point after the current moment can be output.

[0099] Of course, there may be many possible specific ways to present the virtual interactive object having the motion trajectory and the first appearance morphological feature, and there is no limitation to this.

[0100] S204, displaying a virtual interactive object having a motion track and a second appearance feature on the second display surface of the transparent holographic display screen.

[0101] It is understandable that in order to enable users on both sides of the transparent holographic display screen to interact based on the same virtual interactive object, the same virtual interactive object needs to be displayed on both display surfaces of the transparent holographic display screen. However, in order to fit the interactive scene of two or more people interacting with the same object in the real world, the properties of the same virtual interactive object output by the two display surfaces of the transparent holographic display screen are different. That is, the motion trajectory of the virtual interactive object output by the two display surfaces of the holographic transparent display screen is the same, but the appearance is different.

[0102] It is understandable that, in order to achieve a better synchronization effect, the steps S203 and S204 can be performed synchronously. Of course, the order of the two steps can also be set as required, and there is no limitation on this.

[0103] From the above content, it can be seen that after obtaining the input operation of the first user of the transparent holographic display screen on the virtual interactive object displayed on the first display surface, the motion trajectory of the virtual interactive object after the current moment, the first appearance of the virtual interactive object relative to the human eye position of the first user, and the second appearance characteristics of the virtual interactive object relative to the human eye position of the second user on the other side of the holographic transparent display screen will be determined according to the input operation. Since in a real scene, after an object is operated, the motion trajectory of the object is fixed, but if the relative positions of different users and the object are different, the appearance of the object seen by different users will also be different. Based on this, the present application outputs virtual interactive objects with the same motion trajectory but different appearances to the two display surfaces of the holographic projection display screen respectively, so that users on both sides of the holographic transparent display screen can see a virtual scene effect that is more in line with the characteristics of object changes in the real scene, so that the presented virtual scene is more in line with the real scene.

[0104] It is understandable that in the present application, the appearance morphology characteristics of the virtual interactive object may have many possibilities. For ease of understanding, the image display method of the present application is described below using several possible situations of the appearance morphology characteristics as examples.

[0105] like Figure 3 As shown, it shows a flow chart of another embodiment of an image display method of the present application, and the method of this embodiment is applied to the control device mentioned above. The method of this embodiment may include:

[0106] S301, obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen.

[0107] The first user is located at a first display surface side of the transparent holographic display screen.

[0108] S302: Determine a movement trajectory of the virtual interactive object after the current moment in combination with the input operation.

[0109] This step can refer to the previous description of determining the motion trajectory, which will not be repeated here.

[0110] S303: Determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after the current moment.

[0111] The first size is the size of the virtual interactive object relative to the eye position of the first user, that is, the size of the virtual interactive object as seen from the eyes of the first user.

[0112] The first size change feature may include the first size at at least one moment after the current moment, or may include a change trend or change rule of the first size after the current moment.

[0113] It can be understood that, considering that in real scenes, for the same object, the closer the object is to the user, the larger the size of the object seen by the human eye, and vice versa, the farther the relative distance is, the smaller the size is. Therefore, in order to enable the virtual interactive object in the virtual scene to present the corresponding size change characteristics in the real scene as the position of the virtual interactive object relative to the first user's eyes, in the present application, the farther the distance of the virtual interactive object is relative to the first user's eyes, the larger the size of the virtual interactive object relative to the user's eyes.

[0114] For example, in one possible manner, a correspondence relationship between different distances of the virtual interactive object relative to the user's eyes and the size can be set, in which the larger the distance of the virtual interactive object relative to the user's eyes, the smaller the corresponding size. Therefore, by querying the correspondence relationship, the change characteristics of the first size presented by the virtual interactive object as the motion trajectory of the virtual interactive object changes can be determined.

[0115] S304: Determine, in combination with the motion trajectory, a second size change feature corresponding to the second size of the virtual interactive object after the current moment.

[0116] The second size is the size of the virtual interactive object relative to the eye position of the second user;

[0117] The farther the distance of the virtual interactive object is from the second user's eyes, the larger the size of the virtual interactive object is relative to the first user's eyes.

[0118] The specific method of determining the second size change feature based on the motion trajectory is similar to the above process of determining the first size change feature, and will not be repeated here.

[0119] S305: Displaying the virtual interactive object having the motion trajectory and the first size change feature on the first display surface of the transparent holographic display screen.

[0120] S306, displaying the virtual interactive object having the motion track and the second size change feature on the second display surface of the transparent holographic display screen.

[0121] For steps S305 and S306, reference may be made to the related introduction of the previous embodiment, which will not be described in detail here.

[0122] For ease of understanding Figure 3 The scheme shown is explained below with reference to a mixed reality scenario of the present application as an example.

[0123] like Figure 4 and Figure 5As shown, it shows a schematic diagram of a mixed reality scene in which users on both sides of a transparent holographic display screen play a ball using a virtual scene presented by the transparent holographic display screen.

[0124] Depend on Figure 4 and Figure 5 The mixed reality scene includes: a holographic transparent display screen 401, a first user 402 and a second user 403.

[0125] The first user and the second user are located on both sides of the holographic transparent display screen, respectively. As shown in the figure, the first user is located on the first display surface side of the transparent holographic display screen. Figure 4 and Figure 5 The second user is located in a spatial area 404 on the side of the first display surface of the transparent holographic display screen, and the second user is located in an area 405 on the side of the second display surface of the transparent holographic display screen.

[0126] Since the first display surface and the second display surface of the holographic transparent display screen can both present virtual scene images, a virtual sphere is presented on both the first display surface and the second display surface. However, due to the angle problem, the virtual sphere Figure 4 and Figure 5 Only the image of the virtual sphere 406 presented on the first display surface is shown.

[0127] exist Figure 4 In the example, the virtual sphere 406 presented on the first display surface is closer to the first user 402, Figure 5 ,because Figure 4 The distance between the middle virtual sphere 406 and the first user 402 is relatively close, and the size of the virtual sphere is relatively large.

[0128] Of course, in Figure 4 At the corresponding moment, the second display surface will also present the virtual sphere, and the relative position of the virtual sphere in the second display surface relative to the transparent holographic display screen is the same as the relative position of the virtual sphere in the first display surface relative to the transparent holographic display screen. On this basis, according to the position of the second user, it can be known that the virtual sphere on the second display surface is far away from the human eye position of the second user, so the size of the virtual sphere presented in the second display surface will be much smaller than the size of the virtual sphere presented in the first display surface.

[0129] exist Figure 4 In the scene shown, after the first user taps the virtual sphere 406 on the first display surface, the virtual sphere will continue to move along a parabolic trajectory from left to right. At the same time, as the distance between the virtual sphere 406 and the first user's eye position continues to change, the diameter of the virtual sphere will become smaller and smaller. Figure 5When the virtual sphere 406 on the first display surface moves from a position closer to the first user to a position closer to the second user, the size of the virtual sphere 406 is relatively Figure 4 The size of the virtual sphere is obviously smaller, so from the visual perspective of the first user, the virtual sphere appears to be getting smaller as it moves farther and farther away from the user, thus presenting a real effect from the visual perspective of the first user that the real sphere appears to be getting smaller as it moves away.

[0130] Similarly, the motion trajectory of the virtual sphere presented on one side of the second display surface is consistent with the motion trajectory of the virtual sphere presented on the first display surface. The virtual sphere presented on the second display surface will gradually increase in size as it moves along the motion trajectory, so that from the perspective of the second user, the virtual sphere will appear to gradually grow larger as it gradually approaches the user.

[0131] In another possible implementation, the appearance morphology feature of the virtual interactive object may be a color feature of the virtual interactive object. In this case, the motion trajectory of the virtual interactive object after the current moment may be determined in combination with the input operation.

[0132] Accordingly, in combination with the motion trajectory, a first color change feature of the first color that the virtual interactive object needs to present after the current moment is determined. The first color is the color that the virtual interactive object needs to present relative to the human eye position of the first user. For example, the first color change feature may include: the first color of at least one moment after the current moment; or the change rule of the first color after the current moment, etc.

[0133] The farther the virtual interactive object is from the first user's eye position, the lighter the first color that the virtual interactive object needs to present is.

[0134] Similarly, in combination with the motion trajectory, the second color change characteristics of the second color that the virtual interactive object needs to present after the current moment can be determined. The second color is the color that the virtual interactive object needs to present relative to the human eye position of the second user.

[0135] The farther the virtual interactive object is from the second user's eye position, the lighter the color of the second virtual interactive object needs to be.

[0136] It is understandable that the above are two possible situations of appearance and morphology features as examples. In actual applications, the appearance and morphology features may have other possibilities, which will not be elaborated here.

[0137] It should be noted that, in practical applications, the appearance morphology feature may also include multiple possibilities at the same time, such as the first appearance morphology feature mentioned above may include the first size change feature and the first color change feature at the same time. Accordingly, a virtual interactive object having the motion track, the first size change feature and the first color change feature may be displayed on the first display surface of the transparent holographic display screen.

[0138] Similarly, the second appearance morphological feature may include the second size change feature and the second color change feature at the same time, and then, a virtual interactive object having the motion trajectory, the second size change feature and the second color change feature may be displayed on the second display surface of the transparent holographic display screen.

[0139] It can be understood that when the two display surfaces of the transparent holographic display screen display different virtual scene images at the same time, in order to reduce the mutual interference of the display contents of the two display surfaces, in the present application, the first display surface of the transparent holographic display screen can also be superimposed with a first diffraction grating, and the second display surface of the transparent holographic display screen can be superimposed with a second diffraction grating.

[0140] Among them, the diffraction grating is a type of grating. It uses a regular structure to periodically modulate the amplitude or phase (or both) of the incident light. Since the gaps in the diffraction grating are small and dense, even if the diffraction grating is superimposed on the display surface of the transparent holographic display screen, the diffraction grating is invisible from the user's perspective.

[0141] In the present application, the diffraction grating superimposed on the display surface of the transparent holographic display screen is a controllable diffraction grating. Therefore, the light diffraction conditions of different grating areas in the diffraction grating can be controlled and changed to achieve the change of the light transmittance of the corresponding grating area.

[0142] On this basis, the control device can better display different virtual scene images to the first display surface and the second display surface respectively by controlling the two diffraction gratings.

[0143] For example, see Figure 6 , which shows a flow chart of another embodiment of an image display method of the present application. The method of this embodiment may include:

[0144] S601, obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of the transparent holographic display screen.

[0145] The first user is located at a first display surface side of the transparent holographic display screen.

[0146] S602, combining the input operation, determining the motion trajectory of the virtual interactive object after the current moment, the first appearance morphological feature of the virtual interactive object relative to the eye position of the first user, and the second appearance morphological feature of the virtual interactive object relative to the eye position of the second user.

[0147] S603: Displaying the virtual interactive object having a motion trajectory and a first appearance morphological feature on a first display surface of the transparent holographic display screen.

[0148] For the above steps S601 to S603, reference may be made to the relevant introduction of any of the previous embodiments, and will not be repeated here.

[0149] S604, controlling the second diffraction grating to block the first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is invisible on the second display surface.

[0150] For the sake of distinction, the image light corresponding to the virtual object with the motion trajectory and the first appearance morphological feature projected by the control device to the first display surface of the holographic projection device (also referred to as the projection light) is called the first image light. Correspondingly, the subsequent virtual corresponding image light with the motion trajectory and the second appearance morphological feature is called the second image light.

[0151] It is understandable that, based on the second diffraction grating blocking the first image light, the first image light is invisible to the user on the second display surface, and naturally cannot see the virtual interactive object with the motion trajectory and the first appearance morphological characteristics.

[0152] Among them, in the present application, the diffraction grating is an adjustable diffraction grating and there may be many possible situations.

[0153] In a possible case, the first diffraction grating and the second diffraction grating are diffraction gratings with adjustable grating spacing, such as the grating spacing of the first diffraction grating and the second diffraction grating is mechanically adjustable.

[0154] In this case, the control device can send a first electrical control signal to the second diffraction grating, and the first electrical control signal can be a control instruction instructing the second diffraction grating to adjust the physical spacing of the grating in the first sub-grating area covered by the first image light until it is in a light-shielding state.

[0155] In another possible implementation, the second diffraction grating is a diffraction grating with controllable diffraction coefficient. Accordingly, in the above embodiment, the first electrical control signal can be used to control the diffraction coefficient of at least one first sub-grating area in the second diffraction grating to be a diffraction coefficient corresponding to the opaque state.

[0156] For example, the second diffraction grating is an electrically controllable diffraction grating, and the diffraction parameters of the corresponding diffraction areas can be adjusted by adjusting the driving voltage applied to different diffraction areas of the second diffraction grating. On this basis, the control device can send a first electrical control signal to the second diffraction grating, and the first electrical control signal is used to control the target driving voltage applied to at least one first sub-grating area in the second diffraction grating. When the first sub-grating area is applied with the target driving voltage, the diffraction coefficient of the first sub-grating area is the diffraction coefficient corresponding to the opaque state, and the first sub-grating area can be the area in the second diffraction grating that can be covered by the first image light.

[0157] Of course, here an example is used to explain a way of adjusting the diffraction coefficient of an electrically controllable diffraction grating. In practical applications, there may be other possible ways of adjusting the diffraction coefficient of an electrically controllable diffraction grating, which are not limited thereto.

[0158] It should be noted that, in practical applications, the order of steps S603 and S604 is not limited to Figure 6 In practical applications, in order to better maintain the privacy of the content presented on the first display surface and avoid interfering with the image presentation on the second display surface, steps S603 and S604 may be performed synchronously.

[0159] S605: Displaying a virtual interactive object having a motion track and a second appearance feature on the second display surface of the transparent holographic display screen.

[0160] For this step, please refer to the related introduction of the previous embodiment, which will not be repeated here.

[0161] S606, controlling the first diffraction grating to block the second image light corresponding to the virtual interactive object having the motion trajectory and the second appearance morphological feature, so that the virtual interactive object having the motion trajectory and the second appearance morphological feature is invisible on the first display surface.

[0162] Similar to step S604, when the first diffraction grating blocks the second image light, the second image light is invisible to the user on the side of the first display surface, and naturally cannot see the virtual interactive object with the motion trajectory and the second appearance morphological features.

[0163] There are many specific ways to control the first diffraction grating. For example, in one possible case, if the first diffraction grating is a diffraction grating with adjustable grating spacing, the control device can send a second electrical control signal to the first diffraction grating. The second electrical control signal is a control instruction for controlling the first diffraction grating to adjust the grating physical spacing of its second sub-grating area until it is in a light shielding state.

[0164] The first diffraction grating may have one or more second sub-grating regions, and the second sub-grating region is a grating region in the first diffraction grating that is within the coverage of the second image light.

[0165] In another possible case, if the first diffraction grating is a diffraction grating with controllable diffraction coefficient, accordingly, the control device sends a second electrical control signal to the first diffraction grating, and the second electrical control signal can be used to control the diffraction coefficient of at least one second sub-grating area in the first diffraction grating to be a diffraction coefficient corresponding to the opaque state.

[0166] It should be noted that S605 and S606 may be executed synchronously to more reliably achieve that the virtual interactive object presented on the second display surface is invisible on the first display surface.

[0167] It is understandable that in the present application, in order to realize projecting different virtual scene images onto the first display surface and the second display surface respectively, different projection devices can be selected from a plurality of projection devices for projection according to the display surface to be projected.

[0168] For example, see Figure 7 , which shows a flow chart of another embodiment of an image display method of the present application. The method of this embodiment may include:

[0169] S701, obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of the transparent holographic display screen.

[0170] The first user is located at a first display surface side of the transparent holographic display screen.

[0171] S702, combining the input operation, determining the motion trajectory of the virtual interactive object after the current moment, the first appearance morphological feature of the virtual interactive object relative to the eye position of the first user, and the second appearance morphological feature of the virtual interactive object relative to the eye position of the second user.

[0172] S703: Projecting a virtual interactive object having a motion trajectory and a first appearance morphological feature onto a first display surface of the holographic transparent display screen through at least one first projection light source.

[0173] The first projection light source is arranged in the holographic transparent display screen, or is facing the holographic transparent display screen. The at least one first projection light source belongs to a plurality of projection light sources arranged in the holographic transparent display screen or in the scene where the image projection system is located, and belongs to a projection light source capable of projecting an image onto the first display surface.

[0174] For example, the light projection directions of a plurality of projection light sources in the image projection system may be combined to select at least one first projection light source whose light projection direction is toward the first display surface.

[0175] S704, output a first electrical control signal to the second diffraction grating.

[0176] The first electrical control signal is used to control a first sub-grating region in the second diffraction grating within a light projection region of the first projection light source to be in a light-proof state.

[0177] The specific manner in which the second control signal controls the first sub-grating region to be in a light-proof state can be found in the above related introduction and will not be described in detail here.

[0178] S705: Projecting a virtual interactive object having a motion track and a second appearance morphological feature onto a second display surface of the holographic transparent display screen through at least one second projection light source.

[0179] Wherein, the second projection light source is arranged in the holographic transparent display screen, or is facing the holographic transparent display screen.

[0180] The second projection light source is a projection light source among the multiple projection light sources in the image projection system that can project a virtual image onto the second display surface. For example, at least one second projection light source whose light projection direction is toward the second display surface can be selected from the multiple projection light sources.

[0181] S706, output a second electrical control signal to the first diffraction grating.

[0182] The second electrical control signal is used to control the second sub-grating area in the first diffraction grating within the light projection area of ​​the second projection light source to be in a light-proof state. The specific form of the second electrical control signal can be referred to the relevant introduction of the previous embodiment, which will not be repeated here.

[0183] Corresponding to an image display method of the present application, the present application also provides an image display device.

[0184] like Figure 8 As shown, it shows a schematic diagram of the composition structure of an embodiment of an image display device of the present application. The device of this embodiment may include:

[0185] An operation obtaining unit 801 is used to obtain an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, wherein the first user is located at one side of the first display surface of the transparent holographic display screen;

[0186] A feature determination unit 802 is used to determine, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to the human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to the human eye position of a second user, wherein the second user is located at a side of a second display surface of the transparent holographic display screen;

[0187] A first display control unit 803, configured to display the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen;

[0188] The second display control unit 804 is used to display the virtual interactive object with the motion trajectory and the second appearance morphological features on the second display surface of the transparent holographic display screen.

[0189] In a possible implementation, the feature determination unit includes:

[0190] A trajectory determination unit, configured to determine a motion trajectory of the virtual interactive object after a current moment in combination with the input operation;

[0191] A first size determining unit, configured to determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after a current moment, wherein the first size is a size of the virtual interactive object relative to a human eye position of the first user;

[0192] A second size determination unit, configured to determine, in combination with the motion trajectory, a second size change feature corresponding to a second size of the virtual interactive object after a current moment, wherein the second size is a size of the virtual interactive object relative to a human eye position of the second user;

[0193] The farther the distance of the virtual interactive object is from the user's eye position, the larger the size of the virtual interactive object is relative to the user's eye, and the user is any one of the first user and the second user.

[0194] In an optional manner, the feature determination unit further includes:

[0195] A first color determination unit, configured to determine, in combination with the motion trajectory, a first color change feature of a first color that the virtual interactive object needs to present after a current moment, wherein the first color is a color that the virtual interactive object needs to present relative to a human eye position of the first user;

[0196] A second color determination unit, configured to determine, in combination with the motion trajectory, a second color change feature of a second color that the virtual interactive object needs to present after a current moment, the second color being the color that the virtual interactive object needs to present relative to the human eye position of the second user;

[0197] The farther the virtual interactive object is from the position of the user's eyes, the lighter the color of the virtual interactive object needs to be.

[0198] In yet another possible implementation, a first display surface of the transparent holographic display screen is superimposed with a first diffraction grating, and a second display surface of the transparent holographic display screen is superimposed with a second diffraction grating;

[0199] The device also includes:

[0200] a first grating control unit, configured to control the second diffraction grating to block a first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is not visible on the second display surface;

[0201] The second grating control unit is used to control the first diffraction grating to block the second image light corresponding to the virtual interactive object with the motion trajectory and the second appearance morphological characteristics, so that the virtual interactive object with the motion trajectory and the second appearance morphological characteristics is invisible on the first display surface.

[0202] In another possible implementation, the first display control unit is specifically configured to project the virtual interactive object having the motion trajectory and the first appearance morphological feature onto the first display surface of the holographic transparent display screen through at least one first projection light source, wherein the first projection light source is disposed in the holographic transparent display screen, or is directed toward the holographic transparent display screen;

[0203] The first grating control unit is specifically used to output a first electrical control signal to the second diffraction grating, wherein the first electrical control signal is used to control a first sub-grating area in the second diffraction grating within a light projection area of ​​the first projection light source to be in a light-proof state.

[0204] In another possible implementation, the second display control unit is specifically used to project the virtual interactive object having the motion trajectory and the second appearance morphological characteristics onto the second display surface of the holographic transparent display screen through at least one second projection light source, and the second projection light source is arranged in the holographic transparent display screen, or is facing the holographic transparent display screen.

[0205] The second grating control unit is specifically used to output a second electrical control signal to the first diffraction grating, wherein the second electrical control signal is used to control a second sub-grating area in the first diffraction grating within the light projection area of ​​the second projection light source to be in a light-proof state.

[0206] In another aspect, the present application also provides an electronic device, such as Fig. 9 As shown, it shows a schematic diagram of a composition structure of the electronic device, the electronic device can be any type of electronic device, and the electronic device at least includes a memory 901 and a processor 902;

[0207] The processor 901 is used to execute the image display method in any one of the above embodiments.

[0208] The memory 902 is used to store programs required by the processor to perform operations.

[0209] It is understandable that the electronic device may further include a display unit 903 and an input unit 904 .

[0210] Of course, the electronic device may also have Fig. 9 There may be more or fewer components, without limitation.

[0211] On the other hand, the present application also provides a computer-readable storage medium, which stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by a processor to implement the image display method described in any one of the above embodiments.

[0212] The present application also proposes a computer program, which includes computer instructions stored in a computer-readable storage medium. When the computer program is run on an electronic device, it is used to execute the image display method in any of the above embodiments.

[0213] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the embodiments can be referred to each other. At the same time, the features recorded in each embodiment in this specification can be replaced or combined with each other, so that professionals in the field can implement or use this application. For device embodiments, since they are basically similar to method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0214] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0215] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An image display method, comprising: Obtaining an input operation of a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, wherein the first user is located on one side of the first display surface of the transparent holographic display screen; In combination with the input operation, determining a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, the second user being located on a side of a second display surface of the transparent holographic display screen; the motion trajectory of the virtual interactive object is determined according to a force magnitude and a force direction of the input operation, and a current motion speed and motion direction of the virtual interactive object; Displaying the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen; Displaying the virtual interactive object having the motion trajectory and the second appearance morphological feature on the second display surface of the transparent holographic display screen; Among them, by querying the correspondence, the change characteristics of the first size presented by the virtual interactive object as the motion trajectory of the virtual interactive object changes are determined, and the corresponding relationship is the correspondence between different distances and sizes of the virtual interactive object relative to the user's human eyes. The user is any one of the first user and the second user.

2. The method according to claim 1, wherein the step of determining, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user comprises: In combination with the input operation, determining a motion trajectory of the virtual interactive object after a current moment; Determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after a current moment, where the first size is a size of the virtual interactive object relative to a human eye position of the first user; Determine, in combination with the motion trajectory, a second size change feature corresponding to a second size of the virtual interactive object after a current moment, where the second size is a size of the virtual interactive object relative to a human eye position of the second user; The farther the distance of the virtual interactive object is from the user's eye position, the larger the size of the virtual interactive object is relative to the user's eye, and the user is any one of the first user and the second user.

3. The method according to claim 2, wherein the step of determining, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, further comprises: Determine, in combination with the motion trajectory, a first color change feature of a first color that the virtual interactive object needs to present after a current moment, the first color being a color that the virtual interactive object needs to present relative to a human eye position of the first user; Determine, in combination with the motion trajectory, a second color change feature of a second color that the virtual interactive object needs to present after a current moment, the second color being a color that the virtual interactive object needs to present relative to a human eye position of the second user; The farther the virtual interactive object is from the position of the user's eyes, the lighter the color of the virtual interactive object needs to be.

4. The method according to claim 1, wherein the first display surface of the transparent holographic display screen is superimposed with a first diffraction grating, and the second display surface of the transparent holographic display screen is superimposed with a second diffraction grating; The method further comprises: Controlling the second diffraction grating to block the first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is not visible on the second display surface; The first diffraction grating is controlled to block the second image light corresponding to the virtual interactive object having the motion trajectory and the second appearance morphological feature, so that the virtual interactive object having the motion trajectory and the second appearance morphological feature is not visible on the first display surface.

5. The method according to claim 4, wherein displaying the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen comprises: Projecting the virtual interactive object having the motion trajectory and the first appearance morphological feature onto the first display surface of the transparent holographic display screen through at least one first projection light source, wherein the first projection light source is disposed in the transparent holographic display screen or is directed toward the transparent holographic display screen; The controlling the second diffraction grating to shield the first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature comprises: A first electrical control signal is output to the second diffraction grating, wherein the first electrical control signal is used to control a first sub-grating area in the second diffraction grating within a light projection area of ​​the first projection light source to be in a light-proof state.

6. The method according to claim 4, wherein displaying the virtual interactive object having the motion trajectory and the second appearance morphological feature on the second display surface of the transparent holographic display screen comprises: Projecting the virtual interactive object having the motion track and the second appearance morphological feature onto the second display surface of the transparent holographic display screen through at least one second projection light source, wherein the second projection light source is arranged in the transparent holographic display screen, or is facing the transparent holographic display screen; The controlling the first diffraction grating to shield the second image light corresponding to the virtual interactive object having the motion trajectory and the second appearance morphological feature comprises: A second electrical control signal is output to the first diffraction grating, wherein the second electrical control signal is used to control a second sub-grating area in the first diffraction grating within a light projection area of ​​the second projection light source to be in a light-proof state.

7. An image display device, comprising: an operation obtaining unit, configured to obtain an input operation of a first user on a virtual interactive object displayed on a first display surface of the transparent holographic display screen, wherein the first user is located at one side of the first display surface of the transparent holographic display screen; a feature determination unit, configured to determine, in combination with the input operation, a motion trajectory of the virtual interactive object after a current moment, a first appearance morphological feature of the virtual interactive object relative to a human eye position of the first user, and a second appearance morphological feature of the virtual interactive object relative to a human eye position of a second user, the second user being located on a side of a second display surface of the transparent holographic display screen; the motion trajectory of the virtual interactive object is determined according to a force magnitude and a force direction of the input operation, and a current motion speed and motion direction of the virtual interactive object; A first display control unit, configured to display the virtual interactive object having the motion trajectory and the first appearance morphological feature on the first display surface of the transparent holographic display screen; A second display control unit, configured to display the virtual interactive object having the motion trajectory and the second appearance morphological feature on a second display surface of the transparent holographic display screen; Among them, the image display device is also used to determine the change characteristics of the first size presented by the virtual interactive object as the motion trajectory of the virtual interactive object changes by querying the corresponding relationship, and the corresponding relationship is the corresponding relationship between different distances and sizes of the virtual interactive object relative to the user's human eyes. The user is any one of the first user and the second user.

8. The device according to claim 7, wherein the feature determination unit comprises: A trajectory determination unit, configured to determine a motion trajectory of the virtual interactive object after a current moment in combination with the input operation; A first size determining unit, configured to determine, in combination with the motion trajectory, a first size change feature corresponding to a first size of the virtual interactive object after a current moment, wherein the first size is a size of the virtual interactive object relative to a human eye position of the first user; A second size determination unit, configured to determine, in combination with the motion trajectory, a second size change feature corresponding to a second size of the virtual interactive object after a current moment, wherein the second size is a size of the virtual interactive object relative to a human eye position of the second user; The farther the distance of the virtual interactive object is from the user's eye position, the larger the size of the virtual interactive object is relative to the user's eye, and the user is any one of the first user and the second user.

9. The device according to claim 8, wherein the feature determination unit further comprises: A first color determination unit, configured to determine, in combination with the motion trajectory, a first color change feature of a first color that the virtual interactive object needs to present after a current moment, wherein the first color is a color that the virtual interactive object needs to present relative to a human eye position of the first user; A second color determination unit, configured to determine, in combination with the motion trajectory, a second color change feature of a second color that the virtual interactive object needs to present after a current moment, the second color being the color that the virtual interactive object needs to present relative to the human eye position of the second user; The farther the virtual interactive object is from the position of the user's eyes, the lighter the color of the virtual interactive object needs to be.

10. The device according to claim 7, wherein a first display surface of the transparent holographic display screen is superimposed with a first diffraction grating, and a second display surface of the transparent holographic display screen is superimposed with a second diffraction grating; The device also includes: a first grating control unit, configured to control the second diffraction grating to block a first image light corresponding to the virtual interactive object having the motion trajectory and the first appearance morphological feature, so that the virtual interactive object having the motion trajectory and the first appearance morphological feature is not visible on the second display surface; The second grating control unit is used to control the first diffraction grating to block the second image light corresponding to the virtual interactive object with the motion trajectory and the second appearance morphological characteristics, so that the virtual interactive object with the motion trajectory and the second appearance morphological characteristics is invisible on the first display surface.

Images