Display system adjustment method, device and display system

Abstract

The present invention relates to a display system adjustment method, device and display system, which firstly obtain user position information and first landing point position information, adjust the display position of a target object in a display device according to the user position information, then obtain the adjusted second landing point position information, combine the first landing point position information and the second landing point position information to obtain an offset parameter, and adjust the display position of the target object according to the offset parameter, thereby realizing synchronous correction of the control position of a user control device in the display device and improving the consistency of user experience.

Description

Technical Field

[0001] The present invention relates to the field of display, and in particular to a display system adjustment method, device and display system. Background Art

[0002] In a system that tracks user movement, when the user moves, the target object often moves with the user's position to ensure that the target object is always in the user's best viewing field. However, during the above movement process, usually only the spatial position of the target object is changed. When the target object receives an external input signal for interaction, the change in the spatial position of the target object causes a deviation in the corresponding position of the external input signal on the target object, affecting the user experience. Summary of the invention

[0003] The embodiments of the present application provide a display system adjustment method, device and display system, which can improve the consistency of user experience.

[0004] In a first aspect, an embodiment of the present application provides a display system adjustment method, wherein the display system includes a display device and a control device; the display device is used to display one or more targets in a scene, and the control device controls the target by adjusting its landing point on the target;

[0005] The display system adjustment method comprises the following steps:

[0006] Acquire user location information and first landing point location information; wherein the user location information is used to indicate the user's location, and the first landing point location information is used to indicate the landing point of the control device on the target object;

[0007] Adjust the display position of the target object according to the user position information so that the target object is in the best viewing field of the user;

[0008] Acquire second landing point position information; wherein the second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information;

[0009] Acquire an offset parameter according to the first landing point position information and the second landing point position information;

[0010] The display position of the target object is adjusted according to the offset parameter.

[0011] The display device is used to display a three-dimensional scene in a virtual space; the control device is used to manipulate a target object in the three-dimensional scene.

[0012] Optionally, the optimal viewing field of view is: the user's field of view can cover the main view of the target object.

[0013] Optionally, the target object is a window; and the step of adjusting the display position of the target object according to the user position information includes:

[0014] The display position of the window is adjusted so that the normal vector of the window is perpendicular to the position of the user.

[0015] Optionally, the step of adjusting the display position of the window includes:

[0016] Get the center point of the window;

[0017] With the center point as the origin, the window is rotated in a direction parallel to the ground so that the normal vector of the window is perpendicular to the position of the user.

[0018] Optionally, the control device is used to emit a ray toward the target object, and the landing point position information is the intersection position of the ray and the target object.

[0019] Optionally, the first landing point position information includes a first coordinate of the landing point in a spatial rectangular coordinate system, and the second landing point position information includes a second coordinate of the landing point in a spatial rectangular coordinate system, wherein the spatial rectangular coordinate system uses a horizontal extension direction of a plane where the target object at the first landing point position is located as an X-axis, uses a direction where a normal vector of the target object at the first landing point position is located as a Y-axis, and uses a direction perpendicular to the ground as a Z-axis;

[0020] The step of obtaining the offset parameter of the display device comprises:

[0021] The coordinate change between the first coordinate and the second coordinate is obtained to obtain an offset parameter.

[0022] Optionally, it is characterized in that the step of adjusting the display position of the target object according to the offset parameter comprises:

[0023] Based on the center point of the target object, the display position of the target object is adjusted according to the offset parameter, so that the landing point position of the control device on the target object after adjustment is the same as the first landing point position.

[0024] In a second aspect, an embodiment of the present application provides a display system adjustment device, wherein the display system includes a display device and a control device; the display device is used to display one or more targets in a scene, and the control device controls the target by adjusting its landing point on the target;

[0025] The display system adjustment device comprises:

[0026] A first position acquisition module, used to acquire user position information and first landing point position information; wherein the user position information is used to indicate the user's position, and the first landing point position information is used to indicate the landing point position of the control device on the target object;

[0027] A position adjustment module, used to adjust the display position of the target object according to the user position information so that the target object is in the best viewing field of the user;

[0028] A second position acquisition module is used to acquire second landing point position information; wherein the second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information;

[0029] An offset parameter acquisition module, used to acquire an offset parameter according to the first landing point position information and the second landing point position information;

[0030] An adjustment module is used to adjust the display position of the target object according to the offset parameter.

[0031] In a third aspect, an embodiment of the present application provides a display system, comprising: a display device, a control device, a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the display device is used to display one or more targets in a scene, the control device controls the target by adjusting the landing point of the target, and the processor implements the steps of the display system adjustment method as described in any one of the above when executing the computer program.

[0032] In an embodiment of the present application, the user position information and the first landing point position information are first obtained, and the display position of the target object in the display device is adjusted according to the user position information. Then, the adjusted second landing point position information is obtained, and the offset parameters are obtained in combination with the first landing point position information and the second landing point position information. The display position of the target object is adjusted according to the offset parameters, thereby achieving synchronous correction of the control position of the user control device in the display device and improving the consistency of user experience.

[0033] For better understanding and implementation, the present invention is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A flow chart of a display system adjustment method according to an embodiment of the present invention;

[0035] Figure 2 A schematic diagram of adjusting a rectangular window in a three-dimensional space in one embodiment of the present invention;

[0036] Figure 3A top view of adjusting a rectangular window in a three-dimensional space in one embodiment of the present invention;

[0037] Figure 4 It is a structural schematic diagram of a display system adjustment device in one embodiment of the present invention;

[0038] Figure 5 The figure is a schematic diagram of the structure of a display system in one embodiment of the present invention. DETAILED DESCRIPTION

[0039] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0040] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0041] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. The singular forms of "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0042] When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and do not have to be used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances.

[0043] In addition, in the description of this application, unless otherwise specified, "several" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0044] The display system adjustment method and device described in the embodiment of the present application can be applied to a virtual display system, wherein the display system includes a display device and a control device, the display device is used to display one or more targets in the scene, and the control device controls the target by adjusting the landing point of the target in the scene; for a virtual scene with a real object, the target can be a real object, and information related to the real object is presented based on the user's selection of the real object, thereby achieving a virtual display effect. For a virtual scene, the target is a virtual object, and the control of the virtual object can be achieved based on the user's selection and manipulation of the virtual object.

[0045] The display device is a device or equipment such as AR / VR glasses that can present (display) stereoscopic images for users to watch. By presenting stereoscopic images, the display device can present a three-dimensional scene to the user. The control device can be a user input device such as a remote control, a mouse, a keyboard or a stylus that can be used to interact with the target in the presented scene. The display system adjustment method can be integrated into the display device as one of its functions.

[0046] like Figure 1 As shown, the embodiment of the present application provides a display system adjustment method, comprising the following steps:

[0047] Step S1: Obtain user location information and first landing point location information;

[0048] The user location information is used to indicate the user's location. In one embodiment, the user's location can be tracked using a location tracking device such as a location sensor to obtain the user location information. In another embodiment, when the display device is a VR / AR display device worn by the user, the user location information can be obtained by tracking the location of the VR / AR display device.

[0049] The first landing point position information is used to indicate the landing point of the control device on the target object. The landing point can be the landing point of the actual object on the target object, or it can be a virtual landing point obtained based on the mapping relationship between the control device and the target object, such as the cursor position obtained by moving the mouse on the display.

[0050] In one embodiment, the control device is used to emit a ray toward the target object, and the landing point position information is the intersection position of the ray and the target object.

[0051] In one embodiment, the control device may be a visible light indicator that emits visible light to the target object, obtains the landing point of the visible light on the target object by identifying information such as pixel distribution, brightness or color in the scene, and thus determines the landing point position information.

[0052] Step S2: adjusting the display position of the target object according to the user position information so that the target object is always within the user's best viewing field of view;

[0053] The user's optimal viewing field of view may refer to the field of view in which the user can clearly view the target object, and the distance or direction between the user and the display object is adjusted so that the user can see the target object clearly. In one embodiment, the optimal viewing field of view is: the user's field of view can cover the main view of the target object. Specifically, the display position of the target may refer to the distance between the target object and the user, or the angle at which the target object is presented to the user. For example, the target object may be always within the user's optimal viewing field of view by reducing or increasing the distance between the target object and the user, or by rotating the target object, so as to improve the user experience.

[0054] Step S3: Obtaining the second landing point position information;

[0055] The second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information.

[0056] Step S4: acquiring an offset parameter according to the first landing point position information and the second landing point position information;

[0057] Specifically, the landing point position information may include the positions of the first landing point and the second landing point. The positions of the two landing points may be represented by coordinates, and the offset parameter is the coordinate change of the two landing point coordinates.

[0058] Step S5: adjusting the display position of the target object according to the offset parameter.

[0059] By adjusting the display position of the target object according to the offset parameter, the control position of the user control device on the display device is synchronously corrected. In one embodiment, the step of adjusting the display position of the target object according to the offset parameter includes:

[0060] Based on the center point of the target object, the display position of the target object is adjusted according to the offset parameter, so that the landing point position of the control device at the target object after adjustment is the same as the first landing point position, so as to improve the consistency of user experience.

[0061] In an embodiment of the present application, the user position information and the first landing point position information are first obtained, and the display position of the target object in the display device is adjusted according to the user position information. Then, the adjusted second landing point position information is obtained, and the offset parameters are obtained in combination with the first landing point position information and the second landing point position information. The display position of the target object is adjusted according to the offset parameters, thereby achieving synchronous correction of the control position of the user control device in the display device and improving the consistency of user experience.

[0062] In one embodiment, the user's location can be obtained at a set time interval; wherein the time interval can be set according to the actual needs of the user. When a change in the user's location information is detected, the above steps S1-S5 are executed to enable the user control device to calibrate the location of the target object, thereby adjusting the display position of the target object in real time to improve the user experience.

[0063] In one embodiment, the display device is a VR glasses, which can realize the display of a three-dimensional scene in a virtual space with the help of a 3D development engine such as Unity 3D; the control device is a remote controller for manipulating a target object in the three-dimensional scene.

[0064] In the embodiment of the present application, the VR glasses use the Unity 3D development engine to display a three-dimensional scene in a virtual space, and create a target object in the three-dimensional scene according to preset parameters. The preset parameters may include the size of the target object and the coordinates of each point; Figure 2 As shown, the following uses a rectangular window as a target object to illustrate the display system adjustment method described in the present application. For the rectangular window ABCD, its preset parameters may include the spatial positions of the four boundary points A, B, C, and D of the rectangular window, and the rectangular window is created in the three-dimensional space according to the spatial positions of the four boundary points A, B, C, and D. The rectangular window can be used as a display area for the application interface or graphics of the display device; the user uses the remote control to emit a ray to the rectangular window, and the intersection point P of the ray in the window is the landing point. Specifically, the position of the landing point can be directly obtained by calling the Raycast function in Unity 3D. A spatial rectangular coordinate system is established based on the current scene, with the horizontal extension direction of the plane where the rectangular window is located as the X-axis, the direction of the normal vector of the rectangular window as the Y-axis, and the direction perpendicular to the ground as the Z-axis to obtain the coordinates of the first landing point P.

[0065] like Figure 3 As shown, first, the position of the rectangular window is corrected according to the user's position information. Specifically, the LookAt function in Unity 3D can be directly called to make the normal vector of the window perpendicular to the user's position in combination with the coordinates of each point of the rectangular window, so that the window is in the user's best viewing field. Wherein, O is the center point of the rectangular window. Specifically, with point O as the center of the circle, the rectangular window rotates around point O in a direction parallel to the ground. When rotated to position 1, the normal vector of the rectangular window is perpendicular to the user's position.

[0066] At this time, obtain the coordinates of the second landing point P' of the ray in the window, calculate the coordinate change according to the coordinates of the first landing point P and the second landing point P', and use the coordinate change as the offset parameter. According to the offset parameter, move the position of window ABCD in reverse to position 2 to realize the correction of the landing point position.

[0067] like Figure 4 As shown, the embodiment of the present application also provides a display system adjustment device, including:

[0068] A first position acquisition module 1 is used to acquire user position information and first landing point position information; wherein the user position information is used to indicate the user's position, and the first landing point position information is used to indicate the landing point position of the control device on the target object;

[0069] Position adjustment module 2, used to adjust the display position of the target object according to the user position information so that the target object is in the best viewing field of the user;

[0070] A second position acquisition module 3 is used to acquire second landing point position information; wherein the second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information;

[0071] An offset parameter acquisition module 4 is used to acquire an offset parameter according to the first landing point position information and the second landing point position information;

[0072] The adjustment module 5 is used to adjust the display position of the target object according to the offset parameter.

[0073] It should be noted that the display system adjustment device provided in the above embodiment only uses the division of the above functional modules as an example when executing the display system adjustment method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display system adjustment device and the display system adjustment method provided in the above embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0074] like Figure 5 As shown, an embodiment of the present application also provides a display system, including: a display device 100, a control device 200, a memory 300, a processor 400, and a computer program stored in the memory 300 and executable by the processor 400, the display device 100 is used to display one or more targets in a scene, the control device 200 controls the target by adjusting its landing point on the target, and the processor 400 implements the steps of the display system adjustment method as described in any one of the above when executing the computer program.

[0075] In one embodiment, the display device 100 is a device or apparatus such as AR / VR glasses that can present (display) a stereoscopic image for a user to watch. By presenting a stereoscopic image, the display device 100 can present a three-dimensional scene to the user. The control device 200 can be a user input device such as a mouse, keyboard, or stylus that can be used to interact with a target object in the presented scene.

[0076] The present invention is not limited to the above-mentioned embodiments. If various changes or modifications to the present invention do not depart from the spirit and scope of the present invention, and if these changes and modifications fall within the scope of the claims and equivalent technologies of the present invention, the present invention is also intended to include these changes and modifications.

Claims

1. A display system adjustment method, characterized in that: The display system includes a display device and a control device; the display device is used to display one or more targets in the scene, and the control device controls the target by adjusting its landing point on the target; The display system adjustment method comprises the following steps: Acquire user location information and first landing point location information; wherein the user location information is used to indicate the user's location, and the first landing point location information is used to indicate the landing point of the control device on the target object; Adjust the display position of the target object according to the user position information so that the target object is in the best viewing field of the user; Acquire second landing point position information; wherein the second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information; Acquire an offset parameter according to the first landing point position information and the second landing point position information; the first landing point position information includes a first coordinate, the second landing point position information includes a second coordinate, and the offset parameter is obtained according to a coordinate change amount of the first coordinate and the second coordinate; The display position of the target object is adjusted according to the offset parameter, so that the landing point position of the control device at the target object after adjustment is the same as the first landing point position.

2. The display system adjustment method according to claim 1, characterized in that: The display device is used to display a three-dimensional scene in a virtual space; the control device is used to manipulate a target object in the three-dimensional scene.

3. The display system adjustment method according to claim 2, characterized in that: The optimal viewing field of view is: the user's field of view can cover the main view of the target object.

4. The display system adjustment method according to claim 2, characterized in that: The target object is a window; and the step of adjusting the display position of the target object according to the user position information comprises: The display position of the window is adjusted so that the normal vector of the window is perpendicular to the position of the user.

5. The display system adjustment method according to claim 4, characterized in that: The step of adjusting the display position of the window includes: Get the center point of the window; With the center point as the origin, the window is rotated in a direction parallel to the ground so that the normal vector of the window is perpendicular to the position of the user.

6. The display system adjustment method according to claim 1, characterized in that: The control device is used to emit a ray toward the target object, and the landing point position information is the intersection position of the ray and the target object.

7. The display system adjustment method according to claim 1, characterized in that: The first landing point position information includes the first coordinate of the landing point in a spatial rectangular coordinate system, and the second landing point position information includes the second coordinate of the landing point in a spatial rectangular coordinate system. The spatial rectangular coordinate system uses the horizontal extension direction of the plane where the target object at the first landing point position is located as the X-axis, the direction of the normal vector of the target object at the first landing point position as the Y-axis, and the direction perpendicular to the ground as the Z-axis.

8. A display system adjustment device, characterized in that: The display system includes a display device and a control device; the display device is used to display one or more targets in the scene, and the control device controls the target by adjusting its landing point on the target; The display system adjustment device comprises: A first position acquisition module, used to acquire user position information and first landing point position information; wherein the user position information is used to indicate the user's position, and the first landing point position information is used to indicate the landing point position of the control device on the target object; A position adjustment module, used to adjust the display position of the target object according to the user position information so that the target object is in the best viewing field of the user; A second position acquisition module is used to acquire second landing point position information; wherein the second landing point position information is used to indicate the landing point position of the control device on the target object after adjustment according to the user position information; An offset parameter acquisition module, used to acquire an offset parameter according to the first landing point position information and the second landing point position information; the first landing point position information includes a first coordinate, the second landing point position information includes a second coordinate, and the offset parameter is obtained according to the coordinate change amount of the first coordinate and the second coordinate; The adjustment module is used to adjust the display position of the target object according to the offset parameter so that the landing point position of the control device at the target object after adjustment is the same as the first landing point position.

9. A display system, characterized in that: include: A display device, a control device, a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the display device is used to display one or more targets in a scene, the control device controls the target by adjusting the landing point of the target, and the processor implements the steps of the display system adjustment method as described in any one of claims 1 to 7 when executing the computer program.

Images