A display control method and related device

Abstract

This application discloses a display control method and related equipment, relating to the field of human-computer interaction technology. The disclosed method includes: obtaining device tracking information of a target input device of an electronic device, the device tracking information including at least one of the target input device's current position tracking information and spatial posture information; determining a target display mode matching the device tracking information; and controlling the electronic device's display device to switch to the target display mode in response to a difference between the target display mode and the current display mode of the electronic device's display device; wherein the target display mode is used for outputting and controlling the display device with a two-dimensional image based on the position tracking information, or for outputting and controlling the display device with a three-dimensional image based on the position tracking information and the spatial posture information.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a display control method and related equipment. Background Technology

[0002] With the increasing application of naked-eye 3D (Three-Dimensional) desktop displays in professional creation and visualization fields, users can theoretically achieve high-precision editing of two-dimensional plane operations and depth perception of three-dimensional stereoscopic views on the same screen.

[0003] However, current interaction methods remain separated from traditional two-dimensional input devices (such as mice) and independent three-dimensional spatial devices (also known as three-dimensional input devices, such as virtual reality (VR) controllers or tracking handles), lacking coordination between input and display. Consequently, when users perform two-dimensional planar operations on the same screen as well as three-dimensional applications such as spatial structure arrangement, object posture adjustment, or three-dimensional content editing, they need to switch between precise two-dimensional operations and three-dimensional spatial manipulation using the separate two-dimensional input devices and three-dimensional spatial devices. This often leads to problems such as mode fragmentation, interrupted operation rhythm, and increased cognitive and physical burden. Summary of the Invention

[0004] Therefore, this application discloses the following technical solution:

[0005] A display control method, comprising:

[0006] Obtain device tracking information of a target input device of an electronic device, wherein the device tracking information includes at least one of the current position tracking information and spatial attitude information of the target input device;

[0007] Determine the target display mode that matches the device tracking information;

[0008] In response to the fact that the target display mode is different from the current display mode of the electronic device's display device, the electronic device's display device is controlled to switch to the target display mode;

[0009] The target display mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, or to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial attitude information.

[0010] Optionally, the location tracking information includes the current device location information and / or movement information of the target input device.

[0011] Optionally, the target input device is a first input device, which includes a two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device;

[0012] The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information;

[0013] The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

[0014] Optionally, a target display mode matching the device tracking information is determined, including at least one of the following:

[0015] In response to the device location information indicating that the current height information of the target input device is not higher than a first threshold, the target display mode is determined to be the first mode;

[0016] In response to the device location information indicating that the current height information of the target input device is not lower than the second threshold, the target display mode is determined to be the second mode;

[0017] In response to the device location information indicating that the current height information of the target input device is between the first threshold and the second threshold, it is determined that the target display mode maintains the current display mode of the display device, wherein the current display mode is one of the first mode and the second mode;

[0018] Wherein, the first threshold is less than the second threshold, the first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, and the second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial posture information.

[0019] Optionally, the target input device is a second input device, which includes a three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device;

[0020] The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information;

[0021] The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

[0022] Optionally, a target display mode matching the device tracking information is determined, including at least one of the following:

[0023] In response to the device location information indicating that the current height of the target input device is not higher than a third threshold, the target display mode is determined to be the first mode;

[0024] In response to the device location information indicating that the current height information of the target input device is not lower than the fourth threshold, the target display mode is determined to be the second mode;

[0025] In response to the device location information indicating that the current height information of the target input device is between the third threshold and the fourth threshold, the target display mode is determined to be the third mode;

[0026] Wherein, the third threshold is less than the fourth threshold, the first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, the second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial posture information, and the third mode is used to freeze the screen cursor of the display device to allow the target input device to reposition itself.

[0027] Optionally, the display control method further includes at least one of the following:

[0028] If the target display mode is the first mode, the position tracking information of the three-dimensional input device on the plane is filtered, so as to output and display two-dimensional images and control the operation of the display device based on the filtered position tracking information;

[0029] If the target display mode is the third mode, freeze the screen cursor of the display device to allow the three-dimensional input device to reposition itself, and obtain the position difference between the three-dimensional input device entering the third mode and exiting the third mode based on the repositioning. Based on the position difference, perform offset compensation on the reference system corresponding to the three-dimensional input device to simulate the lifting operation of the two-dimensional input device.

[0030] Optionally, controlling the display device of the electronic device to switch to the target display mode includes:

[0031] The display device is controlled to gradually change from the image effect corresponding to the current display mode to the image effect corresponding to the target display mode for a target duration.

[0032] A first input device includes: a two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device;

[0033] The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information;

[0034] The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

[0035] A second input device includes: a three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device;

[0036] The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information;

[0037] The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

[0038] A display control device, comprising:

[0039] The acquisition module is used to obtain device tracking information of a target input device of an electronic device, wherein the device tracking information includes at least one of the current position tracking information and spatial attitude information of the target input device;

[0040] The determination module is used to determine the target display mode that matches the device tracking information;

[0041] A control module is configured to control the display device of the electronic device to switch to the target display mode in response to the difference between the target display mode and the current display mode of the electronic device's display device.

[0042] The target display mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, or to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial attitude information.

[0043] An electronic device, comprising:

[0044] Display device and / or interface, wherein the interface is capable of connecting an external display device;

[0045] Memory is used to store computer instruction sets;

[0046] A processor is configured to implement any of the display control methods provided above by executing a set of computer instructions in the memory.

[0047] A storage medium carrying one or more computer instruction sets, which, when executed by an electronic device, enable the electronic device to implement any of the display control methods provided above. Attached Figure Description

[0048] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0049] Figure 1 This is a flowchart of the display control method provided in this application;

[0050] Figure 2 This is a schematic diagram of the enhanced mouse provided in this application and its operation;

[0051] Figure 3 This is a schematic diagram of the enhanced VR controller provided in this application and its operation;

[0052] Figure 4 These are schematic diagrams illustrating the different operating modes of the enhanced VR controller provided in this application in different operating spaces;

[0053] Figure 5 This is a schematic diagram illustrating an application example provided in this application;

[0054] Figure 6 This is a structural diagram of the display control device provided in this application;

[0055] Figure 7 This is a structural diagram of the first input device provided in this application;

[0056] Figure 8 This is a structural diagram of the second input device provided in this application;

[0057] Figure 9 This is a structural diagram of the electronic device provided in this application. Detailed Implementation

[0058] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0059] Currently, users can achieve high-precision editing of 2D planar operations and depth perception of 3D stereoscopic views on the same screen, enabling cross-dimensional 2D / 3D display and interactive applications. However, current interaction technologies still rely on the separation of traditional 2D input devices (such as mice) and independent 3D spatial devices. Input methods remain limited to separate 2D pointers or 3D spatial manipulation, failing to achieve natural linkage between input and display. This forces users to explicitly consider the current operating mode and break down operation steps according to different needs, then use corresponding input devices such as 2D input devices like mice or 3D spatial devices like VR (Virtual Reality) controllers / tracking handles to interact with or control the display. Consequently, when performing 2D / 3D cross-dimensional applications on the same screen, users need to switch between precise 2D operation and 3D spatial manipulation using separate 2D input devices and 3D spatial devices, often facing issues such as mode fragmentation, interrupted operation rhythm, and increased cognitive and physical burden due to explicit mode switching (e.g., through menus, shortcut keys, or button selection).

[0060] To address at least some of the technical problems in the known technologies, embodiments of this application provide a display control method and related equipment. The provided method can be applied to electronic devices in a variety of general or special computing device environments or configurations, such as personal computers, smart terminals, handheld or portable devices, tablet devices, etc.

[0061] The electronic device has a display device or can be connected to an external display device via an interface. The display device that the electronic device has or is connected to may be, but is not limited to, a naked-eye 3D display. The display device supports both two-dimensional precise control and three-dimensional intuitive control. That is, the display device can be applied to two-dimensional planar display mode (which can be simply referred to as planar mode or 2D display mode) to support 2D screen display and interactive applications, and can also be applied to three-dimensional stereoscopic display mode (which can be simply referred to as spatial mode or 3D display mode) to support 3D screen display and interactive applications.

[0062] See Figure 1The flowchart shown illustrates the display control method provided in this application embodiment, which may include the following steps 101 to 103, which are described in detail below.

[0063] Step 101: Obtain device tracking information of the target input device of the electronic device.

[0064] Specifically, this step involves obtaining device tracking information for the target input device while it is in operation.

[0065] In this embodiment of the application, the target input device is a composite input device that has the ability to perform precise two-dimensional control and intuitive three-dimensional control, thereby supporting 2D / 3D cross-dimensional collaborative interaction. The target input device can perform information input or operation control of electronic devices for two-dimensional screens in 2D display mode, and can also perform information input or operation control of electronic devices for three-dimensional screens in 3D display mode.

[0066] The device tracking information includes at least one of the target input device's current position tracking information and spatial attitude information.

[0067] The current location tracking information of the target input device may include, but is not limited to, the current device location information and / or movement information of the target input device.

[0068] The device position information of the target input device may include, but is not limited to, at least one of the target input device's height information and tilt angle. The height information of the target input device is used to characterize the relative height between the target input device and a preset reference plane, which may be, but is not limited to, the operating plane (such as a physical desktop) where the target input device's console is located. The tilt angle of the target input device refers to the angle between the target input device and the operating plane.

[0069] The movement information of the target input device may include, but is not limited to, the movement direction, speed and / or acceleration of the target input device.

[0070] The spatial attitude information of the target input device may include, but is not limited to, the yaw angle, pitch angle and / or roll angle of the target input device in space.

[0071] In practical applications, distance sensors, angle sensors, 6DOF (Degrees of Freedom) external trackers, and other corresponding sensing units or trackers can be set on the target input device to perform position tracking or attitude perception of the target input device, so as to obtain the current position tracking information, attitude information, and other device tracking information of the target input device.

[0072] Step 102: Determine the target display mode that matches the device tracking information.

[0073] The target display mode can be, but is not limited to, a 2D display mode or a 3D display mode, depending on the actual application. Correspondingly, the target display mode can be used to output and display two-dimensional images and control the operation of the electronic device's display device based on the position tracking information of the target input device (2D display mode), or to output and display three-dimensional images and control the operation of the electronic device's display device based on the position tracking information and spatial attitude information of the target input device (3D display mode).

[0074] Optionally, in the embodiments of this application, the target input device outputs and controls the display device of the electronic device in two dimensions based on a planar operation method (such as the operation method of a mouse on a physical desktop or other plane) in 2D display mode; and outputs and controls the display device of the electronic device in three dimensions based on an air / space operation method (such as the operation method of a VR controller / tracking handle or other three-dimensional spatial device in the air).

[0075] The device tracking information of the target input device will also differ depending on the different operation methods corresponding to different display modes.

[0076] The difference in device tracking information for the target input device can refer to differences in the type of device tracking information and / or the values ​​of the device tracking information. For example, in 2D display mode, the device tracking information may only include the device position information of the target input device, while in 3D display mode, the device tracking information includes both the device position information and the spatial attitude information of the target input device. Furthermore, the values ​​of the device position information (such as the height of the target input device relative to the reference plane) tracked in 2D and 3D display modes are also different. Based on this, after obtaining the device tracking information of the target input device, this step can determine the target display mode of the display device based on the obtained device tracking information.

[0077] The target display mode may be, but is not limited to, 2D or 3D display mode.

[0078] Step 103: In response to the fact that the target display mode is different from the current display mode of the electronic device's display device, control the display device of the electronic device to switch to the target display mode.

[0079] The display device of an electronic device can be the electronic device itself or an external display device, depending on the actual application.

[0080] If the determined target display mode is different from the current display mode of the electronic device, it indicates that there is a need to switch the display mode. Therefore, the display device can be switched from the current display mode to the target display mode, such as switching from the current 2D display mode to the 3D display mode, or switching from the current 3D display mode to the 2D display mode.

[0081] In summary, the display control method provided in this application, by tracking the position / posture of the target input device of the electronic device and controlling the display mode of the electronic device's display device based on the obtained device tracking information, enables seamless switching of the display mode in a single desktop working environment, triggered by natural physical actions on the target input device. This achieves seamless switching between interactive dimensions (such as 2D / 3D) and display modes, avoiding explicit mode switching of the display device based on menu, shortcut key, or button selection. Furthermore, it does not require replacing the hardware of the electronic device or coordinating / switching multiple input devices. Therefore, this application overcomes the drawbacks of prior art when using separate two-dimensional input devices and three-dimensional spatial devices for 2D / 3D cross-dimensional applications, avoiding display mode switching, eliminating problems such as mode breaks and interruptions in operation rhythm, and reducing the cognitive and physical burden on users.

[0082] In an optional embodiment, the target input device is a first input device, which includes a two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device.

[0083] Among them, the two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information.

[0084] Spatial pose tracking devices are used to track their own spatial position and spatial attitude, and based on the obtained position tracking information and spatial attitude information, to output, display and control the three-dimensional image of the display device.

[0085] Two-dimensional input devices can be, but are not limited to, optical mice or other devices that can be used to track their own position on a plane. Spatial pose tracking devices can include, but are not limited to, 6DoF external trackers or IMU (Inertial Measurement Unit), visual marker modules, and other devices or modules that can be used to track their own spatial position and attitude.

[0086] This embodiment obtains the target input device by enhancing the two-dimensional input device and setting a spatial pose tracking device on the two-dimensional input device.

[0087] For example, a 6DoF external tracker (or IMU / visual marker module) can be rigidly fixed on a conventional optical mouse to obtain the target input device in this embodiment. Based on the target input device, screen planar cursor positioning (2D) and spatial pose control (3D) can be integrated, thereby enabling 2D / 3D cross-dimensional collaborative interaction with the display device through the same input device (target input device).

[0088] When rigidly fixing an external 6DoF tracker or IMU / visual marker module to a conventional optical mouse, holes can be made on the upper surface of the optical mouse and the auxiliary device can be rigidly connected with studs / screws or other connectors. The connection point can be located between the index and middle fingers when the mouse is held, with a certain gap (such as about 2 cm) to ensure that it does not affect the hand grip. At the same time, it is necessary to ensure that the buttons, scroll wheel and optical sensor of the optical mouse are not obstructed.

[0089] This implementation method can also be called a mouse-enhanced method. See [link / reference] Figure 2 The illustration shows a product diagram of an enhanced mouse obtained by rigidly fixing a 6DoF external tracker to a conventional optical mouse, and also provides a diagram of holding the enhanced mouse for interactive applications such as information input or operation control of a display device.

[0090] In practical applications, regarding the implementation method of the target input device in this embodiment, for example... Figure 2 The enhanced mouse shown in the diagram can be put into a spatial operation mode by lifting the target input device and operating it in the air, and the display mode of the display device can be controlled to a 3D display mode based on the air position / attitude tracking of the target input device; conversely, the target input device can be placed on a physical desktop or other operating platform to put the target input device into a two-dimensional operation mode, and the display mode of the display device can be controlled to a 2D display mode based on the position tracking of the target input device.

[0091] This embodiment enhances the two-dimensional input device to obtain the target input device, enabling the unification of high-precision two-dimensional editing and three-dimensional embodied control within a single desktop environment. Seamless switching between 2D and 3D interactive dimensions can be triggered by the natural "lifting / lowering" action of the same input device, i.e., the target input device, and seamless switching between 2D and 3D display modes can be linked. There is no need to explicitly switch modes of the display device based on menus, buttons, or other controls, thus forming a near-zero friction cross-dimensional workflow.

[0092] Meanwhile, the implementation method of this embodiment can also maintain the user's existing grip and button habits for existing two-dimensional input devices such as optical mice, thereby ensuring the efficiency and convenience of 2D / 3D cross-dimensional interaction, and also preserving the user's original operating habits to a certain extent, thus improving the usability of the target input device.

[0093] In an optional embodiment, for the implementation where the target input device is the first input device, step 102 of the method provided in this application, namely determining the target display mode that matches the device tracking information of the target input device, can be further implemented as at least one of the following steps "1-1" to "1-3":

[0094] 1-1: In response to the device location information indicating that the current height information of the target input device is not higher than the first threshold, the target display mode is determined to be the first mode.

[0095] The first mode is used to output and display two-dimensional images and control the operation of the electronic device's display device based on the location tracking information of the target input device.

[0096] The first mode can be the 2D display mode of the display device.

[0097] The first threshold can be a value greater than 0 and whose difference from 0 is within a certain range, to ensure that the first threshold is not too large.

[0098] In this embodiment, the device location information of the target input device includes the height information of the target input device, which is used to characterize the relative height between the target input device and a reference surface (such as the operating plane of the target input device).

[0099] In this embodiment, the spatial range corresponding to the relative height of the target input device within a first threshold (not a value of 0) (i.e., the spatial range between the operating surface and the relative height represented by the first threshold) is used as the operating space of the target input device in the first mode of the display device, such as the 2D display mode. Once the device position information of the target input device indicates that the current height information of the target input device is not higher than the first threshold, the target display mode is determined to be the first mode, i.e., the 2D display mode, so as to control the display mode of the display device to the 2D display mode, for example, switching the display device from the current 3D display mode to the 2D display mode, or maintaining the current 2D display mode of the display device, etc.

[0100] This embodiment provides the aforementioned operating space in 2D display mode for the target input device (first input device). On the one hand, it ensures that the target input device can output and control the display device in two dimensions based on two-dimensional planar operations (such as moving, scrolling, clicking buttons, etc.) on the operating surface. On the other hand, it provides a certain space range for the target input device to perform lift-up / mouse-lifting operations in 2D display mode, so as to support the lift-up / mouse-lifting operations of the target input device in 2D display mode.

[0101] The lift-up operation / mouse lift-up operation refers to the action of lifting the entire target input device from the operating surface (such as a mouse pad or physical desktop) and then putting it down when using the target input device. This action is used to reposition the target input device on the operating surface to adapt to the limitations of the operating space, avoid accidental movement of the screen pointer, and improve the smoothness of operation.

[0102] In practice, the value of the first threshold can be reasonably set by combining the lift-up / mouse lift-up operation of the target input device in 2D display mode.

[0103] 1-2: In response to the device location information indicating that the current height information of the target input device is not lower than the second threshold, the target display mode is determined to be the second mode.

[0104] The first threshold is less than the second threshold.

[0105] The second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and spatial attitude information of the target input device.

[0106] The second mode can be a 3D display mode for the display device, such as a glasses-free 3D display mode.

[0107] In this embodiment, the spatial range corresponding to the relative height of the target input device above the second threshold (i.e., the spatial range corresponding to the relative height not below the second threshold) is used as the operating space of the target input device in the second mode of the display device, namely the 3D display mode.

[0108] Once the device location information of the target input device, representing the current height information of the target input device, reaches the second threshold, the target display mode is determined to be the second mode, i.e., the 3D display mode, so as to control the display mode of the display device to the 3D display mode, for example, switching the display device from the current 2D display mode to the 3D display mode, or maintaining the current 3D display mode of the display device, etc.

[0109] 1-3: In response to the present embodiment indicating that the current height information of the target input device is between the first threshold and the second threshold, the target display mode is determined to maintain the current display mode of the display device, wherein the current display mode is one of the first mode and the second mode.

[0110] In addition to setting up operating spaces for 2D and 3D display modes for the target input device (first input device), this embodiment also sets up hysteresis space for the target input device to prevent critical jitter.

[0111] The hysteresis space is the operating space corresponding to the height range between the first threshold and the second threshold, where the relative height between the operating surfaces is within this range.

[0112] If the device position information of the target input device indicates that the current height of the target input device is between the first threshold and the second threshold, it indicates that the target input device is in the hysteresis space. In this case, it is determined that the target display mode maintains the current display mode of the display device. That is, if the display device is currently in 2D display mode, the target display mode is determined to be 2D display mode; conversely, if the display device is currently in 3D display mode, the target display mode is determined to be 3D display mode. This ensures that the current display mode of the display device can be maintained within the hysteresis space, avoiding the drawback of frequently switching display modes due to the repeated changes in the height of the target input device around the set threshold when only a single threshold is set. This achieves the effect of preventing critical jitter.

[0113] It is worth emphasizing that the target input device in this embodiment refers to the first input device.

[0114] For implementations where the target input device is the first input device, such as mouse-enhanced implementations, this embodiment can trigger seamless switching between 2D / 3D interaction dimensions and link seamless switching between 2D / 3D display modes by naturally "lifting / lowering" the same input device, i.e., the first input device, without the need for explicit mode switching based on menus, buttons, or other controls. At the same time, this embodiment also avoids critical jitter by setting hysteresis space for the first input device, preventing the target input device from frequently switching modes of the display device in a short period of time during operation.

[0115] In an optional embodiment, the target input device is a second input device, which includes a three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device.

[0116] This embodiment obtains the target input device by enhancing the three-dimensional input device and setting an auxiliary device at the bottom of the three-dimensional input device.

[0117] One or more auxiliary devices can be installed on the bottom of the 3D input device. In the implementation of multiple auxiliary devices, the multiple auxiliary devices can be centrally located in the same area on the bottom of the 3D input device, or they can be distributed in different areas on the bottom of the 3D input device. There is no restriction on this, depending on the actual application.

[0118] Three-dimensional input devices can be, but are not limited to, VR controllers or tracking handles, used to track their own spatial position and spatial posture, so as to output, display and control three-dimensional images on the display device based on the obtained position tracking information and spatial posture information.

[0119] The auxiliary device may be, but is not limited to, a low-friction slider, a balancing structure, or a limiting structure, used to support the movement of the three-dimensional input device on a plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with a two-dimensional image based on the obtained position tracking information.

[0120] Taking a 3D input device as a VR controller as an example, a second input device can be obtained by adding a low-friction slider, a balancing structure, or a limiting structure to the bottom of the VR controller, and then using the second input device as the target input device. This implementation method can also be called a controller enhancement method.

[0121] In the controller enhancement method, by adding the aforementioned auxiliary device to the bottom of the VR controller, it is possible to support the application of attitude / translation degree of freedom restrictions to the VR controller, thereby restricting the VR controller to move on a plane. Restricting the VR controller to move on a plane will trigger the constraint of the VR controller's original 6DoF interaction mode to a 2DoF fine pointer input to the display screen, thus enabling two-dimensional operation control based on the screen pointer on the VR controller.

[0122] With the addition of auxiliary devices, the VR controller retains the ability to release planar constraints and enter spatial operation mode at any time. Specifically, lifting the VR controller removes the planar restrictions, allowing it to enter its original 6DoF spatial operation mode, thus enabling three-dimensional spatial control of the display device. Simultaneously, by linking the VR controller's operation mode with the display device's display mode, users can seamlessly switch between 3D and 2D display modes by performing operations such as "lifting / lowering" (lifting or placing the target input device from the operating surface) on the enhanced VR controller or other target input devices.

[0123] See Figure 3The diagram shows an enhanced VR controller obtained by setting a low-friction slider at the bottom of the VR controller in the enhanced controller mode. It also provides a diagram of operating the enhanced VR controller on a plane to support two-dimensional planar operation of the display device and retain the ability to release planar constraints and enter spatial operation mode at any time.

[0124] This embodiment obtains the target input device by adding an auxiliary device to the bottom of the 3D input device. It can also unify 2D high-precision editing and 3D embodied control in a single desktop environment. It can also trigger seamless switching between 2D and 3D interactive dimensions by the natural "lifting / lowering" action of the same input device, i.e., the target input device. At the same time, it can link seamless switching between 2D and 3D display modes without the need for explicit mode switching of the display device based on menus, buttons or other controls, thus forming a near-zero friction cross-dimensional workflow.

[0125] In an optional embodiment, for the implementation where the target input device is a second input device, step 102 of the method provided in this application, namely determining the target display mode that matches the device tracking information of the target input device, can be further implemented as at least one of the following steps "2-1" to "2-3":

[0126] 2-1: In response to the device location information indicating that the current height information of the target input device is not higher than the third threshold, the target display mode is determined to be the first mode.

[0127] The first mode in this embodiment is the same as the first mode in the previous embodiment, which can be a 2D display mode, used to output and display two-dimensional images and control the operation of the display device based on the position tracking information of the target input device.

[0128] The third threshold can also be a value greater than 0 and whose difference from 0 is within a certain range, to ensure that the third threshold is not too large.

[0129] In this embodiment, the device position information of the target input device also includes the height information of the target input device, which is used to characterize the relative height between the target input device and a reference surface such as the operating plane of the target input device.

[0130] In this embodiment, the spatial range corresponding to the relative height of the target input device within the third threshold (i.e., the spatial range between the operating surface and the relative height represented by the third threshold) is used as the operating space of the target input device in the first mode of the display device, such as the 2D display mode. Once the device position information of the target input device indicates that the current height information of the target input device is not higher than the third threshold, the target display mode is determined to be the first mode, i.e., the 2D display mode.

[0131] In this embodiment, the target input device refers to the second input device.

[0132] 2-2: In response to the device location information indicating that the current height information of the target input device is not lower than the fourth threshold, the target display mode is determined to be the second mode.

[0133] The third threshold is less than the fourth threshold.

[0134] The second mode in this embodiment is the same as the second mode in the corresponding embodiment above. It can also be a 3D display mode, used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and spatial posture information of the target input device (second input device).

[0135] In this embodiment, the spatial range corresponding to the relative height of the target input device above the fourth threshold (i.e., the spatial range corresponding to the relative height not below the fourth threshold) is used as the operating space of the target input device in the second mode of the display device, such as the 3D display mode.

[0136] Once the device location information of the target input device, representing the current height information of the target input device, reaches the fourth threshold, the target display mode is determined to be the second mode, i.e., the 3D display mode.

[0137] 2-3: In response to the device location information indicating that the current height information of the target input device is between the third threshold and the fourth threshold, the target display mode is determined to be the third mode.

[0138] The third mode can also be called the transition mode.

[0139] In addition to setting up operating spaces in 2D and 3D display modes for the target input device (second input device), this embodiment also sets up an operating space in a third mode for the target input device, which is referred to as the transition space in this embodiment.

[0140] The transition space refers to the operating space corresponding to the height range between the third threshold and the fourth threshold when the relative height between the operating surface and the operating surface is within this range.

[0141] If the device location information of the target input device is detected to indicate that the current height information of the target input device is between the third threshold and the fourth threshold, then the target display mode is determined to be the third mode, so as to control the display mode of the display device to the third mode.

[0142] The third mode is used to freeze the screen cursor of the display device to allow the target input device to be repositioned. In this embodiment, repositioning the target input device is to achieve a mouse-like "mouse lift" function on the target input device, i.e., the second input device.

[0143] Taking an enhanced VR controller (with an auxiliary device added to the bottom of the VR controller) as the target input device and a 2D display mode as the current display mode of the display device, when the height of the enhanced VR controller is between the third threshold and the fourth threshold, the display mode of the electronic device switches to the third mode, namely the transition mode. In the transition mode, the screen cursor is frozen to allow the user to reposition the enhanced VR controller. Through the repositioning process, the enhanced VR controller can achieve a mouse-like "mouse lift" function.

[0144] See Figure 4 This document provides schematic diagrams illustrating the different operating modes (corresponding to different display modes of the display device) of the enhanced VR controller in different operating spaces when operating the display device. Specifically, when the enhanced VR controller is within the spatial range corresponding to a relative height below the third threshold, it operates in mouse mode / planar operation mode, providing two-dimensional interaction / control capabilities similar to a traditional mouse; the display device is in 2D display mode accordingly. When the enhanced VR controller is within the spatial range corresponding to a relative height above the fourth threshold, it operates in controller mode / spatial operation mode, providing its own three-dimensional spatial interaction / control capabilities; the display device is in 3D display mode accordingly. When the enhanced VR controller is within the spatial range corresponding to a relative height between the third and fourth thresholds, the display device is in transition mode, where the screen cursor is frozen, allowing for repositioning of the enhanced VR controller to support a mouse-like "lift-the-mouse" function.

[0145] For implementations where the target input device is the second input device, such as controller-enhanced implementations, this embodiment can trigger seamless switching between 2D / 3D interaction dimensions and link seamless switching between 2D / 3D display modes by naturally "lifting / lowering" the same input device, i.e., the second input device. This eliminates the need for explicit mode switching of the display device based on menus, buttons, or other controls. Simultaneously, by setting a transition space for the second input device and a display mode (third mode) that matches the transition space, the position of the second input device can be repositioned to support the implementation of a function similar to the "lifting" of a traditional mouse on second input devices such as enhanced VR controllers, further improving the two-dimensional operation capabilities of second input devices such as enhanced VR controllers.

[0146] In an optional embodiment, for implementations where the target input device is a second input device, the method provided in this application may further include at least one of the following "3-1" to "3-2":

[0147] 3-1: If the target display mode is the first mode, the position tracking information of the three-dimensional input device in the target input device on the plane is filtered, so as to output and display the two-dimensional image and control the operation of the display device based on the filtered position tracking information.

[0148] When the target input device is a second input device, if the display device is in 2D display mode, it is necessary to use a second input device such as an enhanced VR controller to simulate the two-dimensional interaction / control operation of a two-dimensional input device such as a mouse. In this case, this embodiment filters the position tracking information of the three-dimensional input device in the second input device (target input device) on the plane. Through filtering, low-latency jitter suppression is provided for the 2DoF pointer mapped on the screen plane of the second input device, thereby achieving the effect of suppressing micro-jitter and ensuring the static stability and low latency of the 2DoF pointer.

[0149] Among these methods, lightweight speed-adaptive low-pass filtering (such as OneEuro filtering or similar algorithms) can be used to suppress micro-jitter, thereby ensuring the static stability and low latency of the 2DoF pointer.

[0150] 3-2: If the target display mode is the third mode, freeze the screen cursor of the display device to allow the three-dimensional input device to reposition itself, and obtain the position difference between the three-dimensional input device entering the third mode and exiting the third mode based on the repositioning. Based on the position difference, perform offset compensation on the reference system corresponding to the three-dimensional input device to simulate the lifting operation of the two-dimensional input device.

[0151] The reference frame corresponding to the three-dimensional input device in the target input device can be a local coordinate system used to describe the position and motion of the three-dimensional input device. Based on this reference frame, the position or motion of the three-dimensional input device can be tracked, thereby realizing mode switching or display control of the electronic device display device.

[0152] Offset compensation is performed on the reference frame, including but not limited to calibrating the origin of the reference frame.

[0153] In this embodiment, when the target display mode is the third mode, i.e., the transition mode, in addition to freezing the screen cursor of the display device, the position difference of the 3D input device when entering and exiting the third mode is obtained. This position difference is then used to compensate for the offset of the reference system corresponding to the 3D input device. For example, when entering the "transition mode," the screen pointer coordinates are locked, and the global translation vectors of the enhanced VR controller's entry and exit points are recorded. This allows for recalibration of the input reference (origin) of the reference system, thereby enabling precise simulation of the lifting operation of the 2D input device on the enhanced VR controller, achieving simulation of an infinite workspace and rapid migration with large displacements.

[0154] This embodiment filters the position tracking information of the 3D input device on the plane in the second input device (target input device), providing low-latency jitter suppression for the 2DoF pointer mapped on the screen, ensuring the static stability and low latency of the 2DoF pointer. Furthermore, by offset compensation of the reference frame of the 3D input device in transition mode, it achieves accurate simulation of the lift-up operation of the 2D input device in the 3D input device, enabling simulation of an infinite workspace and rapid migration with large displacements.

[0155] In an optional embodiment, step 103 of the method provided in this application, which controls the display device of the electronic device to switch to the target display mode, can be further implemented as follows: controlling the display device to gradually change from the screen effect corresponding to the current display mode to the screen effect corresponding to the target display mode according to the target duration.

[0156] Optionally, a fade-in time window of a certain duration (e.g., 100–200 ms) can be set as the target duration. Based on the fade-in time window technology, the display device can be processed to gradually transition the screen effect when switching modes, so as to gradually change the screen effect of the display device from the current display mode to the target display mode. For example, according to the set time window length, the display device can be gradually changed from the current parallax-free 2D screen effect to the 3D parallax screen effect, or from the current 3D parallax screen effect to the parallax-free 2D screen effect, etc.

[0157] One such technique is the fade-in time window, a technology used in dynamic backlight control or response time optimization for displays. It is primarily used to improve the smoothness of image transitions and visual comfort. Its core principle is to control the gradual transition time and window range of pixel information (such as pixel brightness) from the previous frame to the current frame during frame switching, thereby avoiding flickering or ghosting caused by abrupt changes in pixel information.

[0158] Subsequently, when the display device enters 3D display mode via mode switching, eye / viewpoint tracking can be enabled to drive binocular parallax output based on eye / viewpoint tracking information, achieving naked-eye 3D and other 3D effect display, while ensuring parallax alignment and depth stability. When the display device enters 2D display mode or transition mode, it can switch back to single-view high-resolution output, keeping the displayed content, such as the focus object, unchanged during the switching moment, only changing the rendering mode (removing binocular offset).

[0159] This embodiment applies techniques such as fade-in time windows to the 2D / 3D display mode switching, which can smooth the transition between 2D and 3D modes, reduce flickering during the mode switching process, and avoid causing user discomfort.

[0160] The following is an application example of the method of this application.

[0161] The display device in this example is a glasses-free 3D monitor, supporting both glasses-free 3D and 2D image display. The goal of this example is to unify high-precision 2D editing and 3D embodied manipulation of the glasses-free 3D monitor within a single desktop environment. This is achieved by triggering seamless switching between the interactive dimensions (2D / glasses-free 3D) of the glasses-free 3D monitor through natural "lift / lower" actions on the target input device, simultaneously enabling seamless switching between the 2D and 3D display modes of the glasses-free 3D monitor, thus forming a near-frictionless cross-dimensional workflow.

[0162] See Figure 5 The provided application example diagram illustrates the system architecture, which is divided into the following layers:

[0163] I. Equipment Layer

[0164] This includes glasses-free 3D displays and cross-dimensional input devices.

[0165] The cross-latitude input device is the target input device in this application, and the cross-latitude input device may include one of the following:

[0166] Enhanced mouse (DiMouse): A 6DoF tracker (such as the ViveTracker / Inside-out module) is rigidly mounted on a traditional optical mouse to enable spatial pose tracking and control functions by lifting the mouse while retaining the traditional functions of the mouse (such as optical sensing and button-based mouse operation).

[0167] Enhanced VR Controller (DimController): A low-friction slider / limiting structure / balancing structure is added to the bottom of the VR controller to restrict the VR controller's posture so that it can move on a plane and can map translation information to the screen plane to obtain a high-precision 2D pointer. When the controller is lifted, the plane restriction can be removed to enter a 6DoF-based spatial operation mode.

[0168] II. Status Determination and Mode Management Layer

[0169] Based on device tracking information such as the height, tilt angle, speed, acceleration, and spatial pose of the cross-dimensional input device relative to the desktop (operating surface), the state machine of the cross-dimensional input device is driven. Two-state (planar mode / spatial mode) and hysteresis control are used for DiMouse, while three-state (planar mode / transition mode / spatial mode, including cursor freeze and reference frame offset compensation) control is used for DimController.

[0170] III. Input Mapping Layer

[0171] Planar mode: Maps the device position, represented by device tracking information of cross-dimensional input devices, to a 2DoF pointer on the screen plane, and provides low-latency jitter suppression of the 2DoF pointer based on filtering of device tracking information (such as OneEuro filtering).

[0172] Spatial mode: Maps the device's 6DoF pose to a virtual manipulator to drive pose changes of displayed objects in a 3D scene.

[0173] IV. Display Linkage Layer

[0174] When switching modes, the glasses-free 3D display adaptively switches between 2D and glasses-free 3D outputs, and achieves parallax alignment in conjunction with eye-tracking / viewpoint tracking during glasses-free 3D display; at the same time, optionally, a smooth transition is provided during the switching between 2D and glasses-free 3D outputs to eliminate flicker.

[0175] V. Tasks and UI (User Interface) Layer

[0176] Used to provide functions such as selection and operation in 2D / 3D display modes:

[0177] 2D display mode: can support, but is not limited to, operations such as panning / rotating / scaling, fine-grained editing, precise alignment, and numerical input in Gizmo;

[0178] 3D display mode: can directly drive the embodied operation of objects / control points / handles based on the 6DoF pose of the input device, but is not limited to.

[0179] Selection and Constraints: Supports object / sub-component / control point selection, and supports axial / planar / range constraints, snapping and alignment (point / edge / face / mesh / reference system) and other operations.

[0180] In this example, the cross-dimensional input device is implemented as follows:

[0181] I. Enhanced Mouse (DiMouse)

[0182] Hardware modification: A hole is made on the upper surface of the traditional optical mouse and the 6DoF tracker is rigidly connected with a stud / screw. The connection point is located between the index and middle fingers, leaving a gap of about 2cm to ensure that it does not affect the grip; at the same time, the buttons, scroll wheel and optical sensor are not obstructed.

[0183] Sensor fusion and mapping: The system maps mouse optical displacement / position information to a screen pointer and tracker position and attitude to a spatial pose flow to achieve 3D interaction or control. The system selects and activates data for the corresponding path based on the state machine.

[0184] Ergonomics: The tracker's weight and center of gravity can be controlled, and the problem of a high center of gravity can be improved by using counterweights or support pads.

[0185] II. Enhanced VR Controller (DimController)

[0186] Mechanical constraints: 3D-printed dual-contact sliders and other auxiliary devices on the bottom of the VR controller to restrict the VR controller's roll / pitch and other postures, allowing the VR controller to slide on the table. At the same time, micro-arc surfaces or low-friction materials can be set on the bottom of the auxiliary devices to improve its stability when moving on the plane.

[0187] Plane Mapping: In 2D display mode, the DimController is moved on a plane to constrain its pose, and its position tracking information on the plane is projected and mapped to the screen pointer coordinates. At the same time, OneEuro filtering and constant velocity adaptive low-pass filtering are used to prevent the screen pointer from jittering, so as to achieve an effect of near "drift-free" when stationary.

[0188] Quickly release constraints: When the DimController height exceeds the corresponding threshold, it can enter spatial mode to allow intuitive operation of large-scale spatial poses.

[0189] In this example, the mode state machine of the cross-dimensional input device and the mode switching logic of the display device are as follows:

[0190] 1. Input: Includes the height h of the cross-latitude input device (measured relative to the operating surface such as the desktop; the relative height of the cross-latitude input device can be tracked by an external tracker or estimated by proximity sensing). In addition, it may also include information such as the tilt angle θ and velocity / acceleration of the cross-latitude input device.

[0191] II. Threshold and Hysteresis:

[0192] Upper threshold H_up: The trigger height for transitioning from planar mode to spatial mode.

[0193] Lower threshold H_down: The trigger height for falling back from spatial mode to planar mode (H_down < H_up). The height between the lower threshold H_down and the upper threshold H_up is used to form a hysteresis band to avoid critical jitter of the enhanced mouse, or to form a transition space to support mouse lift-off operations simulated by the enhanced VR controller.

[0194] III. Dual-state mode corresponding to the enhanced mouse (DiMouse):

[0195] State S2D (Plane Mode): Uses 2DoF information from DiMouse, h < H_up to maintain S2D.

[0196] State S3D (spatial mode): Uses DiMouse's 6DoF pose; h > H_down maintains S3D.

[0197] IV. The three-state mode corresponding to the enhanced VR controller (DimController):

[0198] S2D (Plane Mode): Uses DimController's 2DoF information for 2DoF screen mapping.

[0199] STransit (Transition Mode): Enter this mode when H_down < h < H_up to freeze the screen cursor and allow the user to move the DimController in the air to reposition it; when the DimController falls back to S2D, calculate the position difference Δp when entering / exiting the transition mode, and perform offset compensation on the local reference frame of the DimController based on the position difference Δp to reproduce the "mouse lift" logic.

[0200] S3D (Spatial Mode): h≥H_up enables 6DoF; h≤H_down returns to planar mode link.

[0201] In this example, the display linkage logic of the naked-eye 3D display is as follows:

[0202] I. 2D / 3D switching strategy:

[0203] Enter S3D (Spatial Mode): The naked-eye 3D display drives binocular parallax output based on the position / posture tracking information of the input device, and can enable eye / viewpoint tracking to ensure parallax alignment and depth stability; in addition, a "fade-in" time window (such as 100–200 ms) can be set when switching modes to smooth the transition of the image effect and reduce flicker.

[0204] Enter S2D or STransit (planar mode or transition mode): Switch back to single-view high-resolution output, keeping the displayed content such as the focus object unchanged during the switch, only changing the rendering mode (removing binocular offset).

[0205] II. Coupling with UI:

[0206] The UI can be configured with a Gizmo area, which is an auxiliary control used to visualize and interact with object transformations (such as moving, rotating, scaling, etc.).

[0207] In S2D mode, the Gizmo control area can be displayed as a planar control, while in S3D mode, the Gizmo can be hidden and a "virtual controller" (such as a virtual 3D control ball) can be displayed. The virtual controller's posture is consistent with that of the DimController to present information such as the DimController's position / posture changes to the user, thereby improving the user's intuitiveness in spatial control.

[0208] This example enhances the functionality of conventional input devices (mouse or VR controller) in a single desktop work environment and combines them with a state machine based on the input device's position / attitude to drive the naked-eye 3D display to switch between 2D planar display mode and 3D stereoscopic display mode. It achieves a near-zero friction transition of "lifting the input device to enter spatial operation mode and putting the input device down to enter planar operation mode" without explicit buttons or the need to replace / wear additional hardware. This unifies the process of precise parameter editing in planar mode and embodied spatial manipulation in spatial mode, significantly reducing mode fragmentation, lengthy operation chains, and cognitive / physical burden in 2D / 3D cross-dimensional applications.

[0209] Corresponding to the above-described method, this application also provides a display control device, the composition of which is as follows: Figure 6 The above includes:

[0210] The acquisition module 601 is used to obtain device tracking information of a target input device of an electronic device, wherein the device tracking information includes at least one of the current position tracking information and spatial attitude information of the target input device;

[0211] The determining module 602 is used to determine a target display mode that matches the device tracking information;

[0212] The control module 603 is configured to control the display device of the electronic device to switch to the target display mode in response to the difference between the target display mode and the current display mode of the electronic device's display device.

[0213] The target display mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, or to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial attitude information.

[0214] In one optional implementation, the location tracking information includes the current device location information and / or movement information of the target input device.

[0215] In an optional embodiment, the target input device is a first input device, which includes a two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device;

[0216] The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information;

[0217] The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

[0218] In one alternative implementation, the determining module 602 is specifically used for at least one of the following:

[0219] In response to the device location information indicating that the current height information of the target input device is not higher than a first threshold, the target display mode is determined to be the first mode;

[0220] In response to the device location information indicating that the current height information of the target input device is not lower than the second threshold, the target display mode is determined to be the second mode;

[0221] In response to the device location information indicating that the current height information of the target input device is between the first threshold and the second threshold, it is determined that the target display mode maintains the current display mode of the display device, wherein the current display mode is one of the first mode and the second mode;

[0222] Wherein, the first threshold is less than the second threshold, the first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, and the second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial posture information.

[0223] In an optional embodiment, the target input device is a second input device, which includes a three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device;

[0224] The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information;

[0225] The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

[0226] In one alternative implementation, the determining module 602 is specifically used for at least one of the following:

[0227] In response to the device location information indicating that the current height of the target input device is not higher than a third threshold, the target display mode is determined to be the first mode;

[0228] In response to the device location information indicating that the current height information of the target input device is not lower than the fourth threshold, the target display mode is determined to be the second mode;

[0229] In response to the device location information indicating that the current height information of the target input device is between the third threshold and the fourth threshold, the target display mode is determined to be the third mode;

[0230] Wherein, the third threshold is less than the fourth threshold, the first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, the second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial posture information, and the third mode is used to freeze the screen cursor of the display device to allow the target input device to reposition itself.

[0231] In an alternative embodiment, the above-described apparatus further includes at least one of the following:

[0232] The filtering module is used to filter the position tracking information of the three-dimensional input device on the plane when the target display mode is the first mode, so as to output and display a two-dimensional image and control the operation of the display device based on the filtered position tracking information.

[0233] The compensation module is used to freeze the screen cursor of the display device when the target display mode is the third mode, so as to allow the three-dimensional input device to reposition itself, and to obtain the position difference between the three-dimensional input device entering the third mode and exiting the third mode based on the repositioning, and to perform offset compensation on the reference system corresponding to the three-dimensional input device based on the position difference, so as to simulate the lifting operation of the two-dimensional input device.

[0234] In an optional embodiment, the control module 603 is specifically used to: control the display device to gradually change the screen effect corresponding to the current display mode to the screen effect corresponding to the target display mode according to the target duration.

[0235] This application embodiment also provides a first input device, the composition of which is as follows: Figure 7 As shown, it includes a two-dimensional input device 701 and a spatial pose tracking device 702 disposed on the two-dimensional input device.

[0236] The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information;

[0237] The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

[0238] For more detailed hardware implementation, functional implementation, or working process of the first input device, please refer to the relevant description of the first input device in the corresponding embodiments above, which will not be repeated here.

[0239] This application embodiment also provides a second input device, the composition of which is as follows: Figure 8 As shown, it includes a 3D input device 801 and an auxiliary device 802 disposed at the bottom of the 3D input device;

[0240] The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information;

[0241] The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

[0242] For more detailed hardware implementation, functional implementation, or working process of the second input device, please refer to the relevant description of the second input device in the corresponding embodiments above, which will not be repeated here.

[0243] This application also discloses an electronic device, the composition and structure of which are as follows: Figure 9 As shown, it may include:

[0244] Display device 10, and / or capable of connecting an external display device via an interface. The display device can be used for 3D (such as glasses-free 3D) image display and 2D image display.

[0245] Memory 20 is used to store computer instruction sets;

[0246] Computer instruction sets can be implemented in the form of computer programs.

[0247] The processor 30 is configured to implement the display control method provided in any of the above method embodiments by executing a set of computer instructions in the memory.

[0248] The processor can be a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a neural network processor (NPU), a deep learning processor (DPU), or other programmable logic devices.

[0249] Optionally, electronic devices may also include storage resources such as memory and cache.

[0250] Optionally, the electronic device may also include an image acquisition device.

[0251] In addition to these components, electronic devices may also include communication interfaces, communication buses, and other parts. Memory, processor, and communication interface communicate with each other through the communication bus.

[0252] Communication interfaces are used for communication between electronic devices and other devices. Communication buses can be Peripheral Component Interconnect (PCI) buses or Extended Industry Standard Architecture (EISA) buses, and can be categorized into address buses, data buses, control buses, etc.

[0253] This application also discloses a storage medium carrying one or more computer instruction sets, which, when executed by an electronic device, enable the electronic device to implement the display control method provided in any of the above method embodiments.

[0254] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0255] For ease of description, the above systems or devices are described separately as various modules or units based on their functions. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware components.

[0256] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence or the part that makes a creative contribution, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0257] Finally, it should be noted that in this document, relational terms such as first, second, third, and fourth are used to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0258] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A display control method, comprising: Obtain device tracking information of a target input device of an electronic device, wherein the device tracking information includes at least one of the current position tracking information and spatial attitude information of the target input device; Determine the target display mode that matches the device tracking information; In response to the fact that the target display mode is different from the current display mode of the electronic device's display device, the electronic device's display device is controlled to switch to the target display mode; The target display mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information, or to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial attitude information.

2. The display control method according to claim 1, wherein the position tracking information includes the current device position information and / or movement information of the target input device.

3. The display control method according to claim 2, wherein the target input device is a first input device, and the first input device includes a two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device; The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information; The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

4. The display control method according to claim 3, wherein determining a target display mode that matches the device tracking information includes at least one of the following: In response to the device location information indicating that the current height information of the target input device is not higher than a first threshold, the target display mode is determined to be the first mode; In response to the device location information indicating that the current height information of the target input device is not lower than the second threshold, the target display mode is determined to be the second mode; In response to the device location information indicating that the current height information of the target input device is between the first threshold and the second threshold, it is determined that the target display mode maintains the current display mode of the display device, wherein the current display mode is one of the first mode and the second mode; in, The first threshold is less than the second threshold. The first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information. The second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial attitude information.

5. The display control method according to claim 2, wherein the target input device is a second input device, the second input device comprising a three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device; The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information; The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

6. The display control method according to claim 5, wherein determining a target display mode that matches the device tracking information includes at least one of the following: In response to the device location information indicating that the current height of the target input device is not higher than a third threshold, the target display mode is determined to be the first mode; In response to the device location information indicating that the current height information of the target input device is not lower than the fourth threshold, the target display mode is determined to be the second mode; In response to the device location information indicating that the current height information of the target input device is between the third threshold and the fourth threshold, the target display mode is determined to be the third mode; in, The third threshold is less than the fourth threshold. The first mode is used to output and display two-dimensional images and control the operation of the display device based on the position tracking information. The second mode is used to output and display three-dimensional images and control the operation of the display device based on the position tracking information and the spatial posture information. The third mode is used to freeze the screen cursor of the display device to allow the target input device to reposition itself.

7. The display control method according to claim 6, further comprising at least one of the following: If the target display mode is the first mode, the position tracking information of the three-dimensional input device on the plane is filtered, so as to output and display two-dimensional images and control the operation of the display device based on the filtered position tracking information; If the target display mode is the third mode, freeze the screen cursor of the display device to allow the three-dimensional input device to reposition itself, and obtain the position difference between the three-dimensional input device entering the third mode and exiting the third mode based on the repositioning. Based on the position difference, perform offset compensation on the reference system corresponding to the three-dimensional input device to simulate the lifting operation of the two-dimensional input device.

8. The display control method according to claim 1, wherein controlling the display device of the electronic device to switch to the target display mode includes: The display device is controlled to gradually change from the image effect corresponding to the current display mode to the image effect corresponding to the target display mode for a target duration.

9. A first input device, comprising: A two-dimensional input device and a spatial pose tracking device disposed on the two-dimensional input device; The two-dimensional input device is used to track its own position on the plane, so as to output and display two-dimensional images and control the operation of the display device based on the obtained position tracking information; The spatial pose tracking device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information.

10. A second input device, comprising: A three-dimensional input device and an auxiliary device disposed at the bottom of the three-dimensional input device; The three-dimensional input device is used to track its own spatial position and spatial posture, so as to output and display three-dimensional images and control the operation of the display device based on the obtained position tracking information and spatial posture information; The auxiliary device is used to support the movement of the three-dimensional input device on the plane. By moving the three-dimensional input device on the plane, the three-dimensional input device tracks its own position on the plane, and outputs and controls the display device with two-dimensional images based on the obtained position tracking information.

Images