Simulation laser implementation method and device, terminal and computer readable storage medium

Abstract

The embodiment of the invention discloses a simulation laser implementation method and device, a terminal and a computer readable storage medium, and is applied to a display system, the display system comprises a display device and a device operation device which are cooperatively used, and the device operation device comprises a positioning base and a simulation laser which are cooperatively used. The method comprises the following steps: determining spatial position information of a simulation laser based on a positioning base; determining first geomagnetic included angle information corresponding to the positioning base, second geomagnetic included angle information corresponding to the simulation laser and target included angle information of the simulation laser relative to the positioning base; and finally, correcting the spatial position information and the target included angle information based on the equipment relative position of the display equipment relative to the positioning base. Therefore, the real direction of the simulation laser for the device display area in the display device and the target position where the real direction intersects with the plane where the device display area is located can be obtained, namely the position in the same direction and the direction in which the real laser emitted by the starting point directs can be obtained.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device, terminal and computer-readable storage medium for implementing simulated laser. Background Art

[0002] In recent years, with the large-scale application of electronic demonstration equipment, it is inevitable to highlight some contents in the display device of the electronic demonstration equipment during the demonstration process. In order to allow the presenter to stay away from the electronic demonstration equipment, some contents in the display device are highlighted. Usually, a laser pen can be used to emit laser for highlighting. However, there is a risk of accidentally hurting the human eye during the demonstration using a laser pen. In order to avoid accidentally hurting the human eye with laser, the simulated laser point displayed in the display device can be manipulated based on virtual pointing. However, when the simulated laser point displayed in the display device is manipulated based on virtual pointing, even if the simulated laser pen does not point to the display device, when the simulated laser pen is moved, the simulated laser point on the display device will also be displayed and moved. The actual use experience is not good and is quite different from a real laser pen. Summary of the invention

[0003] The embodiments of the present application provide a simulated laser implementation method, device, terminal and computer-readable storage medium, which can solve the technical problem that when a simulated laser point displayed on a display device is controlled based on virtual pointing, even if the simulated laser pen is not pointed at the display device, when the simulated laser pen is moved, the simulated laser point on the display device will be displayed and moved, and the actual usage experience is not good and is significantly different from a real laser pen.

[0004] In a first aspect, an embodiment of the present application provides a method for implementing a simulated laser, which is applied to a display system, wherein the display system includes a display device and a device operating device used in conjunction with each other, wherein the device operating device includes a positioning base and a simulated laser used in conjunction with each other, and the method includes:

[0005] Determining spatial position information of the simulated laser based on the positioning base, wherein the positioning base is used to connect with the display device;

[0006] Determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0007] Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is determined.

[0008] Optionally, determining the spatial position information of the simulated laser based on the positioning base includes:

[0009] Determine a first spatial three-dimensional coordinate system with the positioning base as a reference;

[0010] In the first spatial three-dimensional coordinate system, three-dimensionally positioning the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system;

[0011] The three-dimensional coordinate information is used as the spatial position information of the simulated laser.

[0012] Optionally, in the first spatial three-dimensional coordinate system, three-dimensionally positioning the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system includes:

[0013] In the first spatial three-dimensional coordinate system, the UWB positioning tag in the simulated laser is subjected to UWB three-dimensional positioning processing based on the positioning base in a UWB three-dimensional positioning manner to determine the three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

[0014] Optionally, the determining the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser includes:

[0015] The first geomagnetic angle information of the first pointing direction of the first magnetometer in the positioning base relative to each coordinate axis in the standard geographic coordinate system is obtained, and the second geomagnetic angle information of the second pointing direction of the second magnetometer in the simulation laser relative to each coordinate axis in the standard geographic coordinate system is obtained.

[0016] Optionally, determining the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information includes:

[0017] Based on the second geomagnetic angle information and the first geomagnetic angle information, angle difference information is determined, and the angle difference information is used as target angle information of the simulated laser relative to the positioning base.

[0018] Optionally, determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information, and the device relative position of the display device relative to the positioning base includes:

[0019] Determining the pointing information of the simulated laser with respect to the display device based on the target angle information and the relative position of the display device with respect to the positioning base;

[0020] Determining simulated laser position information of the simulated laser for the display device based on the spatial position information and the device relative position of the display device relative to the positioning base;

[0021] Based on the pointing information and the simulated laser position information, a target position of a simulated laser point of the simulated laser relative to a device display area in the display device is determined.

[0022] Optionally, the method further comprises:

[0023] Detecting whether the target position of the simulated laser point is located in a device display area of ​​the display device;

[0024] If the target position of the simulated laser spot is located in the device display area, displaying the simulated laser spot at the target position in the device display area;

[0025] If the position of the simulated laser spot is located in a reference display area outside the device display area, the simulated laser spot is canceled from being displayed.

[0026] Optionally, after displaying the simulated laser point at the target position of the device display area, the method further comprises:

[0027] In response to the interactive operation of the simulated laser, a target functional operation corresponding to the interactive operation is performed based on the simulated laser spot.

[0028] In a second aspect, an embodiment of the present application provides a method for implementing a simulated laser, which is applied to a display device, wherein the display device is used in conjunction with a device operating device in a display system, wherein the device operating device includes a positioning base and a simulated laser used in conjunction, and the method includes:

[0029] Obtaining spatial position information of the simulated laser determined based on the positioning base from the device operating device, and obtaining first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser from the device operating device; wherein the positioning base is used to connect to the display device;

[0030] Determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0031] Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is determined.

[0032] In a third aspect, an embodiment of the present application provides a method for implementing a simulated laser, which is applied to a device operating device, the device operating device is used in conjunction with a display device in a display system, the device operating device includes a positioning base and a simulated laser used in conjunction, and the method includes:

[0033] Determining the spatial position information of the simulated laser based on the positioning base, and sending the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect with the display device;

[0034] Acquire first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and send the first geomagnetic angle information and the second geomagnetic angle information to a display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

[0035] In a fourth aspect, an embodiment of the present application provides a simulated laser implementation device, which is applied to a display system, wherein the display system includes a display device and a device operating device used in conjunction with each other, wherein the device operating device includes a positioning base and a simulated laser used in conjunction with each other, and the device includes:

[0036] A spatial position information determination module, adapted to determine the spatial position information of the simulated laser based on the positioning base, wherein the positioning base is used to be connected to the display device;

[0037] a target angle information determination module, adapted to determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0038] The position determination module is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

[0039] In a fifth aspect, an embodiment of the present application provides a display device, the display device is used in conjunction with a device operating device in a display system, the device operating device includes a positioning base and a simulation laser used in conjunction, and the display device includes:

[0040] an acquisition module, adapted to acquire from the device operating device the spatial position information of the simulated laser determined based on the positioning base, and to acquire from the device operating device the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser; wherein the positioning base is used to be connected to the display device;

[0041] A determination module, adapted to determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0042] The target position determination module is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

[0043] In a sixth aspect, an embodiment of the present application provides a device operating apparatus, which is used in conjunction with a display device in a display system, and includes a positioning base and a simulation laser used in conjunction with each other, and the apparatus includes:

[0044] A first sending module, adapted to determine the spatial position information of the simulated laser based on the positioning base, and send the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect to the display device;

[0045] The second sending module is suitable for obtaining the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and sending the first geomagnetic angle information and the second geomagnetic angle information to the display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and is suitable for determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

[0046] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, implement any of the methods described above.

[0047] In an eighth aspect, an embodiment of the present application provides a terminal, comprising: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing any one of the above method steps.

[0048] The embodiment of the present application provides a method for realizing a simulated laser, which is based on a display device and a device operating device used in combination. The device operating device includes a positioning base and a simulated laser used in combination. Based on the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, the target angle information of the simulated laser relative to the positioning base is obtained, and the target position of the simulated laser point of the simulated laser relative to the positioning base is determined based on the spatial position information and the target angle information. Here, the obtained target position is the real position of the pointing direction of the simulated laser relative to the positioning base, and then the spatial position information and the target angle information are corrected based on the device relative position of the display device relative to the positioning base.

[0049] In this way, the actual pointing of the simulated laser with respect to the device display area in the display device and the target position where the actual pointing intersects the plane where the device display area is located can be obtained. The target position is the pointing position of the plane where the simulated actual pointing of the simulated laser corresponds to the device display area, that is, the same position as the actual laser pointing. This effectively solves the technical problem that when the simulated laser point displayed in the display device is controlled based on virtual pointing, even if the simulated laser pen does not point to the display device, the simulated laser point on the display device will be displayed and move when the simulated laser pen is moved, the actual usage experience is not good, and it is quite different from a real laser pen. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0051] Figure 1 An exemplary system architecture diagram of a method for implementing a simulated laser provided in an embodiment of the present application;

[0052] Figure 2 A schematic diagram of a flow chart of a method for implementing a simulated laser provided in an embodiment of the present application;

[0053] Figure 3 A schematic diagram of a process for determining spatial position information of a simulated laser provided in an embodiment of the present application;

[0054] Figure 4A schematic diagram of a process for determining a target position of a simulated laser point of a simulated laser relative to a display area of ​​a display device provided in an embodiment of the present application;

[0055] Figure 5 A schematic diagram of determining a target position of a simulated laser point of a simulated laser relative to a display area of ​​a display device in an embodiment of the present application;

[0056] Figure 6 A schematic diagram of a process of displaying a simulated laser point of a simulated laser provided in an embodiment of the present application;

[0057] Figure 7 A schematic diagram of a flow chart of a method for implementing a simulated laser applied to a display device provided in an embodiment of the present application;

[0058] Figure 8 A schematic flow chart of a method for implementing a simulated laser applied to a device operating apparatus provided in an embodiment of the present application;

[0059] Fig. 9 A schematic diagram of the structure of a simulated laser implementation device applied to a display system provided in an embodiment of the present application;

[0060] Fig.10 A schematic diagram of the structure of a display device provided in an embodiment of the present application;

[0061] Fig.11 A schematic diagram of the structure of a device operating apparatus provided in an embodiment of the present application;

[0062] Fig.12 A schematic diagram of the structure of a terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] In order to make the features and advantages of the embodiments of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the embodiments of the present application.

[0064] With the rapid development of the information technology industry, various electronic demonstration devices have been widely used. In the process of demonstrating the content in the display device, it is usually necessary to use auxiliary equipment for demonstration, such as a laser pen. However, in the process of demonstrating with a real laser pen, the laser may directly hit the human eye, thus posing a safety hazard.

[0065] In the related art, in order to avoid direct laser exposure to human eyes during the demonstration, the demonstration is performed based on the virtual pointing control corresponding to the virtual laser pen. However, as the virtual laser pen moves, even if the virtual laser pen does not point to the display device, the virtual laser point on the display device will also move with the movement of the virtual laser pen, because the virtual laser point in the prior art moves with the movement of the virtual laser pen, rather than with the absolute pointing movement of the virtual laser pen pointing to the display device.

[0066] In order to solve the above technical problems, the embodiment of the present application provides a method for realizing a simulated laser, which is applied to a display system. The display system includes a display device and a device operating device used in conjunction with each other. The device operating device includes a positioning base and a simulated laser used in conjunction with each other. The method includes:

[0067] First, the spatial position information of the simulated laser is determined based on the positioning base, wherein the positioning base is used to connect to the display device; then, the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser are determined, the first geomagnetic angle information is obtained by the base relative to the geomagnetic direction, and the second geomagnetic angle information is obtained by the simulated laser relative to the geomagnetic direction. Since the first geomagnetic angle information and the second geomagnetic angle information are both obtained with reference to the geomagnetic direction, the target angle information of the simulated laser relative to the positioning base can be determined by calculating the first geomagnetic angle information and the second geomagnetic angle information.

[0068] Afterwards, the spatial position information and target angle information are corrected based on the relative position of the display device relative to the positioning base. Thus, the real pointing of the simulated laser to the device display area in the display device and the target position where the real pointing intersects with the plane where the device display area is located can be obtained. The target position is the pointing position of the plane where the simulated real pointing of the simulated laser corresponds to the device display area, that is, the same position as the real laser pointing. This effectively solves the technical problem that when the simulated laser point displayed in the display device is manipulated based on virtual pointing, even if the simulated laser pen does not point to the display device, when the simulated laser pen is moved, the simulated laser point on the display device will be displayed and moved, and the actual use experience is not good, which is quite different from the real laser pen.

[0069] See also Figure 1 , Figure 1 An exemplary system architecture diagram of a simulated laser implementation method provided in an embodiment of the present application.

[0070] like Figure 1As shown, the system architecture may include a device operating apparatus 101, a network 102, and a display device 103. The device operating apparatus 101 includes a positioning base 1011 and a simulated laser 1012 used in conjunction with each other. The positioning base 1011 is used to connect with the display device 103. The network 102 is used to provide a medium for a communication link between the positioning base 1011 and the simulated laser 1012. The network 102 may include various types of wireless communication links or wired communication links. The wireless communication links include Bluetooth communication links, wireless fidelity (Wireless-Fidelity, Wi-Fi) communication links, or microwave communication links, and the wired communication links include optical fibers, twisted pairs, or coaxial cables, etc.

[0071] The positioning base 1011 can interact with the simulated laser 1012 through the network 102 to receive messages from the simulated laser 1012 or send messages to the simulated laser 1012. After the positioning base 1011 is connected to the display device 103, it can interact with the display device 103 to send messages related to the positioning base 1011 and the simulated laser 1012 to the display device 103 or receive messages from the display device 103. When the simulated laser 1012 is hardware, it can be various terminals, including but not limited to smart watches, smart phones, tablet computers, laptop portable computers, etc. that can be paired with the positioning base 1011 and have a magnetometer function. When the simulated laser 1012 is software, it can be installed in the terminals listed above, which can be implemented as multiple software or software modules (for example: used to provide distributed services), or can be implemented as a single software or software module, which is not specifically limited here. The display device 103 can include various display terminals such as displays, projection display devices, computer display screens, and flat panel display screens.

[0072] In an embodiment of the present application, the display device 103, the positioning base 1011 or the simulated laser 1012 can determine the spatial position information of the simulated laser based on the positioning base, and the positioning base is used to connect with the display device; determine the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and determine the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information; based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, determine the target position of the simulated laser point of the simulated laser relative to the target position. Of course, the above steps can also be distributedly executed in the display device 103, the positioning base 1011 and the simulated laser 1012 in combination with the actual situation, and are not specifically limited here.

[0073] It should be understood that Figure 1The number of device operating devices, networks and display devices in the figure is only illustrative, and any number of device operating devices, networks and display devices may be used according to implementation requirements.

[0074] See also Figure 2 , Figure 2 The present invention provides a flowchart of a method for implementing a simulated laser. The method is applied to a display system, wherein the display system includes a display device and a device operating device used in conjunction with each other, and the device operating device includes a positioning base and a simulated laser used in conjunction with each other. Figure 1 As shown, the display device is pre-set with an interface connected to the positioning base, the number of interfaces may be one or more, and the types of interfaces include but are not limited to USB (Universal Serial Bus) Type-A interface, USB Type-B interface, USB Type-C interface and other USB interfaces. When the positioning base is connected to the display device, the display device determines the relative position of the display device and the positioning base by detecting the interface connected to the positioning base.

[0075] like Figure 2 As shown, the method includes:

[0076] S202: Determine spatial position information of the simulated laser based on a positioning base, where the positioning base is used to connect with a display device.

[0077] The simulated laser is positioned by means of a positioning base to determine the spatial position information of the simulated laser. It should be noted that when the simulated laser is positioned based on the positioning base, a preset positioning point on the simulated laser can be positioned. The preset positioning point can be the midpoint of the simulated laser along the length direction, or any one of the two end points of the simulated laser along the length direction. Of course, it can also be other positioning points on the simulated laser set based on actual needs.

[0078] See also Figure 3 , Figure 3 A schematic diagram of a process for determining the spatial position information of a simulated laser provided in an embodiment of the present application.

[0079] Optionally, determining the spatial position information of the simulated laser based on the positioning base in S202 includes:

[0080] S302: Determine a first spatial three-dimensional coordinate system with the positioning base as a reference.

[0081] A first spatial three-dimensional coordinate system is established with the positioning base as a reference. At this time, the positioning base can be the coordinate origin of the three-dimensional coordinate system or a preset coordinate point in the three-dimensional coordinate system. It is easy to understand that when the positioning base is the coordinate origin of the three-dimensional coordinate system, the coordinates of the positioning base can be (0, 0, 0); when the positioning base is a preset coordinate point in the three-dimensional coordinate system, the coordinates of the positioning base can be (1, 1, 1), (1, 2, 3) or (1, 2, 2), etc. The preset coordinate points can be pre-set and are not limited here. Of course, in order to more conveniently establish the first spatial three-dimensional coordinate system, the positioning base is usually used as the coordinate origin of the three-dimensional coordinate system.

[0082] S304: In the first spatial three-dimensional coordinate system, three-dimensionally position the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

[0083] The three-dimensional coordinates of the simulated laser are positioned by the positioning base, so as to determine the three-dimensional coordinate information (x, y, z) of the simulated laser in the first space three-dimensional coordinate system.

[0084] Optionally, in S304, in the first spatial three-dimensional coordinate system, three-dimensional positioning of the simulated laser is performed based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system, including:

[0085] In the first spatial three-dimensional coordinate system, the UWB positioning tag in the simulated laser is subjected to UWB three-dimensional positioning processing based on the positioning base in a UWB (Ultra Wide Band) three-dimensional positioning manner to determine the three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

[0086] Among them, UWB technology is a wireless carrier communication technology. It does not use a sinusoidal carrier, but uses nanosecond non-sinusoidal narrow pulses to transmit data, so it occupies a wide spectrum range. UWB technology has the advantages of low system complexity, low power spectrum density of transmitted signals, insensitivity to channel fading, low interception capability, and high positioning accuracy. It is especially suitable for high-speed wireless access in dense multipath places such as indoors.

[0087] Because UWB technology has high positioning accuracy, it is easy to combine positioning and communication by using UWB technology, which is difficult to do with conventional radio. UWB technology has strong penetration ability and can accurately locate indoors and underground, while GPS (Global Positioning System) can only work within the visible range of GPS positioning satellites. Unlike GPS, which provides absolute geographic location, ultra-wideband radio locators can give relative locations with positioning accuracy up to centimeters. In addition, ultra-wideband radio locators are cheaper in price.

[0088] A UWB three-dimensional positioning module may be embedded in the positioning base. The UWB three-dimensional positioning module matches the UWB positioning tag in the simulated laser. The UWB three-dimensional positioning module is used to realize three-dimensional positioning of the UWB positioning tag in the simulated laser.

[0089] S306: Using the three-dimensional coordinate information as the spatial position information of the simulated laser.

[0090] The calculated three-dimensional coordinate information is used as the spatial position information of the simulated laser to prepare for the subsequent calculation of the absolute position pointed by the simulated laser.

[0091] S204: Determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information.

[0092] The positioning base and the simulation laser are respectively embedded with magnetometers that match each other. The magnetometer in the positioning base is used to detect the actual angle between the positioning base and the three directions of "North Sky East" of the geography department after the positioning base is connected to the display device. Here, it can be the actual angle between the installation direction of the positioning base and the three directions of "North Sky East" of the geography department, or it can be the actual angle between other directions set at an angle to the installation direction of the positioning base and the three directions of "North Sky East" of the geography department. It can be understood that since the relative position relationship between the positioning base and the display device is clear, the actual angle between the extension direction of the display device screen and the three directions of "North Sky East" of the geography department can be obtained based on the actual angle between the positioning base and the three directions of "North Sky East" of the geography department after the positioning base is connected to the display device.

[0093] The magnetometer in the simulated laser is used to detect the actual angle between the pointing direction of the simulated laser and the three directions of "North, East and East" of the geographical system. The pointing direction of the simulated laser is generally the length extension direction of the simulated laser from the tail end to the top end.

[0094] In some feasible implementations, the positioning base and the simulation laser are respectively embedded with mutually matching three-axis magnetometers, and the actual angles between the positioning base and the simulation laser and the three directions of "north celestial east" of the geographical system are obtained by measuring the geomagnetic vector components of the three axes, and the first geomagnetic angle information and the second geomagnetic angle information are determined by calculating the actual angles between the positioning base and the simulation laser and the three directions of "north celestial east" of the geographical system.

[0095] Optionally, determining the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser in S204 includes:

[0096] The first geomagnetic angle information of the first pointing direction of the first magnetometer in the positioning base relative to each coordinate axis in the standard geographic coordinate system is obtained, and the second geomagnetic angle information of the second pointing direction of the second magnetometer in the simulation laser relative to each coordinate axis in the standard geographic coordinate system is obtained.

[0097] It should be noted that the first type of pointing direction of the first geomagnetometer can be determined based on the axis for measuring geomagnetism in the first geomagnetometer, and the first type of pointing direction may include at least three first pointing directions. Here, the axis for measuring geomagnetism in the first geomagnetometer may be greater than or equal to 3, and each length direction along the axis for measuring geomagnetism may be used as each first pointing direction; when there are multiple axes for measuring geomagnetism in the first geomagnetometer, the first pointing direction may correspond to multiple first sub-directions. The standard geographic coordinate system may be a spatial rectangular coordinate system established based on the three directions of "North Sky East" of the geographic system. The "Sky" direction may be used as the Z axis, the "East" direction may be used as the X axis, and the "North" direction may be used as the Y axis.

[0098] When the first geomagnetometer is a three-axis geomagnetometer, generally, the three axes in the three-axis geomagnetometer are perpendicular to each other. Therefore, at this time, the first pointing direction can correspond to the length direction of each of the three axes in the three-axis geomagnetometer. The three first pointing directions are each parallel to the extension direction of each of the three axes in the three-axis geomagnetometer. At this time, the first pointing direction of the first geomagnetometer in the positioning base relative to the first geomagnetic angle information of each coordinate axis in the standard geographic coordinate system can be the three first pointing directions respectively compared to the one-to-one corresponding angles of the three directions of the X-axis, Y-axis and Z-axis of the "North Sky East" coordinate system based on the geographic system. Specifically, the angle between the first pointing direction corresponding to each axis and the three directions of the X-axis, Y-axis and Z-axis of the corresponding "North Sky East" coordinate system can be calculated based on the geomagnetic vector components measured by the three axes in the three-axis geomagnetometer. Of course, in order to improve the accuracy of the measurement of the first geomagnetometer, the number of axes measuring geomagnetism in the first geomagnetometer can be greater than 3.

[0099] When the second geomagnetometer is also a three-axis geomagnetometer, the number of axes used to measure geomagnetism in the second geomagnetometer can be greater than or equal to 3. The three axes in the three-axis geomagnetometer can be perpendicular to each other. Therefore, at this time, the second type of pointing direction can correspond to the length extension direction corresponding to each of the three axes in the three-axis geomagnetometer, and the second type of pointing direction can include 3 second pointing directions. The three second pointing directions are each parallel to the extension direction of each of the three axes in the second geomagnetometer. The relationship between the extension direction of each of the three axes in the second geomagnetometer and the pointing direction of the simulated laser can be predetermined. In a feasible implementation, the distance from any point in the pointing direction of the simulated laser to the corresponding straight line of each of the three axes in the three-axis geomagnetometer is equal; of course, the pointing direction of the simulated laser can also be parallel to any axis in the three-axis geomagnetometer; in some other embodiments, the extension direction of each of the three axes in the three-axis geomagnetometer and the pointing direction of the simulated laser can be flexibly set without restriction. Similarly, of course, in order to improve the accuracy of the measurement of the second geomagnetometer, the number of axes measuring geomagnetism in the second geomagnetometer can be greater than 3.

[0100] The second geomagnetic angle information of the second pointing direction of the second magnetometer in the simulated laser relative to each coordinate axis in the standard geographic coordinate system can be the angles of three second sub-directions respectively corresponding to the X-axis, Y-axis and Z-axis based on the "North Celestial East" coordinate system of the geographic system.

[0101] Of course, in other embodiments, the first magnetometer and the second magnetometer may each have two corresponding axes for measuring geomagnetism. In this case, the virtual laser spot emitted by the corresponding simulated laser is used to move along a one-dimensional direction in the device display area of ​​the display device, and the specific direction of the one-dimensional direction can be set based on specific needs.

[0102] Optionally, determining target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information in S204 includes:

[0103] Based on the second geomagnetic angle information and the first geomagnetic angle information, angle difference information is determined, and the angle difference information is used as target angle information of the simulated laser relative to the positioning base.

[0104] The first geomagnetic angle information is the angle information of the first type of pointing direction of the first geomagnetic meter in the positioning base relative to each coordinate axis in the standard geographic coordinate system, and the second geomagnetic angle information is the angle information of the second pointing direction of the second geomagnetic meter in the simulated laser relative to each coordinate axis in the standard geographic coordinate system. Therefore, based on the second geomagnetic angle information and the first geomagnetic angle information, the angle difference information corresponding to the second geomagnetic angle information compared to the first geomagnetic angle information can be calculated, and based on the angle difference information, the target angle information of the simulated laser compared to the positioning base can be determined.

[0105] It should be noted that the first and second magnetometers need to be recalibrated every time they enter a new environment where the geomagnetic distribution changes significantly, just like the electronic compass in a mobile phone, which requires manual "8" calibration from time to time. The positioning base connected to the display device is not convenient for calibration, because the display device may be embedded in the wall and cannot be moved, and the positioning base needs to be powered by a charging device separately before it can be moved and calibrated. Therefore, the magnetic field data in the new environment can be collected by the second magnetometer on the analog laser and sent to the first magnetometer of the positioning base through wireless methods such as Bluetooth and local area network for calibration. In addition, the speakers of some display devices are side-out, and the strong magnetism on the speakers may affect the operation of the magnetometer. When designing such models, magnetic shielding materials need to be attached to the magnets of the speakers to avoid affecting the side-inserted positioning base. A 6-axis IMU (inertia measurement unit) can be added inside the analog laser, including a three-axis accelerometer and a three-axis gyroscope. The 6-axis IMU can obtain the aerial attitude change data and spatial position motion data of the analog laser, which can be integrated with the data of UWB and magnetometer to assist in error elimination.

[0106] When the first geomagnetic meter corresponding to the positioning base is used to measure the geomagnetic vector components of the three axes of the geomagnetic field and the actual angle calculated with the respective coordinate axes of the "North Celestial East" of the geographical system is 0, the length directions corresponding to the three axes of the geomagnetic field measured by the first geomagnetic meter are respectively parallel to the X-axis direction, Y-axis direction and Z-axis direction of the coordinate system corresponding to the "North Celestial East" of the geographical system.

[0107] The first pointing direction in the simulated laser corresponds to the second pointing direction in the positioning base, and the number of the first pointing directions is equal to the number of the second pointing directions. The target angle information of the simulated laser relative to the positioning base can be understood as the angle information between each second pointing direction of the simulated laser and the corresponding first pointing direction. When a coordinate system is established based on three mutually perpendicular second pointing directions in the positioning base, since the relationship between the extension direction of each of the three axes in the second magnetometer and the pointing direction of the simulated laser is predetermined, the pointing direction of the simulated laser in the coordinate system established based on the three mutually perpendicular second pointing directions in the positioning base is obtained based on the angle information between each second pointing direction of the simulated laser and the corresponding first pointing direction.

[0108] S206: Determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information, and the device relative position of the display device relative to the positioning base.

[0109] Since the positioning base is connected to the display device, and the position where the positioning base is connected to the display device is one of a plurality of pre-set interfaces, when the positioning base is connected to the display device, the display device can detect the interface to which the positioning base is connected, and obtain the relative position relationship between the positioning base and the display device based on the interface to which the positioning base is connected, thereby correcting the spatial position information and the target angle information based on the relative position relationship between the positioning base and the display device, and obtaining the actual spatial position information and the actual angle information of the simulated laser compared to the display device, and determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the actual spatial position information and the actual angle information.

[0110] See also Figure 4 , Figure 4 A schematic diagram of a process for determining a target position of a simulated laser point of a simulated laser relative to a display area of ​​a display device provided in an embodiment of the present application.

[0111] Optionally, in S206, based on the spatial position information, the target angle information, and the device relative position of the display device relative to the positioning base, determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device includes:

[0112] S402: Based on the target angle information and the relative position of the display device with respect to the positioning base, determine the pointing information of the simulated laser with respect to the display device.

[0113] Based on the relative position of the display device with respect to the positioning base, the pointing information of the extended plane of the device display area of ​​the display device compared to the positioning base can be determined, that is, the spatial position and extension direction of the extended plane of the device display area in the coordinate system corresponding to each first pointing direction of the positioning base. At the same time, since the pointing direction of the simulated laser is clear compared to the positioning base in the coordinate system corresponding to each first pointing direction of the positioning base, the pointing information of the pointing direction corresponding to the simulated laser with respect to the display device can be obtained in the target coordinate system with the length direction of the device display area as the Y-axis, the width direction of the device display area as the Z-axis, and the direction perpendicular to the device display area as the Z-axis. This pointing information simulates the pointing information of a real laser pen with respect to the display device.

[0114] S404: Determine simulated laser position information of the simulated laser for the display device based on the spatial position information and the relative position of the display device with respect to the positioning base.

[0115] Based on the relative position of the display device with respect to the positioning base, the position coordinate area of ​​the extended plane of the device display area of ​​the display device compared to the positioning base can be determined, and the spatial position information of the simulated laser compared to the positioning base is clear. Therefore, based on the positioning base, the simulated laser position information of the simulated laser relative to the display device can be obtained in the target coordinate system corresponding to the length direction of the device display area as the Y-axis, the width direction of the device display area as the Z-axis, and the direction perpendicular to the device display area as the Z-axis. The simulated laser position information simulates the actual position of the real laser pen relative to the display device.

[0116] S406: Based on the pointing information and the simulated laser position information, determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device.

[0117] In the target coordinate system, the coordinates of the device display area corresponding to the plane of the device display area are determined, and the plane corresponding to the device display area is also determined. At this time, based on the simulated laser position information and pointing information, that is, a determined coordinate point in the target coordinate system and a direction determined in the target coordinate system, the coordinates of the intersection point corresponding to the plane corresponding to the device display area and the ray formed by the coordinate point and direction can be obtained, that is, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device. Of course, the plane corresponding to the device display area may not intersect with the ray formed by the coordinate point and direction.

[0118] See also Figure 5 , Figure 5 A schematic diagram of determining a target position of a simulated laser point of a simulated laser relative to a display area of ​​a display device in an embodiment of the present application.

[0119] like Figure 5 As shown, in the target coordinate system, based on the pointing information, the first angle θ1 between the projection of the pointing direction of the simulated laser on the XY plane and the X axis, and the second angle θ2 (not shown in the figure) between the projection of the pointing direction of the simulated laser on the XZ plane and the X axis can be obtained, and the simulated laser position information can be (X1, Y1, Z1), Y1-X1·tanθ1 is the Y-axis coordinate of the intersection point corresponding to the plane corresponding to the device display area and the ray formed by the coordinate point and direction, and Z1-X1·tanθ2 is the Z-axis coordinate of the intersection point corresponding to the plane corresponding to the device display area and the ray formed by the coordinate point and direction. Therefore, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is (0, Y1-X1·tanθ1, Z1-X1·tanθ2).

[0120] See also Figure 6 , Figure 6A schematic diagram of a process of displaying a simulated laser point of a simulated laser is provided in an embodiment of the present application.

[0121] like Figure 6 As shown, the simulation laser implementation method provided in the present application may also include:

[0122] S602: Detect whether the target position of the simulated laser point is located in the device display area of ​​the display device.

[0123] The device display area of ​​the display device can be the area corresponding to {X=0, Y3≥Y≥Y2, Z3≥Z≥Z2}. Therefore, it can be directly determined whether (0, Y1-X1·tanθ1, Z1-X1·tanθ2) is in the display area. When Y3≥Y1-X1·tanθ1≥Y2 and Z3≥Z1-X1·tanθ2≥Z2, the target position of the simulated laser point is located in the device display area of ​​the display device. Otherwise, the target position of the simulated laser point is not located in the device display area of ​​the display device.

[0124] S604A: If the target position of the simulated laser spot is located in the device display area, the simulated laser spot is displayed at the target position in the device display area.

[0125] When it is determined that the target position of the simulated laser point is located in the device display area, the simulated laser point can be displayed at the coordinates corresponding to the target position in the device display area. The shape of the simulated laser point can be set in advance or manually designed. The shape of the simulated laser point can be regular or irregular. The shape of the simulated laser point includes but is not limited to a circle, a ring, a regular polygon, and an irregular polygon.

[0126] Optionally, after S604A, the method further includes: in response to the interactive operation of the simulated laser, performing a target function operation corresponding to the interactive operation based on the simulated laser point.

[0127] The interactive operation of the simulated laser may include a confirmation operation, and a drawing operation corresponding to the interactive symbols or interactive graphics drawn based on the simulated laser point. Among them, the target functional operation corresponding to the confirmation operation can be judged based on the functional area corresponding to the position of the simulated laser point in the device display area, such as opening the next page, opening the previous page, pausing, starting playback, etc. In addition, the target functional operation corresponding to the drawing operation can be judged based on the interactive symbols or interactive graphics drawn by the simulated laser point. For example, when the symbol drawn corresponding to the drawing operation is "V", the device display area can be screenshotted, and when the graphic drawn corresponding to the drawing operation is "△", the device display area can be enlarged or reduced. Of course, the mapping relationship between the drawing operation corresponding to the interactive symbols or interactive graphics drawn based on the simulated laser point and the target functional operation can be manually defined based on actual needs.

[0128] S604B: If the position of the simulated laser spot is located in the reference display area outside the device display area, cancel the display of the simulated laser spot.

[0129] When it is determined that the position of the simulated laser point is located in a reference display area outside the device display area, the reference display area, ie, the target position of the simulated laser point is located outside the device display area, the simulated laser point is not displayed.

[0130] See also Figure 7 , Figure 7 A schematic flow chart of a method for implementing a simulated laser system applied to a display device provided in an embodiment of the present application.

[0131] like Figure 7 As shown, the embodiment of the present application also provides a method for realizing a simulated laser applied to a display device, the display device is used in conjunction with a device operating device in the display system in the above embodiment, the device operating device includes a positioning base and a simulated laser used in conjunction, the method includes:

[0132] S702: The display device obtains spatial position information of the simulated laser determined based on the positioning base from the device operating device, and obtains first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser from the device operating device; wherein the positioning base is used to connect to the display device.

[0133] The specific content of step S702 may refer to step S202 and step S204, which will not be described in detail here.

[0134] S704: The display device determines target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information.

[0135] The specific content of step S704 may refer to step S204 and will not be described in detail here.

[0136] S706: The display device determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information, and the relative position of the display device relative to the positioning base.

[0137] The specific content of step S706 can refer to step S206, which will not be described in detail here.

[0138] See also Figure 8 , Figure 8 A schematic flow chart of a method for implementing a simulated laser applied to an equipment operating device provided in an embodiment of the present application.

[0139] like Figure 8As shown, the device operating device is used in conjunction with the display device in the display system, and the device operating device includes a positioning base and a simulation laser used in conjunction with each other. The method includes:

[0140] S802: The device operating device determines the spatial position information of the simulated laser based on the positioning base, and sends the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect with the display device.

[0141] Among them, the simulated laser in the equipment operating device can send the spatial position information of the simulated laser to the positioning base, and the positioning base sends the spatial position information of the simulated laser to the display device. The device for signal interaction between the positioning base and the simulated laser can be a 2.4G wireless module. Other specific contents not mentioned in step S802 can be referred to step S202, and will not be elaborated here.

[0142] S804: The equipment operating device obtains the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and sends the first geomagnetic angle information and the second geomagnetic angle information to the display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

[0143] The specific content of step S804 may refer to step S204 and step S206, which will not be described in detail here.

[0144] See also Fig. 9 , Fig. 9 A schematic diagram of the structure of a simulated laser implementation device applied to a display system provided in an embodiment of the present application.

[0145] like Fig. 9 As shown, the simulated laser realization device 900 is applied to a display system, the display system includes a display device and a device operating device used in conjunction with each other, the device operating device includes a positioning base and a simulated laser used in conjunction with each other, and the device includes:

[0146] A spatial position information determination module 910, adapted to determine the spatial position information of the simulated laser based on a positioning base, the positioning base being used to connect to a display device;

[0147] The target angle information determination module 920 is adapted to determine the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and determine the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0148] The position determination module 930 is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

[0149] Optionally, the spatial position information determination module 910 is adapted to determine a first spatial three-dimensional coordinate system with the positioning base as a reference;

[0150] In the first spatial three-dimensional coordinate system, three-dimensionally positioning the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system;

[0151] The three-dimensional coordinate information is used as the spatial position information of the simulated laser.

[0152] Optionally, the spatial position information determination module 910 is suitable for performing UWB three-dimensional positioning processing on the UWB positioning tag in the simulated laser in a UWB three-dimensional positioning manner based on the positioning base in the first spatial three-dimensional coordinate system, and determining the three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

[0153] Optionally, the target angle information determination module 920 is suitable for obtaining first geomagnetic angle information of a first type of pointing direction of a first magnetometer in a positioning base relative to each coordinate axis in a standard geographic coordinate system, and obtaining second geomagnetic angle information of a second type of pointing direction of a second magnetometer in a simulated laser relative to each coordinate axis in a standard geographic coordinate system.

[0154] Optionally, the target angle information determination module 920 is adapted to determine angle difference information based on the second geomagnetic angle information and the first geomagnetic angle information, and use the angle difference information as target angle information of the simulated laser relative to the positioning base.

[0155] Optionally, the position determination module 930 is adapted to determine the pointing information of the simulated laser with respect to the display device based on the target angle information and the device relative position of the display device with respect to the positioning base;

[0156] Determine simulated laser position information of the simulated laser for the display device based on the spatial position information and the relative position of the display device relative to the positioning base;

[0157] Based on the pointing information and the simulated laser position information, a target position of a simulated laser point of the simulated laser relative to a device display area in the display device is determined.

[0158] Optionally, the simulated laser implementation device 900 further includes a detection module, which is adapted to detect whether the target position of the simulated laser point is located in a device display area of ​​the display device;

[0159] If the target position of the simulated laser spot is located in the device display area, the simulated laser spot is displayed at the target position in the device display area;

[0160] If the position of the simulated laser spot is located in the reference display area outside the device display area, the simulated laser spot is canceled.

[0161] Optionally, the simulated laser implementation device 900 further includes an interaction module, which is adapted to respond to the interaction operation of the simulated laser and perform a target function operation corresponding to the interaction operation based on the simulated laser point.

[0162] See also Fig.10 , Fig.10 A schematic diagram of the structure of a display device provided in an embodiment of the present application.

[0163] like Fig.10 As shown, the display device 1000 is used in conjunction with a device operating device in a display system, the device operating device includes a positioning base and a simulation laser used in conjunction, and the display device includes:

[0164] The acquisition module 1010 is adapted to acquire spatial position information of the simulated laser determined based on the positioning base from the device operating device, and to acquire first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser from the device operating device; wherein the positioning base is used to connect to the display device;

[0165] A determination module 1020, adapted to determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0166] The target position determination module 1030 is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

[0167] See also Fig.11 , Fig.11 A schematic diagram of the structure of a device operating apparatus provided in an embodiment of the present application.

[0168] like Fig.11 As shown, the device operating device is used in conjunction with the display device in the display system, and the device operating device includes a positioning base and a simulation laser used in conjunction with each other, and the device includes:

[0169] A first sending module 1110 is adapted to determine the spatial position information of the simulated laser based on the positioning base, and send the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect to the display device;

[0170] The second sending module 1120 is suitable for obtaining the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and sending the first geomagnetic angle information and the second geomagnetic angle information to the display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and is suitable for determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

[0171] An embodiment of the present application also provides a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by a processor, any of the above methods can be implemented.

[0172] See also Fig.12 , Fig.12 A schematic diagram of the structure of a terminal provided in an embodiment of the present application. Fig.12 As shown, the terminal 1200 may include: at least one processor 1201 , at least one network interface 1204 , a user interface 1203 , a memory 1205 , and at least one communication bus 1202 .

[0173] The communication bus 1202 is used to realize the connection and communication between these components.

[0174] The user interface 1203 may include a display screen (Display) and a camera (Camera), and the optional user interface 1203 may also include a standard wired interface and a wireless interface.

[0175] The network interface 1204 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0176] Among them, the processor 1201 may include one or more processing cores. The processor 1201 uses various interfaces and lines to connect various parts within the entire terminal 1200, and executes various functions and processes data of the terminal 1200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1205, and calling data stored in the memory 1205. Optionally, the processor 1201 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1201 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1201, and it can be implemented separately through a chip.

[0177] Among them, the memory 1205 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory, ROM). Optionally, the memory 1205 includes a non-transitory computer-readable storage medium. The memory 1205 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1205 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1205 may also be optionally at least one storage device located away from the aforementioned processor 1201. As Fig.12 As shown, the memory 1205 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a simulated laser implementation program applied to a display system and / or a display device and / or a device operating device.

[0178] exist Fig.12In the terminal 1200 shown, the user interface 1203 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 1201 can be used to call the simulated laser implementation program applied to the display system stored in the memory 1205. When applied to the display system, the display system includes a display device and a device operating device used in conjunction with each other, and the device operating device includes a positioning base and a simulated laser used in conjunction with each other, and specifically performs the following operations:

[0179] Determining spatial position information of the simulated laser based on a positioning base, wherein the positioning base is used to connect with a display device;

[0180] Determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0181] Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is determined.

[0182] In some embodiments, when the processor 1201 determines the spatial position information of the simulated laser based on the positioning base, the processor 1201 specifically performs the following steps:

[0183] Determine a first spatial three-dimensional coordinate system with the positioning base as a reference;

[0184] In the first spatial three-dimensional coordinate system, three-dimensionally positioning the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system;

[0185] The three-dimensional coordinate information is used as the spatial position information of the simulated laser.

[0186] In some embodiments, when the processor 1201 performs three-dimensional positioning of the simulated laser based on the positioning base in the first spatial three-dimensional coordinate system and obtains three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system, the processor 1201 specifically performs the following steps:

[0187] In the first spatial three-dimensional coordinate system, the UWB three-dimensional positioning processing is performed on the UWB positioning tag in the simulated laser in a UWB three-dimensional positioning manner based on the positioning base to determine the three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

[0188] In some embodiments, when the processor 1201 determines the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, the processor 1201 specifically performs the following steps:

[0189] The first geomagnetic angle information of the first pointing direction of the first magnetometer in the positioning base relative to each coordinate axis in the standard geographic coordinate system is obtained, and the second geomagnetic angle information of the second pointing direction of the second magnetometer in the simulation laser relative to each coordinate axis in the standard geographic coordinate system is obtained.

[0190] In some embodiments, when the processor 1201 determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, the processor 1201 specifically performs the following steps:

[0191] Based on the second geomagnetic angle information and the first geomagnetic angle information, angle difference information is determined, and the angle difference information is used as target angle information of the simulated laser relative to the positioning base.

[0192] In some embodiments, when the processor 1201 determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information, and the device relative position of the display device relative to the positioning base, the processor 1201 specifically performs the following steps:

[0193] Based on the target angle information and the relative position of the display device with respect to the positioning base, determining the pointing information of the simulated laser with respect to the display device;

[0194] Determine simulated laser position information of the simulated laser for the display device based on the spatial position information and the relative position of the display device relative to the positioning base;

[0195] Based on the pointing information and the simulated laser position information, a target position of a simulated laser point of the simulated laser relative to a device display area in the display device is determined.

[0196] In some embodiments, the processor 1201 is further adapted to perform the step of detecting whether the target position of the simulated laser point is located in a device display area of ​​the display device;

[0197] If the target position of the simulated laser spot is located in the device display area, the simulated laser spot is displayed at the target position in the device display area;

[0198] If the position of the simulated laser spot is located in the reference display area outside the device display area, the simulated laser spot is canceled.

[0199] In some embodiments, the processor 1201 is further adapted to execute an interactive operation in response to the simulated laser, and execute a target functional operation corresponding to the interactive operation based on the simulated laser point.

[0200] The processor 1201 can also be used to call the simulated laser implementation program applied to the display device stored in the memory 1205. When applied to the display device, the display device is used in conjunction with a device operating device in the display system. The device operating device includes a positioning base and a simulated laser used in conjunction, and specifically performs the following operations:

[0201] Acquire spatial position information of the simulated laser determined based on the positioning base from the device operating device, and acquire first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser from the device operating device; wherein the positioning base is used to connect to the display device;

[0202] Determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information;

[0203] Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is determined.

[0204] The processor 1201 can also be used to call the simulated laser implementation program stored in the memory 1205 and applied to the device operating device. When applied to the device operating device, the device operating device is used in conjunction with the display device in the display system. The device operating device includes a positioning base and a simulated laser used in conjunction, and specifically performs the following operations:

[0205] Determine the spatial position information of the simulated laser based on the positioning base, and send the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect with the display device;

[0206] Acquire first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and send the first geomagnetic angle information and the second geomagnetic angle information to the display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

[0207] In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0208] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0209] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0210] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0211] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of the present application.

[0212] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0213] The above is a description of a simulated laser implementation method, device, terminal and computer-readable storage medium provided in an embodiment of the present application. For technicians in this field, according to the ideas of the embodiments of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the embodiments of the present application.

Claims

1. A method for implementing simulated laser, applied to a display system, wherein the display system comprises a display device and a device operating device used in conjunction with each other, wherein the device operating device comprises a positioning base and a simulated laser used in conjunction with each other, characterized in that: The method comprises: Determining spatial position information of the simulated laser based on the positioning base, wherein the positioning base is used to connect with the display device; Determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information; Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the position of the simulated laser point of the simulated laser relative to the target is determined.

2. The method according to claim 1, characterized in that The determining of the spatial position information of the simulated laser based on the positioning base comprises: Determine a first spatial three-dimensional coordinate system with the positioning base as a reference; In the first spatial three-dimensional coordinate system, three-dimensionally positioning the simulated laser based on the positioning base to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system; The three-dimensional coordinate information is used as the spatial position information of the simulated laser.

3. The method according to claim 2, characterized in that The method of performing three-dimensional positioning of the simulated laser based on the positioning base in the first spatial three-dimensional coordinate system to obtain three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system includes: In the first spatial three-dimensional coordinate system, the UWB positioning tag in the simulated laser is subjected to UWB three-dimensional positioning processing based on the positioning base in a UWB three-dimensional positioning manner to determine the three-dimensional coordinate information of the simulated laser in the first spatial three-dimensional coordinate system.

4. The method according to claim 1, characterized in that The determining of the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser includes: The first geomagnetic angle information of the first pointing direction of the first magnetometer in the positioning base relative to each coordinate axis in the standard geographic coordinate system is obtained, and the second geomagnetic angle information of the second pointing direction of the second magnetometer in the simulation laser relative to each coordinate axis in the standard geographic coordinate system is obtained.

5. The method according to claim 4, characterized in that The step of determining the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information includes: Based on the second geomagnetic angle information and the first geomagnetic angle information, angle difference information is determined, and the angle difference information is used as target angle information of the simulated laser relative to the positioning base.

6. The method according to claim 5, characterized in that The step of determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information, and the device relative position of the display device relative to the positioning base comprises: Determining the pointing information of the simulated laser with respect to the display device based on the target angle information and the relative position of the display device with respect to the positioning base; Determining simulated laser position information of the simulated laser for the display device based on the spatial position information and the device relative position of the display device relative to the positioning base; Based on the pointing information and the simulated laser position information, a target position of a simulated laser point of the simulated laser relative to a device display area in the display device is determined.

7. The method according to claim 1, characterized in that The method further comprises: Detecting whether the target position of the simulated laser point is located in a device display area of ​​the display device; If the target position of the simulated laser spot is located in the device display area, displaying the simulated laser spot at the target position in the device display area; If the position of the simulated laser spot is located in a reference display area outside the device display area, the simulated laser spot is canceled from being displayed.

8. The method according to claim 7, characterized in that After the simulated laser point is displayed at the target position of the device display area, the method further includes: In response to the interactive operation of the simulated laser, a target functional operation corresponding to the interactive operation is performed based on the simulated laser spot.

9. A method for implementing simulated laser, applied to a display device, the display device is used in conjunction with a device operating device in a display system, the device operating device comprises a positioning base and a simulated laser used in conjunction, characterized in that: The method comprises: Obtaining spatial position information of the simulated laser determined based on the positioning base from the device operating device, and obtaining first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser from the device operating device; wherein the positioning base is used to connect to the display device; Determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information; Based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base, the target position of the simulated laser point of the simulated laser relative to the device display area in the display device is determined.

10. A method for implementing simulated laser, applied to a device operating device, the device operating device is used in conjunction with a display device in a display system, the device operating device comprises a positioning base and a simulated laser used in conjunction, characterized in that: The method comprises: Determining the spatial position information of the simulated laser based on the positioning base, and sending the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect with the display device; Acquire first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and send the first geomagnetic angle information and the second geomagnetic angle information to a display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and determines the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

11. A simulated laser realization device, applied to a display system, the display system comprises a display device and a device operating device used in conjunction with each other, the device operating device comprises a positioning base and a simulated laser used in conjunction with each other, characterized in that: The device comprises: A spatial position information determination module, adapted to determine the spatial position information of the simulated laser based on the positioning base, wherein the positioning base is used to be connected to the display device; a target angle information determination module, adapted to determine first geomagnetic angle information corresponding to the positioning base and second geomagnetic angle information corresponding to the simulated laser, and determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information; The position determination module is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

12. A display device, the display device is used in conjunction with a device operating device in a display system, the device operating device comprises a positioning base and a simulation laser used in conjunction, characterized in that: The display device comprises: an acquisition module, adapted to acquire from the device operating device the spatial position information of the simulated laser determined based on the positioning base, and to acquire from the device operating device the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser; wherein the positioning base is used to be connected to the display device; A determination module, adapted to determine target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information; The target position determination module is adapted to determine the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the device relative position of the display device relative to the positioning base.

13. A device operating device, the device operating device is used in conjunction with a display device in a display system, the device operating device comprises a positioning base and a simulation laser used in conjunction, characterized in that: The device comprises: A first sending module, adapted to determine the spatial position information of the simulated laser based on the positioning base, and send the spatial position information of the simulated laser to the display device; wherein the positioning base is used to connect to the display device; The second sending module is suitable for obtaining the first geomagnetic angle information corresponding to the positioning base and the second geomagnetic angle information corresponding to the simulated laser, and sending the first geomagnetic angle information and the second geomagnetic angle information to the display device, so that the display device determines the target angle information of the simulated laser relative to the positioning base based on the first geomagnetic angle information and the second geomagnetic angle information, and is suitable for determining the target position of the simulated laser point of the simulated laser relative to the device display area in the display device based on the spatial position information, the target angle information and the relative position of the display device relative to the positioning base.

14. A computer-readable storage medium, wherein: The computer-readable storage medium stores one or more programs, and when the one or more programs are executed by a processor, the method of any one of claims 1 to 8, 9 or 10 is implemented.

15. A terminal, comprising: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 8, 9 or 10.

Images