A method for realizing point positioning in an extended reality technology scene

Abstract

The present invention discloses a method for realizing point positioning in an extended reality technology scene, comprising the following steps: selecting a point in a two-dimensional plane or curved surface of a coordinate system; adding a dimension to form a third dimension based on the coordinate positioning of the point to determine the three-dimensional coordinates of a spatial point. It is not necessary for the user to move in space or perform body movements. For tasks with large workloads or long working hours, the learning and adaptation costs are reduced in a working environment where the original familiar equipment is used and only the functions are added. The user does not need to take off the head display device or glasses, nor does he need to walk around in the scene to complete long-term and high-intensity work. The learning cost is relatively reduced, the learning compatibility is better, and the user acceptance is higher.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method for realizing point positioning in an extended reality technology scene. Background Art

[0002] Extended reality technology (VR, AR and MR) scene experience equipment is a new human-computer interaction method created by combining simulation technology, computer graphics, human-computer interface technology, multimedia technology, sensor technology, network technology and other technologies with the help of computers and the latest sensor technology. Most of the external input devices currently on the market mainly include rings, bracelets, styluses, handles and other forms for real-time scene experience.

[0003] With the development and utilization of extended reality technology (VR, AR and MR), users will perform long-term and high-intensity work in virtual or augmented reality or a combination of the two. This positioning technology can spatially locate and operate relevant elements in the scene as needed. At present, scene experience means such as carrying handles and wearing head-mounted display devices and glasses, such as handles, cannot accurately locate, and are not suitable for users to perform work with certain intensity and precision for a long time. Moreover, this inaccurate positioning depends on new equipment. As an emerging field, extended reality technology (VR, AR and MR) has been less explored and the learning cost for users is high.

[0004] Multi-target position capture and positioning system and method based on multiple cameras (CN106843460B) As a provider of virtual vision, glasses can only be a part of the entire framework of virtual reality. How to project the experiencer into a virtual environment and control the movement of the virtual character through the experiencer's own movement will be the next urgent problem to be solved in virtual reality. The most direct way to solve this problem is to use indoor positioning and position capture technology; the existing indoor wireless positioning system mainly uses short-range wireless technologies such as mobile base stations, infrared, ultrasonic, Bluetooth, Wi-Fi, RFID, etc. These devices are not only expensive, but also complex to install and configure, and the accuracy cannot meet the requirements of virtual reality experience. At present, the use of computer vision technology to capture the position movement of glasses through cameras is widely used by major manufacturers, but due to the limitations of a single camera, it can only capture simple head movements of a single target in a small range, and cannot be expanded to the entire room or a larger area.

[0005] Existing solution: A multi-camera multi-target position capture and positioning system includes a server, at least two cameras, multiple VR glasses, a client and a light ball; specifically: the number of clients, light balls and VR glasses are the same; the LED light ball provides the camera with the experiencer's position; the server receives the image data sent by the camera and processes it to obtain the experiencer's position data; the client reads the data sent by the VR glasses and sends it to the server; receives and processes the experiencer's position data sent by the server, converts all the experiencer's position data into the coordinates of the virtual environment, generates a virtual environment or model in real time, and renders the virtual picture to the VR glasses in real time. This solution can enable the experiencer to move freely without any previous restrictions, provide a virtual reality experience that is close to the real environment, and support multiple people to interact in the same virtual environment. Since this solution involves multiple cameras and image acquisition, first of all, light is an unstable factor that affects the positioning information, and secondly, the camera capture also has a large error, resulting in inaccurate position data. This solution cannot achieve spatial positioning of any point with a certain accuracy.

[0006] Data processing method and device for virtual scenes (CN112530024A) In a virtual scene with multi-user interaction, different mobile terminals may have different types or models (such as mobile phones and VR glasses, or Apple phones and Huawei phones), and their spatial positioning engine algorithms are also different. Coordinate system synchronization (content synchronization) between different mobile terminals is a core technology. Through coordinate system synchronization, virtual content in multi-user VR, AR or MR applications can be shared and interacted in the same coordinate system space. An existing solution is to achieve coordinate system synchronization based on a regular geometric shape plane (such as a square desktop). Specifically as follows: The mobile terminal uses the coordinates of the center point of the horizontal desktop at the current location to calculate as the origin of the terminal reference coordinate system. Then the coordinate axes of the reference coordinate system are calculated using the desktop edge information. Then, the terminal reference coordinate system is established. The calculation process of mobile terminals of different users is the same, so as to establish the same reference coordinate system. The posture output by the mobile terminal spatial positioning engine can be used to calculate the posture of the terminal relative to the reference coordinate system, and then the relative posture between the terminals is calculated, thereby achieving coordinate system synchronization. This solution can realize multi-user VR, AR or MR application interaction on the same desktop with different mobile terminals. Since this solution relies on regular geometric planes, the application scenarios are limited. In any planar or non-planar scenario, this solution will not be able to achieve coordinate system synchronization. Summary of the invention

[0007] In order to solve the above technical problems, the present invention provides a method for realizing point positioning in an extended reality technology (VR, AR and MR) scene, so as to ensure that users can realize three-dimensional precise positioning of spatial points in extended reality technology (VR, AR and MR) scenes. The present invention adopts a positioning method of first determining the two-dimensional coordinates of a point (first finding a two-dimensional plane) and then adding a dimension to determine the three-dimensional coordinates of a spatial point. The positioning or movement of any point in space does not depend on the spatial movement of the device itself, and the plane movement of the device can realize the three-dimensional positioning and movement of the point. The present invention does not require the user to move in space or perform physical movements with his limbs. For operations with large workloads or long working hours, in an operating environment where only functions are added by using the original familiar equipment, the learning and adaptation costs are reduced. Users do not need to take off the head display device or glasses, nor do they need to walk around in the scene to complete long-term and high-intensity work. The learning cost is relatively reduced, the learning compatibility is better, and the user acceptance is higher.

[0008] The present invention is achieved by at least one of the following technical solutions.

[0009] A method for locating a point in an extended reality technology scene includes the following steps: first, a point is selected in a two-dimensional plane or curved surface of a coordinate system, and a dimension is added to form a third dimension based on the positioning of the two-dimensional coordinates of the point, thereby determining the three-dimensional coordinates of a spatial point.

[0010] Furthermore, the coordinate system is a rectangular coordinate system. In the rectangular coordinate plane xOy, the planar movement of the external input device on the work desktop is mapped to the two-dimensional coordinates (x, y) of the extended reality scene space point in the coordinate plane xOy. The external input device is enabled to control the third dimension, so that the extended reality scene space point generates a numerical value in the z direction, and the point has three-dimensional coordinates (x, y, z) in the scene space, thereby realizing the spatial positioning of the point.

[0011] Furthermore, in a spatial rectangular coordinate system with the origin being point O, it is assumed that there is a surface in the global coordinate system as a public surface α, and there is a point A' on the surface α, and the external input device controls point A' to generate two-dimensional coordinates on the surface α. The external input device (such as the function area added to the mouse or the function key of the handle) controls point A' to move to point A on OA', that is, to generate a value in the third dimension, thereby realizing the positioning of the point from the two-dimensional plane to the three-dimensional space.

[0012] Furthermore, for the movement of the point: the target point A is controlled by an external input device, so that the mapping point of the target point A on plane α is converted from point A' to point B', and the external input device controls point B' to move to point B on OB', thereby realizing the movement of the point from A to B.

[0013] Furthermore, the coordinate system is a spherical coordinate system. In the spherical coordinate system with the origin O, the point P is determined θ value, point Q is the projection of the positioning point P on the xOy plane, is the angle that the x-axis rotates counterclockwise to the directed line segment OQ, θ is the angle between the directed line segment OP and the positive direction of the z-axis, thereby positioning in the two-dimensional plane; the external input device inputs in the added third dimension to generate a value r in the direction of the directed line segment OP, r is the distance between the origin O and point P, thereby realizing the two-dimensional to three-dimensional positioning of the point.

[0014] Furthermore, the mapping point of point Q in the scene is point P, which is dynamically represented as the projection point Q of point P on the xOy plane moving on the plane QOz, and the length of the line segment OP is set to h, that is, a numerical value is generated in the direction of the third dimension OP, thereby realizing the two-dimensional to three-dimensional positioning of the point.

[0015] Furthermore, for the movement of a point: the projection point Q1 of point P1 on the xOy plane determines the plane Q1Oz, and the length of line segment OP1 is set to l, the projection point Q1 is moved to point Q2 on the xOy plane, the plane Q2Oz is determined, and the length of line segment OP2 is set to k, thereby realizing the movement of the point from P1 to P2.

[0016] Furthermore, the coordinate system is a cylindrical coordinate system. In the cylindrical coordinate system, θ=θ0 represents a half plane passing through the z-axis, r=r0 represents a cylindrical surface with z as the axis, and a cylinder is determined by inputting r=r0 through an external input device. The two-dimensional coordinates (θ, z) of a point are determined on the two-dimensional surface. Different positions of the cylinder are determined by assigning a value of r, and the three work together to determine the three-dimensional coordinates (r, θ, z) of the spatial point.

[0017] Furthermore, the spatial point is mapped onto a cylinder with the z-axis as the central axis, thereby determining a two-dimensional coordinate within the two-dimensional surface. Changing the position of the cylinder, that is, generating different values ​​in the third dimension, realizes the two-dimensional to three-dimensional positioning of the point.

[0018] Furthermore, for the spatial movement of a point: there are two spatial points A and B, which are mapped on the corresponding two cylinders r=r1 and r=r2. At this time, the projection of spatial point A on the two-dimensional surface r=r2 is A', and the movement of point A' to point B on the surface r=r2 is mapped to the movement of point A to point B in space.

[0019] Compared with the prior art, the present invention has the following beneficial effects:

[0020] It does not require the user to move in space or perform physical movements. For jobs with large workloads or long working hours, it reduces the learning and adaptation costs by using existing familiar equipment and only adding functions. This is obviously a more reasonable choice.

[0021] Users do not need to take off their head-mounted display or glasses, nor do they need to move around in the scene to complete long-term, high-intensity work. The learning cost is relatively low, the learning compatibility is better, and the user acceptance is higher. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are some implementation methods of the present invention.

[0023] Figure 1 This is a flow chart of a method for realizing point positioning in an extended reality technology scenario in this embodiment;

[0024] Figure 2 This is a schematic diagram of implementing point positioning in a rectangular coordinate system in an extended reality technology scenario according to this embodiment;

[0025] Figure 3 This is a schematic diagram of the movement and positioning of a point in a rectangular coordinate system in an extended reality technology scenario according to this embodiment;

[0026] Figure 4 A schematic diagram of implementing point positioning in a spherical coordinate system in an extended reality technology scenario according to this embodiment;

[0027] Figure 5 This is a schematic diagram of implementing point positioning in a cylindrical coordinate system in an extended reality technology scenario according to this embodiment. DETAILED DESCRIPTION

[0028] This section will describe in detail the specific embodiments of the present invention. The preferred embodiments of the present invention are shown in the accompanying drawings. The purpose of the accompanying drawings is to supplement the description of the text part of the specification with graphics, so that people can intuitively and vividly understand each technical feature and the overall technical solution of the present invention, but it cannot be understood as a limitation on the scope of protection of the present invention.

[0029] In the description of the present invention, it should be understood that descriptions involving orientations, such as up, down, front, back, left, right, etc., and orientations or positional relationships indicated are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0030] In the description of the present invention, "several" means one or more, "more" means more than two, "greater than", "less than", "exceed" etc. are understood as not including the number itself, and "above", "below", "within" etc. are understood as including the number itself. If there is a description of "first" or "second", it is only used for the purpose of distinguishing the technical features, and cannot be understood as indicating or implying the relative importance or implicitly indicating the number of the indicated technical features or implicitly indicating the order of the indicated technical features.

[0031] Example 1

[0032] like Figure 1 A method for realizing point positioning in an extended reality technology scenario is shown, comprising the following steps: first selecting a point in a two-dimensional plane or surface of a coordinate system, and adding a dimension to form a third dimension based on the positioning of the two-dimensional coordinates of the point, thereby determining the three-dimensional coordinates of a spatial point.

[0033] like Figure 2 As shown, in rectangular coordinates, there is a coordinate plane xOy. The plane movement of an external input device (such as a mouse) on the work desktop is mapped to the two-dimensional coordinates (x, y) of the extended display scene space point in the coordinate plane xOy. The function keys or function areas of the third dimension controlled by the external input device are enabled, so that the extended display scene space point generates a numerical value in the z direction, that is, the three-dimensional coordinates (x, y, z) of the point in the scene space, thereby realizing the spatial positioning of the point.

[0034] like Figure 3 As shown, in the spatial rectangular coordinate system with the origin being point O, it is assumed that there is a common plane α in the global coordinate system, and there is a point A' on plane α. The external input device (such as the movement of the mouse on the work desktop) controls point A' to generate two-dimensional coordinates on plane α. The external input device (such as the function area added to the mouse or the function key of the handle) controls point A' to move to point A on OA', that is, to generate a value in the third dimension, thereby realizing the positioning of the point from the two-dimensional plane to the three-dimensional space. For the movement of the point, the external input device controls point A, so that the mapping point of the control point A on plane α is converted from A' to B', and the external input device (such as the function area added to the mouse or the function key of the handle) controls point B' to move to point B on OB', thereby realizing the movement of the point from A to B.

[0035] Example 2

[0036] like Figure 4 As shown, in the spherical coordinate system with the origin O, determine the point P θ value (point Q is the projection of the positioning point P on the xOy plane, The external input device inputs in the added third dimension, so that the value r (r is the distance between the origin O and point P) is generated in the direction of the directed line segment OP, thereby realizing the positioning of the point from two dimensions to three dimensions. The mapping point of point Q in the scene is point P, which is dynamically represented as the projection point Q of point P on the xOy plane moving on the surface QOz, and the length of the line segment OP is set to h, that is, a value is generated in the direction of the third dimension OP, thereby realizing the positioning of the point from two dimensions to three dimensions.

[0037] For the movement of points on the spherical coordinate system: the projection point Q1 of point P1 on the xOy plane determines the surface Q1Oz, and the length of line segment OP1 is set to l, the projection point Q1 is moved to point Q2 on the xOy plane, the surface Q2Oz is determined, and the length of line segment OP2 is set to k, thereby realizing the movement of the point from P1 to P2.

[0038] Example 3

[0039] like Figure 5 As shown, in the cylindrical coordinate system, θ=θ0 represents a half plane through the z axis, and r=r0 represents a cylindrical surface with z as the axis. A cylinder is determined by inputting r=r0 through an external input device, and the two-dimensional coordinates (θ, z) of the point are determined on the two-dimensional surface. The different positions of the cylinder are determined by the r assignment, and the three work together to determine the three-dimensional coordinates (r, θ, z) of the spatial point. The spatial point is mapped on the cylinder with the z axis as the central axis, thereby determining a two-dimensional coordinate within the two-dimensional surface. Changing the position of the cylinder, that is, generating different values ​​in the third dimension, realizes the positioning of the point from two-dimensional to three-dimensional.

[0040] Spatial movement of points on the cylindrical coordinate system: There are two spatial points A and B, which are mapped on the corresponding two cylinders r=r1 and r=r2. At this time, the projection of spatial point A on the two-dimensional surface r=r2 is A', and the movement of point A' to point B on the surface r=r2 is mapped to the movement of point A to point B in space.

[0041] The positions of the origins of the above three coordinate systems can be set as needed. In particular, the plane movement of the mouse work desktop maps the two-dimensional coordinates of the above positioning method (including three coordinate systems). The spatial point needs to be determined by the coordinates of three dimensions. Each coordinate system maps the two dimensions of the coordinates of the mouse plane movement. The permutation and combination methods are There are 18 positioning methods in total, taking into account three types of coordinate systems.

[0042] The above description is only an embodiment of the present invention and the principle of the application technology. The present invention is not limited to the specific embodiments described here, and it is obvious to those skilled in the art that various changes, readjustments and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention is described by the above embodiments, the present invention is not limited to the above embodiments, and may also include more other equivalent embodiments without departing from the concept of the present invention, which are not limited to the embodiments described in this embodiment.

Claims

1. A method for realizing point positioning in an extended reality technology scene, characterized in that: The following steps are involved: Enable and control the function area added by the mouse or the function keys of the handle. First, select a point in the two-dimensional plane of the rectangular coordinate system, and add a dimension to form a third dimension based on the positioning of the two-dimensional coordinates of the point, thereby determining the three-dimensional coordinates of a spatial point; In the coordinate plane xOy of rectangular coordinates, the plane movement of the mouse on the work desktop is mapped to the two-dimensional coordinates (x, y) of the extended reality scene space point in the coordinate plane xOy, and the function key or function area of ​​the mouse control of the third dimension is enabled, so that the extended reality scene space point generates a value in the z direction, and the point has a three-dimensional coordinate (x, y, z) in the scene space, realizing the spatial positioning of the point; In the spatial rectangular coordinate system with the origin at point O, suppose there is a common surface α in the global coordinate system, and there is a point A' on surface α. The movement of the mouse on the work desktop controls point A' to generate two-dimensional coordinates on surface α. The mouse controls point A' to move to point A on OA', that is, to generate a value in the third dimension, thereby realizing the positioning of the point from the two-dimensional plane to the three-dimensional space. In the rectangular coordinate system, for the movement of a point: control the target point A through the function area added by the mouse or the function key of the handle, so that the mapping point of the target point A on plane α is converted from point A' to point B', and the mouse controls point B' to move to point B on OB', thereby realizing the movement of the point from A to B.

2. A method for realizing point positioning in an extended reality technology scene, characterized in that: The method comprises the following steps: enabling and controlling the function area added by the mouse or the function key of the handle, first selecting a point in the curved surface of the spherical coordinate system, adding a dimension to form a third dimension based on the positioning of the two-dimensional coordinate of the point, thereby determining the three-dimensional coordinate of a space point; In the spherical coordinate system with the origin O, determine the φ and θ values ​​of point P. Point Q is the projection of the positioning point P on the xOy plane. φ is the angle that the x-axis rotates counterclockwise to the directed line segment OQ. θ is the angle between the directed line segment OP and the positive direction of the z-axis, thereby positioning in the two-dimensional plane. The mouse is input in the added third dimension to generate a value r in the direction of the directed line segment OP. r is the distance between the origin O and point P, thereby realizing the positioning of the point from two-dimensional to three-dimensional. The mapping point of point Q in the scene is point P, which is dynamically represented as the projection point Q of point P on the xOy plane moving on the plane QOz, and the length of the line segment OP is set to h, that is, a value is generated in the direction of the third dimension OP, thereby realizing the positioning of the point from two dimensions to three dimensions; In the spherical coordinate system, for the movement of a point: the projection point Q1 of point P1 on the xOy plane determines the plane Q1Oz, and the length of line segment OP1 is l , move the projection point Q1 to point Q2 on the xOy plane, determine the plane Q2Oz, and let the length of line segment OP2 be k , thereby realizing the movement of the point from P1 to P2.

3. A method for realizing point positioning in an extended reality technology scene, characterized in that: The following steps are involved: Enable and control the mouse function area or the function keys of the handle. First, select a point on the surface of the cylindrical coordinate system, and add a dimension to the two-dimensional coordinates of the point to form a third dimension, thereby determining the three-dimensional coordinates of a space point; In the cylindrical coordinate system, θ=θ0 represents a half plane passing through the z axis, r=r0 represents a cylindrical surface with z as the axis. A cylindrical surface is determined by inputting r=r0 with the mouse, and the two-dimensional coordinates (θ, z) of a point on the two-dimensional surface are determined. Different positions of the cylindrical surface are determined by assigning r values, and the three coordinates (r, θ, z) are determined in coordination. The spatial point is mapped on a cylinder with the z axis as the central axis, thereby determining a two-dimensional coordinate within the two-dimensional surface. Changing the position of the cylinder, that is, generating different values ​​in the third dimension, realizes the positioning of the point from two dimensions to three dimensions. In the cylindrical coordinate system, for the spatial movement of a point: there are two spatial points A and B, which are mapped on the corresponding two cylindrical surfaces r=r1 and r=r2. At this time, the projection of spatial point A on the two-dimensional surface r=r2 is A', and the movement of point A' to point B on the surface r=r2 is mapped to the movement of point A to point B in space.

Images