Target positioning method based on diffractive optical element, electronic device and storage medium
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONGFUJIN PRECISION ELECTRONICES YANTAI CO LTD
- Filing Date
- 2022-07-11
- Publication Date
- 2026-06-30
AI Technical Summary
Existing target detection and localization technologies consume a lot of computing power in applications such as virtual reality and augmented reality, resulting in input delays and affecting the user experience.
A target localization method based on diffractive optical elements is adopted. By scanning in stages and comparing feature values, the basic unit region where the target is located is first roughly located, and then the target coordinates are accurately determined, thereby reducing the consumption of computing power.
It achieves fast and accurate target positioning, reduces computing power consumption, and improves positioning efficiency and user experience.
Smart Images
Figure CN117420502B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of target positioning technology, and in particular to a target positioning method, electronic device and computer-readable storage medium based on diffractive optical elements. Background Technology
[0002] With the continuous development of virtual reality, augmented reality, and mixed reality technologies, their application scenarios are becoming increasingly widespread. In the application of virtual reality technology, object detection and localization technology is indispensable for realizing user input. However, existing object detection and localization technologies search, locate, and transmit information across the entire target area, consuming high computational power and potentially leading to input delays, thus affecting the user experience. Summary of the Invention
[0003] In view of the above, this application provides a target positioning method, electronic device and storage medium based on diffractive optical elements to solve the above problems.
[0004] One embodiment of this application provides a target positioning method based on diffractive optical elements, including:
[0005] A first positioning light is emitted, which is used to scan a preset area where the target is located to obtain the feature values of each standard area in the preset area, wherein the preset area includes multiple standard areas;
[0006] The basic unit region where the target is located is determined based on the feature values of each of the standard regions, wherein each of the standard regions includes multiple basic unit regions.
[0007] A second positioning light is emitted toward the basic unit region where the target is located to obtain the coordinates of the target.
[0008] In one possible implementation, the step of determining the basic unit region where the target is located based on the feature values of each standard region includes:
[0009] Based on whether the target exists within the standard region, construct a region feature value lookup table;
[0010] The feature values of the standard region are compared with the feature value lookup table of the region to determine the basic unit region where the target is located.
[0011] In one possible implementation, when the target is located in different basic unit regions, the feature value of the standard region corresponds uniquely to the feature value of the region in the region feature value lookup table.
[0012] In one possible implementation, the different standard regions include at least one different basic unit region.
[0013] In one possible implementation, the preset region includes n*n basic unit regions, and the standard region includes n*m basic unit regions, where n and m are positive integers, and n ≥ m.
[0014] In one possible implementation, the second positioning light comprises light spots arranged in an array, the area swept by the light spots covering the preset area.
[0015] One embodiment of this application also provides an electronic device, including a first light source, a second light source, a diffractive optical element, a receiver, and a processor. The second light source is connected to the diffractive optical element, and the first light source, the second light source, and the receiver are connected to the processor. The processor is used to control the first light source to emit a first positioning light. The first positioning light is used to scan a preset area where the receiver is located to obtain feature values of each standard area in the preset area. The preset area includes multiple standard areas. The processor is also used to determine the basic unit area where the receiver is located based on the feature values of each standard area. Each standard area includes multiple basic unit areas. The processor is also used to control the second light source to emit a second positioning light towards the basic unit area where the receiver is located to obtain the coordinates of the receiver.
[0016] In one possible implementation, a collimating element is also included, disposed between the second light source and the diffractive optical element.
[0017] In one possible implementation, the diffractive optical element includes a diffraction grating for scattering the second positioning light into an array of light spots.
[0018] One embodiment of this application also provides a computer-readable storage medium that stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the target positioning method based on diffractive optical elements as described above.
[0019] The aforementioned target positioning method, electronic device, and computer-readable storage medium based on diffractive optical elements determine the target's coordinates by scanning and comparing the feature values of a standard region obtained through multiple scans. This method is fast, accurate, and consumes low computing power. Attached Figure Description
[0020] Figure 1 This is a flowchart of the steps of a target positioning method based on diffractive optical elements in one embodiment of this application.
[0021] Figure 2 yes Figure 1The flowchart shown is a step diagram of another embodiment of the target positioning method based on diffractive optical elements.
[0022] Figure 3 yes Figure 1 The diagram shows the structural division of the preset region in the target positioning method based on diffractive optical elements.
[0023] Figure 4 yes Figure 1 The diagram shows the assignment of region feature value lookup table in the target localization method based on diffractive optical elements.
[0024] Figure 5 This is a block diagram of an electronic device according to an embodiment of this application.
[0025] Figure 6 yes Figure 5 A schematic diagram of the second light source scanning receiver in the electronic device shown.
[0026] Explanation of main component symbols
[0027] Electronic devices 100
[0028] First Light Source 10
[0029] Second light source 20
[0030] Diffractive optical element 30
[0031] Receiver 40
[0032] Processor 50
[0033] Collimation element 60
[0034] Preset area 200
[0035] The following detailed description, in conjunction with the accompanying drawings, will further illustrate this application. Detailed Implementation
[0036] To better understand the above-mentioned objectives, features, and advantages of this application, the application will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that, unless otherwise specified, the embodiments and features described in these embodiments can be combined with each other.
[0037] The following description sets forth numerous specific details to provide a thorough understanding of this application. The described embodiments are only a portion, not all, of the embodiments described herein. All other embodiments obtained by those skilled in the art based on the embodiments described herein without inventive effort are within the scope of protection of this application.
[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the specification of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application.
[0039] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects, not to describe a specific order or sequence.
[0040] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0041] The target positioning method based on diffractive optical elements of this application is applied in one or more electronic devices. The electronic device is a device capable of automatically performing numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, processors, microprogrammed control units (MCUs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.
[0042] See Figure 1 As shown, this application proposes a target positioning method based on diffractive optical elements. Depending on different needs, the order of the steps in the flowchart can be changed, and some steps can be omitted.
[0043] S10: Emit the first positioning light. The first positioning light is used to scan the preset area where the target is located to obtain the feature values of each standard area. The preset area includes multiple standard areas.
[0044] This embodiment is for scenarios where the basic range of the target is determined, such as VR, AR, XR, etc. The target can be placed on a device such as a handheld controller or gloves held by the user. That is, this method can be applied to the continuous tracking and positioning of components such as handheld controllers in VR, AR, XR systems to determine the instructions input by the user through gestures and movement trajectories.
[0045] The laser positioning device in the above system emits a first positioning light to perform preliminary positioning of the target. A large area where the target is located is defined as a preset area, and this preset area is divided into several standard areas. The first positioning light performs a low-precision scan within the preset area to detect whether the target exists within the area and obtains the corresponding feature value results. The scanning of the first positioning light only determines the existence of the target, that is, whether the corresponding standard area exists, without determining the exact coordinates of the target. This reduces computing power consumption and improves positioning speed.
[0046] S20: Determine the basic unit region where the target is located based on the characteristic values of each standard region, where each standard region includes multiple basic unit regions.
[0047] The area with the smallest area that makes up the preset area and the standard area is the basic unit area. The feature value is determined based on whether there is a target in the area. In this embodiment, it is defined as follows: when there is a target in the area, a feature value is assigned to the area; when there is no target in the area, no feature value is assigned.
[0048] S30: Emit a second positioning light to the basic unit area where the target is located to obtain the target's coordinates.
[0049] After determining the basic unit region where the target is located using feature values, a second positioning light is emitted to scan this basic unit region to more accurately locate the target and obtain its coordinates. Unlike the first positioning light, the second positioning light obtains the target's detailed coordinates precisely within a limited range, which is used for subsequent steps such as analyzing the target's trajectory.
[0050] In one embodiment, the standard regions include overlapping areas. It should be explained that the overlapping areas between the standard regions are also composed of basic unit regions. Thus, after the first positioning light scans and obtains the feature values of each standard region, the basic unit region where the target is located can be quickly determined through comparison. If there is no overlap between the standard regions, the most accurate region that the first positioning light can find is only the size of the standard region, i.e., the basic unit region is not smaller than the standard region. However, in the case of overlapping areas, the basic unit region is not larger than the standard region. Therefore, including overlapping areas in the standard region division can improve the selection efficiency of the first positioning light, thereby accelerating the positioning efficiency and reducing computational power consumption.
[0051] In one embodiment, the preset region includes n*n basic unit regions, and the standard region includes m*n basic unit regions, where n and m are positive integers, and n≥m.
[0052] In this embodiment, n=3 and m=2. That is, the preset region includes 9 basic unit regions distributed in a 3*3 pattern, such as... Figure 3 As shown, the standard region comprises six basic unit regions (3*2), with the overlapping portion of adjacent standard regions consisting of four basic unit regions. Based on this feature, a region feature value lookup table is designed, as follows: Figure 4 As shown.
[0053] In one embodiment, the second positioning light comprises light spots arranged in an array. In this embodiment, the second positioning light is a multi-group 3x3 array of light spots generated by diffraction, with each spot illuminating a basic unit region. After the basic unit region where the target is located is determined by the first positioning light, the light spots of the second positioning light scan the basic unit region along a predetermined direction, and the specific coordinates of the target in that basic unit region are determined based on which light spot scans the target. In other embodiments, the arrangement of the light spots and scanning parameters of the second positioning light can be determined according to accuracy requirements, the size and number of the target and the basic unit regions.
[0054] Please see Figure 2 In one embodiment, the step of determining the basic unit region where the target is located based on the feature values of the standard region may specifically include:
[0055] S21: Construct a regional feature value comparison table based on whether a target exists within the standard area;
[0056] S22: Compare the feature values of the standard area with the preset area feature value comparison table to determine the basic unit area where the target is located.
[0057] In step S21, the feature value lookup table lists the feature values of each standard region corresponding to the case where the target is located in each basic unit region. In step S22, the feature value data obtained in step S10 is compared with the region feature value lookup table to determine the basic unit region where the target is located.
[0058] In one embodiment, when the target is located in different basic unit regions, the feature value of the corresponding standard region is used in the region feature value lookup table.
[0059] Please see Figure 4This is a region feature value comparison table according to an embodiment of this application. A, B, C, and D represent four standard regions. Standard region A includes six basic unit regions: I, II, IV, V, VII, and VIII; standard region B includes six basic unit regions: II, III, V, VI, VIII, and IX; standard region C includes six basic unit regions: I, II, III, IV, V, and VI; and standard region D includes six basic unit regions: IV, V, VI, VII, VIII, and IX. The horizontal axis represents the feature value obtained in each standard region when the target falls into that basic unit region. Checking the box indicates that the feature value of the target is detected. For example, feature values can be detected in standard regions B and C, but not in A and D. The feature values at this time are compared with... Figure 4 By comparing the data with the reference table, the current target can be determined to be located in the III basic unit region. This method avoids a full scan of the entire preset area, narrows the range for precise scanning and positioning, saves computing resources, and improves detection speed.
[0060] Please see Figure 5 An electronic device 100 includes a first light source 10, a second light source 20, a diffractive optical element 30, a receiver 40, and a processor 50. The second light source 20 is connected to the diffractive optical element 30. The first light source 10, the second light source 20, and the receiver 40 are connected to the processor 50. The processor 50 is used to control the first light source 10 to emit a first positioning light. The first positioning light is used to scan a preset area where the receiver 40 is located to obtain the feature values of each standard area. The processor 50 is also used to determine the basic unit area where the receiver 40 is located based on the feature values of the standard areas. The processor 50 is also used to control the second light source 20 to emit a second positioning light towards the basic unit area where the receiver 40 is located to obtain the coordinates of the receiver 40.
[0061] Electronic device 100 is installed in VR, AR, XR and other scenarios. The target is placed in a wearable device such as a controller and used within a preset range. The first light source 10 and the second light source 20 scan within the predetermined range to locate the specific coordinates of the target, thereby determining the movement trajectory of the user wearing the wearable device and determining the instructions input by the user.
[0062] In one embodiment, a collimating element 60 is further included, disposed between the second light source 20 and the diffractive optical element 30, for converting the light emitted by the second light source 20 into collimated light.
[0063] In one embodiment, the diffractive optical element 30 includes a diffraction grating for scattering the second positioning light into an n*n pattern of light spots, where n and m are positive integers and n ≥ m, to meet the requirements of the first positioning light.
[0064] Please see Figure 6In one embodiment, the second light source 20 emits a second positioning light after passing through the diffractive optical element 30. The second positioning light consists of a 3x3 array of light spots, each corresponding to a basic unit region. After the basic unit region where the receiver 40 is located is determined by the first positioning light, the 3x3 light spots of the second positioning light scan the basic unit region along a predetermined direction. The specific coordinates of the receiver 40 in the basic unit region are determined based on which light spot scans the receiver 40 and when. In other embodiments, the arrangement of the light spots and scanning parameters of the second positioning light can be determined according to accuracy requirements, the size and number of the receiver 40 and the basic unit regions.
[0065] An embodiment of this application also provides a computer-readable storage medium for storing computer instructions that, when executed on an electronic device 100, cause the electronic device 100 to perform the target positioning method based on diffractive optical elements as described above.
[0066] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the electronic device embodiments described above are merely illustrative.
[0067] Furthermore, the functional units in the various embodiments of this application can be integrated into the same processing unit, or each unit can exist physically separately, or two or more units can be integrated into the same unit. The integrated units described above can be implemented in hardware or in the form of hardware plus software functional modules.
[0068] It will be apparent to those skilled in the art that this application is not limited to the details of the exemplary embodiments described above, and that this application can be implemented in other specific forms without departing from the spirit or essential characteristics of this application. Therefore, the embodiments should be considered exemplary and non-limiting in all respects. Furthermore, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Terms such as "first," "second," etc., are used to denote names and do not indicate any particular order.
[0069] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it. Although this application has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of this application without departing from the spirit and scope of the technical solutions of this application.
Claims
1. A target positioning method based on diffractive optical elements, applied to electronic devices, characterized in that, The electronic device includes a first light source, a second light source, a diffractive optical element, a receiver, and a processor. The second light source is connected to the diffractive optical element, and the first light source, the second light source, and the receiver are connected to the processor. The target localization method based on the diffractive optical element includes: The first light source is controlled to emit a first positioning light, which is used to scan a preset area where the receiver is located, and to obtain the feature values of each standard area in the preset area based on the first positioning light received by the receiver, wherein the preset area includes a plurality of the standard areas. The basic unit region where the receiver is located is determined based on the feature values of each of the standard regions, wherein each of the standard regions includes multiple basic unit regions. The second light source is controlled to emit a second positioning light towards the basic unit region where the receiver is located. The second positioning light passes through the diffractive optical element to obtain light spots arranged in an array, and the coordinates of the receiver are obtained based on the second positioning light received by the receiver.
2. The diffractive optical element based target positioning method of claim 1, wherein, The step of determining the basic unit region where the receiver is located based on the feature values of each standard region includes: Based on whether the receiver exists within the standard area, construct a regional feature value lookup table; The feature values of the standard region are compared with the region feature value lookup table to determine the basic unit region where the receiver is located.
3. The DOE-based target positioning method of claim 2, wherein, When the receiver is located in different basic unit regions, the feature value of the standard region corresponding to the region feature value lookup table is unique.
4. The diffractive optical element based target positioning method of claim 1, wherein, Each of the different standard regions includes at least one different basic unit region.
5. The DOE-based target positioning method of claim 4, wherein, The preset region includes n*n basic unit regions, and the standard region includes n*m basic unit regions, where n and m are positive integers, and n≥m.
6. An electronic device, comprising: The system includes a first light source, a second light source, a diffractive optical element, a receiver, and a processor. The second light source is connected to the diffractive optical element. The first light source, the second light source, and the receiver are connected to the processor. The processor controls the first light source to emit a first positioning light. The first positioning light is used to scan a preset area where the receiver is located, and to obtain feature values of each standard area in the preset area based on the first positioning light received by the receiver. The preset area includes multiple standard areas. The processor is also used to determine the basic unit area where the receiver is located based on the feature values of each standard area. Each standard area includes multiple basic unit areas. The processor is also used to control the second light source to emit a second positioning light towards the basic unit area where the receiver is located. The second positioning light passes through the diffractive optical element to obtain light spots arranged in an array. The processor is also used to obtain the coordinates of the receiver based on the second positioning light received by the receiver.
7. The electronic device of claim 6, wherein, The electronic device further includes a collimating element disposed between the second light source and the diffractive optical element.
8. The electronic device of claim 6, wherein, The diffractive optical element includes a diffraction grating, which is used to scatter the second positioning light into light spots arranged in an array.
9. A computer-readable storage medium storing computer instructions, characterized in that, When the computer instructions are executed on the electronic device, the electronic device performs the target positioning method based on diffractive optical elements as described in any one of claims 1 to 5.