Viewing angle measurement method, system, head-mounted display device, and readable storage medium
Patent Information
- Application Number
- CN202311394715.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-25
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2043-10-25
AI Technical Summary
[0004]本申请的主要目的在于提供一种视角测量方法、系统、头戴式显示设备及可读存储介质,旨在解决现有技术当前对于头戴式显示设备的视角管控效果差的技术问题
[0016]This application provides a viewing angle measurement method, system, head-mounted display device, and readable storage medium, applied to a viewing angle measurement system. The viewing angle measurement system includes a ray simulator, a viewing angle simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and an optical axis channel. That is, after the viewing angle measurement system is calibrated, the virtual imaging point of the measurement ray emitted by the ray simulator and reflected by the viewing angle simulator to the rendering center is obtained; based on the virtual imaging point, the virtual imaging image of the target to be rendered rendered by the rendering center is determined; based on the size parameters of the virtual imaging image, the target viewing angle simulated by the viewing angle simulator is measured, wherein the target viewing angle refers to the offset viewing angle of the target to be rendered observed through the viewing angle simulator.
Smart Images

Figure CN117419896B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of head-mounted display technology, and more particularly to a viewing angle measurement method, system, head-mounted display device, and readable storage medium. Background Technology
[0002] With the continuous development of technology, virtual reality (VR) devices and augmented reality (AR) devices are widely used in people's lives. In order to improve the user experience of VR devices, AR devices, and mixed reality (MR) devices, which are broadly defined head-mounted display devices, it is necessary for device manufacturers to strictly control device performance during the production stage. The control of the interactive viewpoint (UI-Angle) is one of them.
[0003] Currently, professional testers are typically employed during the production process to measure viewing angles and ensure that the interactive viewing angle is within a certain deviation range so that the image seen by users wearing the device is not excessively distorted. However, due to the subjectivity of professional testers, the comfortable interactive viewing angle they measure is difficult to cover the needs of the general public, which can easily lead to poor interactive experience between users and head-mounted display devices. Therefore, the current effect of viewing angle control for head-mounted display devices is poor. Summary of the Invention
[0004] The main objective of this application is to provide a viewing angle measurement method, system, head-mounted display device, and readable storage medium, aiming to solve the technical problem of poor viewing angle control of head-mounted display devices in the current technology.
[0005] To achieve the above objectives, this application provides a viewpoint measurement method applied to a viewpoint measurement system. The viewpoint measurement system includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and a light axis channel. The viewpoint measurement method includes:
[0006] After the view measurement system is calibrated, the view simulator will reflect the measurement light emitted by the light simulator to the virtual imaging point of the rendering center via the optical axis channel.
[0007] Based on the virtual imaging points, determine the virtual imaging image of the target to be rendered through the rendering center;
[0008] Based on the size parameters of the virtual imaging image, the target perspective simulated by the perspective simulator is measured, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
[0009] To achieve the above objectives, this application also provides a viewpoint measurement system, which includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and a light axis channel. The viewpoint measurement system further includes an acquisition module, a determination module, and a measurement module.
[0010] The acquisition module is used to acquire the virtual imaging point of the rendering center by the viewpoint simulator reflecting the measurement light emitted by the light simulator through the optical axis channel after the viewpoint measurement system is calibrated.
[0011] The determining module is used to determine, based on the virtual imaging points, the virtual imaging image rendered by the rendering center of the target to be rendered;
[0012] The measurement module is used to measure the target perspective simulated by the perspective simulator according to the size parameters of the virtual imaging screen, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
[0013] This application also provides a head-mounted display device, the head-mounted display device comprising: at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the steps of the viewing angle measurement method described above.
[0014] This application also provides a computer-readable storage medium storing a program for implementing a viewpoint measurement method, wherein when the program for the viewpoint measurement method is executed by a processor, it implements the steps of the viewpoint measurement method as described above.
[0015] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the viewpoint measurement method described above.
[0016] This application provides a viewing angle measurement method, system, head-mounted display device, and readable storage medium, applied to a viewing angle measurement system. The viewing angle measurement system includes a ray simulator, a viewing angle simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and an optical axis channel. That is, after the viewing angle measurement system is calibrated, the virtual imaging point of the measurement ray emitted by the ray simulator and reflected by the viewing angle simulator to the rendering center is obtained; based on the virtual imaging point, the virtual imaging image of the target to be rendered rendered by the rendering center is determined; based on the size parameters of the virtual imaging image, the target viewing angle simulated by the viewing angle simulator is measured, wherein the target viewing angle refers to the offset viewing angle of the target to be rendered observed through the viewing angle simulator.
[0017] In this application, when performing viewpoint measurement, the viewpoint measurement system is first calibrated. Then, the virtual imaging point of the rendering center is obtained by simulating the measurement light received by the viewpoint simulator and reflected through the optical axis channel. Then, the virtual imaging point is used to determine the virtual imaging image of the target to be rendered by the rendering center. That is, the purpose of simulating the scene of a user wearing a head-mounted display device to observe an object and form a virtual imaging image is achieved. Then, according to the size parameters of the virtual imaging image, the target viewpoint simulated by the viewpoint simulator is measured. Since the target viewpoint refers to the offset viewpoint of the target to be rendered observed through the viewpoint simulator, the purpose of simulating the offset viewpoint of the target to be rendered displayed on the head-mounted display device by the user's naked eye can be achieved by using the size parameters of the virtual imaging image. Therefore, the viewpoint measurement system completes the simulation of the interactive viewpoint generated by the user wearing a head-mounted display device to observe the target to be rendered.
[0018] Because the viewing angle measurement system can objectively measure the interactive viewing angle through the size parameters of the virtual imaging screen, the target viewing angle measured by the viewing angle measurement system can objectively provide feedback on the size of the offset viewing angle of the user's observation of the target to be rendered, thereby realizing the accurate measurement of the interactive viewing angle between the user and the head-mounted display device.
[0019] Based on this, this application, when measuring viewing angles, simulates the interactive viewing angle generated when a user wears a head-mounted display device and observes the target to be rendered. This allows for objective measurement of the interactive viewing angle between the user and the viewing angle measurement system, thus laying the foundation for strict performance control of head-mounted display devices during the production stage. This is in contrast to subjective interactive viewing angle measurements performed by professional testers wearing the device. Therefore, it overcomes the technical deficiency that the subjective nature of professional testers' measurements makes it difficult to cover the needs of the general public, leading to poor user experience with head-mounted display devices. Thus, it improves the effectiveness of viewing angle control for head-mounted display devices. Attached Figure Description
[0020] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0021] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1 A schematic diagram of the interactive perspective of the perspective measurement method provided in Embodiment 1 of this application;
[0023] Figure 2 A schematic flowchart of the viewing angle measurement method provided in Embodiment 1 of this application;
[0024] Figure 3 This is a schematic diagram illustrating the implementation of the angle measurement system for the angle measurement method provided in Embodiment 1 of this application.
[0025] Figure 4 A schematic diagram of image comparison using an industrial camera for the perspective measurement method provided in Embodiment 1 of this application;
[0026] Figure 5 This is a flowchart illustrating the viewing angle measurement method provided in Embodiment 2 of this application;
[0027] Figure 6 This is a schematic diagram of the view measurement system provided in Embodiment 3 of this application;
[0028] Figure 7 This is a schematic diagram of the structure of the head-mounted display device provided in Embodiment 4 of this application.
[0029] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0030] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0031] Example 1
[0032] First, it should be understood that for head-mounted display devices such as virtual reality helmets, virtual reality headsets, or virtual reality glasses, during the production stage, in order to improve the user experience, such as evaluating performance aspects like viewing comfort and realism, relevant indicators are usually controlled during the production process. Taking the interaction perspective as an example, referring to... Figure 1 Interactive viewing angle 'a' refers to the angle formed by the line connecting the user's observation point 11 and the point where the observation point lands on the test image plane 12, and the line connecting the observation point and the standard landing point 14. The standard landing point can be the origin of the test image plane, that is, the position where the observation point should land on the test image plane after the user looks straight ahead under standard conditions. By controlling the interactive viewing angle within a certain range, the generation of image distortion can be effectively controlled, thereby improving the user experience. Currently, this is usually done by having professional testers wear head-mounted display devices for actual testing. However, due to the following factors, the interactive viewing angle cannot be objectively measured: 1) Different people's evaluations of the imaging effect will be subjective, leading to variations in the consistency of the completed devices; 2) Qualified testers need rigorous training before they can be employed, making it impossible to achieve real-time testing; 3) The selected standard testers are unlikely to cover the general needs of the public, ultimately resulting in poor viewing angle control for head-mounted display devices. Therefore, there is an urgent need for a method to improve the viewing angle control effect of head-mounted display devices.
[0033] This application provides a viewpoint measurement method applied to a viewpoint measurement system. The viewpoint measurement system includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and a light axis channel. In the first embodiment of the viewpoint measurement method of this application, referring to... Figure 2 The viewing angle measurement method includes:
[0034] Step S10: After the view measurement system is calibrated, the virtual imaging point of the rendering center is obtained by the view simulator reflecting the measurement light emitted by the light simulator through the optical axis channel to the rendering center.
[0035] Step S20: Based on the virtual imaging points, determine the virtual imaging image of the target to be rendered rendered by the rendering center;
[0036] Step S30: Measure the target perspective simulated by the perspective simulator according to the size parameters of the virtual imaging screen, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
[0037] In this embodiment, it should be noted that, although Figure 2The logical order is shown, but in some cases, the steps shown or described may be performed in a different order than that shown here. The viewpoint measurement method is applied to a viewpoint measurement system, which includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered has a target to be rendered and an optical axis channel. The ray simulator emits a simulated laser beam in a set direction, specifically a laser. The viewpoint simulator simulates the interactive viewpoint between the user's naked eye and a head-mounted display device, specifically composed of a reflector and an industrial camera. The fixture to be rendered represents the fixture awaiting rendering and virtual imaging. The target to be rendered in the fixture can be a two-dimensional or three-dimensional object. The optical axis channel represents the channel for light transmission, specifically a through-hole penetrating different cross-sections; the size of the through-hole is not specifically limited. The rendering center renders a virtual image on the test image plane. In addition, the viewpoint measurement system also includes a viewpoint measurement device, a vision program running on the viewpoint measurement device, and auxiliary fixtures. The viewpoint measurement device can be a mobile phone, computer, or personal PC, for example, in one implementable manner, referring to... Figure 3 , Figure 3 This is a schematic diagram of the implementation of the viewing angle measurement system. 21 is a low-power laser emitter, 22 is a simulated light beam, 23 is a fixture to be rendered, 24 is a reflector, and 25 is an industrial camera. The simulated light beam 22 is emitted or reflected through the optical axis channel 26. Specifically, the optical axis channel 26 can be a 1mm micro-through hole from one cross-section to another. The optical axis channel can be placed on an auxiliary fixture. The low-power laser emitter can be fixed on a six-axis. By turning on the low-power laser, a laser beam with good directionality can be emitted. The industrial camera 25 and the reflector 24 are integrated. Their positional relationship is as follows: the reflector 24 is placed close to the front of the industrial camera 25. The reflector 14 is used to reflect the simulated light beam 22 emitted by the low-power laser emitter 21 to the industrial camera 25 through the optical axis channel 26. By collecting the light spot returned from the cross-section of the light emitted along the optical axis, it can be determined whether the viewing angle measurement system has been calibrated.
[0038] Additionally, virtual imaging points are used to characterize the imaging points obtained by measuring light rays in rendering, specifically a combination of one or more pixels. Virtual imaging images are used to characterize the virtual images obtained by rendering the target at the rendering center. Size parameters are used to characterize the size of the virtual imaging images, specifically the length or width of the virtual imaging images. Target viewpoint refers to the offset viewpoint of the target being rendered observed through the viewpoint simulator. The offset viewpoint is used to characterize the angle between the light rays observed from the actual viewpoint and the light rays observed from the normal viewpoint through the viewpoint simulator. The target viewpoint is measured by a preset angle calculation formula, specifically a trigonometric function calculation formula, that is, the target viewpoint is obtained by the ratio of the size parameters of the virtual imaging images to the light rays.
[0039] Additionally, it should be noted that before performing viewpoint measurements, the viewpoint measurement system must first be ensured to be in the calibration phase. Only after the viewpoint measurement system is calibrated can it be ensured that the light emitted by the ray simulator and the light reflected by the viewpoint simulator can be transmitted through the optical axis channel, thereby enabling the output of a standard. This allows for the simulation of the viewpoint of the user's observation of the target to be rendered based on the viewpoint measurement system. For example, referring to... Figure 4 , Figure 4 This is a schematic diagram of image comparison acquired by an industrial camera. The image acquisition is performed with the target power to be rendered and the test image displayed. (a) represents the test image under ideal conditions, (b) represents the actual sampled test image, and (c) represents the viewing angle during viewing angle measurement and analysis. Here, o refers to the imaging point of the light ray measured in the virtual imaging screen under normal viewing angle, and o' refers to the imaging point of the light ray measured in the virtual imaging screen under actual viewing angle. As can be seen from the above, during the viewing angle measurement process, the target viewing angle observed by the user can be objectively fed back.
[0040] As an example, steps S10 to S30 include: after determining that the view measurement system has been calibrated, a measurement ray is emitted from the light simulator to the view simulator via the optical axis channel; after the view simulator receives the measurement ray, the measurement ray is reflected to the rendering center via the optical axis channel through a reflector attached to the view simulator; a virtual imaging point is generated at the rendering center; based on the correspondence between the virtual imaging point and the actual point of the target to be rendered, a virtual imaging image corresponding to the target to be rendered is rendered through the rendering center; the size parameters of the virtual imaging image are input into a preset target view calculation formula to calculate the target view simulated by the view simulator.
[0041] In the field of view measurement, this application first determines whether the field of view measurement system calibration is complete. After the field of view correction is completed, the field of view simulator can simulate the user's observation of the target to be rendered and form a virtual imaging point through light reflection. Then, after the field of view simulator reflects the measurement light emitted by the light simulator through the optical axis channel to the virtual imaging point of the rendering center, the rendering center renders the virtual imaging image of the target to be rendered through the virtual imaging point. Finally, the target field of view simulated by the field of view simulator is calculated based on the size parameters of the virtual imaging image. The target field of view refers to the offset field of view of the target to be rendered observed through the field of view simulator. Since the field of view simulator simulates the user's observation of the target to be rendered, the offset field of view of the target to be rendered displayed on the head-mounted display device can be measured by the size parameters of the virtual imaging image. Therefore, the field of view measurement system completes the simulation of the interactive field of view generated by the user wearing the head-mounted display device to observe the target to be rendered. This overcomes the technical defect that professional testers are subjective and their measured comfortable interactive field of view is difficult to cover the needs of the general public, which may lead to poor user interaction experience with the head-mounted display device. Therefore, the field of view control of the head-mounted display device is improved.
[0042] On the other hand, it should be noted that since the viewing angle measurement system can objectively provide feedback on the interactive viewing angle between the user and the head-mounted display device, it can be used by equipment manufacturers to measure possible deviations in imaging after the AR / VR optical engine is assembled, rather than being limited by the subjectivity of professional testers when controlling the performance parameter "interactive viewing angle" of the device, which may lead to poor interactive experience between the user and the head-mounted display device.
[0043] The step of measuring the target perspective simulated by the perspective simulator based on the size parameters of the virtual imaging image includes:
[0044] Step A10: Obtain the axial field of view and longitudinal field of view of the target to be rendered as observed through the view simulator in the preset coordinate system;
[0045] Step A20: Calculate the axial offset viewpoint and longitudinal offset viewpoint of the target to be rendered observed through the viewpoint simulator based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen.
[0046] Step A30: Based on the fusion of the axial offset view and the longitudinal offset view, determine the target view simulated by the view simulator.
[0047] In this embodiment, it should be noted that, in order to accurately measure the interactive viewing angle between the user and the head-mounted display device, that is, to obtain the offset viewing angle in various directions when the user observes the target to be rendered, a coordinate system can be pre-set in the virtual imaging screen. For example, in one feasible approach, the calibration point after the viewing angle measurement system is calibrated can be used as the center, the horizontal direction of the virtual imaging screen can be used to construct the horizontal coordinate axis, and the vertical coordinate axis can be constructed in the direction perpendicular to the horizontal direction of the virtual imaging screen. Therefore, the axial field of view is used to characterize the field of view in the axial direction of the preset coordinate system, and the longitudinal field of view is used to characterize the field of view in the longitudinal direction of the preset coordinate system. In this context, the field of view (FOP) refers to the angular range of an image that an industrial camera can receive in an imaging scene. It is specifically determined by the hardware parameters of the industrial camera and is a known quantity in the design. After obtaining the axial and longitudinal FOPs, the angle of the target to be rendered observed in the simulated viewpoint of the view simulator along the axial direction (axial offset viewpoint) and the angle of the target to be rendered along the longitudinal direction (longitudinal offset viewpoint) can be calculated using trigonometric functions based on the designed FOPs. Then, the target viewpoint simulated by the view simulator can be obtained by fusing the offset viewpoints in the two directions. The specific formulas for calculating the axial and longitudinal offset viewpoints are as follows:
[0048] α = tan -1 (Δx*tanβ1 / b)
[0049] γ=tan -1 (Δy*tanβ2 / b)
[0050] β1=0.5*FOV1, β2=0.5*FOV2
[0051] Where α is the axial offset angle, γ is the longitudinal offset angle, β1 is the calculated angle of the axial offset angle, β2 is the calculated angle of the longitudinal offset angle, FOV1 is the axial field of view angle, FOV2 is the longitudinal field of view angle, Δx is the lateral measurement distance, Δy is the longitudinal measurement distance, and b is the imaging width of the virtual imaging screen. Specifically, it can be half of the axial screen length of the virtual imaging screen, or half of the axial screen width of the virtual imaging screen, depending on whether the formula involves calculating the axial offset angle or the longitudinal offset angle.
[0052] As an example, steps A10 to A30 include: obtaining the axial field of view and longitudinal field of view of the target to be rendered observed through the view simulator in a preset coordinate system; inputting the axial field of view and the axial image length of the virtual imaging screen into a preset calculation formula to calculate the axial offset view of the target to be rendered observed through the view simulator; and inputting the longitudinal field of view and the axial image width of the virtual imaging screen into a preset calculation formula to calculate the longitudinal offset view of the target to be rendered observed through the view simulator; and fusing the axial offset view and the longitudinal offset view through a preset trigonometric function relationship to obtain the target view simulated by the view simulator. Since the axial offset view and longitudinal offset view of the target to be rendered observed by the view simulator are first calculated when calculating the target view simulated by the view simulator, and then the target view simulated by the view simulator is obtained by fusing the axial offset view and the longitudinal offset view, the measurement of the interactive view simulated by the view simulator takes into account the lateral and longitudinal offset views of the view simulator when observing the target to be rendered. This allows the target view to accurately reflect the offset view in the corresponding direction, thus laying the foundation for improving the view control effect of head-mounted display devices.
[0053] The step of calculating the axial offset view and the longitudinal offset view of the target to be rendered observed through the view simulator based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging image includes:
[0054] Step B10: Calculate the first measurement distance between the target to be rendered and the view simulator based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen.
[0055] Step B20: Decompose the second measurement distance between the view simulator and the virtual imaging screen into the axial measurement distance and the longitudinal measurement distance in the preset coordinate system;
[0056] Step B30: Calculate the axial offset angle based on the axial measurement distance and the first measurement distance, and calculate the longitudinal offset angle based on the longitudinal measurement distance and the first measurement distance.
[0057] In this embodiment, it should be noted that during viewpoint measurement, the length of the test points obtained by the visual camera will vary due to different targets to be rendered. Therefore, each product needs to be sampled during sampling tests. Furthermore, the magnification ratio of pixels to the actual photographed product is unknown. Thus, another method for calculating axial and longitudinal offset viewpoints can be provided. The first measurement distance is the distance between the target to be rendered and the viewpoint simulator, and the second measurement distance is the distance between the viewpoint simulator and the virtual imaging screen. The measurement distance is used to characterize the distance between the target to be rendered and the virtual imaging screen. After decomposing the second measurement distance into lateral and longitudinal measurement distances, the axial and longitudinal offset viewpoints can be calculated in conjunction with the first measurement distance. The specific calculation formula is as follows:
[0058] α = tan -1 (Δx / d)
[0059] γ=tan -1 (Δy / d)
[0060] d = b / tanβ
[0061] Where d is the first measurement distance, Δx is the lateral measurement distance, and Δy is the longitudinal measurement distance.
[0062] As an example, steps B10 to B30 include: calculating a first measurement distance between the target to be rendered and the view simulator based on the axial field of view, the longitudinal field of view, and the length of the virtual imaging image; decomposing a second measurement distance between the view simulator and the virtual imaging image into an axial measurement distance and a longitudinal measurement distance in the preset coordinate system based on a preset trigonometric function relationship; calculating the axial offset angle by inputting the axial measurement distance and the first measurement distance into a preset offset angle calculation formula, and calculating the longitudinal offset angle by inputting the longitudinal measurement distance and the first measurement distance.
[0063] In one feasible approach, the axial offset viewpoint and longitudinal offset viewpoint can be calculated using the field of view angles along the x-axis and y-axis directions of the virtual imaging image captured by an industrial camera. During the calculation process, the parameters b and Δ are changing, but they can be reduced during the calculation process to obtain a completely objective feedback target viewpoint.
[0064] The step of fusing the axial offset view and the longitudinal offset view to determine the target view simulated by the view simulator includes:
[0065] Step C10: Obtain the calibrated angle obtained by the angle measurement system.
[0066] Step C20: By fusing the axial offset view and the longitudinal offset view, the actual view of the target to be rendered observed through the view simulator is obtained;
[0067] Step C30: Subtract the actual viewpoint from the calibrated viewpoint to obtain the target viewpoint simulated by the viewpoint simulator.
[0068] As an example, steps C10 to C30 include: obtaining the calibrated viewing angle obtained by the viewing angle measurement system; calculating the actual viewing angle of the target to be rendered observed by the viewing angle simulator based on the trigonometric function relationship between the axial offset viewing angle and the longitudinal offset viewing angle; and using the difference between the actual viewing angle and the calibrated viewing angle as the target viewing angle simulated by the viewing angle simulator.
[0069] Prior to the step of obtaining the virtual imaging point at the rendering center from the reflection of the measurement light emitted by the ray simulator via the optical axis channel by the view simulator, the view measurement method further includes:
[0070] Step D10: Obtain the first calibration imaging point of the calibration light emitted by the light simulator to the view simulator via the optical axis channel;
[0071] Step D20: Based on the first calibration imaging point, determine whether the light simulator needs to be calibrated;
[0072] Step D30: If the light simulator needs to be calibrated, the first pose of the view simulator is adjusted, and after adjustment, the process returns to step: Obtain the first calibration imaging point of the calibration light emitted by the light simulator to the view simulator via the optical axis channel.
[0073] Step D40: If the light simulator does not need to be calibrated, obtain the second calibration imaging point formed by the reflection of the calibration light through the optical axis channel by the view simulator, and detect whether the view simulator needs to be calibrated based on the second calibration imaging point.
[0074] Step D50: If the view simulator needs to be calibrated, the second pose of the view simulator is adjusted, and after adjustment, the process returns to step: Obtain the second calibration imaging point formed by the view simulator reflecting the calibration light through the optical axis channel.
[0075] Step D60: If the viewpoint simulator does not need to be calibrated, then the viewpoint measurement system calibration is complete.
[0076] In this embodiment, it should be noted that the viewing angle measurement system needs to be calibrated before the viewing angle measurement to ensure smooth operation. For example, in one feasible method, the calibration process is as follows: 1) Place the optical axis contouring device on an auxiliary fixture, wherein the optical axis contouring device has a 1mm micro-hole from one cross-section to another; 2) Fix the laser on the six-axis and turn it on to emit a laser beam in a certain direction; 3) Connect the industrial camera and computer and open the self-developed vision software for real-time image capture; 4) Place the reflector in front of the lens of the industrial camera; 5) Adjust the laser pose through the six-axis to allow the laser beam to pass smoothly through the micro-hole of the contouring optical axis until the laser pose adjustment is completed, and then transmit the laser beam to the industrial camera via the optical axis channel. 6) When the industrial camera reflects the laser beam, adjust the camera posture so that the reflector in front of the industrial camera can completely reflect the laser beam that conforms to the optical axis and reflect it back in the direction from which the laser beam came. The position and posture of the laser and the industrial camera can be judged by the light spot on the cross-section of the light output direction along the optical axis. For example, in one feasible method, if the brightness of the left half of the light spot is less than that of the right half, the position and posture of the industrial camera need to be moved to the left. If the brightness of the right half of the light spot is greater than that of the right half, the position and posture of the industrial camera need to be moved to the right. It is understandable that during the calibration of the viewing angle measurement system, due to the directional characteristics of emission and reflection, the position and posture adjustment directions between the industrial camera and the laser are opposite.
[0077] As an example, steps D10 to D60 include: acquiring a first calibration imaging point of the calibration light emitted by the light simulator from the optical axis channel to the viewpoint simulator; determining whether the light simulator needs to be calibrated based on the brightness of the first calibration imaging point; if the light simulator needs to be calibrated, matching the adjustment method corresponding to the brightness, and adjusting the first pose of the viewpoint simulator according to the adjustment method, and returning to the execution step after adjustment: acquiring a first calibration imaging point of the calibration light emitted by the light simulator from the optical axis channel to the viewpoint simulator; if the light simulator does not need to be calibrated, acquiring a second calibration imaging point formed by the viewpoint simulator reflecting the calibration light through the optical axis channel, and determining whether the viewpoint simulator needs to be calibrated based on the second imaging point; if the viewpoint simulator needs to be calibrated, adjusting the second pose of the viewpoint simulator, and returning to the execution step after adjustment: acquiring a second calibration imaging point formed by the viewpoint simulator reflecting the calibration light through the optical axis channel; if the viewpoint simulator does not need to be calibrated, determining that the viewpoint measurement system calibration is complete.
[0078] The step of adjusting the first pose of the view simulator includes:
[0079] Step E10: Obtain the first pixel value and the second pixel value of the first calibration imaging point;
[0080] Step E20: Determine the adjustment direction of the view simulator based on the pixel difference between the first pixel value and the second pixel value;
[0081] Step E30: Adjust the first pose of the view simulator according to the adjustment direction.
[0082] In this embodiment, it should be noted that when adjusting the first pose of the view simulator, in order to provide a basis for directional adjustment, two pixels can be arbitrarily collected in the first calibration imaging point, and the pixel values of the two pixels can be compared. The direction of the line connecting their pixel values from small to large is taken as the adjustment direction of the first pose. The adjustment method of the second pose of the ray simulator can also be implemented in the same way. However, due to the relative positional relationship between the view simulator and the ray simulator, the adjustment directions of the view simulator and the ray simulator are opposite.
[0083] As an example, steps E10 to E30 include: obtaining a first pixel value and a second pixel value of the first calibration imaging point; using the direction pointed to by the pixel difference between the first pixel value and the second pixel value as the adjustment direction of the view simulator; and adjusting the first pose of the view simulator in the adjustment direction.
[0084] This application provides a viewpoint measurement method applied to a viewpoint measurement system. The viewpoint measurement system includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and an optical axis channel. That is, after the viewpoint measurement system is calibrated, the virtual imaging point of the measurement ray emitted by the ray simulator and reflected by the viewpoint simulator to the rendering center via the optical axis channel is obtained. Based on the virtual imaging point, the virtual imaging image of the target to be rendered rendered by the rendering center is determined. Based on the size parameters of the virtual imaging image, the target viewpoint simulated by the viewpoint simulator is measured, wherein the target viewpoint refers to the offset viewpoint of the target to be rendered observed through the viewpoint simulator.
[0085] In this embodiment of the application, when performing viewing angle measurement, the system first determines that after the viewing angle measurement system is calibrated, it acquires the virtual imaging point of the rendering center through the optical axis channel reflection measurement relationship after the viewing angle simulator simulates receiving the measurement light. Then, through the virtual imaging point, it determines the virtual imaging image of the target to be rendered by the rendering center. That is, it realizes the purpose of simulating the scene of a user wearing a head-mounted display device observing an object and forming a virtual imaging image. Then, according to the size parameters of the virtual imaging image, the target viewing angle simulated by the viewing angle simulator is measured. Since the target viewing angle refers to the offset viewing angle of the target to be rendered observed through the viewing angle simulator, it is possible to measure the offset viewing angle of the target to be rendered displayed on the head-mounted display device by simulating the user's naked eye viewing the target to be rendered through the size parameters of the virtual imaging image. Therefore, the viewing angle measurement system completes the simulation of the interactive viewing angle generated by the user wearing a head-mounted display device observing the target to be rendered.
[0086] Because the viewing angle measurement system can objectively measure the interactive viewing angle through the size parameters of the virtual imaging screen, the target viewing angle measured by the viewing angle measurement system can objectively provide feedback on the size of the offset viewing angle of the user's observation of the target to be rendered, thereby realizing the accurate measurement of the interactive viewing angle between the user and the head-mounted display device.
[0087] Based on this, this application, when measuring viewing angles, simulates the interactive viewing angle generated when a user wears a head-mounted display device and observes the target to be rendered. This allows for objective measurement of the interactive viewing angle between the user and the viewing angle measurement system, thus laying the foundation for strict performance control of head-mounted display devices during the production stage. This is in contrast to subjective interactive viewing angle measurements performed by professional testers wearing the device. Therefore, it overcomes the technical deficiency that the subjective nature of professional testers' measurements makes it difficult to cover the needs of the general public, leading to poor user experience with head-mounted display devices. Thus, it improves the effectiveness of viewing angle control for head-mounted display devices.
[0088] Example 2
[0089] Furthermore, referring to Figure 5 In another embodiment of this application, content that is the same as or similar to that in Embodiment 1 above can be referred to the above description and will not be repeated hereafter. Based on this, the viewpoint measurement system further includes target contouring, wherein the target contouring is the contour of the target to be rendered, and the viewpoint measurement method further includes:
[0090] Step F10: When the target contour is detected to be set on the fixture to be rendered, the following steps are performed: obtain the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator via the optical axis channel, until neither the ray simulator nor the view simulator needs to perform pose adjustment;
[0091] Step F20: Detect whether the target to be rendered has replaced the target morphology;
[0092] Step F30: If yes, then the angle measurement system calibration is complete.
[0093] Step F40: If not, control the target to be rendered to replace the target morphology, and return to the execution step: detect whether the target to be rendered has replaced the target morphology.
[0094] In this embodiment, it should be noted that, in order to ensure that the product is not damaged during the calibration process, a tracing of the target to be rendered, i.e., a target tracing, can be set. In this way, the tracing is always used to replace the target to be rendered during the calibration process, and the replacement of the target to be rendered and the target tracing is completed before the actual viewpoint measurement, thereby laying the foundation for the protection of the product.
[0095] As an example, steps F10 to F40 include: when the target tracing is detected to be set on the fixture to be rendered, the following steps are performed: acquiring the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator via the optical axis channel, until neither the ray simulator nor the view simulator needs to perform pose adjustment; detecting whether the target to be rendered has replaced the target tracing; if the target to be rendered has replaced the target tracing, then determining that the view measurement system calibration is complete; if the target to be rendered has not replaced the target tracing, then controlling the target to be rendered to replace the target tracing, and returning to the execution step: detecting whether the target to be rendered has replaced the target tracing.
[0096] This application provides a method for calibrating a viewing angle measurement system. Specifically, when the target phasing is detected as being placed on the rendering fixture, the following steps are executed: First, obtain the first calibration imaging point of the calibration light emitted by the ray simulator from the ray simulator to the viewing angle simulator via the optical axis channel, until neither the ray simulator nor the viewing angle simulator requires pose adjustment; Detect whether the target to be rendered has replaced the target phasing; if so, determine that the viewing angle measurement system calibration is complete; if not, control the target to be rendered to replace the target phasing, and return to the execution step: Detect whether the target to be rendered has replaced the target phasing. In this application embodiment, when performing viewing angle measurement calibration, the viewing angle measurement system is calibrated by replacing the target to be rendered with a target phasing. Before the formal start of viewing angle measurement, the replacement between the target to be rendered and the target phasing simulates the interactive viewing angle between the user and the head-mounted display device in a real scene. Therefore, this lays the foundation for improving the viewing angle control effect of the head-mounted display device.
[0097] Example 3
[0098] This application embodiment also provides a viewpoint measurement system, which includes a ray simulator, a viewpoint simulator, a rendering fixture, and a rendering center. The rendering fixture is provided with a rendering target and a light axis channel. The viewpoint measurement system further includes an acquisition module, a determination module, and a measurement module. (Refer to...) Figure 6 ,in,
[0099] The acquisition module 101 is used to acquire, after the view measurement system is calibrated, the virtual imaging point of the view simulator reflecting the measurement light emitted by the light simulator to the rendering center via the optical axis channel;
[0100] The determining module 102 is used to determine, based on the virtual imaging points, the virtual imaging image rendered by the rendering center for the target to be rendered;
[0101] The measurement module 103 is used to measure the target perspective simulated by the perspective simulator according to the size parameters of the virtual imaging screen, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
[0102] Optionally, the measurement module 103 is further configured to:
[0103] Obtain the axial and longitudinal field of view angles of the target to be rendered by observing it through the view simulator in the preset coordinate system;
[0104] Based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen, calculate the axial offset view and the longitudinal offset view of the target to be rendered observed through the view simulator.
[0105] The target viewpoint simulated by the viewpoint simulator is determined by fusing the axial offset viewpoint and the longitudinal offset viewpoint.
[0106] Optionally, the measurement module 103 is further configured to:
[0107] Based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen, calculate the first measurement distance between the target to be rendered and the view simulator;
[0108] The second measurement distance between the perspective simulator and the virtual imaging screen is decomposed into the axial measurement distance and the longitudinal measurement distance in the preset coordinate system;
[0109] The axial offset angle is calculated based on the axial measurement distance and the first measurement distance, and the longitudinal offset angle is calculated based on the longitudinal measurement distance and the first measurement distance.
[0110] Optionally, the measurement module 103 is further configured to:
[0111] Obtain the calibrated angle obtained by the angle measurement system;
[0112] By fusing the axial offset view and the longitudinal offset view, the actual view of the target to be rendered observed through the view simulator is obtained;
[0113] The target viewpoint simulated by the viewpoint simulator is obtained by subtracting the actual viewpoint from the calibrated viewpoint.
[0114] Optionally, the viewing angle measurement system is also used for:
[0115] Obtain the first calibration imaging point of the calibration light emitted by the light simulator to the viewpoint simulator via the optical axis channel;
[0116] Based on the first calibration imaging point, determine whether the light simulator needs to be calibrated;
[0117] If the ray simulator needs to be calibrated, the first pose of the view simulator is adjusted, and after adjustment, the process returns to the following step: obtain the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator via the optical axis channel;
[0118] If the light simulator does not need to be calibrated, then obtain the second calibration imaging point formed by the reflection of the calibration light through the optical axis channel by the view simulator, and detect whether the view simulator needs to be calibrated based on the second calibration imaging point.
[0119] If the view simulator needs to be calibrated, the second pose of the view simulator is adjusted, and after adjustment, the execution step is returned: obtain the second calibration imaging point formed by the view simulator reflecting the calibration light through the optical axis channel;
[0120] If the view simulator does not need to be calibrated, then the view measurement system calibration is complete.
[0121] Optionally, the viewing angle measurement system is also used for:
[0122] Obtain the first pixel value and the second pixel value of the first calibration imaging point;
[0123] The adjustment direction of the view simulator is determined based on the pixel difference between the first pixel value and the second pixel value;
[0124] Adjust the first pose of the view simulator according to the adjustment direction.
[0125] Optionally, the viewpoint measurement system further includes target contouring, wherein the target contouring is the contouring of the target to be rendered, and the viewpoint measurement system is further used for:
[0126] When the target contour is detected to be set on the fixture to be rendered, the following steps are performed: obtain the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator through the optical axis channel, until neither the ray simulator nor the view simulator needs to perform pose adjustment;
[0127] Detect whether the target to be rendered has replaced the target morphology;
[0128] If so, then the angle measurement system calibration is complete;
[0129] If not, control the target to be rendered to replace the target morphology, and return to the execution step: detect whether the target to be rendered has replaced the target morphology.
[0130] The viewing angle measurement system provided by this invention, employing the viewing angle measurement method described in the above embodiments, solves the technical problem of poor viewing angle control for head-mounted display devices. Compared with the prior art, the beneficial effects of the viewing angle measurement system provided by this invention are the same as those of the viewing angle measurement method described in the above embodiments, and other technical features of this viewing angle measurement system are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0131] Example 4
[0132] This invention provides a head-mounted display device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which are executed by the at least one processor to enable the at least one processor to perform the viewing angle measurement method in Embodiment 1 above.
[0133] The following is for reference. Figure 7 The diagram illustrates a structural schematic suitable for implementing a head-mounted display device according to embodiments of the present disclosure. The head-mounted display device in embodiments of the present disclosure may include, but is not limited to, Mixed Reality (MR) devices (e.g., MR glasses or MR helmets), Augmented Reality (AR) devices (e.g., AR glasses or AR helmets), Extended Reality (XR) devices, or some combination thereof. Figure 7 The head-mounted display device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0134] like Figure 7 As shown, the head-mounted display device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the head-mounted display device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus.
[0135] Typically, the following systems can be connected to I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. The communication devices allow the head-mounted display device to communicate wirelessly or wiredly with other devices to exchange data. Although head-mounted display devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all of the systems shown. More or fewer systems may be implemented alternatively.
[0136] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.
[0137] The head-mounted display device provided by this invention employs the viewing angle measurement method in the above embodiments, solving the technical problem of poor viewing angle control in head-mounted display devices. Compared with the prior art, the beneficial effects of the head-mounted display device provided by this invention are the same as those of the viewing angle measurement method provided in the above embodiments, and other technical features in this head-mounted display device are the same as those disclosed in the methods of the above embodiments, and will not be repeated here.
[0138] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.
[0139] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
[0140] Example 5
[0141] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, which are used to execute the viewpoint measurement method in the above embodiment.
[0142] The computer-readable storage medium provided in this embodiment of the invention may be, for example, a USB flash drive, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0143] The aforementioned computer-readable storage medium may be included in the head-mounted display device; or it may exist independently and not assembled into the head-mounted display device.
[0144] The aforementioned computer-readable storage medium carries one or more programs that, when executed by a head-mounted display device, cause the head-mounted display device to: after the viewing angle measurement system is calibrated, acquire a virtual imaging point from which the viewing angle simulator reflects the measurement light emitted by the light simulator through the optical axis channel to the rendering center; determine, based on the virtual imaging point, a virtual imaging image of the target to be rendered rendered by the rendering center; and measure the target viewing angle simulated by the viewing angle simulator based on the size parameters of the virtual imaging image, wherein the target viewing angle refers to the offset viewing angle of the target to be rendered observed through the viewing angle simulator.
[0145] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, and conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0146] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0147] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.
[0148] The computer-readable storage medium provided by this invention stores computer-readable program instructions for executing the above-described viewing angle measurement method, thus solving the technical problem of poor viewing angle control for head-mounted display devices. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this invention are the same as those of the viewing angle measurement method provided in the above-described embodiments, and will not be repeated here.
[0149] Example 6
[0150] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the viewpoint measurement method described above.
[0151] The computer program product provided in this application solves the technical problem of poor viewing angle control for head-mounted display devices. Compared with the prior art, the beneficial effects of the computer program product provided in this embodiment are the same as those of the viewing angle measurement method provided in the above embodiments, and will not be repeated here.
[0152] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.
Claims
1. A method for measuring viewing angle, characterized in that, An application is made in a viewpoint measurement system, which includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is provided with a target to be rendered and a light axis channel. The viewpoint measurement method includes: After the view measurement system is calibrated, the view simulator will reflect the measurement light emitted by the light simulator to the virtual imaging point of the rendering center via the optical axis channel. Based on the virtual imaging points, determine the virtual imaging image of the target to be rendered through the rendering center; Based on the size parameters of the virtual imaging image, the target perspective simulated by the perspective simulator is measured, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
2. The viewing angle measurement method as described in claim 1, characterized in that, The step of measuring the target perspective simulated by the perspective simulator based on the size parameters of the virtual imaging image includes: Obtain the axial and longitudinal field of view angles of the target to be rendered by observing it through the view simulator in the preset coordinate system; Based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen, calculate the axial offset view and the longitudinal offset view of the target to be rendered observed through the view simulator. The target viewpoint simulated by the viewpoint simulator is determined by fusing the axial offset viewpoint and the longitudinal offset viewpoint.
3. The viewing angle measurement method as described in claim 2, characterized in that, The step of calculating the axial offset view and the longitudinal offset view of the target to be rendered observed through the view simulator based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging image includes: Based on the axial field of view, the longitudinal field of view, and the size parameters of the virtual imaging screen, calculate the first measurement distance between the target to be rendered and the view simulator; The second measurement distance between the perspective simulator and the virtual imaging screen is decomposed into the axial measurement distance and the longitudinal measurement distance in the preset coordinate system; The axial offset angle is calculated based on the axial measurement distance and the first measurement distance, and the longitudinal offset angle is calculated based on the longitudinal measurement distance and the first measurement distance.
4. The viewing angle measurement method as described in claim 2, characterized in that, The step of fusing the axial offset view and the longitudinal offset view to determine the target view simulated by the view simulator includes: Obtain the calibrated angle obtained by the angle measurement system; By fusing the axial offset view and the longitudinal offset view, the actual view of the target to be rendered observed through the view simulator is obtained; The target viewpoint simulated by the viewpoint simulator is obtained by subtracting the actual viewpoint from the calibrated viewpoint.
5. The viewing angle measurement method as described in claim 2, characterized in that, Before the step of obtaining the virtual imaging point of the rendering center by reflecting the measurement light emitted by the ray simulator through the optical axis channel to the rendering center by the view simulator, the view measurement method further includes: Obtain the first calibration imaging point of the calibration light emitted by the light simulator to the viewpoint simulator via the optical axis channel; Based on the first calibration imaging point, determine whether the light simulator needs to be calibrated; If the ray simulator needs to be calibrated, the first pose of the view simulator is adjusted, and after adjustment, the process returns to the following step: obtain the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator via the optical axis channel; If the light simulator does not need to be calibrated, then obtain the second calibration imaging point formed by the reflection of the calibration light through the optical axis channel by the view simulator, and detect whether the view simulator needs to be calibrated based on the second calibration imaging point. If the view simulator needs to be calibrated, the second pose of the view simulator is adjusted, and after adjustment, the process returns to the following step: obtaining the second calibration imaging point formed by the view simulator reflecting the calibration light through the optical axis channel; If the view simulator does not need to be calibrated, then the view measurement system calibration is complete.
6. The viewing angle measurement method as described in claim 5, characterized in that, The step of adjusting the first pose of the view simulator includes: Obtain the first pixel value and the second pixel value of the first calibration imaging point; The adjustment direction of the view simulator is determined based on the pixel difference between the first pixel value and the second pixel value; Adjust the first pose of the view simulator according to the adjustment direction.
7. The viewing angle measurement method as described in claim 5, characterized in that, The viewpoint measurement system further includes target contouring, wherein the target contouring is the contouring of the target to be rendered, and the viewpoint measurement method further includes: When the target contour is detected to be set on the fixture to be rendered, the following steps are performed: obtain the first calibration imaging point of the calibration ray emitted by the ray simulator to the view simulator through the optical axis channel, until neither the ray simulator nor the view simulator needs to perform pose adjustment; Detect whether the target to be rendered has replaced the target morphology; If so, then the angle measurement system calibration is complete; If not, control the target to be rendered to replace the target morphology, and return to the execution step: detect whether the target to be rendered has replaced the target morphology.
8. A viewing angle measurement system, characterized in that, The viewpoint measurement system includes a ray simulator, a viewpoint simulator, a fixture to be rendered, and a rendering center. The fixture to be rendered is equipped with a target to be rendered and a light axis channel. The viewpoint measurement system also includes an acquisition module, a determination module, and a measurement module. The acquisition module is used to acquire the virtual imaging point of the rendering center by the viewpoint simulator reflecting the measurement light emitted by the light simulator through the optical axis channel after the viewpoint measurement system is calibrated. The determining module is used to determine, based on the virtual imaging points, the virtual imaging image rendered by the rendering center of the target to be rendered; The measurement module is used to measure the target perspective simulated by the perspective simulator according to the size parameters of the virtual imaging screen, wherein the target perspective refers to the offset perspective of the target to be rendered observed through the perspective simulator.
9. A head-mounted display device, characterized in that, The head-mounted display device includes: At least one processor; A memory that is communicatively connected to the at least one processor; The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the steps of the viewpoint measurement method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program for implementing the viewpoint measurement method, which is executed by a processor to implement the steps of the viewpoint measurement method as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Wavefront aberration measuring apparatus
US20040174533A1
Plenoptic camera measurement and calibration of head-mounted displays
US20230221560A1