Virtual reality display method and device for wide field of view

Abstract

The present invention relates to the technical field of information interaction. Disclosed are a virtual reality display method and device for a wide field of view. The virtual reality display method for a wide field of view specifically comprises the following steps: acquiring an included angle between a central axis of the eyes of a target object and a horizontal line; on the basis of the included angle between the central axis of the eyes of the target object and the horizontal line, adjusting an included angle between a flexible display screen that is bent into a semi-cylindrical shape and a visual center of the eyes of the target object; and acquiring motion parameters of the target object that are collected by means of an attitude sensor, and projecting picture information to the flexible display screen on the basis of the motion parameters of the target object and by means of a cylindrical central projection method, so as to realize picture display. Therefore, the computational load during the display of VR helmet pictures of a small animal is reduced, thereby improving the smoothness of the pictures.

Description

Virtual reality display method and device for wide field of view Technical Field

[0001] The present invention relates to the field of information interaction technology, and in particular to a virtual reality display method and device for a wide field of view. Background Art

[0002] Virtual Reality (VR) is a computer-generated simulated environment that allows users to interact with the virtual environment and experience an immersive experience. To achieve this experience, people use VR helmets as key equipment for immersive VR experiences. VR helmets typically consist of a display, sensors, optical lenses, audio equipment, and controllers. VR helmets present images of the virtual world to the user through the display, and sensors can track the user's head movement, allowing the user to change their perspective in the virtual environment. Optical lenses are used to magnify the image on the display and project it into the user's eyes to create a realistic virtual scene. Audio equipment provides immersive audio effects, allowing users to hear sounds from the virtual environment.

[0003] In order to fully understand the biological mechanisms from macroscopic behavior to molecular and cellular levels, many invasive techniques are required, which are not suitable for direct research on humans. Therefore, small animal experiments are indispensable.

[0004] However, human-grade VR equipment cannot be directly used on small animals for three reasons: 1. Weight: Human VR equipment weighs approximately 1.5-2.5 kg, while experimental mice weigh 20-30 g and rats 160-400 g, making it difficult to bear the weight of human VR equipment. 2. Visual structure: Humans are horizontally oriented, looking forward, while small animals are lateral-eyed, looking to the sides. Small animals have a very large field of view, reaching 230° horizontally and 80° up + 30° down = 110° vertically, far exceeding that of humans. If the virtual environment image does not cover the entire field of view, the sense of immersion is poor, which means it is easy to "break the experience," affecting the effectiveness of the experiment. 3. Head coverage: Human eyes are forward-facing, with a slightly smaller field of view and a smaller viewing screen. Furthermore, the human head is relatively large, so even when wearing VR equipment, a large part of the head is still exposed, allowing for techniques such as EEG monitoring. Small animals are naturally short, with their eyes facing diagonally upwards, and a very large field of view, requiring a larger viewing screen, which obscures the animal's head. But in addition to using VR itself in scientific research, many technologies are also needed to intervene and detect the brain at the same time.

[0005] To address these technical issues, people use 3-6 large flat screens or a single spherical screen to surround the animal to simulate reality. However, using 3-6 large flat screens or a single spherical screen to surround the animal requires extensive computation to correct spatial image distortion. VR is interactive, meaning the image must adapt to the viewer's behavior. This requires real-time image generation. Any image lag not only affects viewing experience and interaction, but can also cause nausea and vomiting.

[0006] Therefore, how to reduce the amount of calculation when displaying the VR helmet images of small animals to improve the smoothness of the images has become a technical problem that needs to be solved urgently.

[0007] Summary of the Invention

[0008] The main purpose of the present invention is to provide a virtual reality display method and device for a wide field of view, aiming to reduce the amount of calculation when displaying VR helmet images of small animals to improve the smoothness of the image.

[0009] To achieve the above object, the present invention proposes a virtual reality display method for a wide field of view, comprising the following steps:

[0010] Obtain the angle between the target object's eye center axis and the horizontal;

[0011] Adjusting the angle between the flexible display screen bent into a semi-cylindrical shape and the visual center of the target object's eye according to the angle between the target object's eye center axis and the horizontal;

[0012] The target object motion parameters collected by the posture sensor are obtained, and image information is projected onto the flexible display screen through the cylinder center projection method according to the target object motion parameters to realize image display.

[0013] In one embodiment of the present application, projecting image information onto the flexible display screen by using a cylindrical center projection method according to the target object motion parameters includes the following steps:

[0014] Separate the scenery, shadows, and reflection normals in the image;

[0015] According to the Mercator cylinder center projection formula, the original projection matrices of the scene, shadow, and reflection normal are modified respectively;

[0016] Using the modified projection matrix, the scene, shadows, and reflection normals are mapped onto the flexible display curved into a semi-cylindrical shape.

[0017] In one embodiment of the present application, the angle is 90 degrees.

[0018] In one embodiment of the present application, before projecting the image information onto the flexible display screen by the cylinder center projection method according to the target object motion parameters, visual frustum culling is also included.

[0019] In one embodiment of the present application, when performing vertebral body removal, the following steps are included:

[0020] The visual cone at the fixed position corresponding to the target moves backward by a predetermined distance;

[0021] Perform frustum culling operations;

[0022] After the visual frustum is eliminated, the visual frustum is moved to its original fixed position.

[0023] The present application also discloses a virtual reality display device, comprising:

[0024] A flexible display screen, wherein the working surface of the display screen is curved toward the eyes of the target subject and covers the field of view of the eyes of the target subject;

[0025] A posture sensor, used to collect the motion posture of the target object;

[0026] an image display circuit board connected to the flexible display screen via wires; and

[0027] The graphic workstation obtains the posture parameters collected by the posture sensor and outputs image information to the image display circuit board using the Mercator cylinder center projection formula according to the posture parameters.

[0028] In one embodiment of the present application, it further includes:

[0029] A holder is provided on the head of the target object, and the flexible display screen is on the holder.

[0030] In one embodiment of the present application, the central angle corresponding to the curved surface of the display screen is between 230° and 300°.

[0031] In one embodiment of the present application, the posture sensor includes a six-axis accelerometer.

[0032] In one embodiment of the present application, a motion analysis circuit board is further included, which is connected between the posture sensor and the graphics workstation and is used to convert the electrical signal collected by the posture sensor into a USB signal.

[0033] By adopting the above technical solution, the display content can accurately adapt to the visual needs of the target object based on the target object's eye visual center and posture sensor data. The cylindrical flexible display screen provides a wider visual range, allowing the target object to obtain more image information and enhance the user experience. Based on the real-time update of the posture sensor data, the flexible display screen can adjust the projected image in real time according to the movement changes of the target object, maintain visual consistency with the target object, and realize instant image display. By projecting image information onto the flexible display screen through the cylindrical center projection method, the amount of calculation when the VR helmet image is displayed on the small animal is effectively reduced to improve the smoothness of the image. The process is simple and easy to implement. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The present invention will be described in detail below with reference to specific embodiments and accompanying drawings, wherein:

[0035] FIG1 is a schematic diagram of the flow structure of a virtual reality display method for a wide field of view according to the present invention;

[0036] FIG2 is a schematic structural diagram of a first embodiment of the present invention;

[0037] 10. Flexible display screen; 20. Gesture sensor; 30. Image display circuit board; 40. Conductive slip ring; 50. Graphics workstation; 60. Motion analysis circuit board. DETAILED DESCRIPTION

[0038] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention is described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the following specific embodiments are only used to explain the present invention and do not constitute a limitation of the present invention.

[0039] As shown in FIG1 and FIG2, in order to achieve the above-mentioned object, the present invention proposes a virtual reality display method for a wide field of view, comprising the following steps:

[0040] Obtain the angle between the target object's eye center axis and the horizontal;

[0041] Adjust the angle between the flexible display screen 10 bent into a semi-cylindrical shape and the visual center of the target object's eye according to the angle between the target object's eye center axis and the horizontal;

[0042] The target object motion parameters collected by the posture sensor 20 are acquired, and image information is projected onto the flexible display screen 10 through a cylinder center projection method according to the target object motion parameters to realize image display.

[0043] Specifically, the angle between the target object's eye center axis and the horizontal direction is obtained through manual measurement or other eye movement instruments.

[0044] Based on the measured angle between the target subject's eye center and the horizontal plane, the curved flexible display 10 is adjusted to align with the target subject's eye visual center, ensuring the display is within the target subject's visual range. For example, if the target subject is a mouse, the angle between the mouse's eye center and the horizontal plane is 30 degrees. In this case, the angle between the extension direction of the flexible display 10 and the horizontal plane is 60 degrees. This ensures that the flexible display 10 is within the mouse's visual range.

[0045] The motion parameters of the target object, including rotation angle, acceleration, etc., are acquired using a posture sensor 20 (such as a gyroscope, an accelerometer, etc.).

[0046] Utilizing data from the target object's posture sensor 20 and the cylindrical flexible display 10, the desired image information is projected onto the flexible display 10 through projection from the center of the cylinder. Based on the target object's motion, the projection position and angle are calculated to ensure the image information is correctly displayed on the flexible display 10.

[0047] By adopting the above technical solution, the display content can accurately adapt to the visual needs of the target object according to the data of the target object's eye visual center and the posture sensor 20. The cylindrical flexible display screen 10 provides a wider visual range, allowing the target object to obtain more picture information and enhance the user experience. Based on the real-time update of the posture sensor 20 data, the flexible display screen 10 can adjust the projected picture in real time according to the movement changes of the target object, maintain visual consistency with the target object, and realize instant picture display. By projecting picture information onto the flexible display screen 10 through the cylindrical center projection method, the amount of calculation when the VR helmet picture of the small animal is displayed is effectively reduced to improve the smoothness of the picture. The process is simple and easy to implement.

[0048] In one embodiment of the present application, projecting image information onto the flexible display screen 10 using a cylindrical center projection method according to the target object motion parameters includes the following steps:

[0049] Separate the scenery, shadows, and reflection normals in the image;

[0050] According to the Mercator cylinder center projection formula, the original projection matrices of the scene, shadow, and reflection normal are modified respectively;

[0051] The modified projection matrix is ​​used to map the scene, shadows, and reflection normals onto the flexible display screen 10 that is bent into a semi-cylindrical shape.

[0052] Specifically, the original image is first processed to separate the scene, shadows, and reflection normals. This can be achieved through image processing algorithms and computer vision techniques, such as segmentation algorithms based on color, texture, or depth information.

[0053] Based on the Mercator cylindrical center projection formula, the original projection matrix is ​​modified for each separated part (scenery, shadow, and reflection normal). These modifications include adjusting the projection angle, position, scale, or other transformation operations to ensure that they are correctly mapped onto the flexible display screen 10 curved into a semi-cylindrical shape.

[0054] Using the modified projection matrix, the separated scenes, shadows, and reflection normals are mapped onto the semi-cylindrical flexible display screen 10. This can be achieved through graphics rendering technology, where each separated part is projected onto a corresponding position on the flexible display screen 10 to display the image.

[0055] By using the above technical solution, by separating different parts of the image and modifying the projection matrix for each part according to the Mercator projection formula, customized display of different parts can be achieved, enhancing the visual effect. Mapping the separated scenery, shadows, and reflection normals onto the flexible display 10, which is curved into a semi-cylindrical shape, can fully utilize the shape of the display and provide a more realistic and immersive visual experience. Modifying the projection matrix to take into account the shape of the curved display can reduce distortion during the projection process, making the scenery, shadows, and reflection normals mapped onto the flexible display 10 more accurate and realistic.

[0056] In one embodiment of the present application, the angle is 90 degrees.

[0057] Specifically, by adjusting the angle between the flexible display screen 10 bent into a semi-cylindrical shape and the visual center of the target object's eyes to 90 degrees, the flexible display screen 10 can cover the target object's eyes with a wide field of view to the maximum extent.

[0058] In one embodiment of the present application, before projecting the image information onto the flexible display screen 10 by the cylindrical center projection method according to the target object motion parameters, visual frustum culling is also included.

[0059] Specifically, during the projection process, a frustum must first be created. This frustum represents the space visible within the target object's eye field of view. The frustum is defined by the target's corresponding eye position, the projection matrix, and the clipping planes.

[0060] Using the frustum culling algorithm, objects in the scene are filtered, retaining only those within the frustum for projection and rendering. This step can effectively reduce the processing and rendering work of invisible objects, improving performance.

[0061] Perform image separation on the visible objects after culling, and separate different parts such as scenery, shadows, and reflection normals from each other for subsequent processing.

[0062] The above technical solution uses the frustum culling algorithm to exclude invisible objects from the scene, reducing the rendering workload and thus improving rendering efficiency. Only visible objects within the frustum are imaged and projected, reducing unnecessary calculations and rendering processes.

[0063] In one embodiment of the present application, when performing vertebral body removal, the following steps are included:

[0064] The visual cone at the fixed position corresponding to the target moves backward by a predetermined distance;

[0065] Perform frustum culling operations;

[0066] After the visual frustum is eliminated, the visual frustum is moved to its original fixed position.

[0067] Specifically, the target object is located at its fixed position, and a viewing frustum (also called a cone) corresponds to the target object. The viewing frustum is a visible volume that determines the part of the scene that needs to be drawn during the rendering process.

[0068] First, the viewing frustum is moved back a certain distance along the viewing direction. This distance is pre-set. The purpose of this is to move the viewing frustum out of the location of the target object, which can reduce the range of the rear viewing frustum to be culled.

[0069] After the frustum culling operation is completed, the frustum is moved back to its original fixed position. This is done to ensure that the frustum still corresponds to the target object during subsequent rendering. At the same time, since the rear view is partially retained, the target object's view is not lost.

[0070] The present application also discloses a virtual reality display device, comprising:

[0071] A flexible display screen 10, wherein the working surface of the display screen is curved toward the eyes of the target subject and covers the field of view of the eyes of the target subject;

[0072] A posture sensor 20 is used to collect the motion posture of the target object;

[0073] An image display circuit board 30 connected to the flexible display screen 10 via wires; and

[0074] The graphic workstation obtains the posture parameters collected by the posture sensor and outputs image information to the image display circuit board using the Mercator cylinder center projection formula according to the posture parameters.

[0075] Specifically, the flexible display 10 is made of a flexible material and can operate in a bent state. The working surface of the display faces the eyes of the target subject and is curved to cover the target subject's field of view. The flexible display 10 is typically made of organic light-emitting diodes (OLEDs) or similar materials, which can be bent without affecting the display effect.

[0076] The posture sensor 20 is used to collect the target object's motion posture. The posture sensor 20 can be an inertial measurement unit (IMU) composed of an accelerometer and a gyroscope. It can detect motion parameters such as rotation, tilt, and acceleration of the target object's head or body.

[0077] The image display circuit board 30 is connected to the flexible display screen 10 and transmits image signals to the flexible display screen 10 via wires. This circuit board is typically made of a printed circuit board (PCB) and is equipped with components such as a driver circuit and a signal processor. It is used to receive image information from the graphics workstation 50 and convert it into a signal suitable for display on the flexible display screen 10.

[0078] The graphics workstation 50 is the control center of the virtual reality display device. It is connected to the posture sensor 20 and the image display circuit board 30. The graphics workstation 50 can be a computer or a dedicated control unit. The graphics workstation 50 obtains the posture parameters collected by the posture sensor 20 and generates corresponding image information based on these parameters. The graphics workstation 50 then sends the image information to the image display circuit board 30 to present the virtual reality scene on the flexible display screen 10.

[0079] The posture sensor 20 is connected to the graphics workstation 50 via wires to transmit the collected posture parameters to the graphics workstation 50. The graphics workstation 50 transmits the image information to the image display circuit board 30 via another set of wires. The image display circuit board 30 is directly connected to the flexible display screen 10 and transmits the image signal to the flexible display screen 10 via the driver circuit on the circuit board.

[0080] By adopting the above technical solution, the curved shape of the flexible display screen 10 can cover the field of view of the target object's eyes, making the displayed image closer to the real scene. Combined with the Mercator cylinder center projection formula, it can greatly reduce the rendering burden of the graphics workstation 50. The posture sensor 20 can capture the movement posture of the target object in real time, so that the virtual reality scene can interact and respond according to the movement of the target object.

[0081] In one embodiment of the present application, it further includes:

[0082] A holder is provided on the head of the target object, and the flexible display screen 10 is on the holder.

[0083] Specifically, the target subject of this application can be a mouse, rabbit, or the like. The fixator is a device placed on the target subject's head to stably secure the virtual reality device to the target subject's head. It is a pin that can be surgically inserted into the target subject's skull to secure the fixator.

[0084] In one embodiment of the present application, the central angle corresponding to the curved surface of the display screen is between 230° and 300°.

[0085] Specifically, setting the center angle between 230° and 300° can expand the display's field of view. This allows the display to provide more environmental awareness information. The target subject in the VR scene can more comprehensively perceive the surrounding environment, including the position and movement of scenery, dynamic elements, and other objects, thereby enhancing immersion and interactive experience.

[0086] In one embodiment of the present application, the posture sensor 20 is a six-axis accelerometer.

[0087] Specifically, a six-axis accelerometer is a sensor that can measure the acceleration and angular changes of an object in three spatial dimensions. It is typically composed of a three-axis accelerometer and a three-axis gyroscope. The accelerometer is used to measure the object's linear acceleration, while the gyroscope is used to measure the object's angular velocity and angular changes.

[0088] Using this technical solution, the six-axis accelerometer combines the measurement capabilities of an accelerometer and a gyroscope, providing more precise and accurate posture parameters, including linear acceleration, angular velocity, and angle change. This allows the graphics workstation 50 to more accurately output a graphic corresponding to the target object's position, improving the accuracy of the experiment.

[0089] In one embodiment of the present application, a motion analysis circuit board 60 is further included, which is connected between the posture sensor 20 and the graphics workstation 50 and is used to convert the electrical signal collected by the posture sensor 20 into a USB signal.

[0090] In one embodiment of the present application, it further includes:

[0091] The conductive slip ring 40 is connected to the posture sensor 20 and the flexible display screen 10 through a wire. The other end of the conductive slip ring 40 is connected to the graphic workstation 50 .

[0092] Specifically, the conductive slip ring 40 is a ring-shaped device used to transmit electrical signals between the attitude sensor 20 and the flexible display 10. The attitude sensor 20 and the flexible display 10 are both connected to the conductive slip ring 40 via wires, and the other end of the conductive slip ring 40 is connected to the graphics workstation 50.

[0093] The conductive slip ring 40 acts as an interface for electrical signal transmission, allowing the wires of the gesture sensor 20 and the flexible display 10 to be transmitted through the rotating ring structure without causing the wires to become tangled or broken. It provides a reliable electrical connection, enabling the gesture sensor 20 and the flexible display 10 to exchange data with the graphics workstation 50.

[0094] The gesture sensor 20 and the flexible display 10 are each connected to a conductive slip ring 40 via wires. The other end of the conductive slip ring 40 is connected to a graphics workstation 50. The gesture sensor 20 transmits the acquired gesture parameters to the conductive slip ring 40 via wires. The conductive slip ring 40 transmits the gesture parameters to the graphics workstation 50, which then transmits the video signal to the flexible display 10 via the conductive slip ring 40. The rotation of the conductive slip ring 40 allows the gesture sensor 20 and the flexible display 10 to remain connected even when the target object moves, without the risk of wire entanglement or strain.

[0095] With this technical solution, the rotating structure of the conductive slip ring 40 prevents wires from becoming entangled when the target object moves, ensuring stable and continuous signal transmission. The presence of the conductive slip ring 40 enables the gesture sensor 20 and flexible display 10 to move and rotate relatively freely, providing greater flexibility and freedom, and enhancing the target object's virtual reality experience. By integrating wire transmission functionality, the conductive slip ring 40 simplifies the device wiring process, reduces wire clutter, and improves device reliability and ease of use.

[0096] The above description is only a preferred embodiment of the present invention and does not limit the patent scope of the present invention. All equivalent structural transformations made by using the contents of the present invention description and drawings under the inventive concept of the present invention, or direct / indirect application in other related technical fields are included in the patent protection scope of the present invention.

Claims

1. A virtual reality display method for a wide field of view, characterized in that: The following steps are involved: Obtain the angle between the target object's eye center axis and the horizontal plane; According to the angle between the central axis of the eye of the target object and the horizontal, adjusting the angle between the flexible display screen bent into a semi-cylindrical shape and the visual center of the eye of the target object; The motion parameters of the target object collected by the posture sensor are obtained, and according to the motion parameters of the target object, the picture information is projected onto the flexible display screen through the cylinder center projection method to realize picture display.

2. The virtual reality display method for wide field of view according to claim 1, characterized in that: Projecting picture information onto the flexible display screen by a cylindrical center projection method according to the target object motion parameters comprises the following steps: Separate the scenery, shadows, and reflection normals in the image; According to the Mercator cylinder center projection formula, the original projection matrices of the scene, shadow, and reflection normal are modified respectively; Using the modified projection matrix, the scene, shadows, and reflection normals are mapped onto the flexible display that is bent into a semi-cylindrical shape.

3. The virtual reality display method for wide field of view according to claim 1, characterized in that: The angle is 90 degrees.

4. The virtual reality display method for wide field of view according to claim 1, characterized in that: Before projecting the picture information onto the flexible display screen by the cylinder center projection method according to the target object motion parameters, visual frustum culling is also included.

5. The virtual reality display method for wide field of view according to claim 3, characterized in that: When performing vertebral removal, the following steps are included: The visual cone at the fixed position corresponding to the target moves backward by a predetermined distance; Perform frustum culling operations; After the visual frustum is removed, the visual frustum is moved to the original fixed position.

6. A virtual reality display device, characterized in that: include: A flexible display screen, wherein the working surface of the display screen is curved toward the eyes of the target object and covers the The visual field of the target object's eyes; A posture sensor, used for collecting the motion posture of the target object; An image display circuit board connected to the flexible display screen via wires; and The graphic workstation obtains the posture parameters collected by the posture sensor, and outputs image information to the image display circuit board using the Mercator cylinder center projection formula according to the posture parameters.

7. The virtual reality display device according to claim 6, characterized in that: Also includes: A fixture is arranged on the head of the target object, and the flexible display screen is fixed on the fixture.

8. The virtual reality display device according to claim 6, characterized in that: The central angle corresponding to the curved surface of the display screen is between 230° and 300°.

9. The virtual reality display device according to claim 6, characterized in that: The attitude sensor includes a six-axis accelerometer.

10. The virtual reality display device according to claim 6, characterized in that: It also includes a motion analysis circuit board, which is connected between the posture sensor and the graphic workstation and is used for converting the electrical signal collected by the posture sensor into a USB signal.

Images