MR head display system with medium-high-definition perspective camera

Abstract

The utility model relates to an MR head display system with a medium-high definition perspective camera. The MR head display system comprises an RGB binocular image sensor, a flexible board, a TOF camera, a signal processing board and a 3D image video stream display module. The 3D image video stream display module comprises a binocular OLED (Organic Light Emitting Diode) display screen and two RGB (Red, Green and Blue) camera mainboards; the display screen is electrically connected with the RGB camera mainboards; the two RGB camera mainboards are connected with the signal processing board through the flexible board and transmit shot video information of a real scene to the signal processing board; the signal processing board is also connected with the TOF camera and the PC and is used for receiving distance information transmitted by the TOF camera and VR virtual reality images stored in the PC; the signal processing board transmits the generated 3D image video stream to the two RGB camera mainboards through the flexible board; and the two RGB camera mainboards transmit the 3D image video stream to the binocular display screen for display through the video interface.

Description

Technical Field

[0001] The utility model relates to the technical field of MR mixed reality, in particular to an MR head-mounted display system with a medium-high definition perspective camera. Background Art

[0002] For half a century, VR virtual reality technology has been very mature in the fields of entertainment, education, medicine, and technology. People can view various virtual scenes through VR video displays. However, people are gradually dissatisfied with the pure virtual scenes of VR and also hope to develop more applications by combining real scenes. MR mixed reality technology has also entered people's production and life.

[0003] Most of the existing MR mixed reality head-mounted display systems need to redesign the original VR helmets, wasting a lot of manpower, material resources, and financial resources. Content of the Utility Model

[0004] In view of the above analysis, the utility model aims to provide an MR head-mounted display with a medium-high definition perspective camera to solve the problem that most of the existing MR mixed reality head-mounted display systems need to redesign the original VR helmets.

[0005] The purpose of the utility model is mainly achieved through the following technical solutions:

[0006] An MR head-mounted display system with a medium-high definition perspective camera, the MR head-mounted display system includes an RGB binocular image sensor, an FPC flexible board, a TOF camera, a signal processing board, and a 3D image video stream display module; the 3D image video stream display module includes a binocular OLED display screen and two RGB camera main boards, and the OLED display screen is electrically connected to the RGB camera main boards; the two RGB camera main boards are connected to the signal processing board through the FPC flexible board to transmit the video information of the captured real scene to the signal processing board; the signal processing board is also connected to the TOF camera and a PC, and is used to receive the distance information transmitted by the TOF camera and the VR virtual reality images stored in the PC; the signal processing board transmits the generated 3D image video stream to the two RGB camera main boards through the FPC flexible board; the two RGB camera main boards transmit the 3D image video stream to the binocular OLED display screen through a video interface for display.

[0007] Further, the head-mounted display system further includes a housing; the housing includes a head-mounted display mask and a helmet; the front part of the helmet is connected to the upper part of the head-mounted display mask by screws; both the helmet and the head-mounted display mask are of a double-layer structure.

[0008] Further, the head-mounted display system further includes an eye-tracking module; the eye-tracking module includes a servo motor and an adapter; the servo motor is located inside the double-layer structure of the helmet; the servo motor is connected to the TOF camera through the adapter; a part of the adapter protrudes from the upper surface of the helmet and is fixedly connected to the TOF camera, and the TOF camera is located directly above the helmet.

[0009] Further, the outer surface of the head-mounted display mask is provided with first and second through holes; the RGB binocular image sensor passes through the first and second through holes and exposes outside the head-mounted display mask; the 3D image video stream display module further includes binocular barrels and lenses; the binocular OLED display screen and the lens are arranged in the binocular barrels, the OLED display screen is located inside the barrels and is mounted on the RGB camera main board, and the lens is arranged on the side close to the human face; the inner surface of the head-mounted display mask is provided with third and fourth through holes; the binocular barrels pass through the third and fourth through holes, and the image on the OLED display screen is displayed through the lenses in the binocular barrels.

[0010] Further, the MR head-mounted display system further includes a signal transfer board; the signal transfer board and two RGB camera main boards are fixed on the inner wall of the outer layer of the head-mounted display mask by screws; the signal processing board is fixed on the inner wall of the outer layer of the helmet by screws; the FPC flexible board includes a first FPC flexible board and a second FPC flexible board; both sides of the signal transfer board are respectively connected to one side of the first FPC flexible board and the second FPC flexible board, and the other sides of the first FPC flexible board and the second FPC flexible board are respectively connected to an RGB camera main board; the signal transfer board is located directly below the signal processing board.

[0011] Further, both the first FPC flexible board and the second FPC flexible board include a first connector and a second connector; third connectors are arranged on both RGB camera main boards; the first connectors of the two FPC flexible boards are respectively connected to the third connectors of their corresponding RGB camera main boards;

[0012] The signal transfer board includes a fifth connector, a sixth connector, and a seventh connector;

[0013] The second connectors on the first FPC flexible board and the second FPC flexible board are respectively connected to the fifth connector and the sixth connector of the signal transfer board; the seventh connector of the signal transfer board is connected to the signal processing board;

[0014] Fourth connectors and eighth connectors are arranged on both RGB camera main boards. The fourth connector includes an I 2 C interface, an RS422 serial port, a MIPI interface, a data IO interface, and a power interface; the fourth connector is connected to the binocular OLED display screen; the eighth connector is connected to the RGB binocular image sensor.

[0015] Further, interface protection and filtering circuits are arranged on both RGB camera main boards;

[0016] The interface protection and filtering circuit includes multiple ESD diodes and filtering capacitors; the anodes of the multiple ESD diodes are grounded, and the cathodes are connected to the signal pins of the third connector; one end of the filtering capacitor is connected to the power pin of the third connector, and the other end is grounded.

[0017] Furthermore, the signal processing board includes a high-performance VR processor, a power conversion module, and a motor drive chip; the power conversion module is used to supply power to the high-performance VR processor and the motor drive chip; the motor drive chip is externally connected to a servo motor.

[0018] Furthermore, both the signal transfer board and the signal processing board include I 2 C interfaces, RS422 serial ports, MIPI interfaces, data IO interfaces, and power interfaces. The seventh connector of the signal transfer board is connected to the signal processing board through the I 2 C interface, RS422 serial port, MIPI interface, data IO interface, and power interface.

[0019] Furthermore, the head-mounted display mask is made by 3D printing.

[0020] Compared with the prior art, the present utility model can at least achieve one of the following beneficial effects:

[0021] 1. The MR head-mounted display system with a medium-high definition perspective camera of the present utility model includes I 2 C interfaces, RS422 serial ports, MIPI interfaces, data IO interfaces, and power interfaces. The interfaces are rich, and without changing the structure of the original VR system, it can be directly connected to the VR through the seventh connector of the signal transfer board to implement an MR head-mounted display system with a medium-high definition perspective camera.

[0022] 2. The MR head-mounted display system with a medium-high definition perspective camera of the present utility model includes an eye tracking module; the eye tracking module includes a servo motor and a transfer piece; the servo motor is connected to the TOF camera through the transfer piece; as the TOF camera rotates with the spatial angle of the VR display image, a 3D image video that changes with the real space is generated, and the image is more vivid. The present utility model also provides an RGB binocular image sensor, which can see the utensils of the actual operator, facilitating real operation.

[0023] 3. The layout of the signal transfer board, FPC flexible board, and RGB camera main board of the present utility model is reasonable. They are all arranged inside the head-mounted display mask, and the structure is compact; the head-mounted display mask is made by 3D printing and is comfortable to wear.

[0024] 4. Interface protection and filtering circuits are provided on both RGB camera main boards of the present utility model, making the performance of the 3D image video stream display module stable, safe, and reliable.

[0025] 5. The 3D image video stream display module of the present utility model further includes a binocular barrel and a lens; the lens magnifies the 3D image on the OLED display screen by dozens of times to achieve a good viewing effect.

[0026] In the present utility model, the above technical solutions can also be combined with each other to achieve more preferred combination solutions. Other features and advantages of the present utility model will be described in the following content, and some advantages can be made obvious from the description or understood by implementing the present utility model. The purpose and other advantages of the present utility model can be realized and obtained through the content specifically pointed out in the text and the drawings. Brief Description of the Drawings

[0027] The drawings are only for the purpose of showing specific embodiments and are not considered as a limitation of the present utility model. Throughout the drawings, the same reference signs represent the same components.

[0028] Figure 1 Schematic diagram of the installation of the circuit board on the inner wall of the outer layer of the head-mounted display mask of an MR head-mounted display system with a medium-high definition perspective camera;

[0029] Figure 2 Schematic diagram of the outer surface structure of the head-mounted display mask of an MR head-mounted display system with a medium-high definition perspective camera;

[0030] Figure 3 Pin diagram of the seventh connector of an MR head-mounted display system with a medium-high definition perspective camera;

[0031] Figure 4 Pin diagram of the first connector of the first FPC flexible board and the second FPC flexible board of an MR head-mounted display system with a medium-high definition perspective camera;

[0032] Figure 5 Interface protection and filtering circuit diagram on the RGB camera main board of an MR head-mounted display system with a medium-high definition perspective camera.

[0033] Reference Signs:

[0034] 1 - Seventh connector of the signal transfer board;

[0035] 2 - FPC flexible board;

[0036] 3 - RGB camera main board;

[0037] 4 - Fifth connector;

[0038] 5 - Head-mounted display mask;

[0039] 6 - RGB binocular image sensor;

[0040] 7 - Sixth connector. Detailed Description of the Embodiments

[0041] The preferred embodiments of the present invention will be specifically described below with reference to the accompanying drawings. The accompanying drawings form a part of this application and are used together with the embodiments of the present invention to explain the principles of the present invention, rather than to limit the scope of the present invention.

[0042] A specific embodiment of the present invention discloses an MR headset system with a medium-high definition perspective camera, as Figure 1 shown. The MR headset system includes an RGB binocular image sensor, an FPC flexible board, a TOF camera, a signal processing board, and a 3D image video stream display module; the 3D image video stream display module includes a binocular OLED display screen and two RGB camera main boards, and the OLED display screen is electrically connected to the RGB camera main boards; the two RGB camera main boards are connected to the signal processing board through the FPC flexible board to transmit the video information of the captured real scene to the signal processing board; the signal processing board is also connected to the TOF camera and a PC, and is used to receive the distance information transmitted by the TOF camera and the VR virtual reality images stored in the PC; the signal processing board transmits the generated 3D image video stream to the two RGB camera main boards through the FPC flexible board; the two RGB camera main boards transmit the 3D image video stream to the binocular OLED display screen for display through a video interface.

[0043] Specifically, the TOF camera measures the distance between the TOF camera and the real scene in front in the real scene. The RGB binocular image sensor reflects the real scene image, and the virtual image is synthesized with the real scene image (for example, the virtual image and the real scene image are synthesized vertically, or the real scene image is displayed by windowing in the whole image). When wearing the MR headset system to view VR virtual reality, the real scene image can also be seen and corresponding operations can be performed.

[0044] In a specific embodiment of the present invention, when the wearer sees that the VR is a medical surgery scene, a scalpel can also be picked up to perform surgery on the patient in the virtual scene.

[0045] In another specific embodiment of the present invention, when the wearer sees that the VR is a driving scene, the steering wheel in the real scene can be operated for driving.

[0046] The headset system further includes a housing; the housing includes a headset mask and a helmet; the front part of the helmet is connected to the upper part of the headset mask by screws; both the helmet and the headset mask are of a double-layer structure.

[0047] Specifically, the two RGB camera main boards and the FPC flexible board are arranged inside the double-layer structure of the headset mask, and the image receiving window of the RGB binocular image sensor exposes the outer surface of the headset mask to obtain the RGB image of the real scene. The signal processing board is arranged inside the double-layer structure of the helmet.

[0048] The head-mounted display system further includes an eye tracking module; the eye tracking module includes a servo motor and an adapter; the servo motor is located inside the double-layer structure of the helmet; the servo motor is connected to the TOF camera through the adapter; part of the adapter protrudes from the upper surface of the helmet and is fixedly connected to the TOF camera, and the TOF camera is located directly above the helmet.

[0049] Specifically, the eye tracking module can drive the TOF camera to turn according to the shooting angle of the VR image.

[0050] The outer surface of the head-mounted display mask is provided with first and second through holes; the RGB binocular image sensor passes through the first and second through holes and exposes outside the head-mounted display mask; the 3D image video stream display module further includes binocular barrels and lenses; the binocular OLED display screen and the lens are arranged in the binocular barrels, the OLED display screen is located inside the barrel and is mounted on the RGB camera main board, and the lens is arranged on the side close to the human face; the inner surface of the head-mounted display mask is provided with third and fourth through holes; the binocular barrels pass through the third and fourth through holes, and the image on the OLED display screen is displayed through the lens in the binocular barrels.

[0051] As Figure 1 shown, it is a schematic diagram of the internal structure of the head-mounted display mask of the MR head-mounted display system. As Figure 2 shown, it is a schematic diagram of the outer surface of the head-mounted display mask of the MR head-mounted display system.

[0052] Specifically, the binocular OLED display screen in the 3D image video stream display module is arranged at one end of the barrel close to the outer surface of the head-mounted display mask, and the binocular OLED display screen is connected to the RGB camera main board through a fourth connector. The lens is arranged at one end of the barrel close to the inner surface of the head-mounted display mask. The lens magnifies the image of the OLED display screen. In a specific embodiment of the present invention, a magnification effect of dozens of times is achieved through the combination of four optical lenses.

[0053] The MR head-mounted display system further includes a signal transfer board; the signal transfer board and two RGB camera main boards are fixed on the inner wall of the outer layer of the head-mounted display mask by screws; the signal processing board is fixed on the inner wall of the outer layer of the helmet by screws; the FPC flexible board includes a first FPC flexible board and a second FPC flexible board; both sides of the signal transfer board are respectively connected to one side of the first FPC flexible board and the second FPC flexible board, and the other sides of the first FPC flexible board and the second FPC flexible board are respectively connected to an RGB camera main board; the signal transfer board is located directly below the signal processing board.

[0054] Both the first FPC flexible board and the second FPC flexible board include a first connector and a second connector; third connectors are arranged on both RGB camera main boards; the first connectors of the two FPC flexible boards are respectively connected to the third connectors of their corresponding RGB camera main boards;

[0055] The signal transfer board includes a fifth connector, a sixth connector, and a seventh connector;

[0056] The second connectors on the first FPC flexible board and the second FPC flexible board are respectively connected to the fifth connector and the sixth connector of the signal transfer board; the seventh connector of the signal transfer board is connected to the signal processing board;

[0057] Both of the two RGB camera main boards are provided with a fourth connector and an eighth connector. The fourth connector includes an 2 I2C interface, an RS422 serial port, a MIPI interface, a data IO interface, and a power interface; the fourth connector is connected to the binocular OLED display screen; the eighth connector is connected to the RGB binocular image sensor.

[0058] The pin diagram of each pin of the seventh connector is as Figure 3 shown.

[0059] The pin diagram of each pin of the first connector on the first FPC flexible board and the second FPC flexible board is as Figure 4 shown.

[0060] Both the signal transfer board and the signal processing board include an 2 I2C interface, an RS422 serial port, a MIPI interface, a data IO interface, and a power interface. The seventh connector of the signal transfer board is connected to the signal processing board through an 2 I2C interface, an RS422 serial port, a MIPI interface, a data IO interface, and a power interface.

[0061] Specifically, the MIPI interface uses differential signals to transmit the images of the RGB image sensor. The power interface can supply power to the binocular OLED display screen, the RGB image sensor, the two RGB camera main boards, the first FPC flexible board, the second FPC flexible board, and the signal transfer board. The 2 I2C interface and the RS422 serial port can transmit the configuration information of the binocular OLED display screen, such as brightness and contrast. The data IO interface is used to transmit the field synchronization, clock signal, and line synchronization information of the binocular OLED display screen.

[0062] Both of the two RGB camera main boards are provided with an interface protection and filtering circuit;

[0063] The interface protection and filtering circuit includes a plurality of ESD diodes and filtering capacitors; the anodes of the plurality of ESD diodes are grounded, and the cathodes are connected to each signal pin of the third connector; one end of the filtering capacitor is connected to the power pin of the third connector, and the other end is grounded.

[0064] As Figure 5 shown is the interface protection and filtering circuit provided on the RGB camera main board.

[0065] Specifically, the filtering circuit can filter out interference and ensure the accuracy and stability of the signal transmission process; in the interface protection, the ESD diode can prevent damage to the OLED display screen and the circuit board caused by static electricity.

[0066] The signal processing board includes a high-performance VR processor, a power conversion module, and a motor drive chip; the power conversion module is used to supply power to the high-performance VR processor and the motor drive chip; the motor drive chip is externally connected to the servo motor.

[0067] Specifically, the high-performance VR processor can synthesize the distance information transmitted by the RGB binocular image sensor and the TOF camera, as well as the VR virtual reality images stored in the PC.

[0068] The head-mounted display mask is made by 3D printing.

[0069] Specifically, making the head-mounted display mask by 3D printing can make the mask conform to the wearer's facial features, making the wearer feel comfortable.

[0070] Compared with the prior art, the MR head-mounted display system with a medium-high definition perspective camera provided in this embodiment includes an I 2 C interface, an RS422 serial port, a MIPI interface, a data IO interface, and a power interface. The interfaces are rich, and without changing the structure of the original VR system, it can be directly connected to the VR through the seventh connector of the signal transfer board to implement the MR head-mounted display system with a medium-high definition perspective camera. The MR head-mounted display system with a medium-high definition perspective camera provided in this embodiment includes an eye tracking module; the eye tracking module includes a servo motor and an adapter; the servo motor is connected to the TOF camera through the adapter; as the TOF camera rotates with the spatial angle of the VR display image, a 3D image video that changes with the real space is generated, and the image is more realistic. The present utility model also sets an RGB binocular image sensor, which can see the utensils of the actual operator, facilitating real-world operations. The signal transfer board, FPC flexible board, and RGB camera main board provided in this embodiment are reasonably arranged and are all arranged inside the head-mounted display mask, with a compact structure; the head-mounted display mask is made by 3D printing and is comfortable to wear. Interface protection and filtering circuits are provided on both of the two RGB camera main boards provided in this embodiment, making the 3D image video stream display module stable in performance, safe and reliable. The 3D image video stream display module provided in this embodiment also includes binocular barrels and lenses; the lenses magnify the 3D images on the OLED display screen by dozens of times, achieving a good viewing effect.

[0071] Those skilled in the art can understand that the programs / software involved in the head-mounted display system in the above embodiments are common methods in the prior art, and the present utility model does not involve any improvements in software. The present utility model only needs to connect the devices with corresponding functions through the connection relationships given in the embodiments of the present utility model, and does not involve any improvements in program software. As for the connection methods between the hardware devices with corresponding functions, those skilled in the art can all implement them using the prior art and will not be elaborated here.

[0072] The above are only the preferred specific embodiments of the present utility model, but the protection scope of the present utility model is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present utility model should be covered within the protection scope of the present utility model.

Claims

1. A MR head-mounted display system with a medium- and high-definition perspective camera, characterized in that: The MR head display system includes an RGB binocular image sensor, an FPC flexible board, a TOF camera, a signal processing board, and a 3D image video stream display module; The 3D image video stream display module includes a binocular OLED display screen and two RGB camera main boards, wherein the OLED display screen is electrically connected to the RGB camera main board; The two RGB camera main boards are connected to the signal processing board through the FPC flexible board to transmit the video information of the real scene to the signal processing board; The signal processing board is also connected to the TOF camera and the PC to receive the distance information transmitted by the TOF camera and the VR virtual reality image stored in the PC. The signal processing board transmits the generated 3D image video stream to the two RGB camera main boards through the FPC flexible board. The two RGB camera main boards transmit the 3D image video stream to the binocular OLED display screen for display through the video interface.

2. The MR head display system according to claim 1, characterized in that: The head-mounted display system also includes a shell; the shell includes a head-mounted display mask and a helmet; the front of the helmet is connected to the upper part of the head-mounted display mask by screws; the helmet and the head-mounted display mask are both double-layer structures.

3. The MR head display system according to claim 2, characterized in that: The head display system also includes an eye tracking module; the eye tracking module includes a servo motor and an adapter; the servo motor is located inside the double-layer structure of the helmet; the servo motor is connected to the TOF camera through an adapter; a portion of the adapter leaks out of the upper surface of the helmet and is fixedly connected to the TOF camera, and the TOF camera is located directly above the helmet.

4. The MR head-mounted display system according to claim 2, characterized in that: The outer surface of the head display mask is provided with a first through hole and a second through hole; the RGB binocular image sensor passes through the first through hole and is exposed outside the head display mask; the 3D image video stream display module also includes a binocular lens barrel and a lens; the binocular OLED display screen and the lens are arranged in the binocular lens barrel, the OLED display screen is located inside the lens barrel and is installed on the RGB camera main board, and the lens is arranged on the side close to the human face; The inner surface of the head display mask is provided with a third and a fourth through hole; the binocular lens barrel passes through the third and the fourth through hole, and the image on the OLED display screen is displayed through the lens in the binocular lens barrel.

5. The MR head display system according to claim 4, characterized in that: The MR head display system also includes a signal adapter board; the signal adapter board and two RGB camera main boards are fixed to the inner wall of the outer layer of the head display mask by screws; the signal processing board is fixed to the inner wall of the outer layer of the helmet by screws; the FPC flexible board includes a first FPC flexible board and a second FPC flexible board; the two sides of the signal adapter board are respectively connected to one side of the first FPC flexible board and the second FPC flexible board, and the other sides of the first FPC flexible board and the second FPC flexible board are respectively connected to an RGB camera main board; the signal adapter board is located directly below the signal processing board.

6. The MR head display system according to claim 5, characterized in that: The first FPC flexible board and the second FPC flexible board both include a first connector and a second connector; the two RGB camera mainboards are both provided with a third connector; the two FPC flexible board first connectors are respectively connected to the corresponding RGB camera mainboard third connectors; The signal transfer board includes a fifth connector, a sixth connector, and a seventh connector; The second connectors on the first FPC flexible board and the second FPC flexible board are respectively connected to the fifth connector and the sixth connector of the signal transfer board; The seventh connector of the signal adapter board is connected to the signal processing board; The two RGB camera mainboards are provided with a fourth connector and an eighth connector, and the fourth connector includes I 2 C interface, RS422 serial port, MIPI interface, data IO interface, power interface; The fourth connector is connected to the binocular OLED display screen; and the eighth connector is connected to the RGB binocular image sensor.

7. The MR head display system according to claim 6, characterized in that: Both RGB camera mainboards are equipped with interface protection and filtering circuits; The interface protection and filtering circuit includes multiple ESD diodes and filter capacitors; the positive poles of the multiple ESD diodes are grounded, and the negative poles are connected to the signal pins of the third connector; one end of the filter capacitor is connected to the power pin of the third connector, and the other end is grounded.

8. The MR head display system according to claim 6, characterized in that: The signal processing board includes a high-performance VR processor, a power conversion module, and a motor driver chip; the power conversion module is used to supply power to the high-performance VR processor and the motor driver chip; the motor driver chip is externally connected to a servo motor.

9. The MR head display system according to claim 7, characterized in that: The signal transfer board and the signal processing board both include I 2 C interface, RS422 serial port, MIPI interface, data IO interface, power interface, the seventh connector of the signal transfer board is connected through I 2 C interface, RS422 serial port, MIPI interface, data IO interface, and power interface are connected to the signal processing board.

10. The MR head display system according to claim 2, characterized in that: The head display mask is made by 3D printing.

Images