Multiband light-weight wide-field-of-view head-mounted enhanced display device

Abstract

The invention discloses a multiband light-weight wide-view-field head-mounted enhanced display device which comprises a main control device and a head-mounted display device which are designed in a split mode and are in communication connection. Wherein the head-mounted display device comprises a head-mounted main body structure, and an image acquisition device, a micro display device and an optical imaging system which are positioned at the front end of the head-mounted main body structure; the image acquisition device is located on the micro display device, and the optical imaging system is located on a light path emitted by the micro display device; wherein the image acquisition device is provided with three cameras which respectively have different spectral response characteristics and are used for acquiring different optical band information and real-time images of the surrounding environment. According to the method, the wide view field design is adopted, so that the user can obtain clear image information in a wider view angle range, the information obtaining efficiency of the user in the use process is improved, and the immersion and participation degree of the user are enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of head-mounted display equipment, and in particular to a multi-band, lightweight, wide-viewing-range head-mounted enhanced display device. Background Art

[0002] With the rapid development of information technology, virtual reality (VR) and augmented reality (AR) technology, head-mounted display (HMD) has gradually become one of the hot spots of scientific and technological applications. HMD has shown great potential in integrating virtual information with the real environment and creating an immersive experience, and market demand continues to rise. In recent years, domestic and foreign scholars and companies have conducted increasingly in-depth research in this field, and application scenarios cover education, medical care, manufacturing, aerospace, military and other fields.

[0003] In terms of international research, the technology development in Europe and the United States is relatively mature. Well-known companies such as Oculus, Microsoft and MagicLeap have not only successfully launched a number of advanced HMD products, but also promoted technological progress through continuous research and development activities. At the same time, many academic institutions are also actively engaged in research in the field of HMD, covering human-computer interaction, visual display technology, content creation and other aspects, aiming to promote the development of industry standardization and application ecology. In terms of domestic research, with the gradual evolution of technology and the increase in market demand, major universities and research institutions have invested in the research and development of HMD technology. In recent years, a number of national scientific research projects have focused on augmented reality technology and its innovation in practical applications, promoting the localization development of related technologies.

[0004] The research on HMD technology not only provides a scientific basis for technological progress, but also injects new impetus into digital transformation. In the field of education, HMD can create an immersive learning environment, effectively improving learning outcomes and student interest. In the medical field, it provides doctors with simulation training and patient rehabilitation programs, reducing medical risks. In the military field, HMD can provide soldiers with comprehensive situational awareness and information mastery capabilities, enabling them to respond flexibly in complex and changing combat environments. Therefore, in-depth research on the technological progress and application potential of HMD is of great practical significance for promoting innovation and development in various industries.

[0005] Although HMD technology has made some progress, most HMD devices on the market still have significant shortcomings. For example, although Microsoft HoloLens 2 supports augmented reality functions, its field of view is only 52°, which makes it difficult to provide a wide visual experience. Although the field of view of the US GPNVG-18 reaches 97°, it is heavy and can easily cause discomfort and fatigue when worn for a long time. In addition, the imaging effect is poor under the viewing angle of a single band. Therefore, it is particularly necessary to develop a multi-band lightweight wide-field head-mounted enhanced display device and system, which will significantly improve the combat and rescue efficiency in fields such as military and emergency response, while promoting technological innovation and market expansion. Summary of the invention

[0006] The technical problem to be solved by the present invention is to provide a multi-band, lightweight, wide-viewing-range head-mounted enhanced display device.

[0007] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0008] A multi-band lightweight wide-viewing-range head-mounted enhanced display device comprises: a main control device 100 and a head-mounted display device 200 which are designed in a split manner and are communicatively connected; wherein:

[0009] The head mounted display device 200 includes a head mounted main structure 210, and an image acquisition system 220, a micro display device 230 and an optical imaging system 240 located at the front end of the head mounted main structure 210;

[0010] The image acquisition system 220 is located on the micro display device 230, and the optical imaging system 240 is located on the light path emitted by the micro display device 230;

[0011] The image acquisition system 220 is provided with three cameras, each having a different spectral response characteristic, for acquiring different light band information and real-time images of the surrounding environment.

[0012] In one embodiment of the present invention, the three-way camera includes a visible light camera 221, an infrared camera 222, and a near infrared camera 223; the infrared camera 222 is located between the three-way camera.

[0013] In one embodiment of the present invention, the camera centers of the visible light camera 221 , the infrared camera 222 , and the near infrared camera 223 are on the same horizontal line.

[0014] In one embodiment of the present invention, the head-mounted main structure 210 includes a head-mounted shell, on which a first full-function data interface 224, an image enhancement mode button 225, an image processing button 226, a first display screen brightness adjustment button 227, and a second display screen brightness adjustment button 228 are provided;

[0015] The image enhancement mode button 225 is located on the top of the housing; the image enhancement mode button 225 and the image processing button 226 are located on one side of the housing, and the first display screen brightness adjustment button 227 and the second display screen brightness adjustment button 228 are located on the other side of the housing;

[0016] Among them, the first full-function data interface 224 is used for data transmission and communication with the main control device 100;

[0017] The image enhancement mode button 225 is used to activate the image enhancement display mode;

[0018] The image processing button 226 is set to directly process the multi-band image;

[0019] The first display screen brightness adjustment button 227 and the second display screen brightness adjustment button 228 are used to adjust the brightness of the micro display device 230;

[0020] In addition, the image enhancement display mode and the algorithm for processing multi-band images are integrated in the main control device 100; the main control device 100 receives signals from the image enhancement mode button 225 and the image processing button 226, executes corresponding image operations, and the processed image is displayed on the micro display device 230.

[0021] In one embodiment of the present invention, the micro display device 230 includes a micro display screen 231 and a light shielding lens 232;

[0022] The shading lens 232 is located at the front end of the micro display screen 231, and is connected to the head-mounted main structure 210 through an adjusting member 233, and the shading lens 232 can be replaced and adjusted in posture through the adjusting member 233;

[0023] The micro display screen 231 is connected to the head-mounted main structure 210 via an optical mechanical bracket 234 .

[0024] In one embodiment of the present invention, the optical imaging system 240 includes a prism 241, a polarization beam splitter 242, and a semi-transparent and semi-reflective curved mirror 243; the prism 241 is located on the light path emitted by the micro display screen 231 in the micro display device 230, and the light passes through the prism 241 and is projected onto the polarization beam splitter 242 and is divided into two light beams. The reflected light passes through the semi-transparent and semi-reflective curved mirror 243 to form an enlarged virtual image, and the projected light is used to enable the user to see the real world, and the user can see the real world and the virtual image in the same field of view.

[0025] In one embodiment of the present invention, the head-mounted main structure 210 includes an adjustable headband 212; the adjustable headband 212 is connected to the head-mounted shell through a head-mounted bracket 211; and the head-mounted shell is made of a material that is both light and hard; and the headband 212 is made of an elastic material.

[0026] In one embodiment of the present invention, the main control device 100 is externally provided with a second full-function data interface 110 for physically connecting with the first full-function data interface 224 in the image acquisition device 220 .

[0027] In one embodiment of the present invention, an image processing module is integrated inside the main control device 100 for processing images from the head mounted display device 200 in real time.

[0028] Compared with the prior art, the present invention has the following beneficial effects:

[0029] The present invention integrates visible, near-infrared and infrared cameras, which can capture spectral information of different bands respectively, and can realize more comprehensive and accurate image acquisition and recognition for different target characteristics in different usage scenarios, thereby improving the richness of image information. Among them, the visible camera can clearly image under low illumination conditions (0.001lux), so that the device can still capture and present high-quality image information at night, in a dim indoor environment or in an outdoor scene with limited light, greatly expanding the application scope of the device and realizing the accurate monitoring function of the device in all-weather and multi-scenes. In addition, a wide field of view design is adopted, so that users can obtain clear image information within a wider viewing angle range, improve the information acquisition efficiency of users during use, and enhance the immersion and participation of users. The collaborative work of three cameras with different bands can realize multi-level and multi-dimensional capture of environmental information. The infrared camera is located in the center of the module, and the visible light camera and the near-infrared camera are respectively located on the left and right sides of the infrared camera, and the centers of the three cameras are on the same horizontal line. This arrangement can significantly reduce blind spots, improve the accuracy and integrity of environmental perception, and is of great significance for applications such as 3D reconstruction, target detection, and scene recognition.

[0030] The main structure of the lightweight head-mounted display device is made of lightweight and high-strength materials such as carbon fiber, which effectively reduces the overall weight. The customized multi-band camera is small in size and light in weight, which further reduces the space occupied while ensuring performance, and improves the compactness and integration of the head-mounted part. The power supply of the head-mounted display device is directly provided by the main control device through a full-function data cable, without the need for additional batteries, which not only simplifies the device structure, but also greatly reduces the overall weight. In addition, the optical system of the optical imaging system adopts a lightweight and reliable performance solution. In summary, the present invention successfully achieves the lightweight design of the head-mounted display device through a series of carefully designed optimization measures, bringing a more comfortable user experience to users.

[0031] The multi-band lightweight wide-viewing-range head-mounted enhanced display device and system described in the present invention are optimized in terms of material selection and structural design, thereby achieving lightweighting of the device. The entire head-mounted display part weighs only 300g, greatly improving the wearing comfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 The present invention provides a multi-band, lightweight, wide-viewing-range head-mounted enhanced display device according to an embodiment of the present invention.

[0033] Figure 2 FIG. 4 is a schematic diagram of a head mounted display device according to an embodiment of the present invention.

[0034] Figure 3 FIG. 4 is a schematic diagram of an optical imaging system according to an embodiment of the present invention.

[0035] Figure 4 Schematic diagram of a main control device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0036] In order to facilitate those skilled in the art to understand the technical solution of the present invention, the technical solution of the present invention is further described in conjunction with the accompanying drawings of the specification.

[0037] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0038] See also Figure 1 As shown, the present invention provides a multi-band lightweight wide-viewing-range head-mounted enhanced display device, including a main control device 100 and a head-mounted display device 200 that adopt a split design and are communicatively connected.

[0039] See also Figures 1 to 3As shown, in one embodiment of the present invention, the head-mounted display device 200 includes a head-mounted main structure 210, and an image acquisition system 220, a micro display device 230 and an optical imaging system 240 located at the front end of the head-mounted main structure 210.

[0040] In this embodiment, the head-mounted main structure 210 includes a head-mounted shell and an adjustable headband 212; the adjustable headband 212 is connected to the head-mounted shell through a head-mounted bracket 211. The head-mounted shell is made of a material that is both light and hard to form a stable frame for supporting and fixing other components, such as carbon fiber. Combined with ergonomic design, the headband 212 can ensure comfort and stability under long-term wearing. It is made of elastic material and has an adjustment buckle on the headband 212, which can be adjusted according to the size of the user's head circumference.

[0041] In this embodiment, the image acquisition system 220 is located on the micro display device 230, and the optical imaging system 240 is located on the light path emitted by the micro display device 230. Among them, the image acquisition system 220 is provided with three cameras, each having different spectral response characteristics, for collecting different light band information and real-time images of the surrounding environment. The three cameras include a visible light camera 221, an infrared camera 222, and a near infrared camera 223, and the infrared camera 222 is located between the three cameras. And the camera centers of the visible light camera 221, the infrared camera 222, and the near infrared camera 223 are on the same horizontal line.

[0042] In this embodiment, the present invention takes into account the band and viewing angle of the camera in the selection of the camera module of the three-way camera, and selects wide-view cameras of different bands to ensure that the device can achieve accurate monitoring in all-weather and multi-scene conditions. Among them, the field of view of the visible light camera 221 is 120°~140°, and it has the ability to clearly image in low-light environments, such as 0.001lux, so that high-quality visual information can still be captured at night or in extremely low light conditions. The field of view of the infrared camera 222 is 90°~120°, focusing on capturing the infrared radiation data of the target object, and is particularly suitable for night monitoring and penetrating scenes such as smoke, haze and other visual obstacles. The field of view of the near-infrared camera 223 is 90°~120°, focusing on capturing detailed information to improve the accuracy of image enhancement recognition.

[0043] In this embodiment, the head-mounted housing is provided with a first full-function data interface 224, an image enhancement mode button 225, an image processing button 226, a first display screen brightness adjustment button 227, and a second display screen brightness adjustment button 228. The image enhancement mode button 225 is located at the top of the housing, the image enhancement mode button 225 and the image processing button 226 are located on one side of the housing, and the first display screen brightness adjustment button 227 and the second display screen brightness adjustment button 228 are located on the other side of the housing.

[0044] In this embodiment, the first full-function data interface 224 is used to transmit and communicate data with the main control device 100, the image enhancement mode button 225 is used to activate the image enhancement display mode, the image processing button 226 is set to directly process the multi-band image, the first display screen brightness adjustment button 227 and the second display screen brightness adjustment button 228 are used to adjust the brightness of the micro display device 230, specifically to adjust the brightness of the micro display screen 231, and the image enhancement display mode and the algorithm for processing the multi-band image are integrated in the main control device 100. The present invention does not limit the specific method of image enhancement, nor does it limit the method of image preprocessing to make it clear. The main control device 100 receives the signal of the image enhancement mode button 225 and the image processing button 226, performs the corresponding image operation, and the processed image is displayed on the micro display device 230.

[0045] In this embodiment, the micro display device 230 includes a micro display screen 231 and a shading lens 232. The shading lens 232 is located at the front end of the micro display screen 231, and the shading lens 232 is connected to the head-mounted shell (211) through an adjusting member 233, and the shading lens 232 can be replaced and adjusted in posture through the adjusting member 233. In this embodiment, the adjusting member 233 is, for example, an adjusting bolt. The micro display screen 231 is connected to the head-mounted shell through an optical machine bracket 234. The micro display screen 231 adopts high-resolution, high-contrast Micro-LED display technology for displaying virtual images. The purpose of setting the shading lens 232 is that when this device is used at night, light will be transmitted from the micro display screen 231. In order to prevent the micro display screen 231 from leaking light, the shading lens 232 is set to cover it.

[0046] In one embodiment of the present invention, the optical imaging system 240 includes a prism 241, a polarization beam splitter 242, and a semi-transparent and semi-reflective curved mirror 243. The prism 241 is located on the light path emitted by the micro display screen 231 in the micro display device 230. After passing through the prism 241, the light is projected onto the polarization beam splitter 242 and is split into two light paths. The reflected light passes through the semi-transparent and semi-reflective curved mirror 243 to form an enlarged virtual image, and the projected light is used to enable the user to see the real world, and the user can see the real world and the virtual image in the same field of view.

[0047] See also Figures 1 to 4 As shown, in one embodiment of the present invention, the main control device 100 is internally integrated with an image processing module, and is externally provided with a second full-function data interface 110, a power button 120, and an expansion interface 130. The first full-function data interface 224 and the second full-function data interface 110 are physically connected through a data line, and are used to transmit power, transmit data, and communicate with the head-mounted display device 200. The image processing module uses a high-performance processor such as a CPU or GPU to process images from the head-mounted display device 200 in real time, including image preprocessing, image registration and fusion, image enhancement, target recognition, etc. This process covers distortion correction, color correction, information fusion and depth optimization of multi-band images to generate image outputs with high definition and rich details. The expansion interface 130 is used to connect other external devices to improve the compatibility and scalability of the device. Among them, the power supply of the main control device 100 uses a high-density, long-life lithium-ion battery to provide power support for the head-mounted display device 200 and the main control device 100, ensuring that the device can continue to work for a long time. Furthermore, the main control device 100 is also provided with a power indicator light 140, a DC power interface 150, and a reset button 160. When the battery power of the device is close to being exhausted, the power indicator light 140 will emit a flashing signal to prompt the user to charge through the DC power interface 150. If the device encounters a fault, an abnormal state, or needs to be restored to factory settings, the user can use a slender tool such as a paper clip to insert the reset button 160 to perform a reset operation to restore the normal operation of the device.

[0048] See also Figures 1 to 4As shown, in an embodiment of the present invention, at the user operation level, the device connects the first full-function data interface 224 and the second full-function data interface 110 through a data cable. After the user wears the head-mounted display device 200, press the power button 120 to activate the device, and the camera module in the image acquisition system 220 is started to capture real-time images in the surrounding environment respectively, and convert these data into digital signals for transmission. The obtained digital signal is transmitted to the image processing module of the main control device 100 via the first full-function data interface 224 for a series of processing and analysis to generate an image output with high definition and rich details. Based on the processed image data, the main control device 100 constructs a virtual AR environment and generates corresponding virtual images. These images are then fed back to the micro display screen 231 through the second full-function data interface 110. The micro display screen 231 is lit, and the light with image information is projected through the prism 241, and then through the polarization beam splitter 242 and the semi-transparent and semi-reflective curved mirror 243 to the user's field of view. In a low-light environment, the user can activate the image enhancement display mode by pressing the image enhancement mode button 225 to ensure clear visual effects even in low-light conditions. At the same time, the image processing button 226 is pressed to process the image in the visible spectrum to meet the user's specific requirements for image quality. In addition, the first display brightness adjustment button 227 and the second display brightness adjustment button 228 are used to adjust the brightness of the micro display screen 231, allowing the user to flexibly adjust according to different light environments.

[0049] It is obvious to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, the embodiments should be regarded as exemplary and non-limiting from any point of view, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention, and any reference numerals in the claims should not be regarded as limiting the claims involved.

[0050] The above-described embodiments merely represent implementation methods of the invention. The protection scope of the present invention is not limited to the above-described embodiments. For those skilled in the art, several modifications and improvements may be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention.

Claims

1. A multi-band, lightweight, wide-viewing-range head-mounted enhanced display device, characterized in that: include: A main control device (100) and a head mounted display device (200) are of split design and are communicatively connected; wherein: The head-mounted display device (200) comprises a head-mounted main structure (210), and an image acquisition system (220), a micro display device (230) and an optical imaging system (240) located at the front end of the head-mounted main structure (210); The image acquisition system (220) is located on the micro display device (230), and the optical imaging system (240) is located on the path of light emitted by the micro display device (230); The image acquisition system (220) is provided with three cameras, each having a different spectral response characteristic, for acquiring information of different light bands of the surrounding environment and real-time images.

2. The multi-band lightweight wide-viewing-range head-mounted enhanced display device according to claim 1, characterized in that: The three-way camera comprises a visible light camera (221), an infrared camera (222), and a near infrared camera (223); the infrared camera (222) is located between the three-way camera.

3. The multi-band lightweight wide-viewing-range head-mounted enhanced display device according to claim 2, characterized in that: The camera centers of the visible light camera (221), the infrared camera (222), and the near infrared camera (223) are on the same horizontal line.

4. The multi-band lightweight wide-viewing-range head-mounted enhanced display device according to claim 2, characterized in that: The head-mounted main body structure (210) comprises a head-mounted shell, on which a first full-function data interface (224), an image enhancement mode button (225), an image processing button (226), a first display screen brightness adjustment button (227) and a second display screen brightness adjustment button (228) are arranged; The image enhancement mode button (225) is located on the top of the housing; the image enhancement mode button (225) and the image processing button (226) are located on one side of the housing, and the first display screen brightness adjustment button (227) and the second display screen brightness adjustment button (228) are located on the other side of the housing; Wherein, the first full-function data interface (224) is used for data transmission and communication with the main control device (100); The image enhancement mode button (225) is used to activate the image enhancement display mode; The image processing button (226) is set to directly process the multi-band image; The first display screen brightness adjustment button (227) and the second display screen brightness adjustment button (228) are used to adjust the brightness of the micro display device (230); Furthermore, an image enhancement display mode and an algorithm for processing multi-band images are integrated in a main control device (100); the main control device (100) receives signals from an image enhancement mode button (225) and an image processing button (226), executes corresponding image operations, and the processed image is displayed on a micro display device (230).

5. The multi-band lightweight wide viewing area head-mounted enhanced display device according to claim 1, characterized in that: The micro display device (230) comprises a micro display screen (231); the micro display screen (231) is connected to the head-mounted main body structure (210) via an optical machine bracket (234).

6. The multi-band lightweight wide viewing area head-mounted enhanced display device according to claim 5, characterized in that: The micro display device (230) comprises a shading lens (232); the shading lens (232) is located at the front end of the micro display screen (231), and is connected to the head-mounted main structure (210) through an adjusting member (233), and the shading lens (232) can be replaced and its posture can be adjusted through the adjusting member (233).

7. The multi-band lightweight wide viewing area head-mounted enhanced display device according to claim 1, characterized in that: The optical imaging system (240) comprises a prism (241), a polarization beam splitter (242), and a semi-transparent and semi-reflective curved mirror (243); the prism (241) is located on the path of light emitted by a micro display screen (231) in a micro display device (230); the light passes through the prism (241) and is projected onto the polarization beam splitter (242) to be split into two paths of light; the reflected light passes through the semi-transparent and semi-reflective curved mirror (243) to form an enlarged virtual image; the projected light is used to enable a user to see the real world, and the user can see the real world and the virtual image in the same field of view.

8. The multi-band lightweight wide-viewing-range head-mounted enhanced display device according to claim 1, characterized in that: The head-mounted main body structure (210) comprises an adjustable headband (212); the adjustable headband (212) is connected to the head-mounted shell through a head-mounted bracket (211); and the head-mounted shell is made of a material that is both light and hard; and the headband (212) is made of an elastic material.

9. The multi-band lightweight wide viewing area head-mounted enhanced display device according to claim 1, characterized in that: The main control device (100) is provided with a second full-function data interface (110) outside, which is used for physically connecting with the first full-function data interface (224) in the image acquisition device (220).

10. The multi-band lightweight wide-viewing-range head-mounted enhanced display device according to claim 1, characterized in that: An image processing module is integrated inside the main control device (100) and is used for processing images from the head-mounted display device (200) in real time.

Images