Panoramic xr head-mounted intelligent integrated system, and related apparatus

Abstract

The present invention relates to the technical field of virtual reality, and comprises a virtual reality spherical internal display apparatus operating system, a multi-element panoramic recording apparatus, a keyboard system having touch screen keys, and a spherical internal display apparatus. The operating system involves a plurality of functional modules such as a stretching distortion-free display algorithm and a multi-dimensional data analysis and simulation module, can implement functions such as accurate mapping of a planar image to a spherical screen, multi-dimensional data processing, and application development and release, and has a security protection feature. The multi-element panoramic recording apparatus is composed of a spherical camera, a gyroscope, and a compass module, and can implement 360-degree dead-zone-free shooting and record multi-dimensional information. The keyboard system having touch screen keys can sense a finger touch position and display a simulacra image. A housing and internal components of the internal display apparatus cooperate to provide effects such as spherical panoramic display, omnidirectional sound immersion, image orientation adjustment, and picture optimization. The present invention effectively solves problems in virtual reality technology in multiple aspects such as image display, data recording and analysis, and operation interaction, has wide application prospects in various fields such as entertainment, education, security monitoring, and industrial design, and greatly improves the sense of immersive experience, functionality and practicability of virtual reality.

Description

A panoramic XR head-mounted intelligent integrated system and related devices Technical Field

[0001] This invention relates to the field of extended reality (XR) technology, and in particular to a panoramic XR head-mounted intelligent integrated system and related multi-element panoramic recording device, keyboard system with touch screen buttons, and other supporting devices, aiming to provide a highly immersive, multifunctional XR experience solution with powerful computing and interactive capabilities. Background Technology

[0002] With the continuous development of virtual reality technology, people's demand for more realistic and immersive virtual reality experiences is growing. Traditional flat-panel display technology has limitations in viewing angle when displaying panoramic information, making it difficult to provide a comprehensive visual experience. Meanwhile, in terms of data recording, existing recording devices often struggle to comprehensively and accurately record multi-dimensional information, such as shooting angle, posture, and environmental information. Regarding operation and interaction, traditional keyboards and other input devices lack intuitive positional feedback, hindering efficient operation in virtual reality environments. Furthermore, there are still many areas for improvement in the security of virtual reality devices, the ease of application development, and the high-quality presentation of sound and images. Technical issues

[0003] To overcome the shortcomings of existing technologies, this invention aims to solve the following technical problems: First, how to achieve image display without stretching or distortion on a spherical display screen to provide a more realistic visual effect; second, how to effectively analyze and simulate multi-dimensional data, including 3D data and data from a spherical panoramic camera and other multi-dimensional recording devices; third, how to design a keyboard system that can accurately sense the user's finger touch position and provide real-time feedback to improve operational interactivity; fourth, how to build a secure and application-friendly virtual reality operating system; fifth, how to achieve omnidirectional sound immersion, realistic wind simulation immersive experience, precise image display direction adjustment, and optimization of image color, among other aspects, in an internal display device; and sixth, how to develop an efficient multi-element panoramic recording device to achieve 360-degree shooting without blind spots, ensuring seamless and stretch-free stitching of spherical images or videos, and completely recording multi-dimensional information such as posture, orientation, and environment during shooting. Technical solutions

[0004] This invention provides an operating system for a virtual reality spherical internal display device, including a non-stretching and deformation-free display algorithm. This algorithm uses a unique image processing algorithm to map planar images onto a spherical display screen, ensuring that the image's proportions and shape remain unchanged from any viewing angle. It also includes a multi-dimensional data analysis and simulation module, compatible with 3D data and capable of analyzing and simulating multi-dimensional data from a spherical panoramic camera multi-dimensional recording device in real time; a personalized interface and theme; an application development and publishing platform; an AI voice recognition operation module; a network connection and computing power generation module; a security protection module; an external operation accessory connection module; and a multi-language support module. For the multi-element panoramic recording device, it consists of a spherical camera (composed of multiple hexagonally arranged small cameras to achieve 360-degree no-dead-angle shooting and automatically stitching into a spherical image or video without stretching), a gyroscope and compass module (whose data is embedded in the captured images or videos to provide attitude and orientation information), a wind direction and wind force measuring instrument, and a handle and internal control unit. The spherical camera uses a special algorithm to stitch images to ensure seamless, stretch-free stitching and the inclusion of multiple elements. The keyboard system with touchscreen buttons includes a keyboard body, a touchscreen button module using capacitive touchscreen technology for high-precision finger touch position sensing, a position sensing and processing module, a communication module, a power module, and a finger position simulacrum generation algorithm. It can sense the user's finger position on the keyboard and display the simulacrum in real time on an external output device. The internal display device has a specially shaped shell (at least partly spherical or near-spherical to house and protect internal components), a spherical internal display screen that displays a spherical panoramic image or provides a similar spherical field of view effect, and an independently controllable sound player covering the inner surface of the shell to achieve precise sound positioning and playback, creating an immersive sound effect. It also includes a gyroscope and compass mounted at the top center of the device to detect the user's head posture and geographical orientation to adjust the image display direction, and a special light-transmitting filter located between the spherical display screen and the user's eyes to adjust screen color, reduce blue light, adjust distance and 3D effects, and prevent water fogging. There are also external data and ventilation interfaces and a silent ventilation system to maintain air circulation inside the device while remaining quiet, and the fan speed and direction can be adjusted to simulate wind effects. Beneficial effects

[0005] The invention offers significant advantages. Through a non-stretching deformation display algorithm, the visual effect of the spherical display screen is greatly enhanced, allowing users to perceive images with realistic proportions and shapes from any viewing angle, thus strengthening the immersive experience of virtual reality. The multi-dimensional data analysis and simulation module enables the device to process and display richer multi-dimensional information, providing users with a more comprehensive experience. The keyboard system with touchscreen buttons improves the accuracy and intuitiveness of operation, facilitating user operation in the virtual reality environment. The application development and publishing platform allows developers to create custom applications based on this system, enriching the application ecosystem. The security protection module ensures the system's security and stability, preventing unauthorized execution of applications and data leaks. The omnidirectional sound immersion effect, realistic wind simulation immersive experience, precise image display direction adjustment, and image optimization functions in the internal display device further enhance the user's immersive experience. The multi-element panoramic recording device can comprehensively and accurately record shooting information, providing strong support for subsequent data analysis and applications. Attached Figure Description

[0006] Figure 1 is a semi-cross-sectional view of a spherical internal display device (the complete device is a sphere). In the figure, 1 is the sound playback device, and 2 is the spherical internal display screen. Figure 2 is a sectional view of the left side of the spherical internal display device. In the figure, 1 is the spherical part in the device's specific-shaped shell, 2 is the sound playback device, 3 is the ventilation and external data / power interface, 4 is the location of the neck ring and shoulder support structure (the shoulder support structure is not shown in the figure), 5 is the spherical internal display screen, 6 is the gyroscope and compass device, 7 is a special light-transmitting filter, and 8 is an arbitrarily shaped shell. Figure 3 is a plan view of the bottom neck ring of the spherical internal display device. In the figure, 1 is the front air inlet / outlet, 2 is the large air inlet / outlet on the left and right sides, and 3 is the rear air inlet / outlet. Figure 4 is a schematic diagram of the key structure of a keyboard with a touch screen. In the figure, 1 is the touch screen, and 2 is the position sensing module. Figure 5 is a schematic diagram of the left side structure of a keyboard with a touch screen. 1 is the touch screen, 2 is the position sensing module, and 3 is the keyboard body. Figure 6 is a structural diagram of a panoramic multi-dimensional recording device: 1 is a spherical camera, internally composed of multiple hexagonal planar cameras stitched together to form a sphere, with a compass and gyroscope at the center; 2 is the camera base contact layer, containing a green low-light lamp to facilitate material stitching to the bottom notch of the sphere; 3 is the wind layer support and wiring conduit; 4 is the wind force and direction measuring instrument. Figure 7 is a schematic diagram of the image shape after the operating system of this invention loads a normal planar image onto the spherical display screen, without stretching or deformation algorithm. The best embodiment of the present invention

[0007] In the preferred implementation, the operating system of the virtual reality spherical display device is first initialized, and a personalized interface and theme are configured according to user needs. Simultaneously, a network connection is established, and the necessary network resources and computing power are obtained using the network connection and computing power generation module. Regarding image display, a non-stretching distortion display algorithm accurately maps planar images or 3D model data onto the spherical display screen. The system provides a spherical panoramic view without blind spots, allowing the user to freely turn their head within the display. The display device does not contact the user's head, and the image appears static relative to the display device, providing a deeply immersive experience. Users can interact via voice through the AI ​​voice recognition module, such as switching images and launching applications. For the multi-element panoramic recording device, in the shooting scene, the spherical camera performs 360-degree shooting without blind spots, the gyroscope and compass modules record attitude and orientation information in real time, and the wind direction and wind speed meter records environmental wind information. The device uses a special algorithm to stitch images together in real time and embed multi-dimensional relevant information. After the keyboard system with touchscreen buttons is connected to the virtual reality device, when the user touches the keyboard, the touchscreen button module senses the touch position. The position sensing and processing module processes the data and transmits the finger position simulation image information to the external output device for display via the communication module. The internal display uses a spherical panoramic internal display screen made with high-resolution OLED or Mini LED technology. When the internal display device is running, the gyroscope and compass monitor the user's head posture and geographical direction in real time, adjusting the image display direction of the spherical internal display screen. The sound player achieves accurate sound positioning and playback based on the image content and the user's position. A special light-transmitting filter automatically filters blue light from the screen and protects the visual experience from moisture generated by the user's breathing. The ventilation device of the neck ring is connected to a silent ventilation system to maintain a good internal environment and simulates wind speed and direction based on the analyzed data. Embodiments of the present invention

[0008] In practical implementation, the operating system of the virtual reality spherical internal display device can be installed on virtual reality devices with corresponding hardware configurations. Developers can leverage the provided open application development framework and rich API interfaces based on the application development and release platform to develop various applications, such as virtual reality games and educational applications. Multi-element panoramic recording devices can be applied to virtual reality content creation, live streaming, security monitoring, and other fields; the captured multi-dimensional information can be directly imported into the virtual reality scene for display or analysis. A keyboard system with touchscreen buttons can serve as an input device for virtual reality devices, working in conjunction with other devices to improve operational efficiency. The internal display device can be integrated into virtual reality headsets and other devices, providing users with high-quality visual, auditory, and wind-sensing experiences. Industrial applicability

[0009] This invention demonstrates outstanding industrial applicability. In the virtual reality entertainment industry, it can be widely applied to game development, immersive film and television experiences, and other fields, improving product quality and user experience, and attracting more consumers. In the education sector, it can be used to create virtual laboratories, virtual classrooms, and other environments, providing more intuitive and comprehensive teaching resources. In the security monitoring field, the multi-element panoramic recording device can provide comprehensive and multi-information monitoring data, helping to improve monitoring effectiveness and security analysis. In the fields of industrial design and simulation, the virtual reality spherical display device operating system can help designers and engineers conduct virtual design and simulation testing of products, improving work efficiency and design quality, and has broad market application prospects and economic value.

Claims

1. An operating system for a virtual reality spherical internal display device, characterized in that, The system includes a non-stretch deformation display algorithm, a multi-dimensional data analysis and simulation module, and an application development and release platform.

2. The operating system as described in claim 1, characterized in that, The non-stretchable deformation display algorithm employs a unique image processing algorithm to map a planar image onto a spherical display screen, ensuring that the image maintains its original proportions and shape from any viewing angle.

3. The operating system as described in claim 1, characterized in that, The multidimensional data analysis and simulation module is compatible with 3D data and can analyze multidimensional data from a spherical panoramic camera multidimensional recording device, and simulate this multidimensional information in real time within a spherical display device.

4. A multi-element panoramic recording device, comprising a spherical camera, a gyroscope and compass module, a wind direction and wind force measuring instrument, a handle and an internal control unit, wherein the spherical camera is composed of multiple small cameras arranged in a hexagon, capable of capturing 360-degree images without blind spots and automatically stitching them into a spherical image or video, and the image is not stretched.

5. The panoramic recording device as described in claim 4, characterized in that, The data from the gyroscope and compass modules are embedded into the captured images or videos to provide attitude and orientation information during shooting.

6. The panoramic recording device as described in claim 4, characterized in that, The spherical camera uses a special algorithm to stitch images together, ensuring that the stitched spherical image or video is seamless and unstretched, and includes time, geographical direction, camera device posture, sound, wind information, or any combination thereof.

7. A keyboard system with touchscreen buttons, comprising a keyboard body, a touchscreen button module, a position sensing and processing module, a communication module, a power module, and a finger position simulacrum generation algorithm. The system is capable of sensing the touch position of a user's finger on the keyboard and displaying the simulacrum of the finger position on an external output device in real time.

8. The keyboard system as described in claim 7, characterized in that, The touchscreen button module uses capacitive touchscreen technology to achieve high-precision finger touch position sensing.

9. An internal display device, characterized in that... It includes a housing of a specific shape, at least a portion of which is spherical or nearly spherical to house and protect internal components, and a spherical internal display screen for displaying a spherical panoramic image or providing a display effect similar to an surround panoramic view.

10. The internal display device as claimed in claim 9, characterized in that, The inner surface of the casing is covered with a sound player, which can be independently controlled to achieve precise sound positioning and playback, thereby creating an immersive sound effect.

11. The internal display device as claimed in claim 9, characterized in that, It also includes a gyroscope and a compass, mounted at the top center of the device, to detect the user's head posture and geographic orientation in real time to adjust the image display orientation.

12. The internal display device as claimed in claim 9, characterized in that, It also includes a special light-transmitting filter located between the spherical display and the user's eyes, used to adjust the screen color, prevent blue light, adjust the distance, and prevent water fogging.

13. The operating system as described in claim 1, characterized in that, The application development and deployment platform provides an open application development framework and rich API interfaces, supporting developers to design and deploy custom applications based on the system of this invention.

14. The operating system as described in claim 1, characterized in that, The security protection module has confidentiality and security features. Any application developed using a non-official framework will be unexecutable, and all data reading will be performed within the system's secure container.

15. The internal display device as claimed in claim 9, characterized in that, It also includes a neck ring ventilation device at the bottom inlet of the spherical inner display device to maintain airflow inside the device and keep it quiet. Meanwhile, the ventilation system can adjust the wind speed and direction as needed to simulate the effect of blowing air.

Images