Integrated virtual reality office system, method and equipment and storage medium

Abstract

The invention relates to the technical field of virtual reality, and discloses an integrated virtual reality office system, method and device and a storage medium. The system comprises a calculation box and VR glasses, the calculation box is electrically connected with the VR glasses, and the calculation box comprises a power supply, a camera and a mainboard; the power supply is used for supplying power to the calculation box and the VR glasses; the camera is used for carrying out spatial modeling on the current environment to obtain an environment three-dimensional model and carrying out modeling and gesture recognition on a user to obtain a user three-dimensional model; the mainboard is used for generating corresponding audio and video data according to the environment stereoscopic model and the user stereoscopic model and transmitting the audio and video data to the VR glasses; and the VR glasses are used for playing the audio and video data. Hardware products and software functions are brand-new defined to meet the requirement that the immersive office scene is experienced through the lightweight VR glasses, and the cruising ability is greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to an integrated virtual reality office system, method, device and storage medium. Background Art

[0002] Currently, many multinational or interprovincial companies often spend a lot of time and money on business trips to other places when working together; when holding remote meetings, they communicate through 2D conference systems and TV screens. This traditional method greatly reduces the efficiency of remote collaborative work and consumes a lot of time, energy and cost.

[0003] In the XR (Extended Reality) field, there are many VR (Virtual Reality) products that can satisfy the immersive virtual world experience, but all current VR / MR (Mixed Reality) products face two problems: 1. They are heavy and the wearing experience is not good; 2. The battery life is poor. Summary of the invention

[0004] In view of this, the purpose of the present invention is to overcome the deficiencies in the prior art and to provide an integrated virtual reality office system, method, device and storage medium.

[0005] The present invention provides the following technical solutions:

[0006] In a first aspect, an integrated virtual reality office system is provided in an embodiment of the present disclosure, the system comprising a computing box and VR glasses, the computing box and the VR glasses are electrically connected, and the computing box comprises a power supply, a camera and a mainboard;

[0007] The power supply is used to supply power to the computing box and the VR glasses;

[0008] The camera is used to perform spatial modeling of the current environment to obtain a three-dimensional model of the environment, and to perform modeling and gesture recognition of the user to obtain a three-dimensional model of the user;

[0009] The mainboard is used to generate corresponding audio and video data according to the environment stereo model and the user stereo model, and transmit the audio and video data to the VR glasses;

[0010] The VR glasses are used to play the audio and video data.

[0011] Optionally, the camera includes:

[0012] A 6DOF camera is used to perform SLAM spatial modeling on the current environment and identify objects in the current environment to obtain a three-dimensional model of the environment, and perform gesture recognition on the user to obtain gesture information;

[0013] An RGB camera is used to assist the 6DOF camera and model the user according to the gesture information to obtain a three-dimensional model of the user;

[0014] The computing box also includes:

[0015] The TOF sensor is used to measure the distance between the computing box and the object.

[0016] Optionally, the computing box further includes:

[0017] A comprehensive sensor, used to measure basic information of the environment and the object, and transmit the basic information to the VR glasses, wherein the basic information includes at least one of temperature, liquid level and distance;

[0018] The VR glasses are further used to generate prompt information according to the basic information.

[0019] Optionally, the audio and video data includes audio data and video data, the VR glasses include a main circuit and a shell, the main circuit is arranged in the shell, the main circuit includes an optical module, a speaker and a flexible circuit board, and the optical module is electrically connected to the speaker through the flexible circuit board;

[0020] An optical module, used for converting the video data into a virtual image and displaying the virtual image;

[0021] A speaker, used to play the audio data, identify the position of the speaking user, collect the speech content of the speaking user, and transmit the speech content to the computing box;

[0022] A flexible printed circuit board is used to identify the timbre characteristics of the speaking user and transmit the timbre characteristics to the computing box.

[0023] Optionally, the integrated virtual reality office system uses pancake technology to compress the thickness and weight of the optical module.

[0024] Optionally, the computing box is further used to convert the speech content into text in real time and generate a text record after the speaker finishes speaking;

[0025] The computing box is also used to compare the timbre feature with a pre-stored user timbre feature library to determine the identity of the speaking user.

[0026] Optionally, the integrated virtual reality office system further includes:

[0027] A keyboard is used to be anchored at a fixed position on a plane through the SLAM space modeling to provide input operations for the user.

[0028] In a second aspect, an integrated virtual reality office method is provided in an embodiment of the present disclosure, which is applied to the integrated virtual reality office system as described in the first aspect, wherein the system includes a computing box and VR glasses, wherein the computing box and the VR glasses are electrically connected, and the computing box includes a power supply, a camera, and a motherboard, and the method includes:

[0029] Supplying power to the computing box and the VR glasses through the power supply;

[0030] The camera is used to spatially model the current environment to obtain a three-dimensional model of the environment, and the user is modeled and gestures are recognized to obtain a three-dimensional model of the user;

[0031] Generate corresponding audio and video data according to the environment stereo model and the user stereo model through the mainboard, and transmit the audio and video data to the VR glasses;

[0032] The audio and video data are played through the VR glasses.

[0033] In a third aspect, a computer device is provided in an embodiment of the present disclosure, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the steps of the integrated virtual reality office method described in the second aspect when executing the computer program.

[0034] In a fourth aspect, a computer-readable storage medium is provided in an embodiment of the present disclosure, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the integrated virtual reality office method described in the second aspect are implemented.

[0035] Beneficial effects of this application:

[0036] The integrated virtual reality office system provided by the embodiment of the present application includes a computing box and VR glasses, wherein the computing box and the VR glasses are electrically connected, and the computing box includes a power supply, a camera and a mainboard; the power supply is used to supply power to the computing box and the VR glasses; the camera is used to spatially model the current environment to obtain a stereoscopic model of the environment, and to model and gesture recognize the user to obtain a stereoscopic model of the user; the mainboard is used to generate corresponding audio and video data according to the stereoscopic model of the environment and the stereoscopic model of the user, and transmit the audio and video data to the VR glasses; the VR glasses are used to play the audio and video data. This application makes a new definition of hardware products and software functions to meet the needs of experiencing immersive office scenes through lightweight VR glasses, and the battery life is greatly enhanced.

[0037] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work. In each of the drawings, similar components are numbered similarly.

[0039] Figure 1 A schematic diagram of the structure of an integrated virtual reality office system provided in an embodiment of the present application is shown;

[0040] Figure 2 A schematic diagram of the structure of another integrated virtual reality office system provided in an embodiment of the present application is shown;

[0041] Figure 3 A schematic diagram of the structure of VR glasses provided in an embodiment of the present application is shown;

[0042] Figure 4 A flowchart of an integrated virtual reality office method provided by an embodiment of the present application is shown;

[0043] Figure 5 A schematic diagram of the structure of a computer device provided in an embodiment of the present application is shown.

[0044] Specific component symbol description:

[0045] 100-integrated virtual reality office system; 110-computing box; 111-power supply; 112-camera; 1121-6DOF camera; 1122-RGB camera; 113-mainboard; 114-TOF sensor; 115-integrated sensor; 120-VR glasses; 121-main circuit; 1211-optical module; 1212-speaker; 1213-flexible circuit board; 122-housing; 130-keyboard. DETAILED DESCRIPTION

[0046] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and cannot be understood as limiting the present invention.

[0047] It should be noted that when an element is referred to as being "fixed to" another element, it may be directly on the other element or there may also be a centered element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a centered element at the same time. In contrast, when an element is referred to as being "directly on" another element, there is no intermediate element. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only.

[0048] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0049] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of the template are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0051] Example 1

[0052] like Figure 1 , which is a schematic diagram of the structure of an integrated virtual reality office system 100 in an embodiment of the present application, and the integrated virtual reality office system 100 provided in the embodiment of the present application includes a computing box 110 and VR glasses 120. The computing box 110 and the VR glasses 120 are electrically connected, and the computing box 110 includes a power supply 111, a camera 112, and a mainboard 113.

[0053] Specifically, the power supply 111 is used to supply power to the computing box 110 and the VR glasses 120 .

[0054] It is understandable that the power supply 111 is built into the computing box 110, and can provide power to the entire system for 3 to 5 hours in the absence of power. If it is in an office location or other location where a power supply can be connected, it can be plugged in and used.

[0055] Furthermore, the camera 112 is used to perform spatial modeling of the current environment to obtain a three-dimensional model of the environment, and to perform modeling and gesture recognition of the user to obtain a three-dimensional model of the user.

[0056] Preferably, in this embodiment, Figure 2 As shown, the camera 112 includes a 6DOF (6 Degree of Freedom) camera 1121, which is used to perform SLAM (Simultaneous localization and mapping) spatial modeling on the current environment and identify objects in the current environment to obtain a three-dimensional model of the environment, and perform gesture recognition on the user to obtain gesture information.

[0057] Understandably, the 6DOF camera 1121 (usually with a depth sensor) can directly obtain the depth information of objects in the environment, that is, the distance between the object and the 6DOF camera 1121, which is essential for building a three-dimensional map. Combining the depth information and the motion information of the 6DOF camera 1121 itself (such as data provided by a gyroscope, accelerometer, etc.), the 6DOF camera 1121 can estimate and track the user's gesture changes and posture changes in real time to generate gesture information. Using the depth information and posture estimation results, the 6DOF camera 1121 can gradually build a three-dimensional stereo model of the environment. This model not only includes the position and shape of objects, but also the spatial relationship between them.

[0058] It should be noted that, in this embodiment, the computing box 110 includes two 6DOF cameras, but in actual situations, the number of 6DOF cameras can be flexibly selected based on the specific scenario, and this embodiment of the present application does not limit this.

[0059] Preferably, in this embodiment, Figure 2 As shown, the camera 110 112 further includes an RGB (Red-Green-Blue) camera 1122 for assisting the 6DOF camera 1121 and modeling the user according to the gesture information to obtain a three-dimensional model of the user.

[0060] Understandably, the RGB camera 1122 can capture color images of the environment, which contain rich texture and color information. Through image processing algorithms, feature points (such as corners, edges, etc.) can be extracted from these images, and these feature points will be used for subsequent matching and positioning. The images captured by the RGB camera 1122 can also be fused with the depth information captured by the 6DOF camera 1121 to more accurately establish a three-dimensional model of the user's body.

[0061] It should be noted that, in this embodiment, the computing box 110 includes an RGB camera, but in actual situations, the number of RGB cameras can be flexibly selected in combination with specific scenarios, and this embodiment of the present application does not limit this.

[0062] Preferably, in this embodiment, Figure 2 As shown, the computing box 110 further includes a TOF sensor 114 for measuring the distance between the computing box 110 and an object.

[0063] Understandably, the TOF (Time of Flight) sensor accurately calculates the distance between the object and the sensor by measuring the time from the emission to the reception of the light pulse. This technology has the characteristics of high precision and fast response. Combining the precise distance information provided by the TOF sensor 114 with the information provided by the 6DOF camera 1121 and the RGB camera 1122 can further improve the accuracy and stability of SLAM spatial modeling. For example, in areas with fewer feature points or in low-light environments, the TOF sensor 114 can provide additional distance information to assist in positioning.

[0064] It should be noted that, in this embodiment, the computing box 110 includes a TOF sensor, but in actual situations, the number of TOF sensors can be flexibly selected in combination with specific scenarios, and this embodiment of the present application does not limit this.

[0065] It can be understood that the following is the comprehensive collaboration process of the 6DOF camera 1121, the RGB camera 1122 and the TOF sensor 114: (1) When the system starts, the RGB camera 1122 first captures the environment image and performs preliminary feature extraction and object recognition. At the same time, the 6DOF camera 1121 begins to obtain depth information and preliminarily estimates the user's gestures and postures; (2) As the device moves and rotates, the RGB camera 1122 and the 6DOF camera 1121 continue to capture new images and depth information, and the system uses this information to continuously update and optimize the user stereo model and the environment stereo model; (3) During the iterative update process, the system will also fuse the precise distance information provided by the TOF sensor 114 with the previous information to further improve the accuracy of the model.

[0066] Through the above process, the 6DOF camera 1121, the RGB camera 1122 and the TOF sensor 114 work together to achieve high-precision SLAM space modeling, establish a 1:1 restoration of the real environment, and accurately locate objects in the real environment and the status of objects in the virtual environment.

[0067] Furthermore, the computing box 110 also includes a mainboard 113, which is used to generate corresponding audio and video data according to the environmental stereo model and the user stereo model, and transmit the audio and video data to the VR glasses 120.

[0068] Understandably, the CPU on the motherboard 113 can run the SLAM space modeling algorithm, and the GPU can decode the 4K image captured by the camera 112. These computing resources jointly support the real-time computing requirements of SLAM space modeling. After performing SLAM space modeling, gesture recognition, posture analysis, and object recognition operations, corresponding audio data and video data are generated, and the motherboard 113 transmits the audio data and video data to the VR glasses 120 via wire.

[0069] Preferably, in this embodiment, Figure 2 As shown, the computing box 110 also includes an integrated sensor 115 for measuring basic information of the environment and the object, and transmitting the basic information to the VR glasses 120, wherein the basic information includes at least one of temperature, liquid level and distance.

[0070] Understandably, the integrated sensor 115 integrates multiple functions, such as measuring temperature, liquid level, distance, etc. at the same time. Working in a virtual space has a hidden danger. In the real environment, you may bump into sharp objects or be injured by very hot objects, which poses a great safety hazard. The integrated sensor 115 can identify information such as the water temperature and liquid level of the water cup, and sense the existence and position of the object by measuring the distance between the sensor and the target object.

[0071] After the integrated sensor 115 sends the above-generated basic information to the VR glasses 120, the VR glasses 120 can intelligently judge the environmental status and provide corresponding prompts or warnings to the user, thereby improving office safety and convenience.

[0072] Furthermore, the VR glasses 120 are used to play the audio and video data.

[0073] Preferably, in this embodiment, if Figure 3As shown, the VR glasses 120 include a main circuit 121 and a shell 122, wherein the main circuit 121 is disposed in the shell 122, and the main circuit 121 includes an optical module 1211, a speaker 1212 and a flexible circuit board 1213, wherein the optical module 1211 is electrically connected to the speaker 1212 via the flexible circuit board 1213; the shell 122 can fix key components of the VR glasses 120 and protect the key components.

[0074] The optical module 1211 is used to convert the video data into a virtual image and display the virtual image.

[0075] It is understandable that the optical module 1211 is a key component for realizing image conversion and display in the VR glasses 120, and generally contains multiple lenses and other optical elements. It can convert video signals into virtual images, and through special optical design, make these images present a three-dimensional, immersive virtual reality effect in front of the user.

[0076] It should be noted that, in this embodiment, the system uses pancake technology to compress the thickness and weight of the optical module 1211, so that the entire VR glasses 120 can be designed to be thinner and lighter, thereby improving the wearing comfort. By using pancake technology, the optical module 1211 can fold the optical path more effectively, thereby significantly reducing the volume and weight of the VR glasses 120 without sacrificing performance. This is of great significance for improving the portability and user experience of VR devices.

[0077] The speaker 1212 is used to play the audio data transmitted by the computing box 110, identify the position of the speaking user, collect the speech content of the speaking user, and transmit the speech content to the computing box 110.

[0078] Understandably, the speaker 1212 can play the audio transmitted from the computing box 110, and can also use the two-channel stereo provided by the speaker 1212, combined with the spatial audio technology in the VR glasses 120, to capture the direction and distance of the sound. The principle is that the three-dimensional coordinates of the sound source can be calculated through the time difference and intensity difference between the sound reaching the two speakers 1212, thereby determining the exact position of the speaking user. This technology is similar to the principle of human binaural positioning of sound, and can provide a real auditory experience in the virtual space.

[0079] At the same time, the speech content of the speaking user can also be collected through the speaker 1212 and transmitted to the computing box 110.

[0080] The flexible circuit board 1213 is used to identify the timbre characteristics of the speaking user and transmit the timbre characteristics to the computing box 110.

[0081] It can be understood that the flexible printed circuit (FPC) 1213 connects all key components and provides signals. A plurality of MICs (Microphones) are pasted on it to form a stereo mic array. The stereo mic array formed by the plurality of MICs pasted on the flexible printed circuit 1213 can capture the timbre characteristics of the speaking user.

[0082] In an optional implementation, the computing box 110 is also used to convert the speech content into text in real time and generate a text record after the speaker finishes speaking.

[0083] Understandably, the computing box 110 can convert the speech content into text in real time through the speech recognition algorithm. The algorithm can recognize multiple languages ​​and dialects, and has a high recognition accuracy. The converted text can be displayed in real time on the screen of the virtual conference room for other users to view. After the meeting, the computing box 110 can automatically generate a complete text meeting record, which can include detailed information such as meeting time, location, participants, speech content, etc., which is convenient for users to check and organize later.

[0084] In an optional implementation, the computing box 110 is further used to compare the timbre feature with a pre-stored user timbre feature library to determine the identity of the speaking user.

[0085] Understandably, the computing box 110 can extract the pitch, timbre, speaking speed, etc. of the timbre characteristics of the speaking user through the audio processing algorithm, and compare these features with the pre-stored user timbre feature library to accurately determine the identity of the speaking user.

[0086] In an alternative embodiment, Figure 2 As shown, the integrated virtual reality office system 100 also includes a keyboard 130, which is anchored at a fixed position on a plane through the SLAM space modeling to provide input operations for the user.

[0087] Understandably, in this embodiment, the physical keyboard 130 can be connected via Bluetooth technology, or the virtual keyboard 130 can be displayed using the VR glasses 120. The virtual keyboard 130 uses the SLAM space algorithm and is anchored at a fixed position on the desktop, and the user can type by tapping the desktop. In addition, the user can perform all the functions of the mouse through the gesture recognition provided by the computing box 110, and can complete all operations such as pushing, pulling, selecting, zooming in, and zooming out in the 3D virtual space through gestures, further enhancing the interactivity and immersion of the VR environment.

[0088] The system is operated through the virtual keyboard 130 and gestures, and multiple windows are established in the 3D space, which can be switched and used to improve office efficiency. Especially for 3D modeling work, operating in the virtual space greatly improves efficiency.

[0089] In summary, this application makes a new definition of hardware products and software functions in the office field. The computing box 110 has a built-in power supply 111, so that the VR glasses 120 perfectly solve the battery life problem that the existing technology cannot solve in the field of office and remote conferencing, and the functions of long-term office and immersive remote conferencing can be fully realized. In addition, the power supply 111, dual 6DOF cameras 1121, RGB cameras 1122, TOF sensors 114, motherboards 113, etc. are moved to the computing box 110, and the corresponding radiator is also moved to the computing box 110, which greatly reduces the weight of the VR glasses 120. From the key indicator of FOV (Field of View), the VR glasses 120 of this application reach 120°, which is far more than the 40° of lightweight AR products. The increase in FOV means that users can feel a wider and more immersive visual experience when using it. In the scene of virtual reality or augmented reality, the wide field of view can make users more naturally integrated into the virtual environment, as if they were there. Secondly, in terms of optical principles, traditional AR products are easily affected by external light intensity. Especially in bright outdoor environments, the clarity of AR devices may be significantly reduced, and the color and contrast will also be greatly affected. This change will seriously affect the user's visual experience, making it difficult to use AR devices under complex lighting conditions such as outdoors. However, the present application has optimized the design of the optical module 1211, effectively reducing the impact of external light intensity on device performance. Even in bright outdoor environments, users can get a clear, colorful and high-contrast visual experience. This feature makes the VR glasses 120 of the present application more reliable and comfortable to use under complex lighting conditions such as outdoors.

[0090] For example, a specific application scenario of this application is as follows:

[0091] In the meeting scene of a real conference room, the computing box 110 first establishes a three-dimensional model of the user and the environment, and restores it to the virtual conference room. The user can choose a seat when entering the conference room. After selecting a seat, based on the user's perspective of other positions, three-dimensional models of the user at different angles are created in other users' VR glasses 120. Details such as the user's line of sight, expression, lips, gestures, and posture can also be restored to the virtual conference room. Scenarios such as gesturing with hands and eye-to-eye talking can be realized, and the meeting can be experienced immersively. The speaker 1212 can identify the exact position of the speaking user. Through timbre recognition, the identity of the speaking user can be accurately determined, the speech is converted into text, and a text meeting record is compiled after the meeting.

[0092] The integrated virtual reality office system 100 provided in the embodiment of the present application makes a new definition in hardware products and software functions to meet the needs of experiencing immersive office scenes through lightweight VR glasses 120, and the battery life is greatly enhanced.

[0093] Example 2

[0094] like Figure 4 As shown, it is a flow chart of an integrated virtual reality office method in an embodiment of the present application, and the method is applied to the integrated virtual reality office system as described in Example 1, the system includes a computing box and VR glasses, the computing box and the VR glasses are electrically connected, the computing box includes a power supply, a camera and a motherboard, and the specific method includes:

[0095] Step S110, supplying power to the computing box and the VR glasses through the power supply.

[0096] Step S120, spatially modeling the current environment through the camera to obtain a three-dimensional model of the environment, and modeling and gesture recognition of the user to obtain a three-dimensional model of the user.

[0097] Step S130: Generate corresponding audio and video data according to the environment stereo model and the user stereo model through the mainboard, and transmit the audio and video data to the VR glasses.

[0098] Step S140: playing the audio and video data through the VR glasses.

[0099] The integrated virtual reality office method provided in the embodiment of the present application can implement each process of the integrated virtual reality office system corresponding to Example 1, and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0100] Example 3

[0101] The present application also provides a computer device. Figure 5 , Figure 5 This is a basic structural block diagram of the computer device in this embodiment.

[0102] The computer device 5 includes a memory 51, a processor 52, and a network interface 53 that are interconnected through a system bus. It should be noted that the figure only shows a computer device 5 with a memory 51, a processor 52, and a network interface 53, but it should be understood that it is not required to implement all the components shown, and more or fewer components can be implemented instead. Among them, those skilled in the art can understand that the computer device here is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC), programmable gate arrays (Field-Programmable Gate Array, FPGA), digital processors (Digital Signal Processor, DSP), embedded devices, etc.

[0103] The computer device may be a computing device such as a desktop computer, a notebook, a PDA, a cloud server, etc. The computer device may interact with a user via a keyboard 130, a mouse, a remote controller, a touch pad, or a voice control device.

[0104] The memory 51 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or D slot compatibility test memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 51 can be an internal storage unit of the computer device 5, such as a hard disk or memory of the computer device 5. In other embodiments, the memory 51 can also be an external storage device of the computer device 5, such as a plug-in hard disk equipped on the computer device 5, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 51 can also include both the internal storage unit of the computer device 5 and its external storage device. In this embodiment, the memory 51 is generally used to store the operating system and various application software installed on the computer device 5, such as computer-readable instructions of the slot compatibility test method, etc. In addition, the memory 51 can also be used to temporarily store various types of data that have been output or are to be output.

[0105] The processor 52 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other integrated virtual reality office chips in some embodiments. The processor 52 is generally used to control the overall operation of the computer device 5. In this embodiment, the processor 52 is used to run computer-readable instructions or process data stored in the memory 51, such as computer-readable instructions for running the slot compatibility test method.

[0106] The network interface 53 may include a wireless network interface or a wired network interface. The network interface 53 is generally used to establish a communication connection between the computer device 5 and other electronic devices.

[0107] The computer device provided in this embodiment can execute the above-mentioned integrated virtual reality office method.

[0108] Example 4

[0109] This embodiment also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the integrated virtual reality office method in the embodiment are implemented.

[0110] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium can be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium can also be an external storage device of a computer device, such as a plug-in hard disk equipped on the computer device, a smart memory card (Smart Media Card, referred to as SMC), a secure digital (Secure Digital, referred to as SD) card, a flash card, etc. Of course, the computer-readable storage medium can also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on the computer device. In addition, the computer-readable storage medium can also be used to temporarily store various types of data that have been output or are to be output.

[0111] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or the flow chart, and the combination of boxes in the structure diagram and / or the flow chart, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] In addition, the functional modules or units in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

[0113] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or partly contributed to the prior art or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a smart phone, a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium can be a non-volatile storage medium or a volatile storage medium. For example, the storage medium can be: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a disk or an optical disk, and other media that can store program codes.

[0114] The above description is only a specific implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. An integrated virtual reality office system, characterized in that: The system includes a computing box and VR glasses, the computing box and the VR glasses are electrically connected, and the computing box includes a power supply, a camera and a mainboard; The power supply is used to supply power to the computing box and the VR glasses; The camera is used to perform spatial modeling of the current environment to obtain a three-dimensional model of the environment, and to perform modeling and gesture recognition of the user to obtain a three-dimensional model of the user; The mainboard is used to generate corresponding audio and video data according to the environment stereo model and the user stereo model, and transmit the audio and video data to the VR glasses; The VR glasses are used to play the audio and video data.

2. The integrated virtual reality office system according to claim 1, characterized in that: The camera comprises: A 6DOF camera is used to perform SLAM spatial modeling on the current environment and identify objects in the current environment to obtain a three-dimensional model of the environment, and perform gesture recognition on the user to obtain gesture information; An RGB camera is used to assist the 6DOF camera and model the user according to the gesture information to obtain a three-dimensional model of the user; The computing box also includes: The TOF sensor is used to measure the distance between the computing box and the object.

3. The integrated virtual reality office system according to claim 2, characterized in that: The computing box also includes: A comprehensive sensor, used to measure basic information of the environment and the object, and transmit the basic information to the VR glasses, wherein the basic information includes at least one of temperature, liquid level and distance; The VR glasses are further used to generate prompt information according to the basic information.

4. The integrated virtual reality office system according to claim 1, characterized in that: The audio and video data includes audio data and video data, the VR glasses include a main circuit and a shell, the main circuit is arranged in the shell, the main circuit includes an optical module, a speaker and a flexible circuit board, and the optical module is electrically connected to the speaker through the flexible circuit board; An optical module, used for converting the video data into a virtual image and displaying the virtual image; A speaker, used to play the audio data, identify the position of the speaking user, collect the speech content of the speaking user, and transmit the speech content to the computing box; A flexible printed circuit board is used to identify the timbre characteristics of the speaking user and transmit the timbre characteristics to the computing box.

5. The integrated virtual reality office system according to claim 4, characterized in that: The integrated virtual reality office system uses pancake technology to compress the thickness and weight of the optical module.

6. The integrated virtual reality office system according to claim 4, characterized in that: The computing box is also used to convert the speech content into text in real time and generate a text record after the speaker finishes speaking; The computing box is also used to compare the timbre feature with a pre-stored user timbre feature library to determine the identity of the speaking user.

7. The integrated virtual reality office system according to claim 1, characterized in that: The integrated virtual reality office system also includes: A keyboard is used to be anchored at a fixed position on a plane through the SLAM space modeling to provide input operations for the user.

8. An integrated virtual reality office method, characterized in that: Applied to the integrated virtual reality office system according to any one of claims 1 to 7, the system comprises a computing box and VR glasses, the computing box and the VR glasses are electrically connected, the computing box comprises a power supply, a camera and a motherboard, and the method comprises: Supplying power to the computing box and the VR glasses through the power supply; The camera is used to spatially model the current environment to obtain a three-dimensional model of the environment, and the user is modeled and gestures are recognized to obtain a three-dimensional model of the user; Generate corresponding audio and video data according to the environment stereo model and the user stereo model through the mainboard, and transmit the audio and video data to the VR glasses; The audio and video data are played through the VR glasses.

9. A computer device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the integrated virtual reality office method according to claim 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the integrated virtual reality office method according to claim 8 are implemented.

Images