Virtual reality interactive equipment for remote video conferencing
By designing virtual reality interactive devices for video conferencing, using smart terminals and projection technology, the virtual reality interactive effect is achieved, solving the problem of poor communication between existing devices in high-level meetings, and improving the effect of remote meetings and the flexibility of equipment.
Patent Information
- Application Number
- CN202410942271.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2044-07-15
AI Technical Summary
Existing virtual reality video conferencing equipment is difficult to achieve effective face-to-face communication in high-level meetings and major decision-making meetings, and the equipment is costly and has low popularity.
A remote virtual reality interaction device for video conferencing is designed. Through the cooperation between the main venue and the sub-venue, the video acquisition device and the audio acquisition device are used to obtain three-dimensional environmental image and voice information, and real-time projection and playback are carried out through the projector and the ring projection screen to achieve the virtual reality interaction effect.
The virtual reality interaction effect of remote meetings is realized, allowing remote meetings to have an immersive feeling, meet the needs of complex scenarios, improve the effect of remote meetings, and flexibly adjust the position of the projector and the retraction and placement of the ring projection screen through the design of transmission and drive components, avoiding the impact of long-term equipment lifting on the conference room.
Smart Images

Figure CN118678020B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video virtual reality interaction, in particular to a virtual reality interaction device for remote video conferencing. Background Art
[0002] Video conferencing is a common type of online conference. Video conferencing uses communication equipment and the Internet to assist in conversation meetings. This form of meeting allows participants to see, hear and interact with participants in other locations in real time, just like in a real conference room. In the main branch venue, the branch venue generally participates in the main venue's meeting through remote video. In order to improve the sense of participation, many virtual reality interaction technologies have emerged, such as Chinese patent ZL2014101069697.
[0003] At present, most common methods of virtual reality conferences are: wearing VR glasses, such as Chinese patent ZL2022223419109. The advantage of this method is that it has the strongest sense of immersion and is the most realistic, but it has many devices and complicated lines. It is also difficult for people in the venue to communicate with each other, and it is difficult to know each other's facial expressions. It lacks the communication and appeal between traditional conference participants.
[0004] Therefore, the better method is to project on a 3D screen. This method can make the members of the scoring venue do not need to wear VR glasses. Most of the participants watch a large screen like watching a movie. It is more friendly to venues with a large number of people and more for communication and teaching. However, for high-level meetings, in major decision-making meetings between a small number of people, more communication is needed. The seats are usually round tables or square tables. Therefore, a device that can be set at various positions to normally view the video scenes of other venues is needed. Although the use of virtual reality for meetings is relatively rare at present, mainly because the related equipment is expensive, the popularization of future technology will effectively reduce the cost of related equipment. It is a major trend to use this method for meetings. For this reason, we propose the use of virtual reality interactive equipment for remote video conferencing. Summary of the invention
[0005] The purpose of the present invention is to provide a virtual reality interactive device for remote video conferencing to solve the problems raised in the above background technology.
[0006] To achieve the above-mentioned object, the present invention provides the following technical solution: a virtual reality interactive device for remote video conferencing, comprising a first intelligent terminal used in a main conference venue for participating in a video conference and a second intelligent terminal used in a branch venue for participating in the conference, wherein the first intelligent terminal used in the main conference venue comprises a video acquisition device, an audio acquisition device and a first control host, and the second intelligent terminal comprises a projector, a circular projection screen, a player and a second control host;
[0007] The target feature image in the main venue is collected by the video acquisition device; the real three-dimensional material and the real human portrait corresponding to the target feature image are obtained, so that the real three-dimensional material and the real human portrait are subsequently projected and displayed in real time by the projector and the annular projection screen, so as to display the real three-dimensional environment and the real human portrait corresponding to the real three-dimensional material;
[0008] The audio information in the main venue is collected by an audio collection device; the collected audio information is transmitted and coordinated by the first control host and the second control host, and played in real time on the player of the branch venue to display the branch venue scene combining the virtual three-dimensional environment with the real environment;
[0009] The second intelligent terminal used in the branch venue also includes a driving device for controlling the projector and the annular projection screen, and the driving device includes:
[0010] An annular seat is fixed on the top of the branch venue room, the annular projection screen is centrally arranged below the annular seat, multiple groups of projectors are arranged, and the multiple groups of projectors are installed on the annular seat through mounting components, and the top of the branch venue room is provided with an adjustment component for adjusting the irradiation direction of each group of projectors, and the top of the branch venue room is provided with a retractable component for assisting the retraction and extension of the annular projection screen.
[0011] Preferably, the retractable assembly includes a mounting plate, a ring-shaped plate is fixed to the lower end of the mounting plate, an annular storage groove for storing the annular projection screen is opened above the annular plate, one end of the annular projection screen is located inside the annular storage groove, a fixed plate is fixed to the other end of the annular projection screen, the fixed plate is located below the mounting plate, a supporting assembly for supporting the annular projection screen during the retractable and retractable process is arranged on the annular plate, a driving assembly for driving the retractable and retractable annular projection screen is arranged on the inner side of the annular storage groove, and a cleaning assembly for cleaning the surface of the annular projection screen during the retractable and retractable process is arranged above the mounting plate.
[0012] Preferably, the support assembly comprises a support ring disposed above the annular plate and used for supporting against the inner side of the annular projection screen, and the support ring and the annular plate are mounted and fixed by a plurality of support frames.
[0013] Preferably, the drive assembly is provided with multiple groups on the annular receiving groove, and the multiple groups of drive assemblies are evenly distributed on the annular receiving groove, the drive assembly includes a U-shaped frame, a rubber wheel for abutting against the annular projection screen is rotatably connected to the U-shaped frame, a first motor for driving the rubber wheel is installed on the U-shaped frame, and an elastic assembly for elastically pushing the U-shaped frame is provided on the inner side of the annular receiving groove.
[0014] Preferably, the elastic component includes multiple groups of first sleeves fixed on the U-shaped frame, the first sleeves are slidably connected with a first slide rod, one end of the first slide rod is fixed to the inner wall of the annular receiving groove, and a spring is sleeved on the outer side of the first sleeve, the two ends of the spring are respectively against the inner wall of the annular receiving groove and the U-shaped frame, and the rubber wheel on the U-shaped frame is kept against the annular projection screen under the push of the elastic force of the spring.
[0015] Preferably, the cleaning component includes an operating disk rotatably connected to the upper end of the mounting disk, brushes that abut against the annular projection screen are fixed around the operating disk, a driving shaft is rotatably connected to the top of the branch venue room, one end of the driving shaft is fixed to the operating disk, and a second motor for driving the driving shaft is installed on the branch venue room.
[0016] Preferably, the mounting assembly includes a mounting seat fixed on the annular seat, a mounting frame is fixed to the lower end of the mounting seat, a rotating shaft is rotatably connected to the mounting frame, and the projector is fixed on the rotating shaft.
[0017] Preferably, the adjustment assembly includes a gear fixed at one end of the rotating shaft, a lifting ring is arranged below the annular seat, a rack is fixed to the inner side of the lifting ring through a connecting plate, the gear and the rack are meshed with each other, and a lifting assembly for lifting the lifting ring and a guide assembly for guiding during the lifting process are arranged in the branch venue room.
[0018] Preferably, the lifting assembly includes a threaded rod rotatably connected to the top of the branch venue room, a threaded tube is threadedly engaged on the threaded rod, one end of the threaded tube is fixed to the upper end of the lifting ring, and a third motor for driving the threaded rod is installed on the branch venue room.
[0019] Preferably, the guide assembly includes a second sliding rod fixed to the top of the branch venue room, a second sleeve is slidably connected to the second sliding rod, and one end of the second sliding rod is fixed to the lifting ring.
[0020] Compared with the prior art, the present invention has the following beneficial effects:
[0021] During the use of the virtual reality interactive device of the present invention for remote conferencing, through the mutual cooperation of the first intelligent terminal used in the main venue and the second intelligent terminal in the branch venue participating in the meeting, the virtual reality interactive effect of the remote conference is achieved between the branch venue and the main venue, making the remote conference produce an immersive feeling, and through a multi-interactive manner, it meets the needs in complex scenarios and further improves the effect of the remote conference.
[0022] In the process of projecting the acquired three-dimensional environment image by multiple groups of projectors of the present invention, the projectors are driven to rotate through transmission, and the positions of the projectors toward the annular projection screen are adjusted through the rotation of the projectors, so as to facilitate more flexible virtual projection operations.
[0023] After the virtual reality interactive video conference is over, the present invention drives the annular projection screen toward the inside of the annular storage groove for folding through transmission. By storing part of the annular projection screen, it is avoided that the annular projection screen is in a state of being suspended at a long distance for a long time, which affects other office activities in the conference room. In the process of folding the annular projection screen, the outer surface of the annular projection screen is cleaned through the cleaning component to ensure the effect of subsequent projection. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 is a flow chart of the virtual reality interaction process of the present invention;
[0025] Figure 2 It is a schematic diagram of the overall appearance structure of the present invention;
[0026] Figure 3 It is a schematic diagram of the positional relationship between the projector and the annular projection screen of the present invention;
[0027] Figure 4 It is a schematic diagram of the structure of the lifting assembly and the guide assembly of the present invention;
[0028] Figure 5 It is a schematic diagram of the structure of the installation component and the adjustment component of the present invention;
[0029] Figure 6 It is a schematic diagram of the internal structure of the installation disk of the present invention;
[0030] Figure 7 It is a schematic diagram of the structure of the retractable assembly and the supporting assembly of the present invention;
[0031] Figure 8 It is a schematic diagram of the structure of the driving component and the elastic component of the present invention;
[0032] Fig. 9 It is a schematic diagram of the structure of the annular plate and the annular receiving groove of the present invention;
[0033] Fig.10 It is a schematic diagram of the cleaning component structure of the present invention.
[0034] In the figure: 1, projector; 2, annular projection screen; 3, annular seat; 401, mounting seat; 402, mounting frame; 403, rotating shaft; 501, gear; 502, lifting ring; 503, connecting plate; 504, rack; 601, threaded rod; 602, threaded pipe; 603, third motor; 701, second sleeve; 702, second slide bar; 801, mounting plate; 802, annular plate; 803, annular storage groove; 804, fixing plate; 901, supporting frame; 902, supporting ring; 1001, U-shaped frame; 1002, rubber wheel; 1003, first motor; 1101, first sleeve; 1102, first slide bar; 1103, spring; 1201, operating panel; 1202, brush; 1203, driving shaft; 1204, second motor. DETAILED DESCRIPTION
[0035] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0036] See also Figure 1-Figure 10 The video conference remote virtual reality interactive device shown in the figure includes a first intelligent terminal used in the main venue of the video conference and a second intelligent terminal used in the branch venue of the conference. The first intelligent terminal used in the main venue includes a video acquisition device, an audio acquisition device and a first control host, and the second intelligent terminal includes a projector 1, a ring projection screen 2, a player and a second control host. The steps applied to this device include:
[0037] The target feature image in the main venue is collected by the video acquisition device; the real three-dimensional material and the real human portrait corresponding to the target feature image are obtained, so that the virtual three-dimensional material and the virtual human portrait can be projected and displayed in real time by the projector 1 and the annular projection screen 2, so as to display the real three-dimensional environment and the virtual human portrait corresponding to the real three-dimensional material;
[0038] During the use of the virtual reality interactive device for remote conferences, the three-dimensional environment image, virtual portrait and conference voice inside the main venue are acquired through the video acquisition device and audio acquisition device inside the main venue and transmitted to the first control host of the main venue;
[0039] Among them, in the process of acquiring the real three-dimensional materials and portraits of the main conference through video acquisition equipment, it mainly uses the binocular stereo vision method. The principle of this method is: simulate human binocular vision to obtain stereo images, use two camera modules to simulate the left and right eyes of a person, and capture the images observed by the left and right eyes respectively; in the simulation process, by calculating the difference (parallax) between the two images, the depth information of the object is inferred. This process is similar to the human brain using binocular vision to perceive the distance and depth of an object; it can also be done through the structured light 3D imaging method. The principle of this method is: use an invisible laser of a specific wavelength as a light source, and the light it emits carries a coded The code information is projected onto the object, and the distortion of the returned code pattern is calculated by a certain algorithm to obtain the position and depth information of the object. In the process of collecting real three-dimensional materials and portraits, in order to improve the measurement accuracy, this method may use an infrared laser to emit a beam of light, and then calculate the distance of the object by measuring the reflection time of the light. In addition, texture projection or structured light and other technologies may be used to increase the surface texture of the object, so as to better distinguish different object surfaces. Therefore, the technology and principle of obtaining the real three-dimensional materials and portraits of the main meeting through video acquisition equipment are relatively familiar, and as a prior art in the application, no further elaboration is made here;
[0040] The audio information in the main venue is collected by the audio collection device; the collected audio information is transmitted and coordinated by the first control host and the second control host, and played in real time on the player of the branch venue to display the main venue scene combining the virtual three-dimensional environment and the real environment;
[0041] The first control host converts the acquired real three-dimensional environment images, human portraits and conference voices into virtual signals, formats them into signal carriers, and transmits the signal carriers to the second control host of the branch venue through data;
[0042] Among them, the 3D environment image conversion method is more commonly used in the process of converting real 3D environment images and portraits into virtual signals. In the conversion process, first, the 3D environment images of the real world are obtained through video acquisition equipment. These devices can capture the depth information of the scene and generate 3D point cloud data or 3D models, that is, simulate the main venue scene; next, these data will be transmitted to the control host for processing, and in the host, special software or algorithms will be used to compress, optimize and encode the 3D image for subsequent use in the virtual environment. Finally, the processed 3D image data will be converted into a format that can be recognized in the virtual environment, such as OBJ, FBX, etc.
[0043] Among them, in the process of converting voice into virtual signal, the conversion of conference voice mainly involves speech recognition (ASR) technology, which captures the voice signal in the conference through the audio acquisition device and then transmits it to the first control host for processing. In the first control host, the speech recognition engine will parse the input voice signal and convert it into text or machine-recognizable instructions. This process may involve steps such as parameter extraction, reference model establishment, and pattern recognition;
[0044] After obtaining the relevant virtual signal carrier information, the second control host analyzes the information to obtain the virtual three-dimensional environment image, human portrait and conference voice, and then projects the obtained three-dimensional environment image onto the circular projection screen 2 through multiple groups of projectors 1 to play and convey the real-time image of the main venue in real time;
[0045] Among them, in the process of video signal analysis, first of all, the second control host will first decode the received video virtual signal. This decoding process is to restore the compressed video data to the original image sequence. Common video encoding formats include H.264, H.265, VP9, etc. The second control host needs to use the corresponding decoder for decoding according to the specific encoding format; then, the decoded video data will go through a series of image processing steps, such as color correction, denoising, sharpening, etc., to improve the quality and clarity of the image; finally, for multi-screen monitoring or specific display modes, the control host also needs to process the video stream, such as segmentation, synthesis, scaling, etc., to meet different display requirements;
[0046] Among them, when the projector 1 projects the acquired three-dimensional environment image onto the annular projection screen 2, the annular projection screen 2 has an arc of 360 degrees. Due to the wide radius of the annular projection screen 2, the vision of the conference participants is completely surrounded, which provides a highly immersive virtual simulation display environment; secondly, in order to achieve real-time virtual forming, the system uses a multi-channel annular projection screen 2 composed of multiple projectors 1 for display, which has a larger display size, wider field of view, more display content, higher resolution, and more impactful and immersive visual effects than ordinary standard projection systems. When the three-dimensional environment image is projected by the projector 1 onto the annular projection screen 2, the player plays the conference voice after transmission and reception in real time, and the conference participants can experience a highly fascinating three-dimensional audio-visual experience and obtain a fascinating visual virtual simulation environment. This experience is incomparable to traditional video equipment.
[0047] It should be noted here that: the real-time projection of the projector 1 on the annular projection screen 2 is a conventional technical means in the technical field, and will not be described in detail here. The projection method can refer to the related technology of Patent No. ZL2018207509497;
[0048] The second intelligent terminal used in the branch venue also includes a driving device for controlling the projector 1 and the annular projection screen 2, and the driving device includes:
[0049] An annular seat 3 is fixed on the top of the branch room, an annular projection screen 2 is centrally arranged below the annular seat 3, multiple groups of projectors 1 are arranged, and multiple groups of projectors 1 are installed on the annular seat 3 through mounting components, an adjustment component for adjusting the irradiation direction of each group of projectors 1 is arranged on the top of the branch room, and a retracting component for assisting the retracting and extending of the annular projection screen 2 is arranged on the top of the branch room;
[0050] During the use of virtual reality interactive equipment for remote conferencing, through the mutual cooperation of the first intelligent terminal used in the main venue and the second intelligent terminal in the branch venue participating in the meeting, the virtual reality interactive effect of the remote conference is achieved between the branch venue and the main venue, making the remote conference feel immersive, and through multi-interaction methods, it meets the needs in complex scenarios and further improves the effect of remote conferencing.
[0051] Preferably, the retractable assembly includes a mounting plate 801, a ring plate 802 is fixed to the lower end of the mounting plate 801, a ring-shaped receiving groove 803 for receiving the ring-shaped projection screen 2 is provided above the ring-shaped plate 802, one end of the ring-shaped projection screen 2 is located inside the ring-shaped receiving groove 803, a fixed plate 804 is fixed to the other end of the ring-shaped projection screen 2, the fixed plate 804 is located below the mounting plate 801, a supporting assembly for supporting the ring-shaped projection screen 2 during the retractable process is provided on the ring-shaped plate 802, a driving assembly for retracting and driving the ring-shaped projection screen 2 is provided on the inner side of the ring-shaped receiving groove 803, and a cleaning assembly for cleaning the surface of the ring-shaped projection screen 2 during the retractable process is provided above the mounting plate 801;
[0052] During the process of projecting the acquired three-dimensional environment image by multiple groups of projectors 1, the projectors 1 are driven to rotate through transmission, and the positions of the projectors 1 toward the annular projection screen 2 are adjusted through the rotation of the projectors 1, so as to facilitate more flexible virtual projection operations;
[0053] After the virtual reality interactive video conference is over, the annular projection screen 2 is driven toward the inside of the annular storage groove 803 through transmission to be folded up. By partially storing the annular projection screen 2, it is avoided that the annular projection screen 2 is suspended at a long distance for a long time, which may affect other office activities in the conference room. In the process of folding the annular projection screen 2, the outer surface of the annular projection screen 2 is cleaned through the cleaning component to ensure the effect of subsequent projection.
[0054] Preferably, the support assembly includes a support ring 902 arranged above the annular plate 802 and used for supporting the inner side of the annular projection screen 2. The support ring 902 and the annular plate 802 are installed and fixed by multiple groups of support frames 901. The support ring 902 is used to provide auxiliary support for the annular projection screen 2, so that the annular projection screen 2 can be more stably retracted and extended. The multiple groups of support frames 901 facilitate the installation and fixation of the support ring 902.
[0055] Preferably, a plurality of drive components are arranged on the annular storage groove 803, and the plurality of drive components are evenly distributed on the annular storage groove 803, and the drive components include a U-shaped frame 1001, a rubber wheel 1002 for abutting against the annular projection screen 2 is rotatably connected to the U-shaped frame 1001, a first motor 1003 for driving the rubber wheel 1002 is installed on the U-shaped frame 1001, and an elastic component for elastically pushing the U-shaped frame 1001 is arranged on the inner side of the annular storage groove 803; the first motor 1003 on each group of drive components is started, and the first motor 1003 is driven by the first motor 1 003, drives the rubber wheel 1002 to rotate. Since the two sides of the annular projection screen 2 are respectively against the inner wall of the annular storage groove 803 and the rubber wheel 1002, during the rotation of the rubber wheel 1002, the friction between the rubber wheel 1002 and the annular projection screen 2 drives the annular projection screen 2 to move toward the inside of the annular storage groove 803 for folding operation; during the process of driving the annular projection screen 2 to be released outward, the gravity of the fixed plate 804 at one end of the annular projection screen 2 causes the released annular projection screen 2 to droop, so that the annular projection screen 2 can be put down easily.
[0056] Preferably, the elastic component includes a plurality of first sleeves 1101 fixed on the U-shaped frame 1001, a first slide bar 1102 is slidably connected to the first sleeve 1101, one end of the first slide bar 1102 is fixed to the inner wall of the annular receiving groove 803, a spring 1103 is sleeved on the outer side of the first sleeve 1101, and the two ends of the spring 1103 are respectively against the inner wall of the annular receiving groove 803 and the U-shaped frame 1001, and the rubber wheel 1002 on the U-shaped frame 1001 is pushed by the elastic force of the spring 1103. The lower part is kept against the annular projection screen 2; the telescopic movement of the U-shaped frame 1001 is guided by the first sleeve 1101 and the first sliding rod 1102, and the U-shaped frame 1001 is squeezed and pushed by the spring 1103, so that the rubber wheel 1002 on the U-shaped frame 1001 is against the annular projection screen 2, and in the process of abutting and squeezing, the two sides of the annular projection screen 2 are respectively against the rubber wheel 1002 and the inner wall of the annular storage groove 803, so as to maintain the state of the annular projection screen 2 after being raised or lowered.
[0057] Preferably, the cleaning component includes an operating disk 1201 rotatably connected to the upper end of the mounting disk 801, brushes 1202 that abut against the annular projection screen 2 are fixed around the operating disk 1201, a driving shaft 1203 is rotatably connected to the top of the branch venue room, one end of the driving shaft 1203 is fixed to the operating disk 1201, and a second motor 1204 for driving the driving shaft 1203 is installed on the branch venue room; during the process of folding the annular projection screen 2, the operating disk 1201 at one end of the driving shaft 1203 is driven to rotate by the second motor 1204, and during the rotation of the operating disk 1201, each group of brushes 1202 is driven to rotate, and along with the folding of the annular projection screen 2 and the rotation of the brushes 1202, the outer surface of the annular projection screen 2 is cleaned to ensure the effect of subsequent projection.
[0058] Preferably, the mounting assembly includes a mounting seat 401 fixed on the annular seat 3, a mounting frame 402 is fixed to the lower end of the mounting seat 401, a rotating shaft 403 is rotatably connected to the mounting frame 402, and the projector 1 is fixed on the rotating shaft 403; the mounting seat 401, the mounting frame 402 and the rotating shaft 403 facilitate the rotatable installation of the auxiliary projector 1.
[0059] Preferably, the adjustment component includes a gear 501 fixed to one end of the rotating shaft 403, a lifting ring 502 is arranged below the annular seat 3, a rack 504 is fixed to the inner side of the lifting ring 502 through a connecting plate 503, the gear 501 and the rack 504 are meshed with each other, and a lifting component for lifting and lowering the lifting ring 502 and a guide component for guiding during the lifting process are arranged in the branch venue room; the lifting ring 502 is driven to perform lifting and lowering movements through the lifting component and the guide component, and during the lifting and lowering movement of the lifting ring 502, the rack 504 is driven to move synchronously through multiple groups of connecting plates 503, and during the movement of multiple groups of racks 504, the rotating shaft 403 and the projector 1 on the rotating shaft 403 are driven to rotate through the mutual meshing transmission between the rack 504 and the gear 501, and the position of the projector 1 toward the annular projection screen 2 is adjusted through the rotation of the projector 1, so as to facilitate more flexible virtual projection operations.
[0060] Preferably, the lifting component includes a threaded rod 601 rotatably connected to the top of the branch venue room, a threaded tube 602 is threadedly engaged with the threaded rod 601, one end of the threaded tube 602 is fixed to the upper end of the lifting ring 502, and a third motor 603 for driving the threaded rod 601 is installed on the branch venue room; the guide component includes a second slide bar 702 fixed to the top of the branch venue room, a second sleeve 701 is slidably connected to the second slide bar 702, and one end of the second slide bar 702 is fixed to the lifting ring 502; the threaded rod 601 is driven to rotate by the third motor 603, and during the rotation of the threaded rod 601, the lifting ring 502 is driven to move by the mutual engagement transmission of the threaded rod 601 and the threaded tube 602, and during the movement of the lifting ring 502, the lifting ring 502 after being subjected to force is lifted and lowered by the sliding guiding action of the second sleeve 701 and the second slide bar 702.
[0061] In this scheme: video conferencing remotely using virtual reality interactive equipment, including the following steps:
[0062] During the use of the virtual reality interactive device for remote conferences, the real three-dimensional environment image, human portrait and conference voice inside the main venue are acquired through the video acquisition device and audio acquisition device inside the main venue, and the acquired real three-dimensional environment image, human portrait and conference voice are transmitted to the first control host of the main venue. The first control host converts the acquired real three-dimensional environment image, human portrait and conference voice into virtual signals, and formats them to form signal carriers, and transmits the signal carriers to the second control host of the branch venue through data. After acquiring the relevant virtual signal carrier information, the second control host parses the information to acquire the virtual three-dimensional environment image, human portrait and conference voice, and then projects the acquired three-dimensional environment image onto the annular projection screen 2 through multiple groups of projectors 1, and plays and conveys the real-time image of the main venue in real time. In the process of playing, the conference voice after transmission and reception is played in real time by the player, so that the branch venue and the main venue achieve the virtual reality interaction effect of the remote conference, so that the remote conference has an immersive feeling, and meets the needs in complex scenes through multiple interactive methods, and further improves the effect of the remote conference;
[0063] During the projection of the acquired three-dimensional environment image by multiple projectors 1, the lifting ring 502 is driven to move up and down through the lifting assembly and the guide assembly. During the projection of the lifting ring 502, the rack 504 is driven to move synchronously through the multiple connecting plates 503. During the movement of the multiple racks 504, the rotating shaft 403 and the projector 1 on the rotating shaft 403 are driven to rotate through the mutual meshing transmission between the rack 504 and the gear 501. Through the rotation of the projector 1, the projection position of the projector 1 toward the annular projection screen 2 is adjusted, so as to facilitate more flexible virtual projection operation.
[0064] After the virtual reality interactive video conference is over, the first motor 1003 on each group of driving components is started, and the rubber wheel 1002 is driven to rotate through the first motor 1003. Because the two sides of the annular projection screen 2 are respectively against the inner wall of the annular storage groove 803 and the rubber wheel 1002, during the rotation of the rubber wheel 1002, the annular projection screen 2 is driven to lean against the inside of the annular storage groove 803 through the friction between the rubber wheel 1002 and the annular projection screen 2 to perform the folding operation. By storing part of the annular projection screen 2, the annular projection screen 2 is prevented from being in a state of being suspended for a long distance for a long time, which affects other office activities in the conference room. In the process of folding the annular projection screen 2, the operating disk 1201 at one end of the driving shaft 1203 is driven to rotate through the second motor 1204. During the rotation of the operating disk 1201, each group of brushes 1202 is driven to rotate. Along with the folding of the annular projection screen 2 and the rotation of the brush 1202, the outer surface of the annular projection screen 2 is cleaned to ensure the effect of subsequent projection.
[0065] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A virtual reality interactive device for remote video conferencing, comprising a first intelligent terminal used in a main conference venue for participating in a video conference and a second intelligent terminal used in a branch conference venue for participating in the conference, wherein the first intelligent terminal used in the main conference venue comprises a video acquisition device, an audio acquisition device and a first control host, and the second intelligent terminal comprises a projector (1), a circular projection screen (2), a player and a second control host; The second intelligent terminal used in the branch venue also includes a driving device for controlling the projector (1) and the annular projection screen (2), and the driving device includes: An annular seat (3) is fixed on the top of the branch meeting room, the annular projection screen (2) is centrally arranged below the annular seat (3), a plurality of projectors (1) are arranged, and the plurality of projectors (1) are mounted on the annular seat (3) via mounting components, an adjustment component for adjusting the illumination direction of each group of projectors (1) is arranged on the top of the branch meeting room, and a retractable component for assisting the retraction and extension of the annular projection screen (2) is arranged on the top of the branch meeting room; The retractable assembly comprises a mounting plate (801), a ring-shaped plate (802) being fixed at the lower end of the mounting plate (801), a ring-shaped receiving groove (803) for receiving the ring-shaped projection screen (2) being provided above the ring-shaped plate (802), one end of the ring-shaped projection screen (2) being located inside the ring-shaped receiving groove (803), a fixed plate (804) being fixed at the other end of the ring-shaped projection screen (2), the fixed plate (804) being located below the mounting plate (801), a supporting assembly for supporting the ring-shaped projection screen (2) during the retractable and retractable process being provided on the ring-shaped plate (802), a driving assembly for driving the retractable and retractable ring-shaped projection screen (2) being provided on the inner side of the ring-shaped receiving groove (803), and a cleaning assembly for cleaning the surface of the ring-shaped projection screen (2) during the retractable and retractable process being provided above the mounting plate (801).
2. The virtual reality interactive device for remote video conferencing according to claim 1, characterized in that: The support assembly comprises a support ring (902) arranged above the annular plate (802) and used for supporting against the inner side of the annular projection screen (2); the support ring (902) and the annular plate (802) are mounted and fixed via a plurality of groups of support frames (901).
3. The virtual reality interactive device for remote video conferencing according to claim 2, characterized in that: The drive assembly is provided in multiple groups on the annular storage groove (803), and the multiple groups of drive assemblies are evenly distributed on the annular storage groove (803), the drive assembly comprises a U-shaped frame (1001), a rubber wheel (1002) for abutting against the annular projection screen (2) is rotatably connected to the U-shaped frame (1001), a first motor (1003) for driving the rubber wheel (1002) is installed on the U-shaped frame (1001), and an elastic force assembly for elastically pushing the U-shaped frame (1001) is provided on the inner side of the annular storage groove (803).
4. The virtual reality interactive device for remote video conferencing according to claim 3, characterized in that: The elastic force component comprises a plurality of groups of first sleeves (1101) fixed on a U-shaped frame (1001), a first slide bar (1102) being slidably connected to the first sleeve (1101), one end of the first slide bar (1102) being fixed to the inner wall of the annular receiving groove (803), a spring (1103) being sleeved on the outer side of the first sleeve (1101), two ends of the spring (1103) respectively abutting against the inner wall of the annular receiving groove (803) and the U-shaped frame (1001), and the rubber wheel (1002) on the U-shaped frame (1001) is kept abutting against the annular projection screen (2) under the push of the elastic force of the spring (1103).
5. The virtual reality interactive device for remote video conferencing according to claim 1, characterized in that: The cleaning component comprises an operating disk (1201) rotatably connected to the upper end of the mounting disk (801); brushes (1202) are fixed around the operating disk (1201) and are against the annular projection screen (2); a driving shaft (1203) is rotatably connected to the top of the branch meeting room; one end of the driving shaft (1203) is fixed to the operating disk (1201); and a second motor (1204) for driving the driving shaft (1203) is installed on the branch meeting room.
6. The virtual reality interactive device for remote video conferencing according to claim 1, characterized in that: The mounting assembly comprises a mounting seat (401) fixed on the annular seat (3); a mounting frame (402) is fixed at the lower end of the mounting seat (401); a rotating shaft (403) is rotatably connected to the mounting frame (402); and the projector (1) is fixed on the rotating shaft (403).
7. The virtual reality interactive device for remote video conferencing according to claim 6, characterized in that: The adjustment component comprises a gear (501) fixed to one end of a rotating shaft (403); a lifting ring (502) is arranged below the annular seat (3); a rack (504) is fixed to the inner side of the lifting ring (502) via a connecting plate (503); the gear (501) and the rack (504) are meshed with each other; and a lifting component for lifting and lowering the lifting ring (502) and a guide component for guiding during the lifting process are arranged in the branch venue room.
8. The virtual reality interactive device for remote video conferencing according to claim 7, characterized in that: The lifting assembly comprises a threaded rod (601) rotatably connected to the top of the branch meeting room, a threaded tube (602) is threadedly engaged on the threaded rod (601), one end of the threaded tube (602) is fixed to the upper end of the lifting ring (502), and a third motor (603) for driving the threaded rod (601) is installed on the branch meeting room.
9. The virtual reality interactive device for remote video conferencing according to claim 8, characterized in that: The guide assembly comprises a second sliding rod (702) fixed to the top of the branch venue room, a second sleeve (701) is slidably connected to the second sliding rod (702), and one end of the second sliding rod (702) is fixed to the lifting ring (502).
Citation Information
Patent Citations
Panoramic annular large screen system
CN104597703A
Educational resource organism system
CN113570917A