Methods and devices for conducting multimedia conferences

By constructing a virtual reality model and building a virtual reality conference scene in the vehicle cabin, the problems of user interaction realism and information security in the integration of virtual reality technology with vehicles are solved, and the privacy and security of multimedia conferences are enhanced.

CN117676070BActive Publication Date: 2025-10-31WUHU AUTOMOBILE ADVANCED TECHNOLOGY INSTITUTE +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311652516.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-30
Publication Date
2025-10-31
Estimated Expiration
2043-11-30

AI Technical Summary

Technical Problem

Existing technologies have failed to effectively combine virtual reality technology with vehicles for multimedia conferencing, resulting in insufficient realism in user interaction and difficulty in guaranteeing meeting privacy and information security.

Method used

By constructing a virtual reality model in the vehicle cockpit, a virtual reality conference scene for multimedia conferencing is built based on virtual reality technology. The scene is then displayed using virtual reality devices, while the motion information of the participants is collected to adjust the interface, generate, and store conference files.

Benefits of technology

It enhances the realism of multimedia conference interaction for users in the vehicle cabin, and improves the privacy and information security of the meeting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117676070B_ABST
    Figure CN117676070B_ABST
Patent Text Reader

Abstract

A method and apparatus for conducting multimedia conferences, belonging to the field of vehicle technology, are disclosed. The method includes: during a multimedia conference conducted in the cockpit of a first vehicle, acquiring a virtual reality model of the vehicle's cockpit and conference information; constructing a virtual reality conference scene based on the virtual reality model and the conference information; and sending the virtual reality conference scene to a virtual reality device for display. Since the virtual reality model is a virtual world constructed based on the real-world scene of the vehicle's cockpit using virtual reality technology, constructing a virtual reality conference scene based on this model and displaying it on the virtual reality device establishes an interactive feedback loop between the real and virtual worlds for multimedia conferences, enabling virtual reality multimedia conferences to be conducted within a vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to a method and apparatus for conducting multimedia conferences. Background Technology

[0002] Virtual Reality (VR) technology combines the virtual and real worlds. With continuous scientific and technological innovation, VR technology has been widely applied in the industrial field, and combining VR technology with vehicles has become an inevitable trend in the development of the automotive industry. Summary of the Invention

[0003] This application provides a method and apparatus for conducting multimedia conferences. This application can apply virtual reality technology to vehicles to conduct multimedia conferences. The technical solution of this application is as follows.

[0004] Firstly, a method for conducting a multimedia conference is provided, the method comprising:

[0005] During a multimedia conference conducted in the cockpit of the first vehicle, a virtual reality model of the cockpit of the first vehicle and conference information of the multimedia conference are acquired, wherein the virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle.

[0006] The virtual reality conference scene of the multimedia conference is constructed based on the virtual reality model and the conference information of the multimedia conference.

[0007] The virtual reality conference scene is sent to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device displays the virtual reality conference scene.

[0008] Optionally, the step of building a virtual reality conference scene for the multimedia conference based on the virtual reality model and the conference information of the multimedia conference includes:

[0009] A meeting setup interface for conducting the multimedia conference is generated based on the meeting information;

[0010] The meeting interface is overlaid with the virtual reality model to obtain the virtual reality meeting scene.

[0011] Optionally, the method further includes:

[0012] Acquire action information of the actions performed by participants in the multimedia conference while wearing the virtual reality device in response to the conference interface in the virtual reality conference scene;

[0013] The meeting interface in the virtual reality meeting scene is adjusted based on the action information.

[0014] Optionally, the method further includes:

[0015] The meeting files are obtained based on the virtual reality meeting scenario. The meeting files are files generated during the multimedia meeting when the participants wear the virtual reality devices to conduct the multimedia meeting.

[0016] The meeting files are sent to a storage device that is communicatively connected to the first vehicle, so that the storage device stores the meeting files.

[0017] Optionally, before conducting the multimedia conference in the cabin of the first vehicle, the method further includes:

[0018] Obtain the virtual reality model of the cockpit of the first vehicle;

[0019] A first virtual interactive interface is generated based on the virtual reality model. The first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference.

[0020] The multimedia conference is created based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

[0021] Optionally, creating the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface includes:

[0022] The interaction information between the virtual reality device and the first virtual interactive interface is obtained, and the interaction information includes at least one of the following: action information of the actions made by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the voice emitted by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface.

[0023] The multimedia conference is created based on the interactive information.

[0024] Secondly, a multimedia conference system is provided, the system comprising: a first vehicle and a virtual reality device, the virtual reality device being communicatively connected to the first vehicle;

[0025] The first vehicle is used to perform the multimedia conferencing method provided by the first aspect or any optional implementation thereof;

[0026] The virtual reality device is used to display the virtual reality conference scene sent by the first vehicle.

[0027] Thirdly, a multimedia conference system is provided, the system comprising: a first vehicle and a virtual reality device, the virtual reality device being communicatively connected to the first vehicle;

[0028] The first vehicle is configured to: acquire a virtual reality model of the first vehicle's cabin and the conference information of the multimedia conference during a multimedia conference in the cabin of the first vehicle; construct a virtual reality conference scene of the multimedia conference based on the virtual reality model and the conference information of the multimedia conference; and send the virtual reality conference scene to the virtual reality device, wherein the virtual reality model is constructed based on virtual reality technology for the cabin of the first vehicle;

[0029] The virtual reality device is used to display the virtual reality conference scene.

[0030] Optionally, the first vehicle is configured to: generate a meeting interface for conducting the multimedia conference based on the meeting information; and overlay the meeting interface with the virtual reality model to obtain the virtual reality meeting scene.

[0031] Optionally, the virtual reality device is further configured to: collect action information of the actions performed by participants in the multimedia conference in relation to the conference interface in the virtual reality conference scene, and send the action information to the first vehicle;

[0032] The first vehicle is also used to adjust the meeting interface in the virtual reality meeting scene based on the motion information.

[0033] Optionally, the system further includes a storage device, which is communicatively connected to the first vehicle;

[0034] The first vehicle is used to acquire meeting files based on the virtual reality conference scenario and send the meeting files to the storage device. The meeting files are files generated during the multimedia conference when the participants wear the virtual reality devices to conduct the multimedia conference.

[0035] The storage device is used to store the meeting files.

[0036] Optionally, the first vehicle is further configured to: acquire the virtual reality model of the cabin of the first vehicle before conducting the multimedia conference in the cabin of the first vehicle; generate a first virtual interactive interface based on the virtual reality model, wherein the first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference; and create the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

[0037] Optionally, the first vehicle is configured to: acquire interaction information between the virtual reality device and the first virtual interactive interface, and create the multimedia conference based on the interaction information; wherein the interaction information includes at least one of the following: action information of actions performed by the conference creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the speech emitted by the conference creator wearing the virtual reality device in response to the first virtual interactive interface.

[0038] Fourthly, a multimedia conferencing device is provided, the device comprising:

[0039] The first acquisition module is used to acquire a virtual reality model of the cockpit of the first vehicle and the conference information of the multimedia conference during the process of conducting a multimedia conference in the cockpit of the first vehicle. The virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle.

[0040] A construction module is used to build a virtual reality conference scene for the multimedia conference based on the virtual reality model and the conference information of the multimedia conference;

[0041] The sending module is used to send the virtual reality conference scene to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device displays the virtual reality conference scene.

[0042] Optionally, the building module is used to: generate a meeting interface for conducting the multimedia conference based on the meeting information; and overlay the meeting interface with the virtual reality model to obtain the virtual reality meeting scene.

[0043] Optionally, the device further includes:

[0044] The second acquisition module is used to acquire action information of the actions performed by the participants of the multimedia conference while wearing the virtual reality device in response to the conference interface in the virtual reality conference scene.

[0045] An adjustment module is used to adjust the meeting interface in the virtual reality meeting scene based on the action information.

[0046] Optionally, the device further includes: a third acquisition module, used to acquire meeting files based on the virtual reality conference scene, wherein the meeting files are files generated during the process of participants in the multimedia conference wearing the virtual reality device to conduct the multimedia conference;

[0047] The sending module is further configured to send the meeting file to a storage device communicatively connected to the first vehicle, so that the storage device stores the meeting file.

[0048] Optionally, the device further includes:

[0049] The fourth acquisition module is used to acquire the virtual reality model of the cabin of the first vehicle before conducting the multimedia conference in the cabin of the first vehicle;

[0050] A generation module is used to generate a first virtual interactive interface based on the virtual reality model. The first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference.

[0051] A creation module is used to create the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

[0052] Optionally, the creation module is used for:

[0053] The interaction information between the virtual reality device and the first virtual interactive interface is obtained, and the interaction information includes at least one of the following: action information of the actions made by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the voice emitted by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface.

[0054] The multimedia conference is created based on the interactive information.

[0055] Fifthly, a multimedia conferencing apparatus is provided, including a memory and a processor, wherein the memory stores a computer program, which is loaded and executed by the processor to implement the multimedia conferencing method provided in the first aspect or any optional implementation thereof.

[0056] In a sixth aspect, a computer-readable storage medium is provided, wherein a computer program is stored therein, which, when executed (e.g., executed by a processor), implements the method for conducting a multimedia conference provided by the first aspect or any optional implementation thereof.

[0057] In a seventh aspect, a computer program product is provided, including a computer program / instruction that, when executed (e.g., executed by a processor), implements the method for conducting a multimedia conference provided by the first aspect or any optional implementation thereof.

[0058] The technical solution provided in this application includes at least the following technical effects:

[0059] The multimedia conferencing method and apparatus provided in this application involve a multimedia conferencing device that, during a multimedia conferencing session conducted in the cockpit of a first vehicle, acquires a virtual reality model of the vehicle's cockpit and the conference information. Based on this model and information, the device constructs a virtual reality conference scene and sends it to a virtual reality device connected to the vehicle, allowing the device to display the scene. Since the virtual reality model is a virtual world constructed from the real-world scene of the vehicle's cockpit using virtual reality technology, constructing and displaying this scene establishes an interactive feedback loop between the real and virtual worlds, creating a new visual environment and enhancing the user's sense of realism. Furthermore, because the user wears the virtual reality device within the vehicle's cockpit, the privacy of the multimedia conferencing is enhanced, ensuring information security.

[0060] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit this application. Attached Figure Description

[0061] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0062] Figure 1 This is a flowchart of a multimedia conferencing system provided in an embodiment of this application;

[0063] Figure 2 This is a flowchart illustrating a method for conducting a multimedia conference, as provided in an embodiment of this application.

[0064] Figure 3 This is a schematic diagram of a display interface provided in an embodiment of this application;

[0065] Figure 4 This is a schematic diagram of a meeting creation interface provided in an embodiment of this application;

[0066] Figure 5 This is a schematic diagram of a virtual interactive interface provided in an embodiment of this application;

[0067] Figure 6This is a schematic diagram of another virtual interactive interface provided in an embodiment of this application;

[0068] Figure 7 This is a schematic diagram of a gesture action provided in an embodiment of this application;

[0069] Figure 8 This is a schematic diagram of a multimedia conferencing device provided in an embodiment of this application;

[0070] Figure 9 This is a schematic diagram of a vehicle provided in an embodiment of this application.

[0071] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. Detailed Implementation

[0072] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0073] With the continuous development of society, vehicles have become an indispensable means of transportation for people's work and travel. Beyond their basic function of transportation, the added value that vehicle cabins can bring is constantly being explored. For example, based on the privacy and security of the vehicle cabin, it can be used as a mobile meeting space. Combined with the continuous innovation of digital virtual technology in recent years, virtual reality technology has been considered the next-generation general-purpose technology platform and the gateway to the next generation of the Internet, a crucial force leading a new round of global industrial revolution. It has already achieved relatively mature applications in industries and other fields, and has a very promising future. Therefore, in-vehicle digital virtual interaction will inevitably become a leading trend in the iterative development of intelligent vehicle cabins.

[0074] The technical solution provided in this application embodiment can realize the combination of virtual reality technology and vehicles, conduct multimedia conferences based on vehicles and virtual reality technology, enhance the user's realistic experience of conducting multimedia conferences, strengthen the privacy of multimedia conferences, and ensure the information security of multimedia conferences.

[0075] The technical solution of this application is described below. First, the system embodiment of this application is introduced.

[0076] The method for conducting multimedia conferences provided in this application can be applied to multimedia conference systems. For example, such as... Figure 1As shown, the system includes a first vehicle 10, a virtual reality device 20, and a storage device 30. The first vehicle 10 is communicatively connected to both the virtual reality device 20 and the storage device 30, and the virtual reality device 20 and the storage device 30 can also communicate with each other. That is, the first vehicle 10, the virtual reality device 20, and the storage device 30 can communicate with each other. For example, the first vehicle 10 and the virtual reality device 20 can be connected wirelessly or via a wired connection, as can the first vehicle 10 and the storage device 30, and vice versa. For instance, the first vehicle 10 and the virtual reality device 20 can communicate via a universal serial bus (USB) or wireless-fidelity (Wi-Fi), the first vehicle 10 and the storage device 30 can be connected via USB, Wi-Fi, or Bluetooth, and the storage device 30 and the virtual reality device 20 can be connected via Wi-Fi. The first vehicle 10 is used to construct a virtual reality conference scene for multimedia conferencing. The virtual reality conference scene is a scenario used to conduct multimedia conferences. Virtual reality device 20 is used to display the virtual reality conference scene of a multimedia conference. Storage device 30 is used to store the conference files generated by participants wearing the virtual reality device 20 during the multimedia conference. Storage device 30 can be a terminal or a server. The terminal can be, for example, a computer, personal computer, laptop computer, mobile phone, smartphone, tablet computer, cloud server, portable mobile terminal, multimedia player, e-book reader, wearable device, smart home appliance, artificial intelligence device, smart wearable device, or smart vehicle device, etc. In some embodiments, the virtual reality device 20 provided in this application embodiment can also be replaced by an augmented reality (AR) device. Figure 1 Taking the multimedia conference system, which includes a virtual reality device 20 and a storage device 30, as an example, the system can include at least one virtual reality device 20 and at least one storage device 30. The number of virtual reality devices 20 and storage devices 30 in the system can be configured according to user needs.

[0077] In an optional embodiment, the multimedia conference system includes: a first vehicle 10 and a virtual reality device 20, which is communicatively connected to the first vehicle 10;

[0078] The first vehicle 10 is used to: acquire a virtual reality model of the cockpit of the first vehicle 10 and the conference information of the multimedia conference during a multimedia conference in the cockpit of the first vehicle 10; build a virtual reality conference scene of the multimedia conference based on the virtual reality model and the conference information of the multimedia conference; and send the virtual reality conference scene to the virtual reality device 20, wherein the virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle 10.

[0079] The virtual reality device 20 is used to display the virtual reality conference scene.

[0080] Optionally, the first vehicle 10 is used to: generate a meeting interface for conducting the multimedia conference based on the meeting information; and overlay the meeting interface onto the virtual reality model to obtain the virtual reality meeting scene.

[0081] Optionally, the virtual reality device 20 is also used to: collect action information of the actions performed by the participants of the multimedia conference in relation to the conference interface in the virtual reality conference scene, and send the action information to the first vehicle 10;

[0082] The first vehicle 10 is also used to adjust the conference interface in the virtual reality conference scene based on the action information.

[0083] Optionally, the system further includes a storage device 30, which is communicatively connected to the first vehicle 10;

[0084] The first vehicle 10 is used to acquire meeting files based on the virtual reality meeting scene and send the meeting files to the storage device 30. The meeting files are generated during the process of the participants of the multimedia meeting wearing the virtual reality device 20 to conduct the multimedia meeting.

[0085] The storage device 30 is used to store the meeting documents.

[0086] Optionally, the first vehicle 10 is further configured to: acquire the virtual reality model of the cabin of the first vehicle 10 before conducting the multimedia conference in the cabin of the first vehicle 10; generate a first virtual interactive interface based on the virtual reality model, wherein the first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference; and create the multimedia conference based on the interaction between the virtual reality device 20 and the conference creation interface in the first virtual interactive interface.

[0087] Optionally, the first vehicle 10 is configured to: acquire interaction information between the virtual reality device 20 and the first virtual interactive interface, and create the multimedia conference based on the interaction information; wherein the interaction information includes at least one of the following: action information of the actions performed by the conference creator wearing the virtual reality device 20 in response to the first virtual interactive interface, and voice information of the speech emitted by the conference creator wearing the virtual reality device 20 in response to the first virtual interactive interface.

[0088] The above embodiments are a brief description of the method for conducting multimedia conferences in a multimedia conference system. The following is a detailed introduction to the method for conducting multimedia conferences.

[0089] The above is a description of the system embodiments of this application. The method embodiments of this application are described below.

[0090] Please refer to Figure 2 The diagram illustrates a flowchart of a multimedia conference setup method provided in an embodiment of this application. This method is executed by a multimedia conference setup device, which, for ease of description, will be referred to as the setup device below. This setup device is deployed in a first vehicle. The multimedia conference setup device can be a vehicle computer, a main control unit (MCU), or a functional module integrated on the system motherboard, etc. See also... Figure 2 The method process includes the following steps S201 to S203.

[0091] S201, during a multimedia conference in the cockpit of the first vehicle, a virtual reality model of the cockpit of the first vehicle and the conference information of the multimedia conference are acquired. The virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle.

[0092] The virtual reality scene is a 3D cockpit image constructed using virtual reality technology based on a 2D cockpit image of the first vehicle. This 3D cockpit image includes a display area for showcasing the meeting interface. The 2D cockpit image of the first vehicle is a two-dimensional image of the vehicle's cockpit captured by a camera. The meeting information is generated when the meeting is created. This information includes participant information, meeting name, meeting time, and meeting duration.

[0093] In an optional embodiment, when a connection is established between the virtual reality device and the multimedia conference initiation device, the initiation device conducts the multimedia conference by interacting with the virtual reality device. Specifically, participants in the multimedia conference (e.g., the conference creator) trigger an initiation command based on the display screen of the first vehicle. After receiving the initiation command, the initiation device obtains a virtual reality model of the first vehicle's cockpit and the conference information of the multimedia conference based on the initiation command. In one embodiment, after receiving the initiation command, the initiation device controls the camera of the first vehicle to capture a two-dimensional image of the first vehicle's cockpit. Based on virtual reality technology, the initiation device constructs a model based on the two-dimensional cockpit image of the first vehicle's cockpit to obtain a three-dimensional cockpit image of the first vehicle's cockpit. Then, the initiation device sets a display area in the three-dimensional cockpit image to display the conference initiation interface to obtain a virtual reality model of the first vehicle's cockpit. Simultaneously, the initiation device obtains the conference information of the multimedia conference. In another embodiment, after receiving the initiation command, the initiation device obtains the pre-stored virtual reality model of the first vehicle's cockpit and the conference information of the multimedia conference based on the initiation command. The virtual reality model and the conference information of the multimedia conference can be stored in the storage space of the first vehicle, or stored on a server, for example, in [location missing]. Figure 1 The storage device shown in this application is not limited in this respect.

[0094] Optionally, before conducting the multimedia conference in the cabin of the first vehicle, the multimedia conference initiation device creates the multimedia conference. For example, the initiation device interacts with a virtual reality device to create the multimedia conference. Specifically, the initiation device acquires a virtual reality model of the cabin of the first vehicle, generates a first virtual interactive interface based on the virtual reality model, displays the virtual reality model and a conference creation interface for creating the multimedia conference, and creates the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

[0095] In one embodiment, a multimedia conferencing application (App) is installed in the first vehicle, thereby enabling... Figure 3As shown, the display screen of the first vehicle shows the logo of the multimedia conferencing app. The person creating the multimedia conference clicks the logo to trigger the deployment device to open the app. After opening the app, the deployment device displays a conference creation interface for creating the multimedia conference and acquires a virtual reality model of the first vehicle's cockpit. Based on this virtual reality model and the conference creation interface, the deployment device generates a first virtual interactive interface, which displays both the virtual reality model and the conference creation interface. The conference creation interface includes multiple conference creation options, such as... Figure 4 As shown, the meeting creation interface includes the following meeting creation options: meeting topic, number of participants, meeting time, meeting reservation, meeting password, and meeting attendees. Optionally, the device can overlay the meeting creation interface onto the display area of ​​the virtual reality model used to display the meeting execution interface (i.e., cover the meeting creation interface onto the display area of ​​the virtual reality model used to display the meeting execution interface, such as...). Figure 5 (As shown) to obtain a first virtual interactive interface. Alternatively, the device employs augmented reality technology to merge the meeting creation interface with the virtual reality model to obtain the first virtual interactive interface. This application does not limit this approach.

[0096] After acquiring a virtual reality model of the cockpit of a first vehicle, the multimedia conferencing device establishes a connection with a virtual reality device worn by the meeting creator, for example, when the first vehicle is connected to the virtual reality device. The device then controls the virtual reality device to display a first virtual interactive interface. The meeting creator interacts with the meeting creation interface displayed on the first virtual interactive interface using the virtual reality device they are wearing. The device creates the multimedia conference based on this interaction. For example, the device generates a meeting creation command based on the interaction and creates the multimedia conference. The interaction between the meeting creator and the first virtual interactive interface includes the meeting creator wearing the virtual reality device interacting with the interface via voice, gestures, or a control stick.

[0097] Optionally, during the interaction between the meeting creator wearing the virtual reality device and the meeting creation interface displayed on the first virtual interactive interface of the virtual reality device, the multimedia conference initiation device acquires the interaction information between the virtual reality device and the meeting creation interface of the first virtual interactive interface. Based on this interaction information, the initiation device generates a meeting creation instruction, which carries the interaction information. The initiation device then creates the multimedia conference based on the interaction information carried by the meeting creation instruction. Optionally, the initiation device determines the conference information of the multimedia conference based on the interaction information carried by the meeting creation instruction, and then creates the multimedia conference based on the conference information. The interaction information includes at least one of the following: action information of the meeting creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the meeting creator wearing the virtual reality device in response to the first virtual interactive interface. The information includes the action information of the meeting creator wearing the virtual reality device and interacting with the first virtual interactive interface. This includes gesture information, controller operation information, and eye movement information. The meeting information also includes the meeting topic name, number of participants, meeting time, meeting password, and participant information.

[0098] In one example, after the meeting creator wears a virtual reality device, they make a first gesture and emit a first voice based on the first virtual interactive interface displayed on the virtual reality device. The virtual reality device collects the gesture information of the first gesture and the voice information of the first voice emitted by the meeting creator, and sends these two information to the convening device. Based on the gesture information, the convening device determines that the meeting creator has selected the meeting topic option in the meeting creation interface of the first virtual interactive interface, and based on the voice information, determines that the name of the multimedia meeting is "aa meeting".

[0099] In one example, after the meeting creator wears a virtual reality (VR) device, they make a second gesture based on the first virtual interface displayed by the VR device. The VR device collects the gesture information of the second gesture and sends it to the deployment device. Based on the gesture information, the deployment device determines that the meeting creator has selected a meeting participant option in the meeting creation interface of the first VR interface. Based on the selected meeting participant option, the deployment device controls the VR device to display a meeting participant selection interface. For example, the deployment device controls the VR device to display the meeting participant selection interface in the first VR interface. Optionally, the deployment device controls the VR device to jump from the meeting creation interface in the first VR interface to the meeting participant selection interface. The VR device collects the gesture information of a third gesture made by the meeting creator based on the meeting participant selection interface and sends it to the deployment device. Based on the gesture information of the third gesture, the deployment device determines the participants selected by the meeting creator, for example, determining that the meeting creator has selected participant 1 and participant 2.

[0100] In one example, after the meeting creator wears a virtual reality (VR) device, they operate the VR device's controllers based on a first virtual interface displayed on the VR device. The VR device collects the controller operation information from the meeting creator and sends it to the convening device. Based on this controller operation information, the convening device determines that the meeting creator has selected the meeting time option in the meeting creation interface of the first VR interface. The VR device also collects the voice information of a second voice message emitted by the meeting creator based on the first VR interface and sends this voice information to the convening device. Based on this voice information, the convening device determines the meeting time. For example, the voice information might be: meeting time January 1, 2024, 10:00:00 AM, meeting duration 60 minutes.

[0101] Based on the interaction between the meeting creator wearing a virtual reality device and the meeting creation interface displayed on the first virtual interactive interface of the virtual reality device, the multimedia conference initiation device determines that the meeting name is "Aa Meeting," the participants include participant 1 and participant 2, the meeting time is 10:00:00 on January 1, 2024, and the meeting duration is 60 minutes. The initiation device creates the multimedia conference based on this determined meeting information. Optionally, after creating the multimedia conference, the initiation device generates a meeting link based on the meeting information and sends the meeting link to the participant's device.

[0102] It should be noted that the virtual reality device includes a first camera and a second camera. The virtual reality device uses the first and second cameras to collect motion information of the meeting creator's actions. For example, the first camera captures a gesture image 1 of the meeting creator's first gesture, and the second camera captures a gesture image 2 of the same gesture. Both gesture images 1 and 2 are gesture information 2 of the first gesture. The virtual reality device sends both gesture images 1 and 2 to the unfolding device, which uses binocular vision technology to compare and analyze the gestures in gesture images 1 and 2 to determine the position information of the meeting creator's hand within the meeting creation interface. Furthermore, the deployment device uses image analysis technology to analyze the gestures in gesture image 1 and gesture image 2 to determine the gesture information of the meeting creator. The deployment device combines the position information of the meeting creator's hand in the meeting creation interface with the gesture information to generate the indicated gesture command (for example, the position information of the meeting creator's hand in the meeting creation interface indicates the position of the meeting topic option in the meeting creation interface, that is, the selection command indicated by the click gesture made by the meeting creator at the meeting topic option). The deployment device determines the meeting creation option selected by the meeting creator in interaction with the first virtual interactive interface based on the gesture command.

[0103] S202. Based on the virtual reality model and the conference information of the multimedia conference, build a virtual reality conference scene for the multimedia conference.

[0104] Optionally, the multimedia conference setup device generates a conference setup interface based on the conference information. This setup device overlays the conference setup interface onto the virtual reality model to obtain a virtual reality conference scene. The conference setup interface includes areas for displaying participant images, a conference name display area, a file-sharing area, a participant list area, and a conference timer area. For example, the setup device acquires information about the participants, the conference name, and the conference time. The setup device divides the conference setup interface into areas for displaying participant images, a conference name display area, a file-sharing area, a participant list area, and a conference timer area. The setup device displays the virtual reality images of the participants in the image display area, the conference name in the conference name display area, and the participant information (e.g., participant names) in the participant list area. For example, the virtual reality conference scene of the multimedia conference is as follows: Figure 6 As shown, the virtual reality meeting scene includes a meeting setup interface.

[0105] The multimedia conferencing device overlays the conferencing interface onto the virtual reality model to obtain the virtual reality conferencing scene. This includes: the device overlaying the conferencing interface onto the display area of ​​the virtual reality model used to display the conferencing interface to obtain the virtual reality conferencing scene; or, the device using augmented reality technology to merge the conferencing interface into the display area of ​​the virtual reality model used to display the conferencing interface, and using real-time 3D rendering technology to render the merged scene to obtain the virtual reality conferencing scene. This application embodiment does not limit this aspect.

[0106] S203. The virtual reality conference scene is sent to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device displays the virtual reality conference scene.

[0107] The multimedia conferencing setup is deployed in the first vehicle, and the virtual reality device that communicates with the first vehicle is also the virtual reality device connected to the setup. The virtual reality device that communicates with the first vehicle includes, but is not limited to, the virtual reality device described in step S201.

[0108] The device can send the virtual reality conference scene of the multimedia conference to the virtual reality device through a communication connection between the device and the virtual reality device. Upon receiving the virtual reality conference scene, the virtual reality device can display it. The virtual reality conference scene displayed by the virtual reality device can be projected onto the retina of the participants wearing the virtual reality device, allowing them to view the virtual reality conference scene.

[0109] In an optional embodiment, during a multimedia conference conducted by participants wearing virtual reality devices in the cabin of a first vehicle, the multimedia conference setup device acquires and stores the conference file based on the virtual reality conference scene displayed by the virtual reality device. For example, the setup device stores the conference file, or it sends the conference file to a storage device communicatively connected to the first vehicle, so that the storage device stores the conference file. The conference file is a file generated by the participants wearing the virtual reality device during the multimedia conference. The conference file can be a file shared by the participants during the multimedia conference, or it can be a file recording the process of the multimedia conference. For example, the conference file can be a video file generated by screen recording, an audio file generated by audio recording, or a log file recording the process of the multimedia conference, etc. Optionally, during a multimedia conference conducted by participants wearing virtual reality devices, the participants trigger a conference recording command in the virtual reality conference scene by interacting with the virtual reality device. The setup device records the conference based on the conference recording command using methods such as video recording, audio recording, or speech-to-text recording to generate a conference file.

[0110] In an optional embodiment, during a multimedia conference conducted in the cabin of a first vehicle while participants wear virtual reality devices, the multimedia conference setup device acquires shared files stored on a storage device and displays these shared files on the conference setup interface within the virtual reality conference scene. If the conference setup interface includes a file-sharing area for the multimedia conference, the shared files are displayed in that file-sharing area.

[0111] In an optional embodiment, during a multimedia conference conducted by participants wearing virtual reality devices in the cabin of a first vehicle, the multimedia conference setup device acquires action information of the actions performed by the participants wearing the virtual reality devices on the conference interface within the virtual reality conference scene. This action information includes gestures performed by the participants on the virtual reality devices and controller operation information for manipulating the virtual reality device's controllers on the conference interface. Gesture information may include gestures such as swiping up, zooming in, zooming out, and swiping down. For example, during a multimedia conference in the cabin of a first vehicle, participants wearing the virtual reality devices may perform actions such as swiping up, zooming in, zooming out, and swiping down on the file-sharing area of ​​the conference interface. Figure 7 The virtual reality device captures the motion image of the gesture shown and sends it to the unfolding device. The unfolding device adjusts the display area of ​​the meeting unfolding interface in the virtual reality meeting scene based on the motion image. Optionally, the unfolding device analyzes the motion image to obtain the action command indicated by the motion image, and adjusts the display area of ​​the meeting unfolding interface in the virtual reality meeting scene based on the action command. For example, if the unfolding device receives the motion image sent by the virtual reality device, and determines through image analysis that the action command indicated by the participant's gesture is to enlarge the display area of ​​the meeting unfolding interface, the unfolding device enlarges the display area of ​​the meeting unfolding interface in the virtual reality meeting scene based on the action command.

[0112] In summary, since this virtual reality model is a virtual world constructed based on the real-world scene (i.e., the real world) of the vehicle's cockpit using virtual reality technology, building a virtual reality conference scene based on this model and displaying it on a virtual reality device can establish an interactive feedback loop between the real and virtual worlds for multimedia conferences. This creates a new visual environment and enhances the realism of user interaction. Furthermore, because users conduct multimedia conferences while wearing virtual reality devices inside the vehicle's cockpit, the privacy of the multimedia conference is enhanced, ensuring information security.

[0113] The following are embodiments of the apparatus of this application, which can be used to execute the embodiments of the method of this application. For details not disclosed in the embodiments of the apparatus of this application, please refer to the embodiments of the method of this application.

[0114] Please refer to Figure 8This diagram illustrates a block diagram of a multimedia conferencing setup apparatus 800 provided in an embodiment of this application. The multimedia conferencing setup apparatus 800 is used to perform... Figure 2 The illustrated embodiment provides a method for conducting a multimedia conference. See also... Figure 8 The multimedia conferencing setup 800 includes...

[0115] The first acquisition module 801 is used to acquire a virtual reality model of the cockpit of the first vehicle and the conference information of the multimedia conference during the process of conducting a multimedia conference in the cockpit of the first vehicle. The virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle.

[0116] Module 802 is used to build a virtual reality conference scene for the multimedia conference based on the virtual reality model and the conference information of the multimedia conference;

[0117] The sending module 803 is used to send the virtual reality conference scene to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device can display the virtual reality conference scene.

[0118] Optionally, the setup module 802 is used to generate a meeting interface for conducting the multimedia conference based on the meeting information;

[0119] The meeting interface is overlaid on the virtual reality model to obtain the virtual reality meeting scene.

[0120] Optionally, the unfolding device 800 further includes:

[0121] The second acquisition module 804 is used to acquire action information of the actions performed by the participants of the multimedia conference while wearing the virtual reality device in response to the conference interface in the virtual reality conference scene.

[0122] The adjustment module 805 is used to adjust the display area of ​​the meeting interface in the virtual reality meeting scene according to the action information.

[0123] Optionally, the unfolding device 800 further includes:

[0124] The third acquisition module 806 is used to acquire meeting files based on the virtual reality meeting scenario. The meeting files are files generated by the participants of the multimedia meeting wearing the virtual reality device to conduct the multimedia meeting.

[0125] The sending module 803 is also used to send the conference file to a storage device that is communicatively connected to the first vehicle, so that the storage device stores the conference file.

[0126] Optionally, before conducting the multimedia conference in the cabin of the first vehicle, the deployment device 800 further includes:

[0127] The fourth acquisition module 807 is used to acquire the virtual reality model of the cockpit of the first vehicle;

[0128] The generation module 808 is used to generate a first virtual interactive interface based on the virtual reality model. The first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference.

[0129] Module 809 is used to create the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

[0130] Optionally, the creation module 809 is used to acquire interaction information between the virtual reality device and the first virtual interactive interface, the interaction information including at least one of the following: action information of the actions made by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the voice emitted by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface; and to create the multimedia conference based on the interaction information.

[0131] In summary, since the virtual reality model acquired by the first acquisition module is a virtual world constructed based on the real-world scene (i.e., the real world) of the vehicle's cabin using virtual reality technology, after the construction module builds a virtual reality conference scene based on this model, the sending module sends the virtual reality conference scene to the virtual reality device so that the virtual reality device can display the virtual reality conference scene. This establishes an interactive feedback loop between the real and virtual worlds for multimedia conferencing, creating a new visual environment and enhancing the realism of user interaction. Simultaneously, because users wear virtual reality devices within the vehicle's cabin to conduct multimedia conferences, the privacy of the multimedia conference is enhanced, ensuring information security.

[0132] The multimedia conferencing setup provided in this application can be a vehicle or a functional component deployed in a vehicle. Optionally, the multimedia conferencing setup is a functional component deployed in a vehicle, and this application also provides a vehicle including the multimedia conferencing setup.

[0133] As an example, please refer to Figure 9 , Figure 9 This is a schematic diagram of a vehicle 900 provided in an embodiment of this application. The vehicle 900 includes the multimedia conferencing setup device provided in the above embodiment to perform the multimedia conferencing setup method described above.

[0134] Typically, the vehicle 900 includes a processor 901 and a memory 902.

[0135] Processor 901 may include one or more processing cores, such as a quad-core processor or an octa-core processor. Processor 901 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 901 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 901 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 901 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0136] The memory 902 may include one or more computer-readable storage media, which may be non-transitory. The memory 902 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 902 is used to store a computer program, the computer program including at least one instruction, which is executed by the processor 901 to implement the multimedia conferencing method provided in the embodiments of this application.

[0137] In some embodiments, the vehicle 900 may also optionally include a peripheral device interface 903 and at least one peripheral device. The processor 901, memory 902, and peripheral device interface 903 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 903 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 904, a touch display screen 905, a camera 906, an audio circuit 907, a positioning component 908, and a power supply 909.

[0138] Peripheral device interface 903 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 901 and memory 902. In some embodiments, processor 901, memory 902 and peripheral device interface 903 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 901, memory 902 and peripheral device interface 903 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0139] The radio frequency (RF) circuit 904 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 904 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 904 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 904 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 904 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 904 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application embodiment.

[0140] Display screen 905 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 905 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 901 for processing. In this case, display screen 905 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 905, located on the front panel of the vehicle 900; in other embodiments, there may be at least two display screens 905, respectively located on different surfaces of the vehicle 900 or in a folded design; in still other embodiments, display screen 905 may be a flexible display screen, located on a curved or folded surface of the vehicle 900. Furthermore, display screen 905 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. Display screen 905 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0141] The camera assembly 906 is used to acquire images or videos. Typically, the camera assembly 906 includes a first camera and a second camera. The first camera is positioned inside the vehicle, and the second camera is positioned around the vehicle's perimeter. The first camera is used to acquire images of the cabin, and the second camera is used to acquire images of the environment surrounding the vehicle.

[0142] The audio circuit 907 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 901 for processing, or input to the radio frequency circuit 904 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the vehicle 900. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert the electrical signals from the processor 901 or the radio frequency circuit 904 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 907 may also include a headphone jack.

[0143] The positioning component 908 is used to determine the current geographical location of the vehicle 900 in order to enable navigation or LBS (Location Based Service). The positioning component 908 can be a positioning component based on the US GPS (Global Positioning System), China's BeiDou system, or Russia's Galileo system.

[0144] Power source 909 is used to supply power to the various components in vehicle 900. Power source 909 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power source 909 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0145] In some embodiments, the vehicle 900 further includes one or more sensors 190. The one or more sensors 190 include, but are not limited to: an acceleration sensor 911, a gyroscope sensor 912, a pressure sensor 913, a fingerprint sensor 914, an optical sensor 915, and a temperature sensor 916.

[0146] Accelerometer 911 can detect the magnitude of acceleration on three coordinate axes of a coordinate system established with respect to the vehicle 900. For example, accelerometer 911 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 901 can control touchscreen 905 to display the user interface in landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 911. Accelerometer 911 can also be used for games or for acquiring user motion data.

[0147] The gyroscope sensor 912 can detect the orientation and rotation angle of the vehicle 900. The gyroscope sensor 912, in conjunction with the accelerometer sensor 911, can collect the user's 3D movements of the vehicle 900. Based on the data collected by the gyroscope sensor 912, the processor 901 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0148] Pressure sensor 913 can be disposed on the side frame of vehicle 900 and / or on the lower layer of touch display screen 905. When pressure sensor 913 is disposed on the side frame of vehicle 900, it can detect the user's grip signal on vehicle 900, and processor 901 can perform left / right hand recognition or quick operation based on the grip signal collected by pressure sensor 913. When pressure sensor 913 is disposed on the lower layer of touch display screen 905, processor 901 can control operable controls on the UI interface based on the user's pressure operation on touch display screen 905. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0149] The fingerprint sensor 914 is used to collect the user's fingerprint. The processor 901 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 914, or vice versa. When the user's identity is identified as trusted, the processor 901 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 914 can be located on the front, back, or side of the display screen 905. When the display screen 905 has physical buttons or a manufacturer's logo, the fingerprint sensor 914 can be integrated with the physical buttons or manufacturer's logo.

[0150] An optical sensor 915 is used to collect ambient light intensity. In one embodiment, the processor 901 can control the display brightness of the touch screen 905 based on the ambient light intensity collected by the optical sensor 915. Specifically, when the ambient light intensity is high, the display brightness of the touch screen 905 is increased; when the ambient light intensity is low, the display brightness of the touch screen 905 is decreased. In another embodiment, the processor 901 can also dynamically adjust the shooting parameters of the camera assembly 906 based on the ambient light intensity collected by the optical sensor 915.

[0151] Those skilled in the art will understand that Figure 9 The structure shown does not constitute a limitation on the vehicle 900 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0152] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program. When the computer program is executed (e.g., by a processor, a multimedia conferencing device, a vehicle, etc.), it implements the multimedia conferencing method provided in the above-described method embodiments. It is worth noting that the computer-readable storage medium mentioned in the embodiments of this application can be a non-volatile storage medium; in other words, it can be a non-transient storage medium.

[0153] Based on the same inventive concept, this application provides a computer program product, including a computer program / instruction, which, when executed (e.g., by a processor, a multimedia conferencing device, a vehicle, etc.), implements the multimedia conferencing method provided in the above-described method embodiments.

[0154] It should be understood that all or part of the steps in the above method embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented in whole or in part as a computer program product. A computer program product includes one or more computer instructions. The computer instructions can be stored in the aforementioned computer-readable storage medium.

[0155] It should be understood that "at least one" as mentioned herein refers to one or more, and "multiple" refers to two or more. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B means A or B; "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first," "second," etc., are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or execution order, and the terms "first," "second," etc., do not necessarily imply that they are different.

[0156] The method embodiments, device embodiments, and system embodiments provided in this application can be referenced interchangeably, and this application does not limit them. The order of operations in the method embodiments provided in this application can be appropriately adjusted, and operations can be added or removed as needed. Any variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and therefore will not be elaborated further.

[0157] In the corresponding embodiments provided in this application, it should be understood that the disclosed systems, etc., can be implemented through other configurations. For example, the system embodiments described above are merely illustrative. For instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Modules described as separate components may or may not be physically separate, and components described as modules may or may not be physical modules. Some or all of the modules can be selected to achieve the purpose of the solution in this embodiment according to actual needs.

[0158] It should be noted that all information (including but not limited to vehicle equipment information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals involved in this application have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of related data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the motion information and voice information involved in this application were obtained with full authorization.

[0159] The above are merely optional embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for conducting a multimedia conference, characterized in that, The method includes: During a multimedia conference conducted in the cockpit of the first vehicle, a virtual reality model of the cockpit of the first vehicle and conference information of the multimedia conference are acquired, wherein the virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle. The virtual reality conference scene of the multimedia conference is constructed based on the virtual reality model and the conference information of the multimedia conference. The virtual reality conference scene is sent to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device displays the virtual reality conference scene.

2. The method according to claim 1, characterized in that, The construction of the virtual reality conference scene for the multimedia conference based on the virtual reality model and the conference information of the multimedia conference includes: A meeting setup interface for conducting the multimedia conference is generated based on the meeting information; The meeting interface is overlaid with the virtual reality model to obtain the virtual reality meeting scene.

3. The method according to claim 2, characterized in that, The method further includes: Acquire action information of the actions performed by participants in the multimedia conference while wearing the virtual reality device in response to the conference interface in the virtual reality conference scene; The meeting interface in the virtual reality meeting scene is adjusted based on the action information.

4. The method according to claim 2, characterized in that, The method further includes: The meeting files are obtained based on the virtual reality meeting scenario. The meeting files are files generated during the multimedia meeting when the participants wear the virtual reality devices to conduct the multimedia meeting. The meeting files are sent to a storage device that is communicatively connected to the first vehicle, so that the storage device stores the meeting files.

5. The method according to any one of claims 1-4, characterized in that, Before conducting the multimedia conference in the cabin of the first vehicle, the method further includes: Obtain the virtual reality model of the cockpit of the first vehicle; A first virtual interactive interface is generated based on the virtual reality model. The first virtual interactive interface displays the virtual reality model and a conference creation interface for creating the multimedia conference. The multimedia conference is created based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface.

6. The method according to claim 5, characterized in that, The creation of the multimedia conference based on the interaction between the virtual reality device and the conference creation interface in the first virtual interactive interface includes: The interaction information between the virtual reality device and the first virtual interactive interface is obtained, and the interaction information includes at least one of the following: action information of the actions made by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface, and voice information of the voice emitted by the meeting creator wearing the virtual reality device in response to the first virtual interactive interface. The multimedia conference is created based on the interactive information.

7. A multimedia conferencing system, characterized in that, The system includes: a first vehicle and a virtual reality device, wherein the virtual reality device is communicatively connected to the first vehicle; The first vehicle is used to perform the method described in any one of claims 1-6; The virtual reality device is used to display the virtual reality conference scene sent by the first vehicle.

8. A multimedia conferencing device, characterized in that, The device includes: The first acquisition module is used to acquire a virtual reality model of the cockpit of the first vehicle and the conference information of the multimedia conference during the process of conducting a multimedia conference in the cockpit of the first vehicle. The virtual reality model is constructed based on virtual reality technology for the cockpit of the first vehicle. A construction module is used to build a virtual reality conference scene for the multimedia conference based on the virtual reality model and the conference information of the multimedia conference; The sending module is used to send the virtual reality conference scene to a virtual reality device that is communicatively connected to the first vehicle, so that the virtual reality device displays the virtual reality conference scene.

9. The apparatus according to claim 8, characterized in that, The building module is used for: A meeting setup interface for conducting the multimedia conference is generated based on the meeting information; The meeting interface is overlaid with the virtual reality model to obtain the virtual reality meeting scene.

10. The apparatus according to claim 9, characterized in that, The device further includes: The second acquisition module is used to acquire action information of the actions performed by the participants of the multimedia conference while wearing the virtual reality device in response to the conference interface in the virtual reality conference scene. An adjustment module is used to adjust the meeting interface in the virtual reality meeting scene based on the action information.

Citation Information

Patent Citations

  • 3D (3-Dimensions) video conference method based on virtual reality technology and equipment

    CN107071334A

  • Cockpit engineering virtual evaluation device

    CN112380735A