Distributed conference system and method

Abstract

The invention discloses a distributed conference system and method. The distributed conference system of one embodiment is applied to a mobile environment, and the distributed conference system comprises a first device used for initiating a conference and constructing a local area network; a plurality of second devices which are not connected with each other, wherein the second devices are used for connecting the local area network and joining the conference; the first device is used for selecting one of the second devices according to the network state of the local area network and changing the selected second device into a new first device. The distributed conference system provided by the embodiment of the invention is applied to the mobile environment, the first equipment and the second equipment participating in the conference can select one of the plurality of second equipment as the new first equipment according to the change condition of the network state, so that the conference in the vehicle-mounted mobile environment is ensured to be normally carried out, and the user experience is improved. And a stable, efficient and safe conference is provided for distributed conferences in the same local area network.

Description

Technical Field

[0001] The present invention relates to the field of display technology, and more specifically, to a distributed conference system and method. Background Art

[0002] Online conferencing is a conferencing method based on network communication technology. It transmits audio, video, text, pictures and other information to the device terminals of each participant, allowing geographically non-adjacent users to communicate in real time through video, audio and other means.

[0003] Traditional network conferences are usually established in a quiet office environment, and the conference communication is carried out through a stable wired or wireless network. When participants are in a mobile environment, for example, when they suddenly need to participate in a meeting while driving or parking, they face the problem of how to join the meeting to ensure the quality of the meeting. For example, when colleagues in the company are on a business trip or friends travel together, there is also a need to set up a meeting in a local network environment. Summary of the invention

[0004] The object of the present invention is to provide a distributed conference system and method to solve at least one of the problems existing in the prior art.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] A first aspect of the present invention provides a distributed conference system, which is applied to a mobile environment and includes:

[0007] The first device is used to initiate a meeting and build a local area network;

[0008] a plurality of second devices that are not connected to each other, the second devices being used to connect to the local area network and join the conference;

[0009] The first device is used to select one of the second devices to be changed into a new first device according to the network status of the local area network.

[0010] The first device is also used to send a conference broadcast of the conference, and the conference broadcast includes control information and conference information, wherein the control information includes one or more of request data of the second device, heartbeat data of the second device that has joined the conference, and change data output to the second device, and the conference information includes the conference content of the conference.

[0011] In an optional embodiment, the first device and the second device are both used to obtain one or more of the location status, environment status, audio status and video status of the participant before joining the meeting, and to adjust one or more of the location status, environment status, audio status and video status of the participant after joining the meeting.

[0012] In an optional embodiment, the conference is a network conference.

[0013] The first device is further configured to establish a network conference connected to a network terminal, generate first network status information between the first device and the network terminal, and send the first network status information to the second device.

[0014] The second device is also used to connect to the network end when the first network status information is lower than a first preset threshold, and send the second network status information connected to the network end to the first device, so that the first device selects the second device with the best second network status information as the new first device to continue the meeting.

[0015] In an optional embodiment, the conference is a local conference.

[0016] The first device is also used to establish a local conference in the local area network.

[0017] The second device is used to generate third network status information between the second device and the first device according to the polling rule, and when the third network status information is lower than a second preset threshold, the second device changes the conference status of the second device.

[0018] A second aspect of the present invention provides a distributed conference system, the distributed conference system comprising:

[0019] A conference initiator, used to initiate a conference; and

[0020] At least one conference receiving terminal distributed in different networks, used for joining the conference;

[0021] The conference initiating end is used to construct a routing tree according to the number of the conference receiving ends and the network status between the conference initiating end and the conference receiving end, and generate an optimal node set for the conference receiving end to join according to the routing tree;

[0022] The conference receiving end is used to select a network node with the best network status from the optimal node set to join the conference.

[0023] In an optional embodiment, the routing tree includes:

[0024] A conference initiating node, corresponding to the conference initiating end;

[0025] A conference receiving node, corresponding to the conference receiving end;

[0026] A hierarchical transmission network node connected between the conference initiating node and the conference receiving node; and

[0027] A weighted edge connecting adjacent network nodes, wherein the weight value of the weighted edge corresponds to the network state between the adjacent nodes.

[0028] In an optional embodiment, the conference initiating end is further used to take the conference initiating node as the starting node and all the conference receiving nodes as the terminating nodes, traverse the network nodes between the conference initiating node and all the conference receiving nodes according to the transmission level and the weight value, and generate a network node set of the conference initiating node and all the conference receiving nodes;

[0029] The conference initiator is further configured to select a path including the most conference receiving nodes in the network node set as a main path, and use the network nodes corresponding to the main path as a first node set; and

[0030] The conference initiator is also used to take the unconnected conference receiving node in the main path as the starting node and any network node of the first node set as the ending node, traverse the network nodes between the unconnected conference receiving node and any network node of the first node set according to the transmission level and the weight value, and generate a second node set required for the unconnected conference receiving node to connect to any network node of the first node set, and the optimal node set includes multiple network nodes in the first node set and the second node set.

[0031] In an optional embodiment, the conference receiving end is further used to obtain network nodes within the connection range, select the network node with the best connection status as the access node, and use the traversal rule to select the network node with the smallest weight value among the adjacent network nodes, and expand from the access node to the conference initiating node in sequence until any network node of the first node set or the second node set in the routing tree corresponding to the conference is found, thereby joining the conference.

[0032] In an optional embodiment, the conference receiving terminal is further used to leave the conference.

[0033] The conference initiator is also used to detect the number of the conference receiving nodes connected to the same network node.

[0034] When it is detected that the number of conference receiving nodes is reduced, the conference initiating end is used to reduce the node out-degree of the network nodes directly connected to the conference receiving nodes in the routing tree by the same amount, and determine whether the node out-degree of the network nodes directly connected to the conference receiving nodes after the reduction is 0; when the node out-degree of the network nodes directly connected to the conference receiving nodes after the reduction is 0, the conference initiating end is also used to continue to reduce the node out-degree of adjacent network nodes, and determine whether the node out-degree of adjacent network nodes is 0, until a network node whose node out-degree is not 0 is detected in the routing tree.

[0035] In an optional embodiment, when the network node corresponding to the departing conference receiving node detects for the first time a network node whose node out-degree is not 0 at the transmission level to the conference initiating node,

[0036] The conference initiating end is also used to build a routing tree with the conference initiating node as the starting node and the network node where the node out-degree is first detected to be not 0 as the terminating node according to the changed number of the conference receiving ends and the network status between the conference initiating end and the conference receiving end.

[0037] In an optional embodiment, one or more of the conference initiating end and / or the conference receiving end are applied to a mobile conference environment, and the weight value is related to one or more of the distance between adjacent network nodes, speed change, and hardware parameters.

[0038] In an optional embodiment, the conference receiving end is applied to multiple conference devices located in the same local area network, and the local area network serves as a network node.

[0039] One of the plurality of conference devices is used as a first device, and the first device is further used to forward the conference established by the conference initiator and establish a local area network.

[0040] Other devices among the multiple conference devices serve as second devices, and the second devices are also used to connect to the local area network and join the conference.

[0041] A third aspect of the present invention provides a method for conducting a conference using the distributed conference system according to the first aspect of the present invention, the method comprising:

[0042] The first device initiates a meeting and builds a local area network;

[0043] A second device connects to the local area network and joins the conference, wherein a plurality of the second devices are not connected to each other;

[0044] The first device selects one of the second devices to be changed into a new first device according to the network status of the local area network.

[0045] A fourth aspect of the present invention provides a method for conducting a conference using the distributed conference system according to the second aspect of the present invention, the method comprising:

[0046] The conference initiator initiates the conference;

[0047] A conference receiving terminal joins the conference, wherein the conference receiving terminal and the conference initiating terminal are at least one conference receiving terminal distributed in different networks;

[0048] The conference initiator constructs a routing tree according to the number of the conference receiving terminals and the network status between the conference initiator and the conference receiving terminals, and generates an optimal node set for the conference receiving terminals to join according to the routing tree;

[0049] The conference receiving end selects a conference path with the best network status from the optimal node set to join the conference.

[0050] The beneficial effects of the present invention are as follows:

[0051] The distributed conference system of the embodiment of the present invention is applied to a mobile environment. The first device and the second device participating in the meeting can select one from multiple second devices as a new first device according to the change of the network status, thereby ensuring the normal progress of the meeting in the vehicle-mounted mobile environment and providing stable, efficient and secure meetings for distributed meetings within the same local area network. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The specific implementation modes of the present invention are further described in detail below in conjunction with the accompanying drawings.

[0053] Figure 1 A schematic diagram showing a framework of a distributed conference system according to an embodiment of the present invention;

[0054] Figure 2 Show Figure 1 A schematic diagram of the process of conducting a conference in the distributed conference system of the illustrated embodiment;

[0055] Figure 3 Show Figure 1 A schematic diagram of a framework of a first device of a distributed conference system of the illustrated embodiment;

[0056] Figure 4 and Figure 5 Schematic diagrams showing different examples of conference windows being displayed on an in-vehicle system;

[0057] Figure 6 A schematic diagram showing that the first device and / or the second device is a computer device;

[0058] Figure 7A schematic diagram showing a framework of a distributed conference system according to an embodiment of the present invention when conducting a network conference;

[0059] Figure 8 A schematic diagram showing a framework of a distributed conference system according to another embodiment of the present invention;

[0060] Fig. 9 A schematic diagram showing the application of the distributed conference system according to an embodiment of the present invention to different regions;

[0061] Fig.10 A schematic diagram showing a routing tree according to an embodiment of the present invention;

[0062] Fig.11 A schematic diagram showing a conference receiving terminal searching for a routing tree when joining a conference according to an embodiment of the present invention;

[0063] Fig.12 A schematic diagram showing a conference receiving terminal adjusting a routing tree after joining a conference according to an embodiment of the present invention;

[0064] Fig.13 A schematic diagram showing how a conference receiving terminal adjusts a routing tree after leaving a conference according to an embodiment of the present invention. DETAILED DESCRIPTION

[0065] In order to explain the present invention more clearly, the present invention is further described below in conjunction with embodiments and drawings. Similar components in the drawings are represented by the same reference numerals. It should be understood by those skilled in the art that the content specifically described below is illustrative rather than restrictive, and the protection scope of the present invention should not be limited thereto.

[0066] The embodiments of the present invention provide a distributed conference system and method to solve one or more of the above problems.

[0067] The first embodiment of the present invention provides a distributed conference system, such as Figure 1 As shown, the distributed conference system is applied to a mobile environment, and the distributed conference system 10 includes:

[0068] The first device 101 is used to initiate a meeting and build a local area network;

[0069] A plurality of second devices 102 that are not connected to each other, wherein the second devices 102 are used to connect to the local area network and join the conference;

[0070] The first device 101 is used to select one of the second devices 102 to be changed into a new first device 101 according to the network status of the local area network.

[0071] In one embodiment, the first device 101 can also be a mobile terminal or a non-mobile terminal. For example, the first device 101 includes a mobile phone, a tablet computer, a laptop computer, a smart watch, a vehicle-mounted system with a screen pen, a co-pilot with a screen device, a rear seat with a screen device or a head-up display device and other virtual projection devices.

[0072] In another embodiment, the second device 102 is also a mobile terminal or a non-mobile terminal.

[0073] In this embodiment, the distributed conference system 10 is applied to a vehicle environment. The vehicle system has functions such as communication, entertainment, navigation, and shopping. When people spend a lot of time in the car for commuting or business trips, participants may suddenly need to participate in a meeting while driving or parking. Therefore, the distributed conference system 10 of this embodiment is applied to a vehicle environment, which can provide users with a wider range of usage scenarios.

[0074] The first device 101 and the second device 102 form a local area network through a specific connection method. A local area network can establish a local meeting alone or participate in a remote meeting through a main device accessing a server. Optionally, the local area network between the first device 101 and the second device can be one or more of wireless local area networks (WLAN), Bluetooth (BT), near field communication (NFC), global system for mobile communication (GSM) or USB wired connection.

[0075] Based on the above design, in an optional embodiment, the first device 101 is used to select one of the second devices 102 to be changed as a new first device 101 according to the network status of the local area network. The distributed system of this embodiment can select one from multiple second devices 102 as a new first device 101 according to the network status change, so as to ensure the normal conduct of the meeting in the vehicle mobile environment.

[0076] Figure 2 The following is a schematic diagram showing the flow of the distributed conference system 10 according to this embodiment. Figure 3 A schematic diagram showing a framework of the first device 101 or the second device 102 of this embodiment is shown. Figure 2 and Figure 3 To illustrate with examples.

[0077] S210, the first device 101 creates a meeting. Exemplarily, the first device 101 can create a new meeting or join a cloud network meeting. For example, the first device 101 is applied to a vehicle system, which can be applied to any vehicle such as a private car, a taxi, a bus, or a public bus, and the second device 102 is a smartphone of a participant in the vehicle.

[0078] S220 , the second device 102 joins the local area network constructed by the first device 101 .

[0079] In this embodiment, after the first device 101 creates a conference, it turns on its own LAN switch, and the remaining second devices 102 are connected to the LAN built by the first device 101. The first device 101 and the second device 102 can establish a connection through the aforementioned wired or wireless method.

[0080] It should be noted that, in this embodiment, the first device 101 and the second device 102 may have different operating systems, as long as they can establish a local area network connection and transmit conference data using the same protocol.

[0081] S230: The first device 101 broadcasts the ongoing conference to the second device 102.

[0082] In an optional embodiment, the conference broadcast includes control information and conference information, and the control information and conference information can be encapsulated by TCP / IP protocol family agreement.

[0083] In this embodiment, the control information includes one or more of the request data of the second device 102, the heartbeat data of the second device 102 that has joined the meeting, and the change data output to the second device 102, such as a screen sharing request, etc. The conference information includes the conference content of the conference, such as the conference number, conference introduction, conference link in the case of network, voice of participants, image, possible file sharing and other conference content.

[0084] S240 : The second device 102 selects whether to join the meeting of the first device 101 according to the acquired control information and meeting information, and outputs a meeting request to the first device 101 .

[0085] Figure 3 A framework diagram of the first device 101 or the second device 102 of this embodiment is shown. In an optional embodiment, the first device 101 and the second device 102 are used to obtain one or more of the location status, environment status, audio status and video status of the participant before joining the meeting, and adjust one or more of the location status, environment status, audio status and video status of the participant after joining the meeting.

[0086] like Figure 3As shown, taking the device terminal of this embodiment as the first device 101 applied to the vehicle-mounted system as an example, the first device 101 and / or the second device 102 includes a collection unit 31, and the collection unit 31 acquires audio data, video data, file data, etc. for the conference. Exemplarily, the conference audio data is played by acquiring a microphone, recording software, vehicle-mounted audio, speakers, or other device speakers. Video data is acquired by a camera or the like.

[0087] In an optional embodiment, when the first device 101 is applied to the vehicle-mounted system, the first device 101 operates independently from the hardware state of the vehicle-mounted system, that is, the first device 101 does not affect and control the hardware state of the vehicle-mounted system, thereby ensuring driving safety.

[0088] In an optional embodiment, the first device 101 and / or the second device 102 is further configured to store the schedule information generated during the meeting in a vehicle-mounted system, such as a memo software, so as to save and record the schedule information and remind the participants on time. Figure 3 As shown, the data transmission unit of the first device 101 can realize the transmission function of schedule information.

[0089] In an optional embodiment, if Figure 3 As shown, the first device 101 and / or the second device 102 also includes a data processing unit 32, which has audio and video encoding and decoding functions. When the acquisition unit 31 acquires the image and sound data of the participants, the data processing unit 32 selects a suitable audio and video codec to encapsulate the acquired image and sound data. At the same time, the network data received from the data transmission unit from another device can be decoded by the data processing unit 32. Specific codecs include but are not limited to AAC, WAV, H264, H265, etc.

[0090] In a specific example, for conference audio data, the data processing unit 32 can identify the timbre based on artificial intelligence technology, and transcribe the sound data emitted by the participants in real time according to the different voiceprints of different participants. It can also determine whether to schedule and store the schedule information based on the content of the meeting, and prompt the user whether to set a memo after the meeting.

[0091] In another example, for files shared in a meeting, the data processing unit 32 of the first device 101 can use a suitable compression algorithm according to the network conditions to ensure that the files are displayed in the data transmission unit of the second device 102 of each participant in a timely manner to perform data transmission between the first device 101 and the second device 102.

[0092] Furthermore, the first device 101 is further used to save the meeting to the in-vehicle system. For example, Figure 3 The data processing unit 32 performs the above functions to prepare for the participants to review the meeting content later.

[0093] In an optional embodiment, if Figure 3 As shown, the first device 101 and / or the second device 102 further includes a data transmission unit 33 to perform data and information transmission between the first device 101 and the second device 102.

[0094] In one example, the data transmission unit 33 is used to package and assemble conference data in layers, send appropriate conference data according to the vehicle network conditions and the hardware processing capabilities of the connected second device 102, give priority to ensuring the establishment of the conference, and then increase the sending of data packets to improve the quality of the conference.

[0095] Furthermore, the data transmission unit 33 is also used to determine whether the connected second device 102 is still in a connected state and whether there are more second devices 102 joining the conference through a heartbeat mechanism. When the data transmission unit 33 receives an access request from the second device 102, other user terminal devices connected to the data transmission unit 33, such as mobile phones, tablets, and phone watches, process the flow switching of the distributed conference system 10.

[0096] In an optional embodiment, if Figure 3 As shown, the first device 101 and / or the second device 102 further include an authentication unit 34, which is responsible for the login and verification of participants, including a new user registration function, a login function, an encryption function when saving a meeting, a function of generating a URI or a meeting number when inviting to join a meeting, a password verification function for participants, etc. At the same time, the authentication unit 34 can also be used to encrypt and transmit the meeting content during the meeting transmission process to ensure the privacy and security of the meeting.

[0097] In an optional embodiment, if Figure 3 As shown, the first device 101 and / or the second device 102 also includes a control unit 35, and the control unit 35 is used to control the working state of the collection unit 31 in the vehicle system. For example, according to different information of the participants in the vehicle obtained by the collection unit 31 such as the microphone 312 and the camera 311, the control unit 35 controls the microphone 312 in the vehicle to adjust the volume collection, and controls the collection angle adjustment of the camera 311 to ensure the sound and image clarity of the participants.

[0098] In another example, depending on the vehicle's driving or parking status, the control unit 35 is also used to control different in-vehicle hardware such as in-vehicle lighting, air-conditioning temperature, seat tilt angle, etc., so that participants can conduct conference discussions in a more comfortable state.

[0099] In an optional embodiment, the first device 101 and / or the second device 102 further includes a conference presentation unit 36 ​​.

[0100] The conference display unit 36 ​​is used to display on the first window 41 of the display interface of the vehicle-mounted system 40, such as Figure 4 As shown, the display interface displays the conference content of the participants of the connected second device 102, for example Figure 4 The displayed list of participants, voice transcription information, and shared files.

[0101] In another example, the conference display unit 36 ​​is used to float on the first window 41 of the vehicle-mounted system 40 with a larger area for display in the form of a second window 362 with a smaller area, for example Figure 5 As shown, the first window 41 displays the navigation interface of the vehicle-mounted system 40 while driving, and the conference display unit 36 ​​minimizes the second window 362 to the upper right corner, using a floating small window display to ensure that it does not affect the user's navigation.

[0102] Furthermore, the conference display unit 36 ​​is also used to display different interface areas according to the display interfaces of different first devices 101 and / or different second devices 102. For example, when a mobile phone is used to attend a meeting, when a smart watch is used to attend a meeting, or when other screens of the vehicle such as HUD, rear seat screen, etc. have different display interfaces, the window area of ​​the conference display is different.

[0103] Based on the above implementation, the first device 101 and / or the second device 102 of this embodiment is a computer device, such as Figure 6 As shown, the computer device includes a memory, a processor, an IO module, a control module, a communication module, etc. Among them, the memory includes but is not limited to various non-volatile memory media or internal memory, which is used to store the operating system or the aforementioned conference system software program. The processor is responsible for executing the conference system software program and other logical functions such as network and data sharing. The IO module includes the processing of input and output devices such as identification and access to cameras, microphones, speakers, audio, external screens, and external devices. The control module is responsible for controlling the equipment installation environment to meet the conditions required for establishing a meeting, such as screen brightness, sound adjustment, etc. The communication module is configured with router and switch functions, can be connected to the regional server, and is responsible for local or remote conference data synchronization and communication in the LAN.

[0104] In an optional embodiment, if Figure 2 and Figure 7 As shown, the conference is a network conference, that is, the conference content needs to be transmitted through the network terminal 70 during the conference, and the first device 101 is also used to establish a network conference connected to the network terminal 70.

[0105] like Figure 2 As shown, S251, when the conference is a network conference, the first device 101 determines the connection status between the first device 101 and the network terminal 70, generates first network status information and sends it to the second device 102.

[0106] In this embodiment, Figure 7 As shown, the first device 101 determines its own network status at a preset frequency, generates first network status information between the first device 101 and the network terminal 70, and sends the first network status information to the second device 102.

[0107] For example, Figure 7 As shown, the first device 101 transmits the first network status information to all the connected second devices 102, for example Figure 7 The first second device 102 in the Nth second device 102.

[0108] like Figure 2 As shown, S261, when the first network status information is lower than a first preset threshold, the first device 101 selects one of the second devices 102 as a new first device 101.

[0109] The second device 102 is also used to connect to the network terminal 70 when the first network status information is lower than the first preset threshold value. At this time, it indicates that the conference status of the current first device 101 as the main device may be abnormal such as freezing. In this case, the first second device 102, the second second device 102, the third second device 102 to the Nth second device 102 are connected to the network terminal 70 respectively, so as to obtain the second network status information of themselves and the network terminal 70, and send the second network status information connected to the network terminal 70 to the first device 101.

[0110] Furthermore, in an optional embodiment, only the second network status information that is worse than the first network status information is sent to the first device 101 among the multiple second devices 102. This process eliminates the second device 102 whose network status is not as good as the first device 101 from the alternative solutions, thereby reducing the conference load.

[0111] After the first device 101 receives each piece of second network status information, the first device 101 selects the second device 102 with the best second network status information as a new first device 101 to continue the meeting.

[0112] During a network conference in a mobile environment, this embodiment can switch different second devices 102 as the first device 101 according to the network status, meet the remote conference needs in a mobile vehicle environment, provide stable, efficient and secure conferences, and is suitable for various scenarios such as business meetings and remote collaboration, and has wide applicability.

[0113] In an optional embodiment, the meeting is a local meeting, that is, the local area network between the devices does not need to be connected to the network terminal 70, such as a personal hotspot connection, Bluetooth connection or NFC and other short-distance connections. For example, people in different seats in the same vehicle are all participants, jointly constructing a local meeting.

[0114] In this embodiment, Figure 2 As shown, in step S252, the second device 102 generates third network status information between the first device 101 according to the polling rule. And in the subsequent step S262, when the third network status information is lower than the second preset threshold, the second device 102 changes the conference status of the second device 102.

[0115] In this embodiment, the first device 101 is also used to establish a local conference in the local area network, and the second device 102 is used to generate third network status information between the first device 101 according to the polling rule, and when the third network status information is lower than the second preset threshold, the second device 102 changes the conference status of the second device 102. Exemplarily, the second device 102 reduces its own conference definition from high definition to low definition to meet the fluency of its own conference.

[0116] In one embodiment, the first device 101 is further used to cache the historical data of the conference and share the historical data with the new first device 101 or the second device 102 .

[0117] In this embodiment, the first device 101 can cache the ongoing meeting history records during the meeting. When the first device 101 is switched or the newly joined second device 102 joins the meeting, the first device 101 can generate meeting information such as the meeting media file address, so that the switched first device 101 or the newly joined second device 102 can share this historical meeting media data.

[0118] Furthermore, the network terminal 70 is also used to synchronously cache the conference, and when the first device 101 or the second device 102 clears the local record, the first device 101 or the second device 102 can access the historical conference through the network terminal 70. Exemplarily, the shared media address can be a file uniform resource location (URL).

[0119] The distributed conference system 10 of the above embodiment of the present invention can meet the needs of remote conferences in a mobile vehicle environment, provide stable, efficient and secure conferences, is suitable for various scenarios such as business meetings and remote collaboration, and has wide applicability.

[0120] Another embodiment of the present invention provides a method for conducting a conference using the distributed conference system of the above embodiment, the method comprising:

[0121] The first device 101 sends a conference broadcast of the conference;

[0122] The second device 102 joins the conference according to the conference broadcast, wherein the first device 101 and the second device 102 are located in the same local area network, and the second devices 102 are not connected to each other;

[0123] The first device 101 selects one of the second devices 102 to be changed into a new first device 101 according to the network status of the local area network.

[0124] The method for conducting a distributed conference described in this embodiment can refer to the distributed system in the above embodiment, and the relevant parts are referenced and will not be repeated here.

[0125] Another embodiment of the present invention provides a distributed conference system 80, such as Figure 8 As shown, the distributed conference system 80 includes:

[0126] A conference initiating terminal 81, used to initiate a conference; and

[0127] At least one conference receiving terminal 82 distributed in different networks, used to join the conference;

[0128] The conference initiating terminal 81 is used to construct a routing tree according to the number of the conference receiving terminals 82 and the network status between the conference initiating terminal 81 and the conference receiving terminals 82, and generate an optimal node set for the conference receiving terminals 82 to join according to the routing tree;

[0129] The conference receiving terminal 82 is used to select a network node with the best network status from the best node set to join the conference.

[0130] In the distributed conference system 80 in the embodiment of the present invention, the conference initiator 81 generates a conference path set by constructing a routing tree, so that different conference receiving terminals 82 in a mobile state can select the optimal conference path in the conference path set to join the meeting according to their own network status, thereby providing stable, efficient and secure conferences, which is suitable for various scenarios such as business meetings and remote collaboration and has wide applicability.

[0131] In this embodiment, the conference initiator 81 and the conference receiver 82 can be installed in the user's conference equipment, such as the mobile device or fixed device described in the above embodiment, for example: the conference equipment includes a mobile phone, a tablet computer, a laptop computer, a smart watch, a car system with a screen pen, a co-pilot with a screen device, a rear seat with a screen device or a head-up display device and other virtual projection devices. Exemplarily, the conference initiator 81 and the conference receiver 82 can be applied to the conference equipment of the participants in the form of software, web pages, applets, etc.

[0132] In an optional embodiment, if Figures 9 to 13 As shown, the routing tree includes:

[0133] A conference initiating node (S1), corresponding to the conference initiating terminal 81;

[0134] Conference receiving nodes (S2-S5), corresponding to the conference receiving terminal 82;

[0135] The network nodes (E1-E9) connected between the conference initiating node S1 and the conference receiving nodes (S2-S5) according to the hierarchical transmission are connected to a plurality of service terminals 83 corresponding to the conference initiating terminal 81 and the conference receiving terminal 82; and

[0136] A weighted edge connecting adjacent network nodes, wherein the weight value of the weighted edge corresponds to the network state between adjacent nodes. Based on the routing tree of this embodiment, the conference initiator is used as the conference initiator node, and the conference receiver is used as the conference receiver node, to construct a conference path between the conference initiator and all conference receivers, and the network state between adjacent nodes is represented by the weighted edge, so that different conference receivers can be connected according to the optimal conference path.

[0137] For example, Fig. 9 As shown, in this embodiment, one conference initiating terminal 81 corresponds to multiple conference receiving terminals 82, and participants distributed in different urban areas need to conduct a network conference.

[0138] The conference initiator can be installed in the vehicle system of the first vehicle in the B urban area, and the user in the first vehicle is the conference initiator. In other words, the first vehicle or the vehicle system installed in the first vehicle is the conference initiator 81, so the first vehicle in the B urban area corresponds to the conference start node in the routing tree.

[0139] The second vehicle or the vehicle-mounted system installed in the second vehicle, which is also located in area B, is a conference receiving terminal 82 corresponding to the participant, corresponding to a conference receiving node in the routing tree.

[0140] The mobile phone located in area D serves as a conference receiving terminal 82, and the mobile phone corresponds to a conference receiving node in the routing tree.

[0141] The computer located in area F serves as a conference receiving terminal 82, and the computer corresponds to a conference receiving node in the routing tree.

[0142] Therefore, the conference transmission path formed by the first vehicle and the second vehicle is: conference initiating node (first vehicle) - network node (server in zone B) - conference receiving node (second vehicle).

[0143] The conference transmission path formed by the first vehicle and the mobile phone is: conference initiator (first vehicle) - network node (server in area B) - network node (server in city A) - network node (server in area D) - conference receiving node (mobile phone).

[0144] The conference transmission path formed by the first vehicle and computer is: conference initiating node (first vehicle) - network node (server in area B) - network node (server in city A) - network node (server in area F) - conference receiving node (computer).

[0145] The conference transmission path formed by the first vehicle and the screen projection device in the conference room is: conference initiating node (first vehicle) - network node (server in Area B) - network node (server in City A) - network node (server in Area F) - conference receiving node (screen projection device).

[0146] In an optional embodiment, one or more of the conference initiating terminal 81 and / or the conference receiving terminal 82 are applied to a mobile conference environment, and the weight value is related to one or more of the distance between adjacent network nodes, speed change, and hardware parameters.

[0147] In this embodiment, Fig. 9 As shown in the figure, when the conference initiator is the first vehicle located in area B, the conference receiver is the second vehicle located in area B, and the first vehicle and the second vehicle are in motion, the distance between the first vehicle and the server in area B, as well as the moving speed of the first vehicle, will change. Therefore, the weight value of the weighted edge between the conference initiator as the conference initiating node and the server in area B as the network node will also change. The higher the weight value of the weighted edge, the higher the loss of the conference transmission path.

[0148] Therefore, the embodiment of the present invention can determine the conference path with the minimum network transmission loss from different network nodes by constructing a routing tree with conference initiating nodes, conference receiving nodes, network nodes and weighted edges, thereby improving the quality of video conferencing.

[0149] This embodiment is for Fig.10 The process of the conference initiator constructing a routing tree and generating a conference path set according to the routing tree is illustrated as an example:

[0150] like Fig.10 As shown, the network structure of the distributed conference consists of a conference sending node S1 and multiple conference receiving nodes S2, S3, and S4, network nodes (E1 to E9) formed between the conference initiating node S1 and multiple conference receiving nodes S2, S3, and S4, and weighted edges between adjacent network nodes with weight values ​​representing network states. Multiple network nodes form multiple different conference transmission paths according to network transmission. The distributed network system of this embodiment ensures the quality of video conferencing by constructing a routing tree and selecting a conference path with the smallest network transmission from the routing tree.

[0151] In an optional embodiment, the conference initiating end is further used to take the conference initiating node as the starting node and all the conference receiving nodes as the terminating nodes, traverse the network nodes between the conference initiating node and all the conference receiving nodes according to the transmission level and weight value, and generate a network node set of the conference initiating node and all the conference receiving nodes.

[0152] For example, Fig.10 As shown, the conference initiating node S1 corresponds to the conference initiating end, and the conference receiving nodes S2, S3, and S4 correspond to different conference receiving ends, for example Fig.10 Two vehicles and a cell phone are shown.

[0153] The conference initiating node S1 is added to the queue as the starting node, and the conference receiving node S2 corresponding to a conference receiving end is used as the terminating node. First, the network node E1 directly connected to the conference initiating node S1 is found, and then the network node E2 or E3 with the smallest weighted edge of the network node E1 is found, and then the network node E5 is further found, and finally the network node E4 is found. The network node E4 is directly connected to the conference receiving node S2. Therefore, the conference path connecting the conference initiating node S1 and the conference receiving node S2 is P1, P1 = E1-E2-E5-E4.

[0154] Based on the same principle, the conference path connecting the conference initiating node S1 and the conference receiving node S3 is P2, where P1 = E1-E3-E6;

[0155] The conference path connecting the conference initiating node S1 and the conference receiving node S4 is P3, where P3 = E1-E3-E6-E9.

[0156] Therefore, the network node set V, V = {E1, E2, E3, E4, E5, E6, E9}, which constitutes the conference initiating node S1 and all the conference receiving nodes S2 to S4, is 7 nodes in total. Through the above process, the conference initiator obtains all the conference paths with the fastest network transmission between the conference initiating node and different conference receiving nodes.

[0157] Furthermore, in one embodiment, the conference initiator is further configured to select a path in the network node set that includes the most conference receiving nodes as a main path, and use network nodes corresponding to the main path as a first node set.

[0158] For example, Fig.10 As shown, conference paths P1 and P2 each include one conference receiving node, and the transmission process of path P3 includes transmission to conference receiving node S3 and conference receiving node S4. Therefore, path P3 including two conference receiving nodes is selected as the main path. Main path P3 includes the largest number of terminal conference requirements. After selecting the main path, the first node set V1 corresponding to the main path, V1 = {E1, E3, E6, E9}, but some conference receiving nodes, such as conference receiving node S2, are not added to the main path and cannot join the meeting.

[0159] Furthermore, in one embodiment, the conference initiating end is also used to take an unconnected conference receiving node in the main path as a starting node and any network node of the first node set as an ending node, traverse the network nodes between the unconnected conference receiving node and any network node of the first node set according to the transmission level and the weight value, and generate a second node set required for the unconnected conference receiving node to connect to any network node of the first node set.

[0160] For example, Fig.10 As shown, the conference receiving node S2 is not added to the main path. Therefore, the conference initiator reroutes the conference receiving node S2, first finds the network node E4 directly connected to the conference receiving node S2, and then finds the network node E5 with the smallest weight path through the network node E4, and can be added to the network node E3 of the first node set V1 corresponding to the main path P3 through the network node E5. Therefore, the path for the unconnected conference receiving node S2 to access the main path P3 is: network node E3-network node E5-network node E4-conference receiving node S2.

[0161] The second node set required for the unconnected conference receiving node S2 to connect to any network node of the first node set V1 is V2, V2 = {E4, E5}, and the second node set is also the minimum network transmission path that the conference receiving node S2 can connect to.

[0162] After the functions executed by the conference initiator, the optimal node set V3 with the fastest transmission that can be achieved by the routing tree of the conference initiator node S1 and multiple conference receiving nodes S2-S4 is obtained as follows: V3 = {E1, E3, E4, E5, E6, E9}, that is, the optimal node set includes multiple network nodes in the first node set and the second node set, for example Fig.10 The black network nodes.

[0163] The adjacent node set E with weighted edges formed by each adjacent network node in the optimal node set V3 is:

[0164] E={E1E3,E3E5,E3E6,E4E5,E6E9},

[0165] Based on the above optimal node set and adjacent node set E, it can be known that the optimal node set includes multiple conference paths of the conference path set formed by the network nodes adjacent in sequence. Through this routing tree, the conference data can ensure the least loss to complete the conference transmission and maximize the quality of the conference.

[0166] Considering that during a distributed conference, in another scenario, changes in vehicle positions may cause the conference receiving end to join and leave. Frequent joining may increase the routing tree burden and resource consumption, affecting the performance and stability of the regional network, and thus affecting the stability of the conference. Therefore, this embodiment further designs the functions that the conference receiving end needs to have in the event of new joining.

[0167] In an optional embodiment, if Fig.11 As shown, the conference receiving end is further used to obtain network nodes within the connection range, select the network node with the best connection status as the access node, and select the network node with the smallest weight value among the adjacent network nodes as the traversal rule, and expand from the access node to the conference initiating node in sequence until any network node of the main path in the routing tree corresponding to the conference is found to join the conference.

[0168] Exemplarily, when a new computer device is added as a new conference device, such as Fig.11 As shown, the new conference receiving end corresponds to the conference receiving node S5 in the routing tree. The conference receiving end obtains the network node E7 with the best network status from the conference receiving node S5, and then selects the network node E4 in the second node set with the smallest weighted edge with the network node E7 according to the network node E7. Since the network node E4 in the second node set and the conference initiating node S1 have the optimal path in the routing tree: E4-E5-E3-E1, after the new conference receiving end joins, it also has good conference quality on the basis of ensuring the stable connection of the original conference receiving end.

[0169] In an optional embodiment, the conference initiating end is further used to reconstruct the routing tree according to the network status of the newly joined conference receiving end.

[0170] For example, Fig.12 As shown, still taking the conference initiating node S5 as a newly added node as an example, the conference initiating end is further used to take the conference initiating node S1 as the starting node and all the conference receiving nodes S2~S5 as the terminating node, traverse the network nodes between the conference initiating node S1 and all the conference receiving nodes S2~S5 according to the transmission level and the weight value, and generate a network node set V of the conference initiating node S1 and all the conference receiving nodes S2~S5, for example, V={E1,E2,E3,E4,E5,E6,E7,E9}.

[0171] The conference initiator is further configured to select a path in the network node set that includes the most conference receiving nodes as a main path, and use the network nodes corresponding to the main path as a first node set. Fig.12 As shown, the conference receiving nodes corresponding to path P4 (P4=E1-E3-E6-E9) are S3 and S4, and the conference receiving nodes corresponding to path P5 (P4=E1-E2-E5-E4-E7) are S2 and S5. Therefore, when multiple paths with the same maximum number of connected conference receiving nodes appear in the network node set, each path serves as the main path. Then, paths P4 and P5 are both used as the main paths, and the first node set is V={E1, E2, E3, E4, E5, E6, E7, E9}.

[0172] Since all conference receiving nodes in the first node set are connected, the conference initiator does not need to construct a second node combination, and the first node set is used as the optimal node set to achieve dynamic reconstruction of the routing tree.

[0173] Considering that during a distributed conference, in another scenario, the departure of a large number of conference receivers will lead to a decrease in network resource utilization, resulting in a waste of network resources and affecting the quality of conference videos of other receivers. Therefore, this embodiment is further designed for the situation of the departure of the conference receiver.

[0174] In another optional embodiment, the conference receiving terminal is further used to leave the conference.

[0175] The conference initiating end is also used to detect the number of the conference receiving ends corresponding to the same terminating node.

[0176] When it is detected that the number of the conference receiving terminals is reduced, the conference initiating terminal is used to reduce the node out-degree of the termination node directly connected to the conference receiving terminal in the routing tree by the same amount, and determine whether the node out-degree of the reduced termination node is 0;

[0177] When the reduced node out-degree of the termination node is 0, the conference initiator is further used to continue reducing the node out-degree of the adjacent network node and determine whether the node out-degree of the adjacent network node is 0 until a network node with a non-0 node out-degree in the routing tree is detected.

[0178] like Fig.13 As shown, when the mobile phone as the conference receiving end leaves, that is, corresponding to the conference receiving node S4 leaving the routing tree, the network node of the optimal node set directly connected to the conference receiving node S4 is E9, and the node out-degree of the network node E9 is further reduced by 1. Fig.13 As shown, after the node out-degree of network node E9 is reduced by 1, whether the node out-degree is 0, which means that network node E9 is not currently connected to other conference receiving nodes, and continues to search for the node out-degree of network node E6 adjacent to network node E9 in the direction of conference initiating node S1 along the hierarchical transmission in the optimal node set. Network node E6 is originally connected to conference receiving node S3 and connected to conference receiving node S4 through network node E9. After the node out-degree of network node E9 is 0, the node out-degree of network node E6 is reduced from 2 to 1. Therefore, when it is detected that the node out-degree of network node E6 is not 0, the network node detection is stopped to ensure the stability of the conference that is still in progress after the conference receiving end leaves the conference.

[0179] In an optional embodiment, when the conference initiator detects for the first time a network node whose node out-degree is not 0 at the transmission level from the terminating node to the starting node, the conference initiator is also used to take the first node as the starting node and the network node where the node out-degree is first detected to be not 0 as the terminating node, and to build a routing tree according to the changed number of conference receiving terminals and the network status between the conference initiator and the conference receiving terminals.

[0180] After the conference receiving end in the aforementioned embodiment leaves and reduces the node out-degree of the directly connected network node, the conference initiating end in this embodiment re-finds the main path according to the aforementioned function, establishes the optimal network routing tree, and finally determines the optimal node set V3 = {E1, E2, E3, E4, E5, E6, E7}.

[0181] Based on the above embodiments, especially when distributed conferences are applied in mobile environments, the distributed conference system of the embodiments of the present invention dynamically adjusts the joining and leaving of conference receiving terminals to construct the optimal conference paths for different conference receiving terminals, thereby reducing network transmission losses, improving the conference stability of the distributed conference system, and providing a stable, efficient, and secure conference experience, which is suitable for various scenarios such as business meetings and remote collaboration.

[0182] In an optional embodiment, the conference receiving end is applied to multiple conference devices located in the same local area network, and the local area network serves as a network node.

[0183] One of the plurality of conference devices is used as a first device 101, and the first device 101 is also used to forward the conference established by the conference initiator and establish a local area network.

[0184] Other devices in the plurality of conference devices serve as second devices 102, and the second devices 102 are further configured to connect to the local area network and join the conference.

[0185] That is to say, the distributed conference system of the embodiment of the present invention can be used in combination with the distributed conference system of the first embodiment. When the two are combined, the network node is the local area network constructed by the first device 101. At the same time, the first device 101 itself also serves as a conference receiving end, and other second devices 102 in the local area network are conference receiving ends connected to the network node.

[0186] Furthermore, the distributed conference system of the embodiment of the present invention can be used in combination with the distributed conference system of the first embodiment, and the functions performed by the various units of the first device 101 and the second device 102 are still performed in the present embodiment, and the relevant parts can be referenced.

[0187] The distributed conference system based on the above-mentioned embodiment of the present invention is suitable for remote environments where participants are located in different conference environments. It can improve the conference stability of the distributed conference system, provide a stable, efficient and secure conference experience, and is suitable for various scenarios such as business meetings and remote collaboration, and has a wide range of adaptability scenarios.

[0188] Another embodiment of the present invention further provides a method for conducting a conference using the distributed conference system of the above embodiment of the present invention, the method comprising:

[0189] The conference initiator initiates the conference;

[0190] A conference receiving terminal joins the conference, wherein the conference receiving terminal and the conference initiating terminal are at least one conference receiving terminal distributed in different networks;

[0191] The conference initiator constructs a routing tree according to the number of the conference receiving terminals and the network status between the conference initiator and the conference receiving terminals, and generates an optimal node set for the conference receiving terminals to join according to the routing tree;

[0192] The conference receiving end selects a network node with the best network status from the optimal node set to join the conference.

[0193] It is worth noting that the specific implementation of the conference method of the embodiment of the present invention can refer to the distributed conference system of the aforementioned embodiment, which will not be described in detail here.

[0194] In the description of the present invention, relational terms such as first and second, etc. are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0195] Obviously, the above embodiments of the present invention are merely examples for clearly illustrating the present invention, and are not limitations on the embodiments of the present invention. For those skilled in the art, other different forms of changes or modifications can be made based on the above description. It is impossible to list all the embodiments here. All obvious changes or modifications derived from the technical solution of the present invention are still within the protection scope of the present invention.

Claims

1. A distributed conference system, characterized in that: The distributed conference system is applied to a mobile environment, and the distributed conference system includes: The first device is used to initiate a meeting and build a local area network; a plurality of second devices that are not connected to each other, the second devices being used to connect to the local area network and join the conference; The first device is used to select one of the second devices to be changed into a new first device according to the network status of the local area network.

2. The distributed conference system according to claim 1, characterized in that: The first device is also used to send a conference broadcast of the conference, and the conference broadcast includes control information and conference information, wherein the control information includes one or more of request data of the second device, heartbeat data of the second device that has joined the conference, and change data output to the second device, and the conference information includes the conference content of the conference.

3. The distributed conference system according to claim 2, characterized in that: The first device and the second device are both used to obtain one or more of the location status, environment status, audio status and video status of the participant before joining the meeting, and to adjust one or more of the location status, environment status, audio status and video status of the participant after joining the meeting.

4. The distributed conference system according to claim 1, characterized in that: The meeting is a network meeting. The first device is further configured to establish a network conference connected to a network terminal, generate first network status information between the first device and the network terminal, and send the first network status information to the second device. The second device is also used to connect to the network end when the first network status information is lower than a first preset threshold, and send the second network status information connected to the network end to the first device, so that the first device selects the second device with the best second network status information as the new first device to continue the meeting.

5. The distributed conference system according to claim 1, characterized in that: The conference is a local conference. The first device is also used to establish a local conference in the local area network. The second device is used to generate third network status information between the second device and the first device according to the polling rule, and when the third network status information is lower than a second preset threshold, the second device changes the conference status of the second device.

6. A distributed conference system, characterized in that: The distributed conference system comprises: A conference initiator, used to initiate a conference; and At least one conference receiving terminal distributed in different networks, used to join the conference; The conference initiating end is used to construct a routing tree according to the number of the conference receiving ends and the network status between the conference initiating end and the conference receiving end, and generate an optimal node set for the conference receiving end to join the conference according to the routing tree; The conference receiving end is used to select a network node with the best network status from the optimal node set to join the conference.

7. The distributed conference system according to claim 6, characterized in that: The routing tree comprises: A conference initiating node, corresponding to the conference initiating end; A conference receiving node, corresponding to the conference receiving end; A hierarchical transmission network node connected between the conference initiating node and the conference receiving node; and A weighted edge connecting adjacent network nodes, wherein the weight value of the weighted edge corresponds to the network state between the adjacent nodes.

8. The distributed conference system according to claim 7, characterized in that: The conference initiating end is further used to take the conference initiating node as the starting node and all the conference receiving nodes as the terminating nodes, traverse the network nodes between the conference initiating node and all the conference receiving nodes according to the transmission level and the weight value, and generate a network node set of the conference initiating node and all the conference receiving nodes; The conference initiator is further configured to select a path including the most conference receiving nodes in the network node set as a main path, and use the network nodes corresponding to the main path as a first node set; as well as The conference initiator is also used to take the unconnected conference receiving node in the main path as the starting node and any network node of the first node set as the ending node, traverse the network nodes between the unconnected conference receiving node and any network node of the first node set according to the transmission level and the weight value, and generate a second node set required for the unconnected conference receiving node to connect to any network node of the first node set, and the optimal node set includes multiple network nodes in the first node set and the second node set.

9. The distributed conference system according to claim 8, characterized in that: The conference receiving end is further used to obtain network nodes within a connection range, select the network node with the best connection status as the access node, select the network node with the smallest weight value among adjacent network nodes as a traversal rule, and expand from the access node to the conference initiating node in sequence until any network node of the first node set or the second node set in the routing tree corresponding to the conference is found, thereby joining the conference.

10. The distributed conference system according to claim 8, characterized in that: The conference receiving terminal is also used to leave the conference. The conference initiator is also used to detect the number of the conference receiving nodes connected to the same network node. When it is detected that the number of conference receiving nodes is reduced, the conference initiating end is used to reduce the node out-degree of the network nodes directly connected to the conference receiving nodes in the routing tree by the same amount, and determine whether the node out-degree of the network nodes directly connected to the conference receiving nodes after the reduction is 0; when the node out-degree of the network nodes directly connected to the conference receiving nodes after the reduction is 0, the conference initiating end is also used to continue to reduce the node out-degree of adjacent network nodes, and determine whether the node out-degree of adjacent network nodes is 0, until a network node whose node out-degree is not 0 is detected in the routing tree.

11. The distributed conference system according to claim 10, characterized in that: When the network node corresponding to the departing conference receiving node detects for the first time a network node whose node out-degree is not 0 at the transmission level to the conference initiating node, The conference initiating end is also used to build a routing tree with the conference initiating node as the starting node and the network node where the node out-degree is first detected to be not 0 as the terminating node according to the changed number of the conference receiving ends and the network status between the conference initiating end and the conference receiving end.

12. The distributed conference system according to claim 6, characterized in that: One or more of the conference initiating end and / or the conference receiving end are applied to a mobile conference environment, and the weight value is related to one or more of the distance between adjacent network nodes, speed change, and hardware parameters.

13. The distributed conference system according to any one of claims 6 to 12, characterized in that: The conference receiving end is applied to multiple conference devices located in the same local area network, and the local area network serves as a network node. One of the plurality of conference devices is used as a first device, and the first device is further used to forward the conference established by the conference initiator and establish a local area network. Other devices among the multiple conference devices serve as second devices, and the second devices are also used to connect to the local area network and join the conference.

14. A method for conducting a conference using the distributed conference system of claim 1, wherein: The method comprises: The first device initiates a meeting and builds a local area network; A second device connects to the local area network and joins the conference, wherein a plurality of the second devices are not connected to each other; The first device selects one of the second devices to be changed into a new first device according to the network status of the local area network.

15. A method for conducting a conference using the distributed conference system according to claim 6, characterized in that: The method comprises: The conference initiator initiates the conference; A conference receiving terminal joins the conference, wherein the conference receiving terminal and the conference initiating terminal are at least one conference receiving terminal distributed in different networks; The conference initiator constructs a routing tree according to the number of the conference receiving terminals and the network status between the conference initiator and the conference receiving terminals, and generates an optimal node set for the conference receiving terminals to join according to the routing tree; The conference receiving end selects a conference path with the best network status from the optimal node set to join the conference.

Images