Adaptive switching and fusion method based on bluetooth intercom and cloud intercom

Abstract

The application belongs to the technical field of wireless communication, and discloses a self-adaptive switching and fusion method based on Bluetooth intercom and cloud intercom, which comprises the following steps: creating a Mesh voice network; constructing a shadow chat network in a cloud network; detecting the online state of all Mesh nodes in real time, and updating the online state of the Mesh nodes in a server in real time; when a Mesh node is out of connection, other Mesh nodes not out of connection report the out-of-connection information of the Mesh node to the server, and simultaneously upload voice data of the node to the server; the server mixes the received voice data, and distributes the mixed voice data to the out-of-connection Mesh node; and the voice data between other Mesh nodes not out of connection in the Mesh network is still transmitted through the Mesh voice network. The method can smoothly switch the voice transmission channel, and keep the real-time performance and the integrity of voice data transmission.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of wireless communication, and particularly relates to an adaptive switching and fusion method based on Bluetooth intercom and cloud intercom. BACKGROUND

[0002] In the prior art, Bluetooth intercom technology is widely used in various fields, such as security intercom fields, automobile off-road communication fields, and small-range communication fields such as outdoor engineering command. The intercom equipment forms a voice network through a mesh mechanism to realize real-time intercom function. Within the Bluetooth signal coverage range, voice data transmission can be realized.

[0003] Due to the factors of the use scene being blocked by buildings or large and small slopes and other obstacles, and having respective band signal interference, the strength and receiving sensitivity of the Bluetooth signal are affected by different use scenes, and the real-time performance and continuous integrity of voice data transmission are often affected. When the node of the existing mesh voice network is disconnected, the voice data of other nodes is lost, and only the voice in the respective sub-mesh network can be maintained. The lost node cannot receive or send the uplink and downlink voice data of the node, which affects the voice data transmission between all other nodes and the lost node, thereby affecting the use experience of the Bluetooth intercom equipment and failing to realize continuous communication function.

[0004] In view of the shortcomings of the prior art, there is an urgent need for an intercom fusion technology capable of maintaining the real-time performance and continuous integrity of voice data transmission to overcome the above-mentioned shortcomings. SUMMARY

[0005] The purpose of the embodiment of the application is to provide an adaptive switching and fusion method based on Bluetooth intercom and cloud intercom, which can smoothly switch the voice transmission channel and maintain the real-time performance and continuous integrity of voice data transmission.

[0006] The embodiment of the application is implemented as follows:

[0007] The adaptive switching and fusion method based on Bluetooth intercom and cloud intercom comprises:

[0008] 101. A Bluetooth Mesh network mechanism is used to create a Mesh voice network, and the Mesh voice network comprises a plurality of Mesh nodes;

[0009] A shadow chat network is constructed in the server of the cloud network, and the nodes of the shadow chat network correspond one-to-one to the Mesh nodes of the Mesh voice network;

[0010] 102. The in-network state of all Mesh nodes of the Mesh voice network is detected in real time, and the in-network state of the Mesh nodes is updated in real time in the server of the cloud network;

[0011] 103、When the Mesh node is lost, the other non-lost Mesh nodes report the Mesh node lost information to the server through the cloud network, and the other non-lost Mesh nodes upload the voice data of the nodes to the server through the cloud network at the same time;

[0012] 104、The server mixes the received voice data, and according to the corresponding relationship of the shadow chat network, the mixed voice data is sent to the lost Mesh node through the cloud network;

[0013] 105、The voice data between the other non-lost Mesh nodes in the Mesh network is still transmitted through the Mesh voice network.

[0014] Step 101 further comprises:

[0015] After creating the Mesh voice network, the Mesh network assigns a network_id to each node, and the network_id of each node is the same. Each node carries the network_id information to send a request to the server through the cloud network to enter the construction of the shadow chat network. The room number of the shadow chat network is network_id.

[0016] Step 103 further comprises:

[0017] The other non-lost Mesh nodes open the cloud network voice sampling channel, upload the voice data of the nodes to the server through the cloud network, and transmit the voice data of the nodes to the Mesh voice network for the other non-lost Mesh nodes except the node to receive.

[0018] Step 104 further comprises:

[0019] The server sorts the received voice data. If different nodes send voice at the same time, the voice data sent by different nodes at the same time is mixed and processed, and the mixed voice data is sent. If no different nodes send voice at the same time, the current voice data is directly sent.

[0020] Step 105 further comprises:

[0021] The other non-lost Mesh nodes receive the voice data of the Mesh voice network and the voice data of the cloud network at the same time, and then play after mixing.

[0022] Wherein, after the shadow chat network is created, the heartbeat needs to be kept between each node and the server, the server detects that the node heartbeat is timed out for several times, the server issues the information that the node is offline to other nodes, other nodes rejudge the mesh node disconnection information and report to the server, and whether the node voice data is uploaded to the server through the cloud network is decided according to the latest mesh node disconnection information.

[0023] Wherein, after the shadow chat network is created, if the node is actively disconnected, the active disconnection information of the node is reported to the server by other nodes that are not disconnected, the server marks the active disconnection node as a leaving state, and the marking information is pushed to other nodes that are not disconnected, other nodes that are not disconnected do not need to upload the node voice data to the server through the cloud network, and continue to maintain the mesh voice network to transmit voice data; if the actively disconnected node returns, the actively disconnected node re-joins the shadow chat network, and the server issues the re-joining information to other nodes that are not disconnected, and other nodes that are not disconnected wait for the actively disconnected node to re-join the mesh voice network.

[0024] Wherein, the cloud network is a 3G network, a 4G network or a 5G network.

[0025] The embodiment of the application acquires the online situation of the mesh network node in real time, when the mesh network node is disconnected, the cloud network transmission is smoothly switched to transmit voice data, so that the normal voice data transmission and reception of the disconnected node are ensured, the experience effect of smooth and no sense is achieved, the mesh network transmission is continued between the mesh network nodes that are not disconnected, the cloud network transmission is used as a backup channel when the node is disconnected, the channel is timely enabled, the stability and integrity of the voice data transmission are ensured, the shadow chat network of each node is formed in the cloud network, the voice data of each node is forwarded by the cloud server according to the mesh network node disconnection situation, the normal voice data transmission under the node disconnection state is ensured, and the effect that all nodes are online in real time and uninterrupted voice data transmission is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 It is a talkback adaptive switching and fusion method flowchart in the application taking 4G as an example;

[0027] Figure 2 It is a mesh networking and cloud networking voice data transmission schematic diagram in the application; Figure 1 ;

[0028] Figure 3 It is a mesh networking and cloud networking voice data transmission schematic diagram in the application; Figure 2 ;

[0029] Figure 4 It is a message interaction schematic diagram of the cloud server and the device end in the application. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in combination with the drawings and examples. It should be understood that the specific examples described herein are only used to explain the present application and do not limit the present application.

[0031] The specific implementation of the present application is described in detail below in combination with specific examples:

[0032] The adaptive switching and fusion method based on Bluetooth intercom and cloud intercom includes:

[0033] 101. A Mesh voice network is created using the Bluetooth Mesh network mechanism, and the Mesh voice network includes multiple Mesh nodes;

[0034] A shadow chat network is constructed on the server side in the cloud network, and the nodes of the shadow chat network correspond one-to-one to the Mesh nodes of the Mesh voice network;

[0035] After the Mesh voice network is created, the Mesh network allocates a network_id to each node, and each node has the same network_id. Each node carries the network_id information and sends a request to the server through the cloud network to enter the construction of the shadow chat network. The room number of the shadow chat network is the network_id.

[0036] 102. The in-network status of all Mesh nodes in the Mesh voice network is detected in real time, and the in-network status of the Mesh nodes is updated in real time in the server in the cloud network;

[0037] 103. When a Mesh node is lost, other non-lost Mesh nodes report the Mesh node disconnection information to the server through the cloud network, and the other non-lost Mesh nodes simultaneously upload the node voice data to the server through the cloud network;

[0038] Among them, the other non-lost Mesh nodes open the cloud network voice sampling channel, upload the node voice data to the server through the cloud network, and simultaneously transmit the node voice data to the Mesh voice network for the other non-lost Mesh nodes except the node to receive;

[0039] 104. The server mixes the received voice data, and according to the corresponding relationship of the shadow chat network, the mixed voice data is distributed to the lost Mesh node through the cloud network;

[0040] Wherein, the server will receive the voice data, if there are different nodes sending voice at the same time, the voice data sent by different nodes at the same time is mixed and processed, and the mixed voice data is issued; if there is no different node sending voice at the same time, the current voice data is directly issued;

[0041] 105, the voice data between other non-lost Mesh nodes in the Mesh network is still transmitted through the Mesh voice network;

[0042] Wherein, the other non-lost Mesh nodes receive the voice data of the Mesh voice network and the voice data of the cloud network at the same time, and then play after mixing and processing.

[0043] Wherein, after the creation of the shadow chat network, the heartbeats between each node and the server need to be maintained, and the server detects that the node heartbeat times out for several times, then the server issues the information that the node is offline to other nodes, other nodes rejudge the Mesh node disconnection information and report to the server, and according to the latest Mesh node disconnection information, it is decided whether to upload the voice data of the node to the server through the cloud network.

[0044] Wherein, after the creation of the shadow chat network, if the node is actively disconnected, the other non-lost nodes will actively report the disconnection information to the server, the server will mark the actively disconnected node as a leaving state, and push the marking information to other non-lost nodes, other non-lost nodes do not need to upload the voice data of the node to the server through the cloud network, but continue to maintain the Mesh voice network to transmit voice data; if the actively disconnected node returns, the actively disconnected node re-joins the shadow chat network, the server issues the re-joining information to other non-lost nodes, and other non-lost nodes wait for the actively disconnected node to re-join the Mesh voice network.

[0045] Wherein, the cloud network is a 3G network, a 4G network or a 5G network.

[0046] As shown in Figure 1 The method for adaptive switching and fusion of intercom in the present application takes the 4G network as an example, and the process is as follows:

[0047] a, using the Bluetooth Mesh network mechanism, a chat network is established, that is, a Mesh voice network is created, and a shadow chat network is constructed on the server side, that is, a 4G cloud voice network is created;

[0048] b, real-time update the Mesh node state to the server, when one or more nodes leave the network (not in the network), report the disconnection node to the server, and start uploading the voice data of the node to the server through 4G;

[0049] c、4G cloud voice network mixes all lost node voice data, the server transmits the voice data of the missing node by the 4G channel; the server mixes the voice data of the lost node according to all node data of each node lost connection, and sends the voice data to the corresponding lost node, so as to achieve the effect of not leaving the network;

[0050] d、In the Mesh network, the non-lost node still transmits voice data through the Mesh.

[0051] As shown in Figure 2 , WT network represents Mesh network, AWT network represents cloud network, and the device (node) can obtain the online status of WT network members in real time. When all members are online, the voice message is sent only through the WT network, and the AWT network is connected but does not sample the voice. When the device detects that the WT network member is lost with itself, the loss list is sent to the APP, and the APP is reported to the cloud. At the same time, the device requests the APP to open the AWT voice sampling channel, and sends its own voice to the WT network and the AWT network. The cloud receives the voice from each device, and according to the loss list of each device, only the voice packet of the member in the loss list is sent to the device through the AWT, and the voice packet of the other non-lost device is still received on the WT network. If two or more members' voice packets are sent on the AWT network at the same time, the sound mixing needs to be performed in the cloud or the APP end. If the device receives the voice from the AWT and the WT network at the same time, the sound mixing needs to be performed in the device.

[0052] In the figure, five members A, B, C, D and E are networked, DE and ABC are away from each other, so that the WT network (WT Mesh network) is divided into two parts, in which D and E can be interconnected, A, B and C can be interconnected, but DE and ABC are lost.

[0053] When ABC finds that DE is lost, Loss(D, E) is reported to the cloud server (server in the figure), and DE reports Loss(A, B, C) to the cloud server.

[0054] ABCDE have members lost with themselves, so the cloud AWT voice channel needs to be opened, and the voice of the device is sent to the WT network and the AWT network at the same time.

[0055] Taking A as an example, the voice from A, B, C, D and E is received, the cloud judges that the loss list of A is D and E, so the voice of D and E is sent to A through the cloud network AWT channel, and the voice of D and E is also sent to B and C, and D and E will receive the voice of ABC from the cloud (if it is to speak at the same time, the sound mixing needs to be performed after the voice is sent).

[0056] So finally, A receives voice from D and E in the AWT network (D voice and E voice in the figure) and receives voice from B and C in the WT network, and plays after mixing in the local device. The BCDE devices are the same.

[0057] When the cloud network may be offline, the device needs to maintain the heartbeat after entering the room of the shadow chat network and before leaving the room of the shadow chat network. If the cloud detects several heartbeat timeouts, it is determined that the device cloud network is offline. The cloud discovers that the device is offline, and also notifies other devices of the offline leaving with the parameter case=offline. After receiving the notification, the device re-determines the Loss list reported to the cloud and decides whether to use the AWT voice channel.

[0058] As shown in Figure 3 For the case of device active offline, specifically:

[0059] The device is preempted by an incoming call, or the user actively switches to other talkback teams, or the user actively exits the team talkback. The network device reports Leave_AWT_room to the cloud and returns to request to join enter_AWT_room(network_id).

[0060] Example: five-person network ABCDE, C switches to other teams during the journey.

[0061] ABDE discovers that C is lost, reports Loss(C) to the cloud, C reports Leave_AWT_room to the cloud, and the cloud marks C as leave state; the cloud pushes C's leaving event Leave_Noti(C) to ABDE, so ABDE will not open the AWT voice channel and still use the WT network communication;

[0062] After C returns to the team, it reports enter_AWT_room(network_id) to the cloud; the cloud pushes C's return event Enter_Noti(C) to ABDE, and ABDE waits for C to be online on the WT network. If the waiting time is exceeded, it is determined that C is offline on the WT network, and the voice data transmission method of C and ABDE is the same as the above node loss method.

[0063] The diagram is an ideal case, and in actual operation, the push may be delayed. After ABDE discovers that C is offline, it can actively query the cloud for several leave state devices and then decide whether to open the AWT channel;

[0064] If the AWT channel is opened, the Leave_Noti message is received, and the device should re-determine whether the member WT network is online and update the Loss list to the cloud.

[0065] IfFigure 4 The diagram shown is a schematic diagram of message interaction between the cloud server and the device in this invention.

[0066] After a device forms a team or returns to a team, it enters the AWT room chat room and sends a request to the cloud server to enter the chat room. The cloud server creates or allows the device to enter the AWT room chat room based on the request.

[0067] The device reports the WT network out-of-connection list to the cloud server in real time. If no one is out of contact, an empty list is reported. The cloud server sends the 4G offline list in real time, including the list of active leavers and those who have dropped out. If no one has dropped out, an empty list is sent. The device removes the leavers from the out-of-connection list and re-reports it to the cloud server.

[0068] If the device determines that the list of missing persons is not empty, it will open or maintain the AWT audio channel; if the WT online list is not empty, it will open or maintain the WT voice channel; the cloud server will send the voice messages of the members in the device's list of missing persons.

[0069] The device maintains a heartbeat with the cloud server to determine the device's online or offline status. If other devices are found to be offline or online via 4G, an updated leave list is pushed to the device, which then updates its local list of disconnected devices and re-reports it to the cloud server.

[0070] When a device leaves the current team, the AWT and WT voice channels are turned off or switched, and a device leave event is reported to the cloud server. The cloud server determines whether the heartbeat has been lost or has received the leave event information, and pushes the leave event information to other members.

[0071] If the device returns to the team, it requests to join the AWT room chat room, and the cloud server pushes the updated leave event information to other members.

[0072] In the current communication environment, 4G has a long coverage distance and stable signal, making it suitable as an auxiliary technology. This invention solves the problem of nodes continuing to receive voice data from other nodes via 4G after the mesh network is disconnected, thereby expanding the coverage of the mesh chat network and enhancing the chat communication range.

[0073] In this invention, cloud communication can also be 3G or 5G communication technology, which can also achieve the function of 4G communication. The basic communication principle is similar and will not be described separately.

[0074] In summary, the adaptive switching and fusion method of Bluetooth intercom and cloud intercom, by acquiring the online status of Mesh network nodes in real time, smoothly switches to cloud network transmission of voice data when a Mesh network node loses connection, ensuring normal voice data transmission and reception for the lost node, achieving a smooth and seamless experience. Meanwhile, Mesh network nodes that are not lost continue to transmit voice data through the Mesh network, only switching to cloud transmission when a connection is lost. Other nodes that are not lost maintain their original connections, without significantly increasing the information processing burden on the device, providing a flexible voice information transmission method.

[0075] The cloud network is used as a backup channel when nodes are disconnected. The channel is activated in a timely manner to ensure the stability and integrity of voice data transmission. By building shadow chat networks for each node in the cloud network, the cloud server forwards the voice data of each node according to the disconnection status of the Mesh network nodes, ensuring the normal transmission of voice data when nodes are disconnected, and achieving the effect of all nodes being online in real time and transmitting voice data without interruption.

[0076] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. An adaptive switching and fusion method based on Bluetooth intercom and cloud intercom, characterized in that, include:

101. Utilize the Bluetooth Mesh network mechanism to create a Mesh voice network, which contains multiple Mesh nodes; A shadow chat network is built on the server side in the cloud network, and the nodes of the shadow chat network correspond one-to-one with the mesh nodes of the mesh voice network.

102. Real-time detection of the network status of all Mesh nodes in the Mesh voice network, and real-time update of the network status of Mesh nodes on the server in the cloud network; 103. When a Mesh node loses connection, other Mesh nodes that are still connected will report the Mesh node's loss of connection information to the server via the cloud network. At the same time, the other Mesh nodes that are still connected will upload their own voice data to the server via the cloud network.

104. The server mixes the received voice data and, based on the correspondence of the shadow chat network, sends the mixed voice data to the disconnected Mesh nodes through the cloud network.

105. Voice data between other mesh nodes that have not lost connection within the mesh network will still be transmitted through the mesh voice network; Step 101 further includes: After creating the Mesh voice network, the Mesh network assigns a network_id to each node. Each node has the same network_id. Each node carries the network_id information and sends a request to the server through the cloud network to enter the construction of the shadow chat network. The room number of the shadow chat network is the network_id. Step 103 further includes: The other non-disconnected Mesh nodes open the cloud network voice sampling channel, upload their own voice data to the server via the cloud network, and simultaneously transmit their own voice data to the Mesh voice network for the other non-disconnected Mesh nodes to receive. Step 104 further includes: The server will process the received voice data. If different nodes send voice data at the same time, the voice data sent by different nodes at the same time will be mixed and then sent down. If no different nodes send voice data at the same time, the current voice data will be sent down directly. Step 105 further includes: If the other non-disconnected Mesh nodes simultaneously receive voice data from both the Mesh voice network and the cloud network, they will mix the audio before playback. After the shadow chat network is created, each node needs to maintain a heartbeat with the server. If the server detects that a node has timed out a number of heartbeats, it will send the node offline information to other nodes. Other nodes will re-evaluate the Mesh node disconnection information and report it to the server. Based on the latest Mesh node disconnection information, they will decide whether to upload their own voice data to the server via the cloud network. After the shadow chat network is created, if a node actively disconnects, other nodes that have not disconnected will report the disconnection information to the server. The server will mark the actively disconnected node as "away" and push this information to other nodes that have not disconnected. These nodes do not need to upload their voice data to the server via the cloud network and will continue to transmit voice data through the Mesh voice network. If the actively disconnected node returns, it will rejoin the shadow chat network. The server will then send this rejoining information to other nodes that have not disconnected, and these nodes will wait for the actively disconnected node to rejoin the Mesh voice network.

2. The adaptive switching and fusion method based on Bluetooth intercom and cloud intercom according to claim 1, characterized in that: The cloud network is a 3G network, a 4G network, or a 5G network.

Images