Networking method and device of portable equipment, portable equipment and medium

Abstract

The embodiment of the invention discloses a networking method and device of portable equipment, the portable equipment and a medium, and relates to the technical field of communication. The method comprises the following steps: when a near field communication module of a second device is detected, establishing near field communication with the second device by using a near field communication module of a first device; receiving equipment attribute ciphertext information and a check code sent by the second equipment through near field communication; when the second equipment is determined to be the safety equipment based on the check code, establishing remote communication with the second equipment based on the equipment attribute ciphertext information by utilizing a remote communication module of the first equipment; the conference data is transmitted with the second equipment through remote communication, so that an automatic networking function between the portable equipment is realized, the time cost and the labor cost are saved, the networking efficiency is further improved, the portable equipment participating in networking is easy to expand, and the networking efficiency is improved. Therefore, the transmission efficiency of the conference data among the plurality of portable devices in the offline conference place is improved.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of communication technologies, and in particular, to a networking method, apparatus, portable device, and medium for portable devices. Background Art

[0002] Currently, communication connections can be established between portable devices through Bluetooth technology or Wireless Fidelity (WIFI) technology. That is, the user clicks to search for pairable devices, manually identifies the target device that can establish a connection, and then inputs the pairing information corresponding to the target device (such as a pairing code or WIFI password) to establish a communication connection through Bluetooth technology or WIFI technology. However, when it is necessary to establish communication between multiple portable devices in an offline venue, the above method has cumbersome manual operations, is time-consuming and laborious, resulting in low networking efficiency, and further causing low transmission efficiency of meeting materials between multiple portable devices in the offline venue. Summary of the Invention

[0003] Embodiments of the present application provide a networking method, apparatus, portable device, and medium for portable devices, which implement the networking function of portable devices and can quickly transmit meeting materials between multiple portable devices to solve the problem of low transmission efficiency of meeting materials between multiple portable devices in the offline venue in the prior art.

[0004] In a first aspect, an embodiment of the present application provides a networking method for a portable device, which is applied to the main control chip of a first device. The first device further includes a short-range communication module and a long-range communication module. The method includes:

[0005] When detecting the short-range communication module of a second device, establish short-range communication with the second device by using the short-range communication module of the first device;

[0006] Receive the device attribute ciphertext information and verification code sent by the second device through short-range communication;

[0007] When determining that the second device is a secure device based on the verification code, establish long-range communication with the second device based on the device attribute ciphertext information by using the long-range communication module of the first device;

[0008] Transmit meeting materials to the second device through long-range communication.

[0009] In the embodiments of the present application, when the short-range communication module of the second device is detected, the short-range communication module of the first device can be used to establish short-range communication with the second device; the encrypted device attribute information and the verification code sent by the second device are received through the short-range communication; when it is determined that the second device is a secure device based on the verification code, the long-range communication module of the first device is used to establish long-range communication with the second device based on the encrypted device attribute information; conference materials are transmitted to the second device through the long-range communication, realizing the networking function of portable devices. The traditional method relies on manual search for pairable devices, identification of target devices, and manual input of pairing information, which is relatively cumbersome and error-prone; however, the above technical solution first uses the short-range communication module to establish short-range communication, then automatically judges the device security based on the verification code, and in the case of the device being a secure device, further uses the long-range communication module to establish long-range communication, realizing the automatic networking function between portable devices, enabling automatic completion of key steps such as information interaction and security verification between portable devices, further reducing the cumbersome process of manual intervention, saving time cost and labor cost, enabling multiple portable devices in an offline venue to quickly complete networking, thereby improving the networking efficiency, and being easy to expand the portable devices participating in the networking, thus improving the transmission efficiency of conference materials between multiple portable devices in the offline venue.

[0010] In a second aspect, an embodiment of the present application provides a networking device for portable devices, which is applied to the main control chip of the first device. The first device further includes a short-range communication module and a long-range communication module. The device includes:

[0011] A first communication establishment module, configured to establish short-range communication with the second device by using the short-range communication module of the first device when the short-range communication module of the second device is detected;

[0012] A receiving module, configured to receive the encrypted device attribute information and the verification code sent by the second device through the short-range communication;

[0013] A second communication establishment module, configured to establish long-range communication with the second device by using the long-range communication module of the first device based on the encrypted device attribute information when it is determined that the second device is a secure device based on the verification code;

[0014] A transmission module, configured to transmit conference materials to the second device through the long-range communication.

[0015] In a third aspect, an embodiment of the present application provides a portable device, which includes:

[0016] At least one processor; and a memory communicatively connected to the at least one processor;

[0017] Among them, the memory stores a computer program that can be executed by at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the networking method of the portable device according to any embodiment of the present application.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the networking method of the portable device according to any embodiment of the present application.

[0019] For the descriptions of the second, third, and fourth aspects in the present application, reference may be made to the detailed description of the first aspect; and for the beneficial effects described in the second, third, and fourth aspects, reference may be made to the analysis of the beneficial effects of the first aspect, which will not be elaborated here.

[0020] In the present application, the name of the networking device of the above-mentioned portable device does not constitute a limitation to the device or functional module itself. In actual implementation, these devices or functional modules may appear under other names. As long as the functions of each device or functional module are similar to those of the present application and fall within the scope of the claims of the present application and their equivalent technologies.

[0021] These aspects or other aspects of the present application will be more clearly understood in the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0023] Figure 1 is a flowchart of the networking method of the portable device provided by an embodiment of the present application;

[0024] Figure 2 is another flowchart of the networking method of the portable device provided by an embodiment of the present application;

[0025] Figure 3 is a structural diagram of the networking device of the portable device provided by an embodiment of the present application;

[0026] Figure 4 is a structural diagram of a portable device provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0027] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. Apparently, the described embodiments are only a part rather than all of the embodiments of this application. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0028] It should be noted that the terms "first", "second", "target", "original", etc. in the specification, claims, and the above-mentioned drawings of this application are used to distinguish similar objects and do not necessarily describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of this application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "include", "have", and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units does not necessarily limit to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products, or devices.

[0029] Figure 1 FIG. is a schematic flowchart of a networking method for a portable device provided by an embodiment of this application. This embodiment can be applied to a scenario where communication connections need to be established between multiple portable devices in an offline venue and conference materials are transmitted. A networking method for a portable device provided by this embodiment can be executed by a networking device for a portable device provided by an embodiment of this application, and this device can be implemented in a software and / or hardware manner. In a specific embodiment, this networking device for a portable device can be integrated in the main control chip of the portable device. For example, the portable device can be a smart watch, a smart bracelet, or a smart phone, etc. The execution subject of this method can be the main control chip of the portable device, that is, the main control chip of the first device, where the first device is a portable device carried by any attendee in the offline venue.

[0030] In a specific embodiment, the portable device can include a main control chip, a short-range communication module, and a long-range communication module; among them, the main control chip is used to control the portable device; the short-range communication module is used to implement short-range communication between portable devices; the long-range communication module is used to implement long-range communication between portable devices; by way of example, the short-range communication module can be a Near Field Communication (NFC) module, and the long-range communication module can be a Bluetooth module or a WIFI module.

[0031] See Figure 1The networking method of the portable device of this embodiment includes but is not limited to the following steps:

[0032] S110: When the short-distance communication module of the second device is detected, establish short-distance communication with the second device using the short-distance communication module of the first device.

[0033] Among them, the second device is a portable device carried by other participants in the offline venue except the participants carrying the first device.

[0034] Specifically, in an offline venue, multiple participants carry portable devices, wherein the portable device carried by one participant is determined as a first device, and the portable devices carried by other participants are determined as second devices, that is, the offline venue includes a first device and at least one second device.

[0035] When the distance between the first device and the second device in the offline venue does not exceed the set distance, the short-distance communication module of the first device can detect the short-distance communication module of the second device. At the same time, the short-distance communication module of the second device can also detect the short-distance communication module of the first device. At this time, the main control chip of the first device can automatically use the short-distance communication module to establish a communication connection with the short-distance communication module of the second device through a short-distance communication protocol (such as NFC communication protocol), that is, to establish short-distance communication. Among them, the set distance is a distance predetermined according to the effective communication range of the short-distance communication module, which is used to determine whether the distance between the short-distance communication modules is within the effective communication range, so as to determine whether the short-distance communication modules of other devices can be detected. Users can adjust and set the set distance according to actual use needs, and the embodiments of the present application do not make specific limitations on this.

[0036] S120. Receive device attribute ciphertext information and a verification code sent by a second device through short-range communication.

[0037] The device attribute ciphertext information is the data content obtained by encrypting the relevant attribute information of the second device. The verification code is used to verify whether the second device is a trustworthy device, so as to determine whether to establish long-distance communication with the second device.

[0038] Specifically, after the first device establishes short-range communication with the second device, the main control chip of the second device can use a pre-stored key to encrypt its own device attribute information to obtain encrypted device attribute ciphertext information. Then, it uses the message digest algorithm to calculate the device attribute ciphertext information to generate a message digest of a fixed length, and determines this message digest as the check code. Then, it sends its own device attribute ciphertext information and the check code to the main control chip of the first device through short-range communication. The key is a key pre-set in the portable device, and these portable devices are the portable devices that are about to enter the offline venue, that is, trusted devices. It should be noted that in the embodiments of the present application, the key can be used for encryption and decryption and is a symmetric key.

[0039] After that, the main control chip of the first device can receive the device attribute ciphertext information and the check code sent by the second device through short-range communication.

[0040] S130. When it is determined that the second device is a secure device based on the check code, use the long-range communication module of the first device to establish long-range communication with the second device based on the device attribute ciphertext information.

[0041] Among them, the secure device is a portable device included in the offline venue. That is, the portable devices that will belong to the offline venue are determined as trusted devices, that is, the portable devices that have been pre-audited and determined to be secure and reliable.

[0042] Specifically, after obtaining the device attribute ciphertext information and the check code of the second device, it can be determined whether the second device is a secure device based on the check code sent by the second device. For example, the message digest algorithm can be used to calculate the received device attribute ciphertext information to generate a message digest of a fixed length, and it is determined whether this message digest is consistent with the check code. If they are consistent, it is determined whether the device attribute ciphertext information is in the preset secure device list, and when the device attribute ciphertext information is in the preset secure device list, it is determined that the second device is a secure device. Among them, the preset secure device list is used to store the device attribute ciphertext information of all secure devices to determine whether the second device is a secure device.

[0043] When it is determined that the second device is a secure device, the long-range communication module of the first device can be used to establish long-range communication with the second device based on the device attribute ciphertext information. For example, the pre-stored key can be used to decrypt the device attribute ciphertext information to obtain the device attribute information of the second device, and the long-range communication module of the first device can be used to establish a communication connection between the long-range communication modules of the first device and the second device based on the device attribute information of the second device through the long-range communication protocol, that is, establish long-range communication.

[0044] If the first device and the second device have both a Bluetooth module and a WIFI module, the long-distance communication mode is determined according to the distance between the first device and the second device. When the distance between the first device and the second device is within the set Bluetooth communication range, the Bluetooth module is used to establish long-distance communication; when the distance between the first device and the second device is not within the set Bluetooth communication range, the WIFI module is used to establish long-distance communication. The set Bluetooth communication range is a distance range pre-determined according to the effective communication range of the Bluetooth module, which is used to determine whether the distance between the Bluetooth modules is within the effective communication range, so as to determine whether to use the Bluetooth module to establish long-distance communication; and the effective communication range of the Bluetooth module is smaller than the effective communication range of the WIFI module.

[0045] S140, transmitting conference data to the second device via long-distance communication.

[0046] Among them, meeting materials refer to various information data related to the meeting when the meeting is held in an offline venue. By way of example, meeting materials may include picture files, audio files, video files, and text files, such as meeting agendas, meeting minutes, meeting summaries, schedules, and memos; when the portable device is a smart watch, the meeting materials may also include a watch dial.

[0047] Specifically, after the first device establishes long-distance communication with the second device, the main control chip of the first device can transmit meeting materials, such as meeting agendas, meeting minutes, meeting summaries, schedules and memos, to the second device through long-distance communication, thereby realizing rapid transmission of meeting materials between multiple portable devices in offline venues.

[0048] It should be noted that the second device involved in S110 to S140 can be one or more, that is, short-range communication and long-range communication can be established between all portable devices in the offline venue through short-range communication modules and long-range communication modules, so as to quickly establish a network.

[0049] In the technical solution of the embodiment of the present application, when the short-range communication module of the second device is detected, the short-range communication module of the first device can be used to establish short-range communication with the second device; the device attribute ciphertext information and the check code sent by the second device are received through the short-range communication; when it is determined that the second device is a secure device based on the check code, the long-range communication module of the first device is used to establish long-range communication with the second device based on the device attribute ciphertext information; the conference materials are transmitted to the second device through the long-range communication, realizing the networking function of the portable devices. The traditional method relies on manual search for pairable devices, identification of target devices, and manual input of pairing information, which is cumbersome and error-prone; however, the above technical solution first uses the short-range communication module to establish short-range communication, then automatically judges the device security based on the check code, and in the case of the device being a secure device, further uses the long-range communication module to establish long-range communication, realizing the automatic networking function between portable devices, enabling the portable devices to automatically complete key steps such as information interaction and security verification, further reducing the cumbersome process of manual intervention, saving time and labor costs, enabling multiple portable devices in an offline venue to quickly complete networking, thereby improving the networking efficiency, and being easy to expand the portable devices participating in the networking, thus improving the transmission efficiency of conference materials between multiple portable devices in the offline venue.

[0050] The following further describes a networking method for a portable device provided by an embodiment of the present application. Figure 2 It is another flowchart of the networking method for a portable device provided by an embodiment of the present application. The embodiment of the present application is optimized based on the above embodiments. Refer to Figure 2 The method of this embodiment includes but is not limited to the following steps:

[0051] S201. When the short-range communication module of the second device is detected, use the short-range communication module of the first device to establish short-range communication with the second device.

[0052] S202. Receive the device attribute ciphertext information and the check code sent by the second device through the short-range communication.

[0053] Optionally, the encrypted device attribute information may include the encrypted device name and the encrypted device identification code. Among them, the encrypted device name is the encrypted data obtained by processing the name information of the portable device through an encryption algorithm. The device name is a string used to identify the portable device, that is, a string that facilitates users and other systems to identify the portable device. It can be the name given by the manufacturer of the portable device or a user-defined name, such as the brand name plus the model of a mobile phone, or the user-defined nickname of a smart watch, etc. The encrypted device identification code is the encrypted data obtained by encrypting the identification code of the portable device. The device identification code is a code or number that uniquely identifies the portable device, usually given by the device manufacturer during device production, such as the Media Access Control Address (MAC address) of the portable device.

[0054] S203. Decrypt the verification code based on the key to obtain the original verification code.

[0055] Among them, the original verification code is the information pre-stored in the portable device, which is used to identify whether the portable device is a secure device, so as to determine whether long-distance communication can be established with it. Each portable device corresponds to an original verification code, and the original verification code can be calculated through a certain verification code generation algorithm (such as a message digest algorithm) for the relevant information of the portable device (including the device name, device identification code, and possible transmission data, etc.). The original verification code obtained in this way satisfies specific rules.

[0056] Specifically, after receiving the encrypted device attribute information and the verification code sent by the second device through short-range communication, the key pre-stored in the first device can be obtained, and the verification code can be decrypted using the key to obtain the decrypted information, that is, the original verification code. It should be noted that at this time, the verification code is the encrypted information obtained by the second device encrypting the original verification code using the key.

[0057] S204. Verify the original verification code to obtain a verification result.

[0058] Among them, the verification result is the conclusion obtained after performing a verification operation on the original verification code. The verification result may include verification success and verification failure.

[0059] Specifically, after obtaining the original verification code, the original verification code can be verified to obtain a verification result. That is, in one implementation, when the original verification code is in the preset list, it is determined that the verification result is successful. Specifically, the original verification code of the security device can be stored in the preset list in advance. That is, the preset list is used to store the original verification code of the security device, so as to determine whether the verification result is successful. That is, the original verification codes of portable devices that have been pre-audited and determined to be secure and reliable are stored in the preset list.

[0060] In another implementation, when the original verification code meets the preset rules, it is determined that the verification result is successful. The preset rules are the generation rules when generating the original verification code of the security device. That is, portable devices that have been pre-audited and determined to be secure and reliable generate the original verification code according to the preset rules.

[0061] In the embodiments of the present application, through the preset list or the preset rules, the situation of malicious tampering or forgery of the verification code can be effectively prevented, thereby improving the accuracy and efficiency of determining the verification result, providing an accurate data basis for determining whether the second device is a security device subsequently, and thus improving the security of networking.

[0062] S205. Determine whether the verification result is successful.

[0063] Specifically, if the verification result is successful, S206 can be executed; if the verification result is failed, S212 can be executed.

[0064] S206. When the verification result is successful, determine that the second device is a security device.

[0065] Specifically, when the verification result is successful, it can be indicated that the original verification code of the second device is in the preset list or meets the preset rules. That is, the second device is a portable device that has been pre-audited and determined to be secure and reliable. At this time, the second device can be determined as a security device.

[0066] S207. Decrypt the device name ciphertext and the device identification code ciphertext respectively based on the key to obtain the device name and the device identification code.

[0067] Specifically, after determining that the second device is a security device, the pre-stored key can be obtained. Then, the key is used to decrypt the device name ciphertext to obtain the device name, and the key is used to decrypt the device identification code ciphertext to obtain the device identification code, providing a data basis for establishing long-distance communication subsequently.

[0068] S208. Use the long-distance communication module of the first device to establish long-distance communication with the second device based on the device name and the device identification code.

[0069] Specifically, after obtaining the device name and device identification code, the long-distance communication module of the first device can be used to establish long-distance communication with the second device based on the device name and device identification code. That is, the main control chip of the first device can search for surrounding pairable devices, and use the device name and device identification code to find the second device from the pairable devices. Then, a pairing request is generated based on the device attribute ciphertext information and verification code of the first device itself, and the pairing request is sent to the second device through short-distance communication; after the main control chip of the second device receives the pairing request, it can extract the device attribute ciphertext information and verification code of the first device from the pairing request, and repeat the execution of S203 to S204. Then, when the verification result is successful, the long-distance communication module of the second device is used to pair with the long-distance communication module of the first device. For example, the Bluetooth module of the second device is used to pair with the Bluetooth module of the first device, so as to establish long-distance communication using the long-distance communication module.

[0070] S209. Transmit conference materials to the second device through long-distance communication.

[0071] Optionally, the first device may further include a microphone, that is, the second device also includes a microphone; the conference materials may include a second audio stream collected by the second device in a preset scenario; where the preset scenario is a specific offline venue set in advance, and the user can adjust and set the preset scenario according to actual needs; the second audio stream is an audio stream obtained by the microphone of the second device collecting the audio signal of the preset scenario.

[0072] Specifically, the main control chip of the first device can transmit conference materials to each other with the second device through long-distance communication, such as an audio file.

[0073] S210. Use the microphone to collect the audio signal of the preset scenario to obtain a first audio stream, and obtain the second audio stream collected by the second device in the preset scenario through long-distance communication.

[0074] Wherein, the first audio stream is an audio stream obtained by the microphone of the first device collecting the audio signal of the preset scenario.

[0075] Specifically, after the first device and the second device establish long-distance communication, the microphones of multiple portable devices in the preset scenario can be formed into a microphone array to collect the audio signal of the preset scenario. That is, the main control chip of the first device can use the microphone to collect the audio signal of the preset scenario to obtain a first audio stream, and at the same time, the main control chip of the second device can also use the microphone to collect the audio signal of the preset scenario to obtain a second audio stream; thus, the main control chip of the first device can obtain the second audio stream collected by the second device through long-distance communication.

[0076] S211. Superimpose the first audio stream and the second audio stream based on the signal acquisition time to obtain the target audio stream.

[0077] Among them, the signal acquisition time is the specific time point corresponding to each sampling point when the microphone acquires the audio signal. The target audio stream is the audio stream obtained after superimposing the first audio stream and the second audio stream.

[0078] Specifically, superimposing the first audio stream and the second audio stream based on the signal acquisition time to obtain the target audio stream includes Sa1 - Sa4:

[0079] Sa1. Determine the same time period and different time periods of the first audio stream and the second audio stream based on the signal acquisition time.

[0080] Among them, the same time period is the time period with the same signal acquisition time in the first audio stream and the second audio stream. The different time periods are the time periods with different signal acquisition times in the first audio stream and the second audio stream; moreover, there may or may not be different time periods between the first audio stream and the second audio stream.

[0081] Specifically, the signal acquisition time of the first audio stream can be compared with the signal acquisition time of the second audio stream, and the time range with the same signal acquisition time is determined as the same time period, and the time range with different signal acquisition times is determined as different time periods. Exemplarily, the signal acquisition time range of the first audio stream is [8:00, 8:10], and the signal acquisition time range of the second audio stream is [8:05, 8:15], then the same time period is [8:05, 8:10], and the different time periods are [8:00, 8:05] and [8:10, 8:15].

[0082] Sa2. Extract the audio stream corresponding to the same time period from the first audio stream to obtain the first identical audio stream, extract the audio stream corresponding to the same time period from the second audio stream to obtain the second identical audio stream, and perform enhancement processing on the first identical audio stream and the second identical audio stream to obtain the enhanced audio stream.

[0083] Among them, the first identical audio stream is the audio stream in the first audio stream whose signal acquisition time is within the same time period. The second identical audio stream is the audio stream in the second audio stream whose signal acquisition time is within the same time period. The enhanced audio stream is the audio stream obtained after performing enhancement processing on the audio signals in the first identical audio stream and the second identical audio stream.

[0084] Specifically, after obtaining the same time period, the audio streams with signal acquisition times within the same time period can be intercepted from the first audio stream to obtain the first identical audio stream, and the audio streams with signal acquisition times within the same time period can be intercepted from the second audio stream to obtain the second identical audio stream. Then, the first identical audio stream and the second identical audio stream are enhanced to obtain the enhanced audio stream.

[0085] Further, enhancing the first identical audio stream and the second identical audio stream to obtain the enhanced audio stream includes: determining the speaker audio stream corresponding to each unit duration from the first identical audio stream and the second identical audio stream, and then, based on the speaker audio stream corresponding to each unit duration, performing weighted fusion on the first identical audio stream and the second identical audio stream to obtain the enhanced audio stream. The unit duration is a preset duration data, which can be 1 second, 3 seconds, 10 seconds, 30 seconds, etc., and can be specifically defined according to actual usage requirements. Since there may be multiple sounds in each unit duration, including the speaker's voice, ambient noise, other participants' voices, background music, or background noise, etc., the speaker audio stream is the audio stream where the audio signal emitted by the identified speaker is located in the first identical audio stream and the second identical audio stream.

[0086] Specifically, since each portable device is carried by a participant in the preset scenario, that is, one portable device corresponds to one participant. Thus, the intensity of the audio signal collected by the microphone of one portable device for the corresponding participant is the strongest, while the intensity of the signal collected from other participants is relatively weak and can be ignored here. For example, when the first device is carried by the first participant and the second device is carried by the second participant, the audio signal of the first participant in the first audio stream collected by the first device is the strongest, and the audio signal of the second participant in the second audio stream collected by the second device is the strongest.

[0087] In addition, in a preset scenario, each unit time period corresponds to a main speaker, and any attendee in the preset scenario may be the main speaker for a unit time period. Therefore, after obtaining the first identical audio stream and the second identical audio stream, the first unit time period can be selected in chronological order from the same time period as the current unit time period, and the audio signal strength of the first identical audio stream within the current unit time period is compared with the audio signal strength of the second identical audio stream within the current unit time period. If the average value of the audio signal strength of the first identical audio stream within the current unit time period is greater than the average value of the audio signal strength of the second identical audio stream within the current unit time period, and all of the audio signal strengths of the first identical audio stream within the current unit time period are within the set strength range, it can be indicated that the first identical audio stream is the main speaker audio stream corresponding to the current unit time period, that is, the attendee corresponding to the first identical audio stream is the main speaker for the current unit time period; if the average value of the audio signal strength of the first identical audio stream within the current unit time period is not greater than the average value of the audio signal strength of the second identical audio stream within the current unit time period, and all of the audio signal strengths of the second identical audio stream within the current unit time period are within the set strength range, it can be indicated that the second identical audio stream is the main speaker audio stream corresponding to the current unit time period, that is, the attendee corresponding to the second identical audio stream is the main speaker for the current unit time period. Then, other unit time periods can be selected in chronological order from the same time period as the current unit time period and the above process can be repeated to obtain the main speaker audio stream corresponding to each unit time period. Among them, the set strength range is a preset audio signal strength range used to determine whether the audio signal strength within a specific unit time period is stable, so as to determine the main speaker audio stream corresponding to each unit time period, which can be specifically limited according to actual usage requirements.

[0088] After that, select the first unit duration in chronological order from the same time period as the current unit duration. If the speaker audio stream corresponding to the current unit duration is the first identical audio stream, then set a larger weight for the first identical audio stream at each moment in the current unit duration, and set a smaller weight for the second identical audio stream, so as to obtain the first weight of the first identical audio stream at each moment in the current unit duration, and the second weight of the second identical audio stream at each moment in the current unit duration, and the first weight is greater than the second weight, and the sum of the first weight and the second weight at the same moment is 1; if the speaker audio stream corresponding to the current unit duration is the second identical audio stream, then set a larger weight for the second identical audio stream at each moment in the current unit duration, and set a smaller weight for the first identical audio stream, so as to obtain the first weight of the first identical audio stream at each moment in the current unit duration, and the second weight of the second identical audio stream at each moment in the current unit duration, and the first weight is less than the second weight, and the sum of the first weight and the second weight at the same moment is 1; then, based on the first weight and the second weight, perform weighted fusion on the audio signals of the first identical audio stream and the second identical audio stream at each moment in the current unit duration in chronological order to obtain the enhanced signal sequence corresponding to the current unit duration. After that, other unit durations can be selected in chronological order from the same time period as the current unit duration and the above process can be repeated to obtain the enhanced signal sequence corresponding to each unit duration, and finally these enhanced signal sequences are integrated in chronological order to obtain the enhanced audio stream.

[0089] In the embodiments of the present application, first, the speaker audio stream corresponding to each unit duration is determined, and based on the speaker audio stream corresponding to each unit duration, different weights are assigned to the first identical audio stream and the second identical audio stream, and then further weighted fusion is performed based on the weights, which can strengthen the audio signal intensity of the speaker at each moment and weaken the audio signal intensity of noise (such as ambient noise, the voices of other participants, background music or background noise, etc.), thereby improving the voice clarity of the speaker in the enhanced audio stream and improving the determination efficiency of the enhanced audio stream, providing an accurate data basis for providing a clearer target audio stream for users.

[0090] Sa3. Extract the audio streams corresponding to different time periods from the first audio stream to obtain the first different audio stream, extract the audio streams corresponding to different time periods from the second audio stream to obtain the second different audio stream, and perform a merging process on the first different audio stream and the second different audio stream to obtain the merged audio stream.

[0091] Among them, the first different audio stream is the audio stream in the first audio stream whose signal acquisition times are in different time periods. The second different audio stream is the audio stream in the second audio stream whose signal acquisition times are in different time periods. The merged audio stream is the audio stream obtained by merging the audio signals in the first identical audio stream and the second identical audio stream.

[0092] Specifically, when the signal acquisition operation of the microphone of the portable device is forced to stop due to an abnormality or other reasons, it may cause the time ranges corresponding to the audio streams collected by each portable device to be different. Therefore, when there are different time periods, it indicates that the signal acquisition time ranges of the first audio stream and the second audio stream are different. Thus, after obtaining different time periods, the audio streams in the first audio stream whose signal acquisition times are in different time periods can be intercepted to obtain the first different audio stream, and the audio streams in the second audio stream whose signal acquisition times are in different time periods can be intercepted to obtain the second different audio stream. Then, the first different audio stream and the second different audio stream are merged in chronological order to obtain the merged audio stream, so as to supplement the missing audio signals.

[0093] Sa4. Integrate the enhanced audio stream and the merged audio stream to obtain the target audio stream.

[0094] Specifically, after obtaining the enhanced audio stream and the merged audio stream, the enhanced audio stream and the merged audio stream can be integrated in chronological order to obtain the target audio stream, so as to obtain a clear and complete audio stream.

[0095] After that, the target audio stream can be sent to the second device through long-distance communication so that each participant in the preset scenario can obtain the target audio stream.

[0096] In the embodiments of the present application, enhancing the first identical audio stream and the second identical audio stream in the same time period can enhance the voice clarity of the speaker and weaken the influence of noise, and merging the first different audio stream and the second different audio stream in different time periods can supplement the missing audio signals, thereby improving the clarity and integrity of the target audio stream, and thus enhancing the user experience.

[0097] Optionally, after transmitting conference materials to a second device via long-distance communication, the main control chip of the first device can use a microphone to collect audio signals of a preset scenario in real time to obtain a first real-time audio stream. Secondly, when recording is required, the recording function of the first device is enabled, and the start time is used as the reference time. Then, starting from the reference time, the first real-time audio stream is intercepted to obtain a first synchronized audio stream, and the reference time is sent to the second device via long-distance communication so that the second device can perform clock synchronization on the collected real-time audio stream based on the reference time to obtain a second synchronized audio stream. That is, the main control chip of the second device uses a microphone to collect audio signals of a preset scenario in real time to obtain a second real-time audio stream, and starting from the reference time, the second real-time audio stream is intercepted to obtain a second synchronized audio stream, that is, the start time of the second synchronized audio stream is the reference time.

[0098] Then, the main control chip of the first device can receive the second synchronized audio stream sent by the second device via long-distance communication, and superimpose the first synchronized audio stream and the second synchronized audio stream to obtain a target audio stream. The implementation method of the superimposing process at this time is the same as that of Sa2 to Sa4, and reference can be made to the above description, which will not be elaborated here. Through the reference time, the audio streams collected by the first device and the second device can be time-synchronized, thereby improving the determination efficiency and determination accuracy of the target audio stream.

[0099] S212. When the verification result is verification failure, determine that the second device is an insecure device.

[0100] Among them, the insecure device is not a portable device included in the offline venue, that is, it is not a portable device that has been pre-audited and determined to be safe and reliable.

[0101] Specifically, when the verification result is verification failure, it can indicate that the second device is not a portable device that has been pre-audited and determined to be safe and reliable. At this time, the second device can be determined as an insecure device, and then an exception prompt message can be generated and sent to the security management system. After receiving the exception prompt message, the security management system can display the exception prompt message, such as displaying the exception prompt message on a display screen, emitting a prompt sound, or sending the exception prompt message to the portable device of the administrator via email or text message, at least one of which can promptly notify the administrator that there are suspicious persons in the preset scenario, thereby protecting the security of the offline venue.

[0102] In the technical solution of the embodiment of the present application, when the short-range communication module of the second device is detected, the short-range communication module of the first device is used to establish short-range communication with the second device, and the device attribute ciphertext information and the verification code sent by the second device are received through the short-range communication. Secondly, the verification code is decrypted based on the key to obtain the original verification code, and the original verification code is verified to obtain the verification result. Then, when the verification result is successful verification, it is determined that the second device is a secure device. The original verification code is obtained by decrypting the verification code, and whether the second device is a secure device is further verified through the original verification code, thereby improving the determination accuracy and determination efficiency of the verification result, thus improving the verification accuracy and improving the security of networking. Then, the device name ciphertext and the device identification code ciphertext are decrypted based on the key respectively to obtain the device name and the device identification code, and the long-range communication module of the first device is used to establish long-range communication with the second device based on the device name and the device identification code. Long-range communication can be automatically established based on the decrypted device name and device identification code without manual participation, saving time and labor costs, thereby improving the establishment efficiency and security of long-range communication, improving the networking efficiency and networking security, and being easy to expand portable devices participating in networking, thus improving the transmission efficiency of conference materials between multiple portable devices in an offline venue.

[0103] After transmitting conference materials to the second device through long-range communication, the audio signal of a preset scenario can be collected by a microphone to obtain a first audio stream, and the second audio stream collected by the second device for the preset scenario can be obtained through long-range communication. Then, the first audio stream and the second audio stream are superimposed based on the signal acquisition time to obtain a target audio stream, realizing the networking recording function. By forming a microphone array with the microphones of multiple portable devices in the preset scenario, the voices of different participants can be collected from different positions, and then the audio streams collected by different devices are further superimposed and processed, improving the clarity and integrity of the target audio stream, and effectively solving the problem that a single portable device cannot clearly record the speech audio of all participants, thus enhancing the user experience.

[0104] Figure 3 is a schematic structural diagram of a networking device for a portable device provided by an embodiment of the present application. Refer to Figure 3 , the networking device for the portable device may include:

[0105] A first communication establishment module 310, configured to establish short-range communication with a second device by using the short-range communication module of the first device when detecting the short-range communication module of the second device;

[0106] A receiving module 320, configured to receive the device attribute ciphertext information and the verification code sent by the second device through short-range communication;

[0107] The second communication establishment module 330 is configured to, when determining that the second device is a secure device based on the check code, establish long-distance communication with the second device based on the device attribute ciphertext information by using the long-distance communication module of the first device;

[0108] The transmission module 340 is configured to transmit conference materials to the second device through long-distance communication.

[0109] In one embodiment, the device attribute ciphertext information includes the device name ciphertext and the device identification code ciphertext. Specifically, the second communication establishment module 330 is configured to: decrypt the device name ciphertext and the device identification code ciphertext respectively based on the key to obtain the device name and the device identification code; and establish long-distance communication with the second device based on the device name and the device identification code by using the long-distance communication module of the first device.

[0110] In one embodiment, determining that the second device is a secure device based on the check code in the second communication establishment module 330 includes: decrypting the check code based on the key to obtain the original check code; verifying the original check code to obtain a verification result; and when the verification result is verification success, determining that the second device is a secure device.

[0111] In one embodiment, verifying the original check code to obtain a verification result in the second communication establishment module 330 includes: when the original check code is in the preset list, determining that the verification result is verification success; or when the original check code meets the preset rule, determining that the verification result is verification success.

[0112] In one embodiment, the first device further includes a microphone. The conference materials include a second audio stream collected by the second device in a preset scenario. The networking device of the portable device further includes an audio processing module. Specifically, the audio processing module is configured to: after transmitting the conference materials to the second device through long-distance communication, collect an audio signal of the preset scenario by using the microphone to obtain a first audio stream, and obtain the second audio stream collected by the second device in the preset scenario through long-distance communication; and superimpose the first audio stream and the second audio stream based on the signal acquisition time to obtain a target audio stream.

[0113] In one embodiment, the audio processing module superimposes the first audio stream and the second audio stream based on the signal acquisition time to obtain a target audio stream, including: determining the same time period and different time periods of the first audio stream and the second audio stream based on the signal acquisition time; extracting the audio stream corresponding to the same time period from the first audio stream to obtain a first identical audio stream, extracting the audio stream corresponding to the same time period from the second audio stream to obtain a second identical audio stream, and performing enhancement processing on the first identical audio stream and the second identical audio stream to obtain an enhanced audio stream; extracting the audio stream corresponding to the different time periods from the first audio stream to obtain a first different audio stream, extracting the audio stream corresponding to the different time periods from the second audio stream to obtain a second different audio stream, and performing merging processing on the first different audio stream and the second different audio stream to obtain a merged audio stream; integrating the enhanced audio stream and the merged audio stream to obtain a target audio stream.

[0114] In one embodiment, the audio processing module performs enhancement processing on the first identical audio stream and the second identical audio stream to obtain an enhanced audio stream, including: determining the speaker audio stream corresponding to each unit duration from the first identical audio stream and the second identical audio stream; based on the speaker audio stream corresponding to each unit duration, performing weighted fusion on the first identical audio stream and the second identical audio stream to obtain an enhanced audio stream.

[0115] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the above division of each functional module is used as an example. In practical applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the above-described functional modules can refer to the corresponding process in the foregoing method embodiments and will not be elaborated herein.

[0116] The networking device of the portable device provided in this embodiment can be applied to the networking method of the portable device provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0117] Figure 4 It is a schematic structural diagram of a portable device provided by an embodiment of the present application. Figure 4 The block diagram of an exemplary portable device 11 suitable for implementing the embodiments of the present application is shown. Figure 4 The shown portable device 11 is only an example and should not impose any limitation on the functions and usage scope of this embodiment.

[0118] Such as Figure 4As shown, the portable device 11 is embodied in the form of a general-purpose computing electronic device. The components of the portable device 11 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples different system components (including the system memory 28 and the processing unit 16).

[0119] The bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of a variety of bus structures. By way of example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0120] The portable device 11 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the portable device 11, including volatile and nonvolatile media, removable and non-removable media.

[0121] The system memory 28 can include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The portable device 11 may further include other removable / non-removable, volatile / nonvolatile computer system storage media. By way of example only, a storage system 34 can be used for reading and writing on non-removable, nonvolatile magnetic media ( Figure 4 not shown, typically referred to as a "hard disk drive"). Although Figure 4 not shown in the figure, a disk drive for reading and writing on a removable nonvolatile disk (such as a "floppy disk") and an optical disk drive for reading and writing on a removable nonvolatile optical disk (such as a CD-ROM, DVD-ROM, or other optical media) can be provided. In these cases, each drive can be coupled to the bus 18 through one or more data media interfaces. The system memory 28 can include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the embodiments of the present application.

[0122] A program / utility 40 having a set (at least one) of program modules 42 can be stored, for example, in the system memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, and the implementation of a network environment may be included in each or some combination of these examples. The program modules 42 generally perform the functions and / or methods described in the embodiments of the present application.

[0123] The portable device 11 can also communicate with one or more external devices 14 (such as a keyboard, a pointing device, a display 24, etc.), and can also communicate with one or more devices that enable a user to interact with the portable device 11, and / or communicate with any device that enables the portable device 11 to communicate with one or more other computing devices (such as a network card, a modem, etc.). Such communication can be carried out through an input / output (I / O) interface 22. Moreover, the portable device 11 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 20.

[0124] As Figure 4 shown, the network adapter 20 communicates with other modules of the portable device 11 through a bus 18. It should be understood that although Figure 4 not shown in the figure, other hardware and / or software modules can be used in combination with the portable device 11, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0125] The processing unit 16 executes various functional applications and page displays by running programs stored in the system memory 28, for example, implementing a networking method for a portable device provided in any embodiment of the present application.

[0126] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, it implements a networking method for a portable device provided in any embodiment of the present application.

[0127] The computer storage medium of this embodiment can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive list) of the computer-readable storage medium include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, the computer-readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device.

[0128] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.

[0129] The program code contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0130] The computer program code for performing the operations of the present application may be written in one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0131] Those of ordinary skill in the art should understand that the various modules or steps of the present application described above may be implemented using a general-purpose computing device. They may be concentrated on a single computing device or distributed across a network composed of multiple computing devices. Optionally, they may be implemented using program code executable by a computer device, so that they can be stored in a storage device and executed by a computing device, or they may be separately fabricated into individual integrated circuit modules, or multiple modules or steps among them may be fabricated into a single integrated circuit module for implementation. Thus, the present application is not limited to any specific combination of hardware and software.

[0132] In addition, the acquisition, storage, use, processing, etc. of data in the technical solution of the present application all comply with the relevant provisions of national laws and regulations.

[0133] Note that the above is only a preferred embodiment of the present application and the applied technical principles. Those skilled in the art will understand that the present application is not limited to the specific embodiments here, and various obvious changes, re-adjustments and substitutions can be made by those skilled in the art without departing from the protection scope of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments only. Without departing from the inventive concept of the present application, more other equivalent embodiments can be included, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A method for networking a portable device, characterized in that: A main control chip applied to a first device, wherein the first device further includes a short-distance communication module and a long-distance communication module, and the method includes: When the short-range communication module of the second device is detected, establishing short-range communication with the second device using the short-range communication module of the first device; receiving the device attribute ciphertext information and the verification code sent by the second device through short distance communication; When the second device is determined to be a secure device based on the verification code, using the long-distance communication module of the first device to establish long-distance communication with the second device based on the device attribute ciphertext information; The conference data is transmitted to the second device via long-distance communication.

2. The method for networking a portable device according to claim 1, characterized in that: The device attribute ciphertext information includes a device name ciphertext and a device identification code ciphertext, and the use of the long-distance communication module of the first device to establish long-distance communication with the second device based on the device attribute ciphertext information includes: Decrypt the device name ciphertext and the device identification code ciphertext based on the key to obtain the device name and the device identification code; Using the long-distance communication module of the first device, long-distance communication with the second device is established based on the device name and the device identification code.

3. The method for networking a portable device according to claim 1, characterized in that: The determining, based on the verification code, that the second device is a secure device includes: Decrypting the verification code based on the key to obtain the original verification code; Verifying the original verification code to obtain a verification result; When the verification result is successful, it is determined that the second device is a secure device.

4. The method for networking a portable device according to claim 3, characterized in that: The verifying the original verification code to obtain a verification result includes: When the original verification code is in the preset list, determining that the verification result is a successful verification; Alternatively, when the original verification code satisfies a preset rule, the verification result is determined to be a successful verification.

5. The method for networking a portable device according to claim 1, characterized in that: The first device further includes a microphone, the conference data includes a second audio stream obtained by the second device collecting a preset scene, and after the conference data is transmitted to the second device through long-distance communication, the method further includes: Using the microphone to collect the audio signal of the preset scene to obtain a first audio stream, and obtaining a second audio stream obtained by the second device collecting the preset scene through long-distance communication; The first audio stream and the second audio stream are superimposed based on signal acquisition time to obtain a target audio stream.

6. The method for networking a portable device according to claim 5, characterized in that: The superimposing the first audio stream and the second audio stream based on the signal acquisition time to obtain a target audio stream includes: Determine the same time period and the different time period of the first audio stream and the second audio stream based on the signal acquisition time; Intercepting the audio stream corresponding to the same time period from the first audio stream to obtain a first identical audio stream, intercepting the audio stream corresponding to the same time period from the second audio stream to obtain a second identical audio stream, and performing enhancement processing on the first identical audio stream and the second identical audio stream to obtain an enhanced audio stream; Intercepting the audio streams corresponding to the different time periods from the first audio stream to obtain a first different audio stream, intercepting the audio streams corresponding to the different time periods from the second audio stream to obtain a second different audio stream, and merging the first different audio stream and the second different audio stream to obtain a merged audio stream; The enhanced audio stream and the merged audio stream are integrated to obtain the target audio stream.

7. The method for networking a portable device according to claim 6, characterized in that: The performing enhancement processing on the first identical audio stream and the second identical audio stream to obtain an enhanced audio stream includes: Determine the speaker audio stream corresponding to each unit time length from the first identical audio stream and the second identical audio stream; Based on the speaker audio stream corresponding to each unit time length, the first identical audio stream and the second identical audio stream are weightedly merged to obtain the enhanced audio stream.

8. A networking device for a portable device, characterized in that: A main control chip applied to a first device, wherein the first device further includes a short-distance communication module and a long-distance communication module, and the device includes: A first communication establishing module, configured to establish short-range communication with the second device using the short-range communication module of the first device when the short-range communication module of the second device is detected; A receiving module, used for receiving the device attribute ciphertext information and the verification code sent by the second device through short distance communication; A second communication establishing module, configured to establish long-distance communication with the second device based on the device attribute ciphertext information by using the long-distance communication module of the first device when the second device is determined to be a secure device based on the verification code; The transmission module is used to transmit conference data with the second device via long-distance communication.

9. A portable device, characterized in that: The portable device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the portable device networking method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the portable device networking method as claimed in any one of claims 1 to 7 is implemented.

Images