Earphone control method, earphone control device, wireless earphone and program product

Abstract

The invention discloses an earphone control method, an earphone control device, a wireless earphone and a computer program product. The earphone control method is applied to a first wireless earphone, the first wireless earphone is provided with a camera, and the method comprises the following steps: performing target identification on an environment image collected by the camera; when it is identified that the second wireless earphone exists, Bluetooth connection with the second wireless earphone is established based on a preset private protocol, and the model of the second wireless earphone is a preset model; and carrying out voice data interaction with the second wireless earphone through the established Bluetooth connection so as to realize talkback communication. Through the scheme of the invention, the interconnection between the earphones can be efficiently and conveniently realized, so that the instant messaging requirement of a user is met.

Description

Technical Field

[0001] The present application belongs to the field of earphone technology, and in particular relates to an earphone control method, an earphone control device, a wireless earphone and a computer program product. Background Art

[0002] The current headset products on the market have obvious deficiencies in achieving convenient communication between devices. The pairing and connection methods of traditional Bluetooth headsets mainly rely on manual operations, involving various operations such as searching for devices in Bluetooth settings, selecting pairing, and entering pairing codes, which makes the operation cumbersome and inefficient. Especially in scenarios where multiple people use headsets, such as when team collaboration, outdoor sports, or when users are in a tour group, establishing a communication connection between headsets is more time-consuming and labor-intensive, and it is difficult to meet the needs of instant communication. Summary of the invention

[0003] The present application provides an earphone control method, an earphone control device, a wireless earphone and a computer program product, which can efficiently and conveniently realize the interconnection between earphones, thereby meeting the user's instant communication needs.

[0004] In a first aspect, the present application provides an earphone control method, the earphone control method is applied to a first wireless earphone, the first wireless earphone is integrated with a camera, and the earphone control method includes:

[0005] Perform target recognition on the environmental images collected by the camera;

[0006] When the presence of the second wireless headset is identified, establishing a Bluetooth connection with the second wireless headset based on a preset private protocol, wherein the model of the second wireless headset is a preset model;

[0007] Voice data is exchanged with the second wireless headset through the established Bluetooth connection to achieve intercom communication.

[0008] In a second aspect, the present application provides an earphone control device, which is applied to a first wireless earphone, the first wireless earphone is integrated with a camera, and the earphone control device includes:

[0009] A recognition module is used to perform target recognition on the environment image collected by the camera;

[0010] a connection module, configured to establish a Bluetooth connection with the second wireless headset based on a preset private protocol when the second wireless headset is identified to exist, wherein the model of the second wireless headset is a preset model;

[0011] The interaction module is used to interact with the second wireless headset via the established Bluetooth connection to exchange voice data so as to achieve intercom communication.

[0012] In a third aspect, the present application provides a wireless headset, comprising a camera, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method of the first aspect when executing the computer program.

[0013] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method of the first aspect are implemented.

[0014] In a fifth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed by one or more processors, it implements the steps of the method of the first aspect.

[0015] Compared with the prior art, the present application has the following beneficial effects: the present application optimizes the structure of the wireless headset and adds a camera to the wireless headset. Through the environmental image captured by the camera, the wireless headset can identify other wireless headsets in the environment in real time, and use the private Bluetooth protocol to quickly establish a stable connection with other identified wireless headsets, realizing a low-latency and high-quality headset intercom function without external network support, providing users with a convenient, efficient and safe short-distance communication experience, thereby meeting the instant communication needs of users in various scenarios.

[0016] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 is a schematic diagram of the implementation flow of the earphone control method provided in an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of the implementation flow of step 101 in the earphone control method provided in an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of the implementation flow of step 102 in the earphone control method provided in an embodiment of the present application;

[0021] Figure 4is a schematic diagram of the implementation flow of step 103 in the earphone control method provided in an embodiment of the present application;

[0022] Figure 5 is another implementation flowchart of step 103 in the earphone control method provided in an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of the structure of the earphone control device provided in an embodiment of the present application;

[0024] Figure 7 It is a schematic diagram of the structure of the wireless headset provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the embodiments described below are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0027] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0028] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0030] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0031] The following describes the headset control method provided in the embodiment of the present application. The subject of executing the headset control method is a wireless headset. To facilitate understanding of the headset control method provided in the embodiment of the present application, the wireless headset is first introduced below:

[0032] The components of the wireless headset include, in addition to the conventional Bluetooth module, sound module and microphone, a camera is also provided.

[0033] Among them, the camera can be set in a conspicuous position of the shell of the wireless headset, for example, it can be set on the outside or front of the earmuff of the wireless headset; and the camera can be a high-resolution micro camera, and is equipped with a wide-angle lens, so as to widen the field of view of the camera and ensure that the camera can effectively capture the image of its surrounding environment; further, the built-in image sensor of the camera can also have high sensitivity and low noise characteristics, so as to adapt to different lighting environments (for example, it can prevent overexposure under direct strong light and can produce clear images in low-light rooms), and can also have shooting functions such as autofocus and automatic white balance, so as to help optimize image quality. Based on the above optimization, after the wireless headset is worn, the additional camera can provide clear visual materials for the operation of the wireless headset.

[0034] Among them, the Bluetooth module can adopt Bluetooth 5.0 and above, support Bluetooth Low Energy (BLE) working mode and classic Bluetooth dual-mode working mode, and can switch the working mode according to the needs of wireless headphones; on this basis, the manufacturer of wireless headphones can also develop a dedicated private protocol based on the Bluetooth standard protocol stack, so as to achieve safe, private and efficient pairing and communication between wireless headphones and other devices. It should be noted that in the process of developing the private protocol based on the Bluetooth standard protocol stack, strict testing and debugging operations can be carried out, and professional Bluetooth test equipment (including but not limited to Bluetooth protocol analyzers, etc.) can be used to verify and optimize each link of the private protocol, so as to ensure the stability and compatibility of the private protocol.

[0035] Among them, the microphone can be a microphone array with a certain angle and regular distribution, so as to achieve spatial positioning of sound; in actual applications, after the microphone collects the human voice, the noise interference in the environment can be removed by the noise reduction algorithm, so as to restore clear speech.

[0036] Among them, the sound module can adopt a combination of dynamic coil and moving iron, and its frequency response can be in the range of 20Hz-20kHz, ensuring full sound quality when playing audio.

[0037] In addition, a multi-function button and an indicator light may be provided on the housing of the wireless headset. After the multi-function button is triggered, different control instructions may be generated in different states, thereby instructing the wireless headset to perform different operations; of course, the multi-function button may also be disassembled into a plurality of different buttons, which is not limited in the embodiments of the present application. The indicator light may be used to indicate the different states of the wireless headset, so that the user can understand the real-time state of the wireless headset in a timely manner; of course, in addition to the indicator light, the current state of the wireless headset may also be notified to the user by voice broadcast, which will not be repeated here. Through the multi-function button and indicator light, the convenience of interaction between the user and the wireless headset may be improved.

[0038] Based on the above-mentioned related structures of the wireless headset, the headset control method proposed in the embodiment of the present application is described in detail below. For the sake of distinction, the wireless headset to which the headset control method is applied is referred to as the first wireless headset in the embodiment of the present application. Figure 1 , the headset control method includes:

[0039] Step 101: Perform target recognition on the environment image captured by the camera.

[0040] After the first wireless headset is started and ready, if it detects that its multi-function button is triggered without connecting to any other device, a detection instruction may be generated, which is used to instruct the first wireless headset to detect whether there are other devices that can be connected and can perform intercom in the environment, such as other wireless headsets with intercom functions. Based on the detection instruction, the first wireless headset may control the camera to start, so as to collect environmental images through the camera.

[0041] After acquiring the environment image, the first wireless headset can actively perform target recognition on the environment image. The purpose of target recognition is to detect and identify the preset model of wireless headsets existing in the current environment. The preset model can be a single model or multiple models; it can be the same model as the first wireless headset or a different model from the first wireless headset. In fact, in the embodiment of the present application, only the preset model of wireless headset is required to support the intercom function. For ease of description, the preset model of wireless headset is recorded as the second wireless headset.

[0042] Step 102: When the existence of the second wireless headset is identified, a Bluetooth connection is established with the second wireless headset based on a preset private protocol.

[0043] If the second wireless headset is currently identified in the environmental image, it can be known that there is a device in the current environment that can communicate with the first wireless headset for intercom. In order to achieve intercom with the second wireless headset, the first wireless headset can switch its Bluetooth module from a low-power listening state to a connection initiation state, thereby starting the connection process with the second wireless headset and establishing a Bluetooth connection with the second wireless headset based on a preset private protocol. After the Bluetooth connection is successfully established, if the first wireless headset is provided with an indicator light, the indicator light can be controlled to display a preset color (for example, blue) to indicate that the first wireless headset is currently successfully connected to other devices that can intercom (that is, the second wireless headset), and the user of the first wireless headset can start intercom.

[0044] Step 103: interacting with the second wireless headset via the established Bluetooth connection to exchange voice data to achieve intercom communication.

[0045] After establishing a Bluetooth connection with the second wireless headset, the first wireless headset can interact with the second wireless headset through the Bluetooth connection for voice data. According to actual intercom needs, the first wireless headset can transmit voice data to the second wireless headset, that is, the first wireless headset is the sender of voice data and the second wireless headset is the receiver of voice data; or the second wireless headset can transmit voice data to the first wireless headset, that is, the second wireless headset is the sender of voice data and the first wireless headset is the receiver of voice data.

[0046] In some embodiments, see Figure 2 To improve the speed and accuracy of target recognition, step 101 may specifically include:

[0047] Step 1011, controlling the camera to capture an environmental image based on a preset capture frame rate.

[0048] The acquisition frame rate can be set to a preset default value, such as 30 frames per second; or, the acquisition frame rate can also be set according to the power of the first wireless headset, for example, when the power is greater than a preset power threshold, the corresponding acquisition frame rate is F1, and when the power is less than or equal to the preset power threshold, the corresponding acquisition frame rate is F2, and F2 is less than F1. In the embodiment of the present application, there is no limitation on the setting method of the acquisition frame rate.

[0049] Step 1012, preprocessing the environment image to obtain a preprocessed image.

[0050] The first wireless headset may pre-process the latest environmental image currently collected. In the embodiment of the present application, the pre-processing may include but is not limited to grayscale processing, Gaussian filtering denoising processing and / or histogram equalization processing, etc., which are not limited here. For the convenience of distinction, the image obtained after the pre-processing is recorded as the pre-processed image.

[0051] Step 1013, input the preprocessed image into a preset target detection model to obtain the detection frame and corresponding confidence level output by the target detection model.

[0052] The first wireless headset can input the preprocessed image into a preset target detection model, which is constructed based on a deep learning convolutional neural network structure. Of course, it can also be constructed based on other neural network structures, which is not limited here. Specifically, the target detection model can first extract the image features of the preprocessed image, and then compare and match the image features with the preset features to obtain a detection frame of the suspected second wireless headset and the corresponding confidence level. Among them, the preset features can be extracted based on images of various angles of the second wireless headset, which is not limited here.

[0053] Step 1014: determine the object selected by the target detection box as the identified second wireless headset.

[0054] The first wireless headset can traverse the confidences corresponding to each detection frame, compare the confidences with a preset confidence threshold, and thus find a detection frame whose corresponding confidence is greater than the preset confidence threshold. For ease of description, the detection frame is referred to as a target detection frame. It can be understood that the object selected by the target detection frame is the identified second wireless headset. The first wireless headset can then cache the target information locally, and the target information may include but is not limited to: image features extracted from the environmental image in which the second wireless headset is identified.

[0055] In some embodiments, see Figure 3 To achieve a safe and reliable Bluetooth connection with the second wireless headset, step 102 may specifically include:

[0056] Step 1021, encapsulate the connection request based on a private protocol.

[0057] According to the data format requirements defined by the private protocol, the first wireless headset can encapsulate a connection request, wherein the connection request includes device information of the first wireless headset. As an example only, the device information includes but is not limited to the model and / or unique identification code of the first wireless headset, which is not limited here.

[0058] Step 1022, broadcast the connection request.

[0059] The first wireless headset can broadcast the encapsulated connection request via Bluetooth, so that other Bluetooth devices in the environment (such as the second wireless headset) can scan the connection request. After scanning the connection request, the second wireless headset can verify the legitimacy and integrity of the connection request, and reply confirmation information to the first wireless headset after the verification is passed.

[0060] Step 1023: after receiving the confirmation information replied by the second wireless headset based on the connection request, negotiate with the second wireless headset to establish a Bluetooth connection.

[0061] After the first wireless headset receives the confirmation information replied by the second wireless headset, the two parties can enter the connection negotiation stage to negotiate relevant information to establish a Bluetooth connection. In this connection negotiation stage, the first wireless headset can specifically perform the following operations: on the one hand, the encryption key is shared with the second wireless headset based on the key exchange mechanism of the preset asymmetric encryption algorithm. It can be understood that the encryption key can be used to encrypt and decrypt voice data when the voice data is subsequently exchanged with the second wireless headset. On the other hand, the connection parameters to be adopted for the Bluetooth connection are negotiated with the second wireless headset. The connection parameters may include but are not limited to the connection frequency, transmission power, data format and transmission timing, etc., which are not limited here. It can be understood that the connection parameters can be dynamically adjusted based on the power and signal strength of the first wireless headset and the second wireless headset, so that the communication effect and power consumption of both parties are balanced.

[0062] When the user wants to end the intercom communication, he can input an end command to the first wireless headset through the multi-function button or voice. After receiving the end command, the first wireless headset can close the Bluetooth connection link, clear the communication cache data with other Bluetooth devices, and return to the initial standby state, waiting for the next time when the user has an intercom demand, and then return to execute step 101 and subsequent steps, which will not be repeated here.

[0063] In some embodiments, see Figure 4 For the scenario where the first wireless headset is the sender of the voice data, step 103 may specifically include:

[0064] Step 1031: upon receiving a talkback instruction, collect a first voice signal.

[0065] After the first wireless headset has established a Bluetooth connection with the second wireless headset, the user can input an intercom command to the first wireless headset through the multi-function button; the first wireless headset can start the microphone to collect signals in response to the received intercom command. For the convenience of distinction, the collected voice signal is recorded as the first voice signal. As described above, for the first voice signal, the first wireless headset can first perform noise reduction processing, specifically, using an adaptive filtering algorithm to dynamically adjust the filter parameters according to the real-time characteristics of the ambient noise, thereby removing the background noise in the first voice signal and enhancing the clarity of the first voice signal.

[0066] Step 1032: encode and encrypt the first voice signal to obtain first voice data.

[0067] The first wireless headset can then encode and encrypt the first voice signal after noise reduction. For encoding, considering the application scenario of intercom, it can specifically adopt a low-latency and high-compression ratio audio encoding algorithm, such as the Opus encoding algorithm, so as to convert the first voice signal into a data format suitable for Bluetooth transmission. For encryption, the encryption key determined during negotiation can be used.

[0068] Step 1033: Transmit the first voice data to the second wireless headset through a private protocol.

[0069] The first wireless headset can transmit the first voice data to the second wireless headset through a private protocol according to the agreed connection parameters, so that the second wireless headset can receive and play the first voice signal corresponding to the first voice data.

[0070] In some embodiments, see Figure 5 For the scenario where the first wireless headset is the receiver of the voice data, step 103 may specifically include:

[0071] Step 1034: upon receiving the second voice data sent by the second wireless headset, decrypt and decode the second voice data to obtain a second voice signal.

[0072] If the Bluetooth module of the first wireless headset receives the second voice data sent by the second wireless headset, the second voice data can be decrypted and decoded first. It can be understood that the decryption process is the reverse operation of the encryption process described above; similarly, the decoding process is the reverse operation of the encoding process described above, which will not be described here. After the decryption and decoding processes are completed, the first wireless headset can restore the original voice signal, and for the sake of distinction, the voice signal is recorded as the second voice signal.

[0073] Step 1035: adjust the second voice signal according to the acoustic characteristics of the first wireless headset and the preset user hearing preference.

[0074] In order to ensure the effect of voice playback and the quality of intercom communication, the first wireless headset can perform audio enhancement processing on the second voice signal. Specifically, the first wireless headset can pre-store its own acoustic characteristics; in addition, as the user uses the first wireless headset, the user's hearing preferences can be updated and stored; based on the acoustic characteristics and the user's hearing preferences, the first wireless headset can adjust the audio parameters of the second voice signal, such as timbre, volume, and balance, which are not limited here.

[0075] Step 1036: play the adjusted second voice signal.

[0076] The first wireless headset can play the adjusted second voice signal through its sound module. Since the adjusted second voice signal has been audio-enhanced, a clearer and smoother intercom effect can be achieved.

[0077] In some embodiments, in order to optimize the intercom experience, the first wireless headset and the second wireless headset may also introduce an automatic repeat request (ARQ) and forward error correction (FEC) mechanism when exchanging voice data, which is specifically manifested as follows: during the transmission of voice data, the sender may periodically send data verification information; the receiver may perform verification based on the data verification information, and feedback confirmation information or request retransmission of abnormal data blocks based on the verification results, wherein the abnormal data blocks include but are not limited to lost or erroneous data blocks. At the same time, FEC may also be used to perform early error correction on some data that may have errors. Through the automatic retransmission request and forward error correction mechanism, the integrity and accuracy of the voice data are guaranteed, and the packet loss rate and bit error rate of the voice data during transmission are reduced.

[0078] In some embodiments, in order to further optimize the intercom experience, the first wireless headset and the second wireless headset may also introduce echo cancellation technology when exchanging voice data, and use an adaptive filter to estimate and eliminate the echo generated by the locally played sound in real time. The specific performance is as follows: during the transmission of voice data, the sender may simultaneously send an echo reference signal; the receiver may calculate the characteristics of the echo signal through an adaptive algorithm based on the echo reference signal and the feedback obtained when the local voice signal is played, thereby subtracting the echo component from the received voice signal to avoid the echo interfering with the other party's voice reception, ensuring that both parties can conduct natural and comfortable intercom communication.

[0079] In some embodiments, before step 101, in order to ensure the normal operation of the first wireless headset, the first wireless headset may also perform the following operations: self-check each component provided by the wireless headset, including but not limited to the Bluetooth module, sound module, microphone and camera mentioned above, so as to determine whether each component is working normally. After each component self-checks successfully, the first wireless headset can initialize the working parameters of each component, for example, initialize the resolution, acquisition frame rate and focus mode of the camera, initialize the working mode of the Bluetooth module, etc., which will not be repeated here. After the working parameters of each component are initialized, a ready message can be output. Among them, the ready message can be notified to the user through an indicator light, or it can be notified to the user through a voice broadcast, which is not limited here.

[0080] In some embodiments, after the first wireless headset has established a Bluetooth connection with the second wireless headset, it can continue to monitor the status of its various components and functional modules, so as to adjust the working parameters of each component and each functional module, or instruct the user to adjust the first wireless headset. For example, when the signal strength is detected to be lower than a preset strength threshold, the user is instructed to adjust his or her own position or the wearing posture of the first wireless headset, when the packet loss rate is higher than the preset packet loss rate threshold, try to reconnect with the second wireless headset, and dynamically optimize the noise reduction algorithm and the strength of the audio enhancement processing according to the monitored audio processing load, so as to ensure the reliability and stability of the first wireless headset, so that the first wireless headset can adapt to complex and changing application environments.

[0081] In some embodiments, the concept of an intercom group is also proposed, that is, the wireless headset can establish a Bluetooth connection with multiple other wireless headsets to form a group capable of intercom. Based on this, when the first wireless headset is already in an intercom group (referred to as the first intercom group), when it establishes a Bluetooth connection with the second wireless headset, it can also send the relevant information of the first intercom group to the second wireless headset (including but not limited to the number of devices and device names in the first intercom group, etc.), so that the second wireless headset confirms whether it wants to join the first intercom group based on the relevant information. When the second wireless headset is already in an intercom group (referred to as the second intercom group), when it establishes a Bluetooth connection with the second wireless headset, it can also receive the relevant information of the second intercom group sent by the second wireless headset (including but not limited to the number of devices and device names in the second intercom group, etc.); the first wireless headset can broadcast the relevant information to the user, thereby confirming whether it wants to join the second intercom group based on the feedback input by the user.

[0082] In some embodiments, different intercom working modes are proposed for intercom groups, including but not limited to group intercom mode and private intercom mode. Among them, group intercom mode refers to interaction with all other devices in the group based on voice signals; that is, in this case, users of all other devices in the intercom group can hear the voice input by this user. Private intercom mode refers to interaction with specified devices in the group based on voice signals; that is, in this case, users of specified devices in the intercom group can hear the voice input by this user. When the first wireless headset is already in the intercom group, the user can input the intercom working mode switching command through the multi-function button to switch the intercom working mode of the first wireless headset; when switching to the private intercom mode, the user can select the specified device in the group by voice input, which will not be repeated here.

[0083] As can be seen from the above, the embodiment of the present application optimizes the structure of the wireless headset and adds a camera to the wireless headset. Through the environmental image captured by the camera, the wireless headset can identify other wireless headsets in the environment in real time, and use the private protocol of Bluetooth to quickly establish a stable connection with other identified wireless headsets, realizing a low-latency and high-quality headset intercom function without external network support, providing users with a convenient, efficient and safe short-range communication experience, thereby meeting the instant communication needs of users in various scenarios.

[0084] Corresponding to the headset control method provided above, an embodiment of the present application further provides a headset control device. The headset control device can be applied to a first wireless headset, and the first wireless headset is provided with a camera.

[0085] See also Figure 6 , the earphone control device 6 comprises:

[0086] The recognition module 601 is used to perform target recognition on the environment image collected by the camera;

[0087] A connection module 602 is used to establish a Bluetooth connection with the second wireless headset based on a preset private protocol when the second wireless headset is identified to exist, wherein the model of the second wireless headset is a preset model;

[0088] The interaction module 603 is used to interact with the second wireless headset via the established Bluetooth connection to perform voice data interaction to achieve intercom communication.

[0089] In some embodiments, the identification module 601 includes:

[0090] A first acquisition unit, used to control the camera to acquire an environmental image based on a preset acquisition frame rate;

[0091] A preprocessing unit, used for preprocessing the environment image to obtain a preprocessed image;

[0092] The detection unit is used to input the preprocessed image into a preset target detection model to obtain the detection frame and corresponding confidence level output by the target detection model;

[0093] A determination unit is used to determine the object selected by the target detection box as the identified second wireless headset, wherein the target detection box is: a detection box whose corresponding confidence is greater than a preset confidence threshold.

[0094] In some embodiments, the connection module 602 includes:

[0095] an encapsulation unit, configured to encapsulate a connection request based on a private protocol, wherein the connection request includes device information of the first wireless headset;

[0096] A broadcast unit, used for broadcasting connection requests;

[0097] The negotiation unit is used to negotiate with the second wireless headset to establish a Bluetooth connection after receiving the confirmation information replied by the second wireless headset based on the connection request.

[0098] In some embodiments, the negotiation unit is specifically used to share an encryption key with the second wireless headset based on a key exchange mechanism of a preset asymmetric encryption algorithm, and to negotiate with the second wireless headset the connection parameters to be adopted for the Bluetooth connection, wherein the encryption key is used to encrypt and decrypt voice data when exchanging voice data with the second wireless headset.

[0099] In some embodiments, the interaction module 603 includes:

[0100] A second collecting unit is used to collect the first voice signal when receiving the intercom command;

[0101] A first processing unit, configured to encode and encrypt the first voice signal to obtain first voice data;

[0102] The transmission unit is used to transmit the first voice data to the second wireless headset through a private protocol.

[0103] In some embodiments, the interaction module 603 includes:

[0104] A second processing unit is used to decrypt and decode the second voice data to obtain a second voice signal when receiving the second voice data sent by the second wireless headset;

[0105] an adjustment unit, configured to adjust the second voice signal according to the acoustic characteristics of the first wireless headset and a preset user hearing preference;

[0106] The playing unit is used to play the adjusted second voice signal.

[0107] In some embodiments, the earphone control device 6 further comprises:

[0108] A self-check module, used to perform self-check on each component provided in the first wireless headset;

[0109] The initialization module is used to initialize the working parameters of each component after each component has successfully completed self-test;

[0110] The output module is used to output a ready message after the working parameters of each component are initialized.

[0111] As can be seen from the above, the embodiment of the present application optimizes the structure of the wireless headset and adds a camera to the wireless headset. Through the environmental image captured by the camera, the wireless headset can identify other wireless headsets in the environment in real time, and use the private protocol of Bluetooth to quickly establish a stable connection with other identified wireless headsets, realizing a low-latency and high-quality headset intercom function without external network support, providing users with a convenient, efficient and safe short-range communication experience, thereby meeting the instant communication needs of users in various scenarios.

[0112] Corresponding to the headset control method provided above, the present application embodiment also provides a wireless headset. Figure 7 The wireless headset 7 in the embodiment of the present application includes: a memory 701, one or more processors 702 ( Figure 7 Only one is shown in the figure) and a computer program stored in the memory 701 and executable on the processor. It should be noted that the wireless headset is also provided with a camera. Figure 7 The memory 701 is used to store software programs and units, and the processor 702 executes various functional applications and data processing by running the software programs and units stored in the memory 701 to obtain the resources corresponding to the above-mentioned preset events. Specifically, the processor 702 implements the following steps when running the computer program stored in the memory 701:

[0113] Perform target recognition on the environmental images collected by the camera;

[0114] When the presence of the second wireless headset is identified, establishing a Bluetooth connection with the second wireless headset based on a preset private protocol, wherein the model of the second wireless headset is a preset model;

[0115] Voice data is exchanged with the second wireless headset through the established Bluetooth connection to achieve intercom communication.

[0116] Assuming that the above is the first possible implementation, in a second possible implementation provided on the basis of the first possible implementation, target recognition is performed on the environment image captured by the camera, including:

[0117] Control the camera to collect environmental images based on a preset collection frame rate;

[0118] Preprocessing the environment image to obtain a preprocessed image;

[0119] Input the preprocessed image into the preset target detection model to obtain the detection frame and corresponding confidence output by the target detection model;

[0120] The object selected by the target detection box is determined as the identified second wireless headset, wherein the target detection box is a detection box whose corresponding confidence is greater than a preset confidence threshold.

[0121] In a third possible implementation provided on the basis of the first possible implementation, establishing a Bluetooth connection with a second wireless headset based on a preset private protocol includes:

[0122] Encapsulating a connection request based on a private protocol, wherein the connection request includes device information of the wireless headset 7;

[0123] Broadcast connection request;

[0124] After receiving confirmation information replied by the second wireless headset based on the connection request, negotiation is performed with the second wireless headset to establish a Bluetooth connection.

[0125] In a fourth possible implementation provided on the basis of the third possible implementation, negotiating with the second wireless headset includes:

[0126] The key exchange mechanism based on the preset asymmetric encryption algorithm shares the encryption key with the second wireless headset, and negotiates with the second wireless headset the connection parameters to be adopted for the Bluetooth connection, wherein the encryption key is used to encrypt and decrypt voice data when exchanging voice data with the second wireless headset.

[0127] In a fifth possible implementation provided on the basis of the first possible implementation, the second possible implementation, or the third possible implementation, the interaction of voice data with the second wireless headset through the established Bluetooth connection includes:

[0128] When receiving the intercom command, collecting the first voice signal;

[0129] Encoding and encrypting the first voice signal to obtain first voice data;

[0130] The first voice data is transmitted to the second wireless headset through a private protocol.

[0131] In a sixth possible implementation provided on the basis of the first possible implementation, or on the basis of the second possible implementation, or on the basis of the third possible implementation, performing voice data interaction with a second wireless headset through an established Bluetooth connection includes:

[0132] When receiving the second voice data sent by the second wireless headset, decrypting and decoding the second voice data to obtain a second voice signal;

[0133] Adjusting the second voice signal according to the acoustic characteristics of the wireless headset 7 and the preset user hearing preference;

[0134] The adjusted second voice signal is played.

[0135] In a seventh possible implementation provided on the basis of the first possible implementation, or on the basis of the second possible implementation, or on the basis of the third possible implementation, before performing target recognition on the environment image captured by the camera, the processor 702 implements the following steps by running a computer program stored in the memory 701:

[0136] Performing self-inspection on each component provided in the wireless headset 7;

[0137] After each component has successfully completed self-test, the working parameters of each component are initialized;

[0138] After the working parameters of each component are initialized, a ready message is output.

[0139] It should be understood that in the embodiment of the present application, the processor 702 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0140] The memory 701 may include a read-only memory and a random access memory, and provide instructions and data to the processor 702. A part or all of the memory 701 may also include a non-volatile random access memory. For example, the memory 701 may also store information of a device category.

[0141] As can be seen from the above, the embodiment of the present application optimizes the structure of the wireless headset and adds a camera to the wireless headset. Through the environmental image captured by the camera, the wireless headset can identify other wireless headsets in the environment in real time, and use the private protocol of Bluetooth to quickly establish a stable connection with other identified wireless headsets, realizing a low-latency and high-quality headset intercom function without external network support, providing users with a convenient, efficient and safe short-range communication experience, thereby meeting the instant communication needs of users in various scenarios.

[0142] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the above-mentioned device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0143] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0144] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the associated hardware through a computer program. The above-mentioned computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the above-mentioned computer program includes computer program code, and the above-mentioned computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The above-mentioned computer-readable storage medium may include: any entity or device capable of carrying the above-mentioned computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer-readable memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the above-mentioned computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media does not include electrical carrier signals and telecommunication signals.

[0145] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for controlling a headset, characterized in that: The headset control method is applied to a first wireless headset, the first wireless headset is provided with a camera, and the headset control method includes: Performing target recognition on the environment image captured by the camera; When the presence of a second wireless headset is identified, establishing a Bluetooth connection with the second wireless headset based on a preset private protocol, wherein the model of the second wireless headset is a preset model; The voice data is interacted with the second wireless headset through the established Bluetooth connection to achieve intercom communication.

2. The earphone control method according to claim 1, characterized in that: The performing target recognition on the environment image collected by the camera includes: Controlling the camera to capture the environment image based on a preset capture frame rate; Preprocessing the environment image to obtain a preprocessed image; Inputting the preprocessed image into a preset target detection model to obtain a detection frame and a corresponding confidence level output by the target detection model; The object selected by the target detection frame is determined as the identified second wireless headset, wherein the target detection frame is a detection frame whose corresponding confidence is greater than a preset confidence threshold.

3. The earphone control method according to claim 1, characterized in that: The establishing a Bluetooth connection with the second wireless headset based on a preset private protocol includes: encapsulating a connection request based on the private protocol, wherein the connection request includes device information of the first wireless headset; broadcasting the connection request; After receiving confirmation information replied by the second wireless headset based on the connection request, negotiation is performed with the second wireless headset to establish a Bluetooth connection.

4. The earphone control method according to claim 3, characterized in that: The negotiating with the second wireless headset includes: The method comprises the following steps: sharing an encryption key with the second wireless headset based on a key exchange mechanism of a preset asymmetric encryption algorithm, and negotiating with the second wireless headset connection parameters to be adopted for the Bluetooth connection, wherein the encryption key is used to encrypt and decrypt the voice data when the voice data is interacted with the second wireless headset.

5. The earphone control method according to any one of claims 1 to 4, characterized in that: The interacting with the second wireless headset through the established Bluetooth connection for voice data includes: When receiving the intercom command, collecting the first voice signal; Encoding and encrypting the first voice signal to obtain first voice data; The first voice data is transmitted to the second wireless headset through the private protocol.

6. The earphone control method according to any one of claims 1 to 4, characterized in that: The interacting with the second wireless headset through the established Bluetooth connection for voice data includes: When receiving the second voice data sent by the second wireless headset, decrypting and decoding the second voice data to obtain a second voice signal; adjusting the second voice signal according to the acoustic characteristics of the first wireless headset and a preset user hearing preference; Play the adjusted second voice signal.

7. The earphone control method according to any one of claims 1 to 4, characterized in that: Before performing target recognition on the environment image captured by the camera, the headphone control method further includes: Performing a self-check on each component provided in the first wireless headset; After each of the components has successfully completed self-test, initializing the operating parameters of each of the components; After the working parameters of each of the components are initialized, a ready message is output.

8. An earphone control device, characterized in that: The headset control device is applied to a first wireless headset, the first wireless headset is provided with a camera, and the headset control device includes: A recognition module, used for performing target recognition on the environment image collected by the camera; a connection module, configured to establish a Bluetooth connection with the second wireless headset based on a preset private protocol when the second wireless headset is identified to exist, wherein the model of the second wireless headset is a preset model; The interaction module is used to interact with the second wireless headset via the established Bluetooth connection to perform voice data interaction to achieve intercom communication.

9. A wireless headset, comprising a camera, a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 7 is implemented.

Images