Cabin talkback integrated control method, system, equipment and medium

Abstract

The embodiment of the invention relates to the technical field of vehicle-mounted cabins, and discloses a cabin talkback integrated control method, system and device and a medium. When a user carries out talkback operation, the first cabin domain controller issues a PTT instruction for activating the first interphone; after receiving the PPT instruction, the first interphone collects a voice signal and transmits the voice signal to a first cabin area controller through a BLE Bluetooth link, and the first cabin area controller receives and stores the voice signal; when a user carries out receiving operation, the second interphone receives a voice signal of the first interphone and transmits the voice signal to the second cockpit domain controller through the BLE Bluetooth link; and the second cockpit domain controller receives and stores the voice signal and controls a loudspeaker to play the voice signal. The technical problem that a cockpit is low in control capability of intercom equipment can be at least solved.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle-mounted cockpits, and in particular to a cockpit intercom integrated control method, system, device and medium. Background Art

[0002] With the development of automobile intelligence, the in-vehicle cockpit has gradually become the core area for interaction between drivers and vehicles. More and more Internet of Things (IoT) devices are integrated into smart cockpits to improve driving convenience, safety and entertainment. However, the existing cockpit intercom system still faces many problems in its integration with the smart cockpit.

[0003] At present, some in-vehicle cockpit systems connect intercom devices to the cockpit domain controller through the Classic Bluetooth protocol, and usually use the Hands-Free Profile (HFP) to implement voice call functions. However, this solution has the following major defects: the HFP protocol relies on the classic Bluetooth channel and shares bandwidth with other classic Bluetooth-based applications in the vehicle system (such as CarPlay and Android Auto), which is prone to conflicts. When multiple applications occupy the classic Bluetooth channel at the same time, the communication quality will be reduced, which will affect the user experience. The HFP protocol only supports narrowband audio transmission, with low sound quality, and cannot meet users' needs for high-quality voice communication. With the increasing application of voice interaction in vehicle systems, users' requirements for audio clarity and transmission quality are also increasing.

[0004] In the prior art, the cockpit domain controller has a relatively simple control function for the intercom, which can usually only realize the basic call start and end functions, and lacks rich interaction and expansion capabilities. For example, users cannot store, manage or convert the voice data of the intercom in the cockpit, which affects the flexibility of the system and the user experience. Summary of the invention

[0005] One object of the present application is to provide a cockpit intercom integrated control method, system, device and medium, at least to solve the technical problem of low control ability of the cockpit intercom equipment.

[0006] To achieve the above objectives, some embodiments of the present application provide the following aspects:

[0007] In the first aspect, some embodiments of the present application also provide a cockpit intercom integrated control method, including when a user performs an intercom operation, a first cockpit domain controller issues a PTT command to activate a first intercom; after receiving the PPT command, the first intercom collects a voice signal, and transmits the voice signal to the first cockpit domain controller via a BLE Bluetooth link, and the first cockpit domain controller receives and stores the voice signal; when the user performs a receiving operation, the second intercom receives the voice signal of the first intercom, and transmits it to the second cockpit domain controller via the BLE Bluetooth link; the second cockpit domain controller receives and stores the voice signal.

[0008] On the second aspect, some embodiments of the present application also provide a cockpit intercom system, comprising multiple cockpit domain controllers, used to control the activation of intercoms and the reception of voice signals via a BLE Bluetooth link; multiple intercoms, used to respond to PPT instructions of the cockpit domain controller, collect voice signals and transmit them to the cockpit domain controller via a BLE Bluetooth link; the cockpit domain controller also includes a storage module and a processing module for storing and processing the voice signals, and controlling the speaker to play the voice signals; the cockpit domain controller and the intercom perform the steps of the method described above.

[0009] In a third aspect, some embodiments of the present application further provide an electronic device, comprising: one or more processors; and a memory storing computer program instructions, wherein the computer program instructions, when executed, cause the processor to perform the steps of the method described above.

[0010] In a fourth aspect, some embodiments of the present application further provide a computer-readable medium having computer program instructions stored thereon, wherein the computer program instructions can be executed by a processor to implement the method as described above.

[0011] Compared with the related art, the solution provided in the embodiment of the present application is an integrated control method for the vehicle cockpit intercom system based on the LE Audio protocol, which realizes voice communication between the cockpit domain controller and the intercom through low-power Bluetooth (BLE) connection, and develops supporting software applications in the cockpit to expand the user's interactive capabilities in the cockpit. It not only improves the connection performance and audio quality of the intercom equipment, but also enriches the integrated interactive scenarios of the cockpit and the intercom, and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0013] Figure 1 A flowchart of a cockpit intercom integrated control method provided according to an embodiment of the present application;

[0014] Figure 2 A schematic diagram of the structure of a cockpit intercom integrated device provided according to an embodiment of the present application;

[0015] Figure 3 This is an architecture diagram of a cockpit intercom integration system provided according to an embodiment of the present application;

[0016] Figure 4 A schematic diagram of a flow chart of a cabin intercom integrated control method provided according to an embodiment of the present application;

[0017] Figure 5 A schematic diagram of a flow chart of a cabin intercom integrated control method provided according to an embodiment of the present application;

[0018] Figure 6 The present invention is a schematic diagram of the structure of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0020] First embodiment

[0021] The first embodiment of the present application relates to a cockpit intercom integrated control method. Figure 1 As shown, the method may include the following steps:

[0022] When the user performs an intercom operation, the first cockpit domain controller sends a PTT command to activate the first intercom; after receiving the PPT command, the first intercom collects a voice signal and transmits the voice signal to the first cockpit domain controller through a BLE Bluetooth link, and the first cockpit domain controller receives and stores the voice signal;

[0023] When the user performs a receiving operation, the second intercom receives the voice signal of the first intercom and transmits it to the second cockpit domain controller through the BLE Bluetooth link; the second cockpit domain controller receives and stores the voice signal and controls the speaker to play the voice signal.

[0024] The following is a detailed description of each of the above steps.

[0025] After the user presses the intercom button, the button monitoring module or event detection module inside the first cockpit domain controller will detect this operation in real time and identify the operation as an instruction to start the intercom mode. This action indicates that the user needs to have real-time voice communication with other cockpits. After recognizing the user operation, the first cockpit domain controller will generate a PTT (Push-To-Talk) instruction. The generation of this instruction includes the following: indicating that the instruction is a command to start intercom, to distinguish it from other possible control instructions (such as receiving mode, stop talking, etc.); user identity or cockpit identification, used to indicate that the instruction comes from the first cockpit, so that the intercom and the receiving device can confirm the source of the voice signal; timestamp, recording the generation time of the instruction, to facilitate data synchronization and management in the subsequent intercom process.

[0026] After generating the PTT command, the first cockpit domain controller transmits the command to the first intercom via the BLE Bluetooth link. The BLE Bluetooth link is chosen based on its low power consumption and low latency, which enables the PTT command to be quickly transmitted to the intercom, reducing the delay in the intercom startup. At the same time, the security features of BLE ensure the security of the command during transmission and avoid external interference.

[0027] After receiving the PTT command from the first cockpit domain controller, the first intercom will recognize the command as a command to start intercom, thereby activating the voice acquisition module. The control processor inside the intercom decodes the PTT command and confirms that it is a command to "start voice acquisition"; the voice acquisition module enters the working state, and the microphone of the intercom begins to collect the user's voice signal in real time. In order to improve the user experience, the first cockpit domain controller can set a feedback mechanism. When the first intercom successfully receives and activates the PTT command, it can notify the first cockpit domain controller through a feedback signal, indicating that the intercom mode has been successfully started. The cockpit control system can inform the user that the intercom function has been turned on through indicator lights, sounds or screen prompts, so that the user is clear about the current communication status.

[0028] The microphone of the intercom starts to collect the user's voice signal in real time, converts the collected analog voice signal into an electrical signal, and transmits it to the signal processing unit for further processing, including noise suppression, echo cancellation, gain control and other operations. These processing steps can improve the clarity of the voice so that the receiver can clearly hear the user's voice. The processed voice signal is converted into a digital signal for transmission over the BLE Bluetooth link.

[0029] After the voice signal processing is completed, the intercom divides the digitized voice signal into multiple data packets and packages the data packets according to the transmission requirements of the BLE Bluetooth link. Each data packet contains fields such as identification information, data length, and check bits to ensure data integrity and accurate transmission. At the same time, the data packet also contains timestamp information, which facilitates the cockpit domain controller to arrange the data packets in order and play them synchronously when receiving data.

[0030] After the data packet is completed, the intercom transmits the data packets one by one to the first cockpit domain controller through the BLE Bluetooth link. The low power consumption and low latency characteristics of BLE Bluetooth ensure the efficient transmission of data packets and can meet the requirements of real-time intercom. During the transmission process, the built-in transmission protocol of the BLE link will check the integrity of the data packet to ensure that there is no data loss or error during the transmission process. If packet loss or data error occurs, the link protocol will automatically retransmit to ensure the transmission quality of the voice signal.

[0031] The first cockpit domain controller listens to and receives voice data packets transmitted by the intercom in the Bluetooth link. The received data packets first enter the Bluetooth receiving module of the controller, which unpacks and reassembles them into a continuous voice signal stream. The unpacked voice data stream is transmitted to the processing module of the cockpit domain controller to ensure that the data is played or stored in the correct order. The storage module in the cockpit domain controller stores the unpacked and reassembled voice signal in an internal storage unit, such as flash memory or RAM, for subsequent calls. The stored voice signal can be used for a variety of purposes, such as real-time playback, subsequent playback, or data analysis. The application software of the cockpit domain controller can further process the stored voice data, such as speech recognition, text transcription, etc.

[0032] When the user selects the receiving operation in another cockpit (i.e., the second cockpit), the system starts the receiving process of the second cockpit domain controller, so that the second intercom enters the receiving state. The second cockpit domain controller sends the receiving instruction to the second intercom via the BLE Bluetooth link to put it into the receiving state. The receiving instruction usually contains information such as source identification, instruction type, and timestamp, so that the intercom can identify the receiving operation and execute the corresponding process. After receiving the instruction, the second intercom feeds back a confirmation signal to the second cockpit domain controller, indicating that it has entered the receiving mode.

[0033] After the first intercom collects the user's voice signal and completes the packaging and transmission of the BLE Bluetooth link, it transmits the voice signal to other intercoms in the network through the Bluetooth link. The low latency characteristics of the BLE Bluetooth link enable voice data to be quickly transmitted to the second intercom. The second intercom listens to the data transmission signal from the first intercom in the BLE connection and receives the voice signal data packets. These data packets include the user's voice content, timestamp and verification information to ensure the accuracy of the data during the transmission process.

[0034] After receiving the voice data packet transmitted by the first intercom, the second intercom first unpacks the data packet and reassembles the segmented voice data into a complete voice signal stream. The timestamp information in the data packet enables the second intercom to sort the voice stream according to the order in which the data is generated, ensuring the integrity and coherence of the voice. After unpacking, the second intercom generates a complete voice signal stream and prepares to forward the signal stream to the second cockpit domain controller.

[0035] The second intercom transmits the reorganized voice signal stream to the second cockpit domain controller through the BLE Bluetooth link or the direct data transmission channel. During this process, the voice signal stream maintains the original sound quality to ensure the clarity of the voice. After receiving the voice signal, the second cockpit domain controller passes it to the internal processing module for further operation, such as real-time playback or storage. After receiving the voice signal, the second cockpit domain controller can immediately play the voice content through the speaker in the cockpit, so that the user can listen in time. At the same time, the second cockpit domain controller can also store the received voice signal so that the user can play back the voice when needed. If the system is equipped with a user feedback mechanism, when the voice signal is successfully received and forwarded, the second cockpit domain controller can inform the user that the voice signal reception has been completed through indicator lights, screen displays or sound prompts.

[0036] The second cockpit domain controller receives the voice signal stream forwarded from the second intercom via the BLE Bluetooth link. The cockpit domain controller decodes and reorders the received data packets to ensure the integrity and order of the audio data to obtain a continuous voice signal stream. The decoded voice signal is stored in the internal storage module of the second cockpit domain controller, such as RAM or flash memory. During the storage process, the system records the data's timestamp, source identification, and other relevant information for subsequent retrieval or playback.

[0037] The storage of voice signals can provide basic support for subsequent voice playback, analysis, and text transcription. When needed, users can access stored voice records through the cockpit control system. While receiving and decoding the voice signal, the second cockpit domain controller will transmit the signal to the vehicle speakers for real-time playback. The real-time playback function ensures that users can instantly hear the voice information from the first cockpit, realizing seamless intercom communication between cockpits. In order to let users know the status of intercom communication, the second cockpit domain controller can provide synchronous prompts when playing voice, such as displaying "Intercom" on the cockpit display or lighting up the indicator light to indicate the communication status.

[0038] After the voice playback is completed, the system can provide sound or visual prompts to inform the user that the current intercom process has ended. If the new voice signal received fails to be successfully played or stored, the system will also provide timely feedback to ensure that the user can understand the status of the intercom. The real-time playback function allows users to clearly hear the voice content emitted by the first cockpit, facilitating direct communication and collaboration between different cockpits. At the same time, the storage function of the voice signal makes it easy for users to view or replay it after the intercom ends, further improving the flexibility of the intercom system.

[0039] It is not difficult to find that compared with the related art, in the solution provided by the embodiment of the present application, the voice signal transmission between the cockpit domain controller and the intercom device adopts the BLE Bluetooth link, which effectively avoids the bandwidth conflict problem in the classic Bluetooth protocol. At the same time, the low latency characteristic of the BLE link ensures the instant transmission of voice signals and improves the user experience. In addition, the storage function of the voice signal in the cockpit domain controller facilitates the user to play back or process the voice later, thereby realizing the integrated and intelligent control of the cockpit intercom.

[0040] Second embodiment

[0041] The second embodiment of the present application relates to a cockpit intercom integrated control method. The second implementation is an improvement on the first embodiment, and the specific improvements are:

[0042] like Figure 2 As shown, the application (App) in the cockpit domain controller is used to control and manage the intercom function. The intercom operation can be started or stopped through the App, and information such as the intercom status can be viewed. After receiving the command, the App sends a control signal to the BT Stack module of the cockpit domain controller to indicate the start or end of the intercom.

[0043] The BT Stack module is responsible for the Bluetooth communication management between the cockpit domain controller and the intercom, including connection establishment, data transmission and connection maintenance. Through the BT Stack, the cockpit domain controller can complete Bluetooth pairing with the intercom to form a stable communication link. The BT Stack is also responsible for executing the LE Audio protocol and the TMAP protocol to ensure high-quality unicast audio transmission. As the core of control and data processing, the CG module receives control signals from the App and passes instructions to the BT Stack module to achieve operational control of the intercom. The CG module can also process the audio data transmitted by the intercom and send the processed audio to the App for storage or further analysis.

[0044] Intercom (CT, Communication Terminal), as a communication terminal (CT), is responsible for collecting the user's voice signal, encoding it through the LE Audio protocol, and transmitting it to the cockpit domain controller. The intercom conducts unicast audio communication with the cockpit domain controller through the TMAP protocol to achieve stable voice data transmission.

[0045] like Figure 3 As shown, the cockpit domain controller and the intercom are connected via BLE Bluetooth, and the LE Audio protocol is used for voice data transmission. The intercoms communicate with each other via analog / digital signals. The cockpit domain controller initiates the match, and the intercom responds to the pairing, completing the BLE Bluetooth connection.

[0046] Each cockpit is equipped with a cockpit domain controller to control the communication operation of the intercom. The cockpit domain controller and the intercom are connected via BLE Bluetooth, using the LE Audio protocol for high-quality voice data transmission.

[0047] Each cockpit is equipped with an intercom, which is responsible for collecting and receiving the user's voice signals and communicating with the cockpit domain controller through a BLE Bluetooth link. Intercoms in different cockpits communicate directly through analog or digital signals to achieve low latency and efficient real-time voice transmission.

[0048] During system initialization, the cockpit domain controller initiates a BLE Bluetooth pairing request and sends a pairing signal to the intercom in the corresponding cockpit. After receiving the pairing request, the intercom sends a response confirmation signal to the cockpit domain controller. After pairing is completed, a BLE Bluetooth connection is established between the cockpit domain controller and the intercom to form a stable data link to ensure subsequent voice data transmission. The BLE Bluetooth link uses the LE Audio protocol to support high-quality audio transmission, ensuring voice clarity and low latency.

[0049] When the user starts the intercom operation in the first cockpit, the first cockpit domain controller sends a PTT (Push-To-Talk) command to the first intercom to activate the voice collection mode. After receiving the PTT command, the first intercom starts to collect the user's voice signal and encodes it into high-quality audio data in LE Audio format. Through the BLE Bluetooth link, the first intercom transmits the collected voice data to the first cockpit domain controller, which receives and stores the voice signal and can choose to play or process it later.

[0050] After the intercom in the first cockpit collects the voice signal, in addition to transmitting the voice data to the first cockpit domain controller via BLE, it also transmits the voice signal directly to the intercom in the second cockpit via analog or digital signals. This direct communication method of analog / digital signals makes the voice transmission between intercoms independent of the Bluetooth link, reduces latency and improves real-time performance, and is suitable for intercom applications between multiple cockpits.

[0051] After the second intercom receives the voice signal from the first intercom, it prepares to forward it to the second cockpit domain controller for playback in the cockpit. When the intercom in the second cockpit receives the voice signal transmitted by the first intercom, it immediately forwards the voice signal to the second cockpit domain controller via the BLE Bluetooth link.

[0052] After receiving the voice signal, the second cockpit domain controller performs real-time playback and controls the vehicle-mounted speakers to amplify and play the received voice signal to ensure that the user in the second cockpit can clearly hear the voice content from the first cockpit. At the same time, the second cockpit domain controller also stores the voice signal in the internal storage module, which is convenient for users to play back or further process it when needed.

[0053] The pairing connection between the cockpit domain controller and the intercom is achieved through BLE Bluetooth and LE Audio protocols, ensuring the stability of the connection and the high quality of audio transmission. Intercoms communicate directly through analog or digital signals, reducing the delay in the transmission path and ensuring real-time intercom communication experience between different cockpits. The use of LE Audio protocol makes the voice signal transmitted by Bluetooth have higher sound quality, bringing users a clearer auditory experience.

[0054] The voice signal is collected through the Mic module; the voice signal is recorded through the Audio module. The cockpit domain controller converts the voice signal from voice to text through the matching interactive application software, and stores the conversion result. The cockpit domain controller analyzes the intercom content based on the voice signal, and provides the user with voice playback and text display functions through the interactive application software.

[0055] like Figure 4 As shown in the figure, the user presses the voice intercom button in the cockpit to trigger the intercom start operation. This operation is detected by the application in the cockpit and triggers the sending of a series of control commands. After receiving the key event, the cockpit application sends a PTT (Push-To-Talk) command to the intercom device to activate the intercom to enter the intercom state.

[0056] The PTT command is transmitted to the intercom through the control gateway and Bluetooth protocol stack, instructing it to prepare for voice collection and transmission. The Mic module (microphone module) of the intercom starts to collect the user's voice signal, converts the sound signal into an electrical signal and transmits it to the Audio module. To ensure the quality of the voice signal, the Mic module has noise reduction and gain control functions to reduce the interference of environmental noise.

[0057] The audio signal collected by the Mic module enters the Audio module. The Audio module is responsible for converting the analog audio signal into a digital signal and passing it to the App for further processing. The Audio module completes the digitization of the voice signal through the ADC analog-to-digital converter to ensure signal clarity.

[0058] The digitized voice signal is encoded by the LE Audio protocol (combined with TMAP) and transmitted to the intercom device through the BLE Bluetooth link to complete the transmission of voice data. The LE Audio protocol and TMAP provide high-quality audio transmission capabilities, ensuring that the intercom device receives clear voice signals.

[0059] While the Bluetooth link is transmitting, the App also records and receives the voice signal collected by the Mic module through the Audio module. The App stores the voice data in the internal storage module to provide support for subsequent processing. The App stores the recorded voice data and converts voice to text as needed. This conversion function makes it easy to display the voice content in text form or for subsequent analysis. The converted text data can be further used for voice analysis, such as keyword extraction, semantic recognition, etc., to enhance the interactive experience in the cockpit.

[0060] The voice signal transmitted through the LE Audio link is received and processed by the intercom device, enabling the user to conduct real-time voice intercom. When the intercom operation ends, both the intercom device and the App will receive the end signal and stop voice collection and transmission. The App archives the stored voice signals and text conversion content for subsequent playback or analysis. The archived voice data can be used for historical review, user analysis, or as reference material in special cases.

[0061] like Figure 5 As shown, the intercom receives a voice signal from the intercom at the other end. The voice signal is usually collected by the intercom at the other end and transmitted to the current intercom through the intercom network. After receiving the signal, the intercom encodes it into a data frame in the LEAudio format to ensure high-quality audio transmission.

[0062] The intercom transmits the voice signal to the cockpit domain controller of the cockpit through the BLE Bluetooth link through the LE Audio and TMAP protocols. After receiving the voice signal transmitted by the intercom, the cockpit domain controller immediately passes the signal to the vehicle speaker for playback. The cockpit domain controller processes the audio signal by adjusting the volume and gain to adapt to the ambient volume in the car, ensuring that the user can clearly hear the voice content from the other end.

[0063] While playing, the cockpit domain controller transmits the voice signal to the cockpit application (App). After receiving the voice signal, the App enters the data recording and processing state. The App will record and store the voice signal to provide data support for subsequent operations. The App stores the received voice signal. The stored voice file contains metadata such as timestamp and peer identification information for subsequent query or playback. These stored voice data can be used for historical record viewing or other application scenarios. After storage is completed, the App can convert the voice signal from voice to text and convert the voice content into text information. This function makes it convenient for users to view the content of the conversation in text form, and also facilitates further data analysis and processing.

[0064] The converted text data can enter the conversation analysis module. This module will process the conversation content through keyword extraction, sentiment analysis or topic classification to obtain the semantic information of the conversation. Through conversation analysis, the system can identify the user's needs or emotional state, thereby realizing intelligent interactive response in the cockpit.

[0065] It is not difficult to find that in the embodiment of the present application, by improving the connection method between the cockpit domain controller and the intercom, the BLE Bluetooth connection and LE Audio protocol are adopted to ensure high-quality, low-latency audio transmission, while supporting direct communication of analog / digital signals between intercoms, further reducing delays and improving real-time performance. The storage of voice signals, voice-to-text conversion, and conversation analysis functions are realized through the App, which not only improves the intercom experience in the cockpit, but also provides users with intelligent functions such as voice playback, text viewing, and emotion recognition, thereby enhancing the interactivity and data processing capabilities of the system, and bringing users a more convenient and efficient intercom communication experience.

[0066] The step division of the above methods is only for the purpose of clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this patent.

[0067] Third embodiment

[0068] A third embodiment of the present application relates to a cockpit intercom system, the system comprising:

[0069] Multiple cockpit domain controllers for controlling intercom activation and voice signal reception via BLE Bluetooth links;

[0070] Multiple intercoms, used to respond to the PPT instructions of the cockpit domain controller, collect voice signals and transmit them to the cockpit domain controller via a BLE Bluetooth link;

[0071] The cockpit domain controller also includes a storage module and a processing module for storing and processing the voice signal, and controlling the speaker to play the voice signal;

[0072] The cockpit domain controller and the intercom execute the steps of the above method.

[0073] It is not difficult to find that this embodiment is a system embodiment corresponding to the first embodiment, and this embodiment can be implemented in conjunction with the first embodiment. The relevant technical details mentioned in the first embodiment are still valid in this embodiment, and in order to reduce repetition, they are not repeated here. Accordingly, the relevant technical details mentioned in this embodiment can also be applied in the first embodiment.

[0074] It is worth mentioning that all modules involved in this embodiment are logic modules. In practical applications, a logic unit can be a physical unit, a part of a physical unit, or a combination of multiple physical units. In addition, in order to highlight the innovative part of this application, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by this application, but this does not mean that there are no other units in this embodiment.

[0075] In addition, some embodiments of the present application also provide an electronic device. The electronic device may be a digital computer in various forms, such as a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, etc. The electronic device may also be a mobile device in various forms, such as a personal digital processing, a cellular phone, a smart phone, a wearable device, and other similar computing devices.

[0076] The electronic device includes: one or more processors; and a memory storing computer program instructions, wherein when the computer program instructions are executed, the processor executes the steps of the method provided in any one or more of the above embodiments. Figure 6 An exemplary structural diagram of the electronic device is disclosed. Figure 6As shown, the electronic device includes: one or more processors 1101, memory 1102, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Among them, the components shown in this article, their connections and relationships, and their functions are only used as examples, and are not intended to limit the implementation of the present application described and / or required herein.

[0077] The electronic device may further include: an input device 1103 and an output device 1104. The processor 1101, the memory 1102, the input device 1103 and the output device 1104 may be connected via a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0078] The input device 1103 can receive input digital or character information, and generate key signal input related to the user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 1104 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0079] To provide interaction with a user, the electronic device may be a computer. The computer has: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball), through which the user can provide input to the computer. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0080] In the embodiments of the present application, a computer program / instruction is stored on a computer-readable medium, and when the computer program / instruction is executed by a processor, the steps of the method provided by any one or more of the above embodiments are implemented. The computer-readable medium may be included in the electronic device described in the above embodiments; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more computer-readable instructions.

[0081] The memory 1102 can be used as a non-transient computer-readable storage medium, which can be used to store non-transient software programs, non-transient computer executable programs and modules. The processor 1101 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 1102, so as to implement the program instructions / modules corresponding to the method provided by any one or more embodiments in the embodiments of the present application.

[0082] The memory 1102 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 1102 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 1102 may optionally include a memory remotely arranged relative to the processor 1101, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0083] It should be noted that the computer-readable medium described in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device.

[0084] Computer readable media include permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0085] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0086] In the above-described embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. For example, it can be implemented by using an application specific integrated circuit (ASIC), a general-purpose computer or any other similar hardware device. In certain embodiments, the software program of the present application can be executed by a processor to implement the above steps or functions. Similarly, the software program of the present application (including relevant data structures) can be stored in a computer-readable recording medium, for example, a RAM memory, a magnetic or optical drive or a floppy disk and similar devices. In addition, some steps or functions of the present application can be implemented by hardware, for example, as a circuit that cooperates with a processor to perform each step or function.

[0087] The computer program product provided in the embodiment of the present application includes one or more computer programs / instructions, and when the computer program / instructions are executed by the processor, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from a computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0088] The flow chart or block diagram in the accompanying drawings shows the possible architecture, function and operation of the equipment, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated system for hardware that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0089] The scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes that fall within the meaning and scope of the equivalent elements of the claims are included in the present application. Any figure mark in the claims should not be regarded as limiting the claims involved. In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the device claim may also be implemented by one unit or device through software or hardware. The words "first", "second", etc. are only used to distinguish the description, and do not indicate any particular order, nor can they be understood as indicating or implying relative importance.

[0090] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily mention changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims, and the above embodiments should be regarded as exemplary and non-restrictive.

Claims

1. A cockpit intercom integrated control method, characterized in that: The method comprises: When the user performs an intercom operation, the first cockpit domain controller sends a PTT command to activate the first intercom; after receiving the PPT command, the first intercom collects a voice signal and transmits the voice signal to the first cockpit domain controller through a BLE Bluetooth link, and the first cockpit domain controller receives and stores the voice signal; When the user performs a receiving operation, the second intercom receives the voice signal of the first intercom and transmits it to the second cockpit domain controller through the BLE Bluetooth link; the second cockpit domain controller receives and stores the voice signal and controls the speaker to play the voice signal.

2. The method according to claim 1, characterized in that: The method comprises: the cockpit domain controller is connected to the intercom via BLE Bluetooth, and the LE Audio protocol is used to transmit voice data.

3. The method according to claim 2, characterized in that The method comprises: communicating between intercoms via analog / digital signals.

4. The method according to claim 3, characterized in that The method comprises: the cockpit domain controller initiates matching, the intercom responds to pairing, and completes the BLE Bluetooth connection.

5. The method according to claim 4, characterized in that The method comprises: collecting the voice signal through a Mic module; and recording the voice signal through an Audio module.

6. The method according to claim 5, characterized in that The cockpit domain controller converts the voice signal from speech to text through the matching interactive application software and stores the conversion result.

7. The method according to claim 6, characterized in that The cockpit domain controller analyzes the intercom content based on the voice signal, and provides voice playback and text display functions to the user through the interactive application software.

8. A cockpit intercom system, characterized in that: The system comprises: Multiple cockpit domain controllers for controlling intercom activation and voice signal reception via BLE Bluetooth links; Multiple intercoms, used to respond to the PPT instructions of the cockpit domain controller, collect voice signals and transmit them to the cockpit domain controller via a BLE Bluetooth link; The cockpit domain controller also includes a storage module and a processing module for storing and processing the voice signal, and controlling the speaker to play the voice signal; The cockpit domain controller and the intercom perform the steps of the method described in any one of claims 1 to 7.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; and A memory storing computer program instructions, which, when executed, cause the processor to perform the steps of the method as claimed in any one of claims 1 to 7.

10. A computer readable medium having a computer program / instructions stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images