Cabin simultaneous interpretation method and cabin simultaneous interpretation system

Abstract

The invention provides a cabin simultaneous interpretation method and a cabin simultaneous interpretation system, the method is applied to a domain controller of a vehicle, and the vehicle is also provided with a pickup module, a voice device, a translation module and a monitoring module; comprising the steps of obtaining state information of voice equipment; starting a monitoring module to monitor the voice equipment according to the state information to obtain first monitoring data; according to the first monitoring data, adjusting a pickup angle of a pickup module to enable the pickup module to face the voice equipment; controlling a pickup module to collect sound information in the vehicle; the translation module is controlled to convert the sound information into translation voice; and outputting the translated voice to a voice device, so that the voice device plays the translated voice. The technical problem that the quality and accuracy of simultaneous interpretation are affected due to the fact that the body types of users are different and the space in the vehicle may move, when the users speak, the sound receiving microphone cannot adjust the sound receiving angle according to the sound source position, the sound receiving effect is prone to being unstable is solved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a cockpit simultaneous interpretation method and a cockpit simultaneous interpretation system. Background Art

[0002] In today's era of globalization, people travel more frequently and communication becomes more diversified. As an important means of transportation, cars are no longer limited to transportation, but also carry people's needs for efficient communication during travel. The simultaneous interpretation system in the car cabin came into being, aiming to provide a convenient communication environment for users with different language backgrounds.

[0003] At present, the simultaneous interpretation system in the car cockpit usually realizes basic translation work by setting up translation software in the car and matching it with a microphone.

[0004] However, there is at least one of the following problems in the related technology: due to the differences in body shapes of users and the possible interactive movement in the space inside the car, when the user is speaking, the receiving microphone can only determine whether the sound source is in its corresponding receiving area, and cannot adjust its receiving angle according to the location of the sound source, which can easily lead to unstable receiving effect, affecting the quality and accuracy of simultaneous interpretation, and greatly reducing the user experience. Summary of the invention

[0005] The technical problem to be solved by this application is: due to the differences in body shapes of users and the possible interactive movement in the space inside the car, when the user is speaking, the receiving microphone can only determine whether the sound source is in its corresponding receiving area, and cannot adjust its receiving angle according to the location of the sound source, which can easily lead to unstable receiving effect, affecting the quality and accuracy of simultaneous interpretation, and greatly reducing the user experience.

[0006] To solve the above problems, the present application provides a cockpit simultaneous interpretation method, which is applied to a domain controller of a vehicle, and a sound pickup module, a voice device, a translation module and multiple monitoring modules are also provided in the vehicle; the cockpit simultaneous interpretation method includes: obtaining status information of the voice device; starting at least one monitoring module to monitor the voice device according to the status information to obtain first monitoring data, and the first monitoring data includes: the signal strength between the voice device and any monitoring module, and the signal transmission angle between the voice device and any monitoring module; according to the first monitoring data, adjusting the sound pickup angle of the sound pickup module so that the sound pickup module faces the voice device; controlling the sound pickup module to collect sound information in the vehicle; controlling the translation module to convert the sound information into translated voice; outputting the translated voice to the voice device so that the voice device plays the translated voice.

[0007] Compared with the prior art, the technical effect achieved by adopting this technical solution is as follows: compared with the related technology in which one receiving microphone corresponds to one receiving area, its receiving angle cannot be adjusted, and it can only obtain sound signals in a specific area, and it is impossible to adjust the receiving angle according to the position of the sound source; the present application monitors the voice device through multiple monitoring modules, and can obtain monitoring data including signal strength and signal transmission angle from different angles and positions. It can dynamically adjust the direction of the pickup module according to the actual situation of the voice device in the car, so that it is always facing the voice device, and more comprehensively reflects the position of the voice device in the vehicle. Even if the user changes his position due to body shape differences or moves in the space inside the car, the pickup angle can be adjusted in time to ensure a stable receiving effect, thereby improving the quality and accuracy of simultaneous interpretation.

[0008] In one example of the present application, obtaining status information of a voice device includes: controlling at least one monitoring module to monitor the signal connection between the voice device and the domain controller; if the voice device is connected to the domain controller, determining that the voice device is in an active state and activating a translation system.

[0009] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: by obtaining the activity status of the voice device to choose whether to activate the translation system, the user does not need to manually operate to turn on the translation system, which improves the intelligence of the system; at the same time, it avoids unnecessary waste of system resources and improves the response speed and efficiency of the system.

[0010] In one example of the present application, a first plane and a second plane arranged relatively to each other are provided in the vehicle; at least one monitoring module is arranged on the first plane, recorded as a first slave anchor point; at least one monitoring module is arranged on the second plane, recorded as a second slave anchor point; after determining that the voice device is in an active state, the method includes: obtaining a first positioning coordinate of the voice device in the vehicle according to the signal strength and signal transmission angle between the voice device and the first slave anchor point; obtaining a second positioning coordinate of the voice device in the vehicle according to the signal strength and signal transmission angle between the voice device and the second slave anchor point; and locating the voice device according to the first positioning coordinate and the second positioning coordinate.

[0011] Compared with the prior art, the technical effect achieved by adopting this technical solution is as follows: by setting a first slave anchor point on the first plane in the vehicle and setting a second slave anchor point on the second plane corresponding to the first slave anchor point; monitoring the voice device from different heights and positions, and obtaining the signal strength and signal transmission angle between the voice device and different slave anchor points, the voice device can be positioned more accurately, the pickup module can be controlled more accurately to adjust the pickup angle, and the sound reception effect can be improved.

[0012] In one example of the present application, the vehicle is also provided with at least one sensor module, and the sensor modules are all located below the seats; the method also includes: when the monitoring module detects the first monitoring data, starting the sensor module; controlling the sensor module to monitor the target object on the seat; when the target object is a user, the sensor module generates second monitoring data, and the second monitoring data includes the user's sitting position; according to the first positioning coordinates and the second positioning coordinates, the voice device is positioned, including: according to the first positioning coordinates, the second positioning coordinates and the second monitoring data, the user wearing the voice device and located in the vehicle is spatially positioned.

[0013] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: by setting a sensor module under the seat and combining it with the first monitoring data, the user's position information is obtained from multiple dimensions, thereby further improving the positioning accuracy of users wearing voice devices. When the signal strength or the transmission angle is interfered with, resulting in inaccurate positioning of the voice device, the second monitoring data provided by the sensor module can be used as an auxiliary judgment basis, thereby improving the system's positioning capability in complex environments and ensuring that the sound reception effect is always good.

[0014] In one example of the present application, the method further includes: assigning weights to signal strength and signal transmission angle; calculating an evaluation value of the sound pickup effect between the sound pickup module and the voice device; and determining the sound pickup module corresponding to the voice device based on the evaluation value.

[0015] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: weights are allocated according to signal strength and signal transmission angle, and the evaluation value of the sound reception effect is calculated, which can comprehensively consider the influence of different factors on the sound reception effect; for example, if the signal strength is large but the transmission angle is not ideal, the relationship between the two can be balanced through weight allocation, and the optimal sound pickup solution can be found to ensure that the sound pickup module can receive clear and accurate voice signals.

[0016] In one example of the present application, the method further includes: if the voice device is not connected to the domain controller, determining that the voice device is in a silent state; or, if the voice device fails to connect to the domain controller, controlling the voice device to connect to the domain controller again and sending a prompt to the user.

[0017] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: judging and processing the different connection states of the voice device, taking corresponding measures when the connection is not made or the connection fails, ensuring that the user can understand the status of the device in a timely manner, and when problems occur in the voice device or domain controller, they can be handled in a timely manner.

[0018] In one example of the present application, the vehicle is further provided with a display module, and the display module is used for the user to set a target translation language; before the control module converts the sound information into a translation voice, the method further includes: displaying a plurality of preset translation languages ​​through the display module; determining a target translation language from a plurality of preset translation languages ​​in response to a selection operation of the user on the display module; controlling the translation module to convert the sound information into a translation voice, including: controlling the translation module to convert the sound information into a translation voice corresponding to the target translation language.

[0019] Compared with the prior art, the technical effect achieved by adopting this technical solution is as follows: the user is allowed to set the target translation language through the display module, which improves the pertinence and personalization of the translation, can meet the needs of different users for different translation languages, and enhances the flexibility of the system and the user experience.

[0020] In one example of the present application, the display module is also used to display the translated text output by the translation module; controlling the translation module to convert the sound information into the translated speech corresponding to the target translation language includes: controlling the translation module to convert the sound information into the translated speech and translated text corresponding to the target translation language; the cockpit simultaneous interpretation method also includes: outputting the translated text to the display module so that the display module displays the translated text.

[0021] Compared with the prior art, the technical effect achieved by adopting this technical solution is: outputting the translated text to the display module for display, providing users with a variety of information acquisition methods, improving the comprehensibility and verifiability of the translation results, and making it easier for users to view and confirm the translation content. In one example of the present application, the sound pickup module is controlled to collect sound information in the vehicle, including: converting the sound information into a digital signal; parsing the digital signal, and generating sound features corresponding to the sound information, the sound features including audio frequency, audio amplitude and audio phase; generating an anti-phase sound wave according to the sound features, and inputting it into at least one voice device.

[0022] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: sound information is generated by collecting sounds in the vehicle, the voice information is analyzed to generate its corresponding sound features, and the domain controller generates an inverted sound wave according to the sound features. When the inverted sound wave is input into the voice device, it can effectively offset the ambient noise in the vehicle and the user's original voice, and reduce the interference of the noise in the vehicle to the users listening to the translated voice through active noise reduction.

[0023] In one example of the present application, a cockpit simultaneous interpretation system is provided, comprising: a domain controller, a sound pickup module, a voice device, a translation module and a plurality of monitoring modules arranged in a vehicle, wherein the sound pickup module, the voice device, the translation module and the plurality of monitoring modules are all communicatively connected to the domain controller; wherein the domain controller obtains status information of the voice device; controls at least one monitoring module to monitor the voice device according to the status information to obtain first monitoring data, wherein the first monitoring data comprises: signal strength between the voice device and any monitoring module, and signal transmission angle between the voice device and any monitoring module; adjusts the sound pickup angle of the sound pickup module according to the first monitoring data so that the sound pickup module faces the voice device; controls the sound pickup module to collect sound information in the vehicle; controls the translation module to convert the sound information into translated voice; outputs the translated voice to the voice device so that the voice device plays the translated voice.

[0024] Compared with the existing technology, the technical effect achieved by adopting this technical solution is as follows: the component structure of the cockpit simultaneous interpretation system and the communication connection relationship between each module are clarified, ensuring the integrity and collaborative working ability of the system.

[0025] After adopting the technical solution of this application, the following technical effects can be achieved: (1) This application monitors the voice device through multiple monitoring modules, and can obtain monitoring data including signal strength and signal transmission angle from different angles and positions. It can dynamically adjust the direction of the pickup module according to the actual situation of the voice device in the car, so that it is always facing the voice device, and more comprehensively reflects the position of the voice device in the vehicle. Even if the user changes his position due to body size differences or movement in the space inside the car, the pickup angle can be adjusted in time to ensure a stable sound reception effect, thereby improving the quality and accuracy of simultaneous interpretation; (2) By obtaining the activity status of the voice device, the system can choose whether to activate the translation system. Users do not need to manually turn on the translation system, which improves the intelligence of the system. (3) The sensor module is combined with the first monitoring data to obtain the user's location information from multiple dimensions. When the signal strength or transmission angle is interfered with and causes inaccurate positioning, the second monitoring data provided by the sensor module can be used as an auxiliary judgment basis to improve the system's positioning capability in complex environments. (4) By allocating weights based on signal strength and signal transmission angle and calculating the evaluation value of the sound pickup effect, the optimal sound pickup solution can be found by comprehensively considering the impact of different factors on the sound pickup effect, ensuring that the simultaneous interpretation system can receive clear and accurate voice signals. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings to be used in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. Figure 1 A flowchart of a cockpit simultaneous interpretation method provided in an embodiment of the present application; Figure 2 A schematic diagram of the monitoring module layout provided in an embodiment of the present application; Figure 3 This is a module connection diagram within the cockpit simultaneous interpretation system provided in an embodiment of the present application.

[0027] Description of reference numerals: 100. Cockpit simultaneous interpretation system; 10. Sound pickup module; 20. Voice equipment; 30. Monitoring module; 40. Translation module; 50. Domain controller. DETAILED DESCRIPTION

[0028] The embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and should not be construed as limitations on the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0029] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0030] See also Figure 1 , Figure 1 This is a flowchart of a cockpit simultaneous interpretation method according to an embodiment of the present application. Figures 2 to 3 Specifically, a cockpit simultaneous interpretation method is provided, wherein a sound pickup module 10, a voice device 20, a translation module 40 and a plurality of monitoring modules 30 are provided in a vehicle; the cockpit simultaneous interpretation method comprises: S10: Obtaining status information of the voice device; S20: starting at least one monitoring module to monitor the voice device according to the state information to obtain first monitoring data; S30: adjusting the sound pickup angle of the sound pickup module according to the first monitoring data so that the sound pickup module faces the voice device; S40: Controlling the sound pickup module to collect sound information in the vehicle; S50: Control the translation module to convert the sound information into translation speech; S60: Outputting the translated speech to the speech device so that the speech device plays the translated speech.

[0031] Preferably, the first monitoring data includes: the signal strength between the voice device and any monitoring module, and the signal transmission angle between the voice device and any monitoring module.

[0032] Preferably, the signal transmission angle is the angle at which the monitoring module and the voice device deviate from the center axis of the vehicle.

[0033] Furthermore, S10 also includes: S11: Control at least one monitoring module to monitor the signal connection between the voice device and the domain controller; S111: If the voice device is connected to the domain controller, the voice device is determined to be active and the translation module is activated; S112: If the voice device is not connected to the domain controller, determine that the voice device is in a silent state; S113: If the voice device fails to connect to the domain controller, the voice device is controlled to connect to the domain controller again, and a prompt is sent to the user.

[0034] Preferably, a storage compartment is also provided in the vehicle, and the voice device 20 can be charged in the storage compartment.

[0035] Preferably, the voice device 20 is a Bluetooth headset.

[0036] In combination with specific usage conditions, the monitoring module 30 will monitor the signal connection between the voice device 20 and the domain controller 50 in real time; the first situation is: when the user takes out the Bluetooth headset placed in the placement bin, the Bluetooth headset will start Bluetooth broadcasting, and the domain controller 50 will start the connection process after searching for the Bluetooth headset. When the monitoring module 30 detects that the Bluetooth headset is successfully connected to the domain controller 50, the Bluetooth headset is calibrated as active and the translation module 40 is activated; the second situation in contrast is: when the user takes out the Bluetooth headset placed in the placement bin, the Bluetooth headset starts Bluetooth broadcasting, the domain controller 50 searches for the headset but fails to connect to the Bluetooth headset. At this time, the domain controller 50 will try to connect to the Bluetooth headset again. If multiple connection failures occur, a prompt will be issued to the user; the third situation is: the Bluetooth headset has been in the placement bin. At this time, the Bluetooth headset does not send a Bluetooth broadcast, and the domain controller 50 cannot search for the signal of the Bluetooth headset, which is a silent state.

[0037] It should be noted that the above three situations are only for facilitating the understanding of the solutions in this application and do not constitute excessive limitations.

[0038] Preferably, a capacitor module is provided on the voice device 20, and through the induction of the capacitor module, when the user wears the voice device 20, the voice device 20 is automatically activated.

[0039] Further, referring to the attached drawings, a first plane and a second plane are arranged opposite to each other in the vehicle; at least one monitoring module 30 is arranged on the first plane, which is recorded as a first secondary anchor point; at least one monitoring module 30 is arranged on the second plane, which is recorded as a second secondary anchor point; After determining that the voice device 20 is in an active state, the cockpit simultaneous interpretation method further includes: obtaining a first positioning coordinate of the voice device 20 in the vehicle according to a signal strength and a signal transmission angle between the voice device 20 and the first slave anchor point; Obtaining a second positioning coordinate of the voice device 20 in the vehicle according to the signal strength and signal transmission angle between the voice device 20 and the second slave anchor point; According to the first positioning coordinates and the second positioning coordinates, the voice device 20 is positioned. Preferably, the first plane is at the ceiling of the vehicle, and the second plane is parallel to the first plane and is located at the vehicle seat.

[0040] Preferably, at least one first secondary anchor point is disposed on a roof inside the vehicle, and at least one second secondary anchor point is disposed below the first secondary anchor point.

[0041] Among them, in combination with the accompanying drawings, the RSSI signal strength and signal transmission angle between the first slave anchor point located on the ceiling of the vehicle and the voice device 20 provide a side coordinate axis in the vehicle's D space, which is used to locate the user's head position in the vehicle's overhead view, and combined with the second slave anchor point set on the second plane, the user's head with the voice device 20 can be located at the three coordinates xyz in the vehicle's cabin D space; in simple terms, by setting two slave anchor points on the first plane and / or the second plane, the coordinates of the voice device 20 in one plane can be determined, and combined with the slave anchor point of another plane, the xyz coordinates of the voice device 20 in the vehicle cabin can be further determined, and the pickup angle of the pickup module 10 is adjusted according to the xyz coordinates to face the voice device 20.

[0042] It should be noted that the first monitoring data is the signal strength and signal transmission angle between each voice device 20 and each monitoring module 30 .

[0043] Preferably, the voice device 20 can be either a Bluetooth headset or a Bluetooth headset with a built-in Ultra Wide Band (UWB) module.

[0044] Preferably, the signal strength may include either a received signal strength indicator (RSSI) signal strength of UWB or a RSSI signal strength of Bluetooth Low Energy (BLE).

[0045] Preferably, there are multiple monitoring modules 30, and each of the monitoring modules 30 can serve as either a Bluetooth anchor point or a UWB anchor point.

[0046] Preferably, the sound pickup module 10 is a plurality of array microphones, and the plurality of array microphones are all arranged at the seat positions of the vehicle.

[0047] Preferably, any array microphone is provided with an angle feedback sensor.

[0048] Preferably, the number of monitoring modules 30 may be 3 to 6.

[0049] In some embodiments, the monitoring module 30 may be a Bluetooth slave anchor point, which is deployed in the cockpit to monitor the Bluetooth connection between the domain controller 50 and the Bluetooth headset; wherein each Bluetooth slave anchor point provides one RSSI signal strength and RSSI angle information for each Bluetooth headset.

[0050] In a specific example, as shown in the figure, specifically, there are three monitoring modules 30, so the three Bluetooth slave anchor points deployed in the cockpit will have three RSSI signal values ​​and RSSI angles for the Bluetooth headset worn by each user; the three Bluetooth slave anchor points are respectively: anchor point A, anchor point B and anchor point D, wherein anchor point A and anchor point B are respectively deployed at the two ends of the central axis of the ceiling in the car, and are used to provide the plane D positioning coordinates of user C in the top view of the car, anchor point B is deployed at the rear of the car, and anchor point D is set directly below anchor point B, and anchor point D is used to provide the positioning coordinates of user C when the car is in the front view; thus, the domain controller 50 determines the spatial position coordinates of the Bluetooth headset in the vehicle based on the RSSI signal strength of itself from user C fed back by anchor point A, anchor point B and anchor point D, and the angle between itself and user C based on the deviation of the central axis, and the domain controller 50 adjusts the pickup angle of the array microphone according to its spatial position coordinates to ensure that the array microphone can pick up sound in the direction of the Bluetooth headset in real time.

[0051] It should be further explained that the location where the monitoring module 30 is set is not limited to the locations of the A anchor point, the B anchor point and the D anchor point in the above example, and its setting location can be selected arbitrarily as long as the purpose of accurately locating the voice device 20 can be achieved.

[0052] In some other embodiments, the monitoring module 30 can be a UWB slave anchor point, each of which is arranged in the cockpit, and the UWB signals of the Bluetooth headset at the distance from each UWB slave anchor point are obtained respectively; wherein each UWB slave anchor point provides at least one RSSI signal strength and RSSI angle for each Bluetooth-UWB headset; it should be noted that when the monitoring module 30 is a UWB slave anchor point, its layout principle and idea are the same as those of an ordinary Bluetooth anchor point, and no further elaboration will be made here on how to layout the UWB slave anchor point, which can be obtained through the setting of the above-mentioned ordinary Bluetooth anchor point.

[0053] Furthermore, the vehicle is also provided with at least one sensor module, and the at least one sensor module is provided below the seat; The cockpit simultaneous interpretation method includes: when the monitoring module 30 detects the first monitoring data, starting the sensor module; Controlling the sensor module to detect the target object on the seat; When the target object is a user, the sensing module generates second monitoring data, the second monitoring data including the user's sitting position; Positioning the voice device 20 according to the first positioning coordinates and the second positioning coordinates includes: spatially positioning a user who is in the vehicle and wearing the voice device 20 according to the first positioning coordinates, the second positioning coordinates and the second monitoring data.

[0054] Preferably, the sensor module can monitor according to the pressure received and the object located on the seat, so as to distinguish whether the object on the seat is a passenger or other cargo. When it is determined to be a user, the sensor module generates second monitoring data.

[0055] Preferably, the second monitoring data includes the user's sitting position.

[0056] Furthermore, by utilizing the sensor module arranged on the seat, when the sensor module detects that the target object is a user, the user wearing the voice device 20 in the vehicle is spatially positioned in combination with the first positioning coordinates and the second positioning coordinates in the above content, thereby further improving the positioning accuracy of the user wearing the voice device 20. No matter how the user changes his position in the vehicle, the user's position can be accurately determined through multi-dimensional positioning methods, thereby improving the reception effect.

[0057] Furthermore, the cockpit simultaneous interpretation method further includes: weighting the signal strength and the signal transmission angle; Calculating an evaluation value of the sound pickup effect between the sound pickup module 10 and the voice device 20; According to the evaluation value, the sound pickup module 10 corresponding to the voice device 20 is determined.

[0058] Preferably, the domain controller 50 can select the pickup module 10 with the best sound reception effect for the corresponding voice device 20 according to the evaluation value of the sound reception effect between the pickup module 10 and the voice device 20, and control the best pickup module 10 to adjust its sound reception angle.

[0059] For example, when the user moves from one seat to another, the domain controller 50 will reposition the user and the voice device 20 based on the first positioning coordinates, the second positioning coordinates and the second monitoring data, and evaluate the signal strength and signal transmission angle between the voice device 20 and the domain controller 50 after the adjustment of the position to determine the best pickup module 10 for the voice device 20. This enables the system to select the best pickup module 10 for sound reception based on actual conditions, thereby improving the quality and stability of sound reception.

[0060] Furthermore, the vehicle is also provided with a display module, which is used for the user to set the target translation language; Before controlling the translation module 40 to convert the sound information into the translated speech, the cockpit simultaneous interpretation method further includes: displaying a plurality of preset translation languages ​​through a display module; In response to a selection operation of a user on the display module, determining a target translation language from a plurality of preset translation languages; Controlling the translation module 40 to convert the sound information into the translation language includes: The control translation module 40 converts the sound information into a translation speech corresponding to the target translation language.

[0061] Furthermore, the display module is also used to display the translated text output by the translation module 40; Controlling the translation module 40 to convert the sound information into a translation speech corresponding to the target translation language includes: Control the translation module 40 to convert the sound information into translation speech and translation text corresponding to the target translation language; The cockpit simultaneous interpretation method also includes: outputting the translated text to a display module, so that the display module displays the translated text.

[0062] In combination with specific usage conditions, when the user takes out the Bluetooth headset located in the placement compartment, the Bluetooth headset is automatically connected to the domain controller 50. After the capacitor module detects that the user is wearing it and successfully connects to the domain controller 50, the domain controller 50 activates the translation module 40; at the same time, the user can operate the display module corresponding to his seat, select the preset translation voice and the initial language, and the display device is connected to the translation module 40 to display the text content of the voice and the translated text content in real time. The translated text and the translated voice complement each other to improve the accuracy of the translation.

[0063] Preferably, the sound pickup module 10 is controlled to collect sound information in the vehicle, including: converting the sound information into a digital signal; parsing the digital signal, and generating sound features corresponding to the sound information, the sound features including audio frequency, audio amplitude and audio phase; generating an anti-phase sound wave according to the sound features, and inputting it into at least one voice device 20; and improving the stability and adaptability of the system by generating white noise.

[0064] In a specific example, multiple users in the cockpit start to communicate in a selected or automatically recognized language; user A speaks English, user B speaks Spanish, and user C speaks Latin; when user A says, "How is the whether like today?", the array microphone of user A inputs this English sentence into the domain controller 50, and the translation module 40 translates the content. At the same time, when the speech of user A is input into the domain controller 50, the domain controller 50 generates an anti-phase sound wave according to the sound characteristics of the speech of user A, and acts on the voice devices 20 of users B and C, so that the Bluetooth headsets of users B and C perform active noise reduction and filter the original speech of user A. At the same time, the domain controller 50 translates the language of user A into the Spanish of user B and the Latin of user C through the translation module 40, simulates the timbre of user A through AI, outputs it to the Bluetooth headsets of users B and C through Bluetooth, and displays the translated content on the corresponding display screens of users B and C.

[0065] Similarly, when user B and user C communicate in Spanish and Latin, user A can also block the original Spanish and Latin of user B and user C in the Bluetooth headset and get English spoken in the tone of user B and user C.

[0066] It should be noted that the above examples are only for facilitating the understanding of the system operation logic in this application and do not impose any limitation thereto.

[0067] Preferably, the monitoring module 30 includes a vehicle-mounted main anchor point and a vehicle-mounted secondary anchor point.

[0068] Preferably, any monitoring module 30 can serve as a master anchor point or a slave anchor point including reusing the above-mentioned digital key.

[0069] In combination with the specific situation, the Bluetooth BLE digital key mainly relies on the user's mobile phone, the vehicle-mounted main anchor point and the vehicle-mounted slave anchor point to form a BLE-based RSSI positioning architecture; among them, the user's mobile phone establishes a BLE connection with the main anchor point, and the main anchor point can obtain the RSSI signal value representing the distance between the main anchor point and the mobile phone. The slave anchor point is responsible for monitoring the BLE connection between the user's mobile phone and the main anchor point, and each slave anchor point can obtain an RSSI signal value representing the distance between the slave anchor point and the mobile phone; due to the different positions of the user's mobile phone relative to different anchor points, the received signal strength will also be different, so the domain controller 50 will collect these RSSI signal values ​​from the main anchor point and the slave anchor point; by analyzing and calculating these RSSI signal values ​​with differences, the domain controller 50 can obtain the position of the user's mobile phone relative to the vehicle, and finally, based on the calculated user location information, the domain controller 50 determines whether to give a signal to unlock the vehicle.

[0070] Furthermore, the present application also provides an electronic device, which includes a processor and a memory; the memory is used to store data in the simultaneous interpretation system, and the processor is used to call the data in the memory. The electronic device can implement any of the above-mentioned cabin simultaneous interpretation methods.

[0071] For further information, please see the attached Figure 3 The present application provides a cockpit simultaneous interpretation system 100, comprising: a domain controller 50, a sound pickup module 10, a voice device 20, a translation module 40 and a plurality of monitoring modules 30 arranged in a vehicle, wherein the sound pickup module 10, the voice device 20, the translation module 40 and the plurality of monitoring modules 30 are all in communication connection with the domain controller 50; Among them, the domain controller 50 obtains the status information of the voice device 20; controls at least one monitoring module 30 to monitor the voice device 20 according to the status information to obtain first monitoring data, and the first monitoring data includes: the signal strength between the voice device 20 and any monitoring module 30, and the signal transmission angle between the voice device 20 and any monitoring module 30; according to the first monitoring data, adjusts the pickup angle of the sound pickup module 10 so that the sound pickup module 10 faces the voice device 20; controls the sound pickup module 10 to collect sound information in the vehicle; controls the translation module 40 to convert the sound information into translated speech; outputs the translated speech to the voice device 20, so that the voice device 20 plays the translated speech.

[0072] Furthermore, the present application also provides a vehicle that can apply the above-mentioned cockpit simultaneous interpretation method and includes the above-mentioned cockpit simultaneous interpretation system 100 and electronic equipment.

[0073] Although the present application is disclosed as above, the present application is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present application. Therefore, the protection scope of the present application shall be subject to the scope defined by the claims.

Claims

1. A cockpit simultaneous interpretation method, characterized in that: A domain controller applied to a vehicle, wherein the vehicle is also provided with a sound pickup module, a voice device, a translation module and a plurality of monitoring modules; The cockpit simultaneous interpretation method comprises: Obtaining status information of the voice device; Controlling at least one of the monitoring modules to monitor the voice device according to the state information to obtain first monitoring data, wherein the first monitoring data includes: signal strength between the voice device and any of the monitoring modules, and signal transmission angle between the voice device and any of the monitoring modules; According to the first monitoring data, adjusting the sound pickup angle of the sound pickup module so that the sound pickup module faces the voice device; Controlling the sound pickup module to collect sound information in the vehicle; Controlling the translation module to convert the sound information into translated speech; The translated speech is output to the speech device, so that the speech device plays the translated speech.

2. The cockpit simultaneous interpretation method according to claim 1, characterized in that: The obtaining of the status information of the voice device includes: Controlling at least one of the monitoring modules to monitor the signal connection between the voice device and the domain controller; If the voice device is connected to the domain controller, the voice device is determined to be in an active state, and the translation module is activated.

3. The cockpit simultaneous interpretation method according to claim 2, characterized in that: The vehicle is provided with a first plane and a second plane which are arranged opposite to each other; at least one monitoring module is arranged on the first plane and is recorded as a first slave anchor point; At least one of the monitoring modules is arranged on the second plane and is recorded as a second slave anchor point; After determining that the voice device is in an active state, the method further includes: Obtaining a first positioning coordinate of the voice device in the vehicle according to the signal strength and the signal transmission angle between the voice device and the first slave anchor point; Obtaining a second positioning coordinate of the voice device in the vehicle according to the signal strength and the signal transmission angle between the voice device and the second slave anchor point; The voice device is positioned according to the first positioning coordinates and the second positioning coordinates.

4. The cockpit simultaneous interpretation method according to claim 3, characterized in that: The vehicle is further provided with at least one sensor module, and the sensor modules are all provided below the seat; the method further comprises: When the monitoring module detects the first monitoring data, the sensor module is activated; controlling the sensor module to monitor the target object on the seat; When the target object is a user, the sensor module generates second monitoring data, and the second monitoring data includes the sitting position of the user; The positioning of the voice device according to the first positioning coordinates and the second positioning coordinates includes: The user wearing the voice device and located in the vehicle is spatially positioned according to the first positioning coordinates, the second positioning coordinates and the second monitoring data.

5. The cockpit simultaneous interpretation method according to claim 4, characterized in that: The method further comprises: Performing weight allocation on the signal strength and the signal transmission angle; Calculating an evaluation value of the sound pickup effect between the sound pickup module and the voice device; The sound pickup module corresponding to the voice device is determined according to the evaluation value.

6. The cockpit simultaneous interpretation method according to claim 2, characterized in that: The method further comprises: If the voice device is not connected to the domain controller, determining that the voice device is in a silent state; or, If the voice device fails to connect to the domain controller, the voice device is controlled to connect to the domain controller again and a prompt is issued to the user.

7. The cockpit simultaneous interpretation method according to claim 1, characterized in that: The vehicle is further provided with a display module, and the display module is used for a user to set a target translation language; before controlling the translation module to convert the sound information into a translation voice, the method further includes: Displaying multiple preset translation languages ​​through the display module; In response to a selection operation of a user on the display module, determining the target translation language from the plurality of preset translation languages; The controlling the translation module to convert the sound information into the translated speech comprises: The translation module is controlled to convert the sound information into a translation speech corresponding to the target translation language.

8. The cockpit simultaneous interpretation method according to claim 7, characterized in that: The display module is also used to display the translated text output by the translation module; The controlling the translation module to convert the sound information into a translation speech corresponding to the target translation language comprises: Controlling the translation module to convert the sound information into translation speech and translation text corresponding to the target translation language; The method further comprises: The translated text is output to the display module so that the display module displays the translated text.

9. The cockpit simultaneous interpretation method according to claim 8, characterized in that: The controlling the sound pickup module to collect sound information in the vehicle includes: Converting the sound information into digital signals; Analyzing the digital signal and generating sound features corresponding to the sound information, wherein the sound features include audio frequency, audio amplitude and audio phase; An anti-phase sound wave is generated according to the sound feature and input into at least one of the voice devices.

10. A cockpit simultaneous interpretation system, characterized in that: include: A domain controller, a sound pickup module, a voice device, a translation module and a plurality of monitoring modules are arranged in the vehicle, wherein the sound pickup module, the voice device, the translation module and the plurality of monitoring modules are all in communication connection with the domain controller; Among them, the domain controller obtains the status information of the voice device; controls at least one of the monitoring modules to monitor the voice device according to the status information to obtain first monitoring data, and the first monitoring data includes: the signal strength between the voice device and any of the monitoring modules, and the signal transmission angle between the voice device and any of the monitoring modules; according to the first monitoring data, adjusts the pickup angle of the sound pickup module so that the sound pickup module faces the voice device; controls the sound pickup module to collect sound information in the vehicle; controls the translation module to convert the sound information into translated voice; outputs the translated voice to the voice device, so that the voice device plays the translated voice.

Images