Vehicle-mounted information system privacy protection method and device, vehicle, medium and program

By receiving voice commands from users in the car and obtaining facial information, judging user identity and controlling privacy levels, the problem of poor privacy protection flexibility of vehicle information system in special car use scenarios is solved, and the effectiveness of vehicle owner's private information is achieved Protection and normal use of system functions.

CN119037301APending Publication Date: 2024-11-29CHONGQING CHANGAN AUTOMOBILE CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411043841.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The existing on-board information system has poor privacy protection flexibility in special car use scenarios, which can easily lead to the leakage of drivers' private information.

Method used

By receiving voice commands from users in the car, obtaining user's face information, determining whether the user is the vehicle owner, and controlling the on-board information system to block or display the vehicle owner's privacy information based on the privacy level of voice commands and facial information, ensuring that Only the vehicle owner can access sensitive information.

Benefits of technology

It improves the privacy protection flexibility of the on-board information system in special car use scenarios, prevents the incorrect response of voice commands by non-drivers, ensures the security of the private information of the vehicle owner, and ensures the normal use of the basic functions of the on-board information system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119037301A_ABST
    Figure CN119037301A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of intelligent control, and discloses a privacy protection method and device for a vehicle-mounted information system, a vehicle, a medium and a program. When it is determined that the user sending the voice instruction is in the main driving state, face information of the user is obtained; judging whether the user is a vehicle owner or not based on the voice instruction and the face information; and if the user is not the vehicle owner, determining the privacy level of the voice instruction, and controlling the vehicle-mounted information system to shield the privacy information of the vehicle owner from the user based on the privacy level. When it is detected that the user sending the voice instruction is in the main driving state, identity verification is conducted according to the voice instruction and the face information of the user, and if identity verification does not pass, the corresponding control mode is selected to conduct privacy shielding on the current vehicle driver according to the privacy level of the voice instruction sent by the user; therefore, privacy information of a vehicle owner is protected, normal use of basic functions of the vehicle-mounted information system is guaranteed, and flexibility is higher.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent control technology, and in particular to a privacy protection method, device, vehicle, medium and program for an in-vehicle information system. Background Art

[0002] With the continuous advancement of technology, in-vehicle information systems have become standard in modern cars. In-vehicle information systems can provide drivers with convenient functions such as music playback, navigation, phone calls, WeChat, etc., greatly improving the driver's travel experience. However, these systems may display the driver's private information during operation, such as address books, chat records, etc.

[0003] At present, the privacy protection mode is often turned on through voiceprint recognition when it is determined that the person in the car is not the owner. However, the system may mistakenly receive voice commands from other people in the car. After recognizing that the voiceprint is inconsistent with the owner, the privacy protection mode is mistakenly turned on and the use of functions is restricted, which greatly affects the driving experience of the owner. In addition, the privacy protection effect can be achieved by displaying information consistent with the user's login account when it is detected that there is only one user in the car, and avoiding displaying sensitive information of the account on the center console when it is detected that there are other users in the car. However, when others drive the vehicle, they do not necessarily switch login accounts and when there is only one user in the car, it is easy to cause system misjudgment, and the account information is likely to be seen by others, resulting in the driver's privacy leakage. The current privacy protection method has poor flexibility in these special car use scenarios, and there is still a risk of privacy leakage. Summary of the invention

[0004] In view of this, the present invention provides a privacy protection method, device, vehicle, medium and program for an in-vehicle information system to solve the problem that the relevant technology has poor flexibility in special vehicle usage scenarios and still has the risk of privacy leakage.

[0005] In a first aspect, the present invention provides a privacy protection method for an in-vehicle information system, the method comprising:

[0006] Receive voice commands from users in the car;

[0007] When it is determined that the user who issued the voice command is in the main driver's seat, the user's facial information is obtained;

[0008] Based on voice commands and facial information, determine whether the user is the vehicle owner;

[0009] If the user is not the vehicle owner, the privacy level of the voice command is determined, and based on the privacy level, the vehicle information system is controlled to shield the vehicle owner's private information from the user.

[0010] Beneficial effects: When it is detected that the user who issues the voice command is in the main driver's seat, identity authentication is performed based on the user's voice command and facial information to prevent the system from erroneously responding to voice commands from non-drivers in the car. If the identity authentication fails, the corresponding control method is selected based on the privacy level of the user's voice command to shield the current vehicle driver from privacy, thereby protecting the privacy information of the vehicle owner and ensuring the normal use of the basic functions of the vehicle information system with greater flexibility.

[0011] In an optional implementation, controlling the vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level includes:

[0012] When it is detected that the privacy level is less than the preset privacy level, respond to the voice command and control the vehicle information system to display system information corresponding to the current privacy level to the user;

[0013] When it is detected that the privacy level is not less than the preset privacy level, the voice command is refused to be responded.

[0014] Beneficial effect: By comparing the privacy level of the voice command with the preset privacy level, if the privacy level of the command is lower, a response is made and the system information after filtering out the privacy information is displayed to ensure the driver's basic vehicle needs and personal safety; if the privacy level of the command is higher, the command is refused to be executed, thereby protecting the privacy of the vehicle owner.

[0015] In an optional implementation, the voice command includes at least one of a media command, a navigation command, and a communication command; responding to the voice command and controlling the vehicle information system to display system information corresponding to the current privacy level to the user includes:

[0016] Responding to the media instruction, and controlling the vehicle information system to display first system information corresponding to the current privacy level to the user, wherein the first system information is system information that filters out the media privacy information of the vehicle owner, and the media privacy information includes at least one of media collection records, media playback records, and media usage information;

[0017] and / or, responding to a navigation instruction and controlling the vehicle information system to display second system information corresponding to the current privacy level to the user, wherein the second system information is system information that filters out navigation privacy information of the vehicle owner, and the navigation privacy information includes at least one of historical navigation records, navigation mark locations, and historical navigation routes;

[0018] And / or, respond to communication instructions and control the in-vehicle information system to display third system information corresponding to the current privacy level to the user, wherein the third system information is system information that filters out the vehicle owner's communication privacy information, and the communication privacy information includes at least one of an address book list, historical call records, and contact information.

[0019] Beneficial effect: When the privacy level corresponding to the voice commands such as media commands, navigation commands and communication commands issued by the user is lower than the preset privacy level, the basic vehicle use needs of the driver are guaranteed by responding to the commands and displaying the system information after filtering out the privacy information.

[0020] In an optional implementation, controlling the vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level includes:

[0021] When it is detected that the privacy level is lower than the preset privacy level, the current login account of the vehicle information system is switched to a first preset account corresponding to the current privacy level; first preset accounts with different privacy levels correspond to different numbers of permissions to be enabled;

[0022] When it is detected that the privacy level is not less than the preset privacy level, the current login account of the vehicle information system is switched to a second preset account, and the number of permissions enabled for the second preset account is less than the number of permissions enabled for the first preset account.

[0023] Beneficial effect: By comparing the privacy level of the voice command with the preset privacy level, if the privacy level of the command is lower, the system account will be switched to a preset account with a larger number of permissions enabled, to ensure the normal use of basic functions and improve the user's driving experience; if the privacy level of the command is higher, the system account will be switched to a preset account with a smaller number of permissions enabled, to protect the privacy of the vehicle owner.

[0024] In an optional implementation, determining the privacy level of the voice command includes:

[0025] Perform semantic recognition on voice commands to determine the target operation of the vehicle information system;

[0026] Based on the permission level corresponding to the target operation, the privacy level of the voice command is obtained.

[0027] Beneficial effect: By performing semantic analysis on voice commands, a series of operations that the system needs to perform are determined, and the privacy level of the voice commands is obtained according to the maximum permission level corresponding to these operations, which facilitates the subsequent selection of a privacy protection strategy corresponding to the privacy level.

[0028] In an optional embodiment, the method further includes:

[0029] If the user is the vehicle owner, the in-vehicle information system is controlled to respond to the voice command, and the in-vehicle information system is controlled to display system information corresponding to the voice command to the user.

[0030] Beneficial effect: When the user identity verification is passed, the system responds to the user's voice commands and displays the corresponding central control information to the user, thus meeting the user's diverse driving needs.

[0031] In an optional embodiment, the method further includes:

[0032] If the user is the vehicle owner, based on the user's privacy information, the vehicle information system is controlled to recommend personalized information to the user.

[0033] Beneficial effect: When the user identity is authenticated, personalized information is recommended based on the user's privacy information to improve the user experience.

[0034] In an optional implementation, after receiving the voice command of the user in the vehicle, the method further includes:

[0035] Based on voice commands, the sound source is located to determine the transmission distance between the user and the sound receiving device;

[0036] When it is detected that the transmission distance is less than the preset transmission distance, it is determined that the user who issues the voice command is located in the main driver's seat.

[0037] Beneficial effect: By locating the sound source of the voice command, it is determined whether the user who issued the voice command is in the main driver's seat, preventing the system from erroneously responding to the command requirements of non-drivers and affecting the driving experience of the main driver.

[0038] In an optional implementation, judging whether the user is the vehicle owner based on the voice command and the face information includes:

[0039] Perform voiceprint recognition based on voice commands to obtain the user's voiceprint information;

[0040] Determine whether the voiceprint information and the face information exist in the identity information database of the vehicle owner;

[0041] If the voiceprint information or face information does not exist in the identity information database, it is determined that the user is not the vehicle owner.

[0042] Beneficial effect: By combining voiceprint recognition and face recognition to comprehensively verify the driver's identity, the accuracy of identity verification is improved.

[0043] In a second aspect, the present invention provides a privacy protection device for an in-vehicle information system, the device comprising:

[0044] An acquisition module is used to receive voice commands from users in the car;

[0045] A processing module, configured to obtain the user's facial information after determining that the user who issued the voice command is in the main vehicle;

[0046] A detection module, used to determine whether the user is the vehicle owner based on voice commands and facial information;

[0047] The control module is used to determine the privacy level of the voice command if the user is not the vehicle owner, and control the vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level.

[0048] In a third aspect, the present invention provides a vehicle, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the privacy protection method for the vehicle information system of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0049] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the vehicle information system privacy protection method of the first aspect or any corresponding embodiment thereof.

[0050] In a fifth aspect, the present invention provides a computer program product, including computer instructions, which are used to enable a computer to execute the privacy protection method for an in-vehicle information system of the first aspect or any corresponding embodiment thereof.

[0051] The beneficial effects of the present invention are:

[0052] When it is detected that the user issuing the voice command is in the main driver's seat, identity authentication is performed based on the user's voice command and facial information to prevent the system from mistakenly responding to voice commands from non-drivers in the car. If the identity authentication fails, the corresponding control method is selected according to the privacy level of the user's voice command to shield the privacy of the current vehicle driver, thereby protecting the privacy information of the vehicle owner and ensuring the normal use of the basic functions of the vehicle information system, with greater flexibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0054] Figure 1is a flowchart of a privacy protection method for an in-vehicle information system according to an embodiment of the present invention;

[0055] Figure 2 is a flowchart of another method for protecting privacy of an in-vehicle information system according to an embodiment of the present invention;

[0056] Figure 3 is a flowchart of another method for protecting privacy of an in-vehicle information system according to an embodiment of the present invention;

[0057] Figure 4 is a specific flow chart of a privacy protection method according to an embodiment of the present invention;

[0058] Figure 5 is a specific flow chart of another privacy protection method according to an embodiment of the present invention;

[0059] Figure 6 is a structural block diagram of a privacy protection device for an in-vehicle information system according to an embodiment of the present invention;

[0060] Figure 7 Schematic diagram of the hardware structure of a vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION

[0061] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0062] With the continuous advancement of technology, in-vehicle information systems have become standard in modern cars. In-vehicle information systems can provide drivers with convenient functions such as music playback, navigation, phone calls, WeChat, etc., which greatly improves the driver's travel experience. However, these systems may display the driver's private information, such as address books, chat records, etc. during operation. When there are other passengers in the car, this information is likely to be seen by others, resulting in the leakage of the driver's privacy. At present, the data protection function of most in-vehicle information systems is still relatively weak, and there is no effective means to protect the driver's privacy. Therefore, the development of an intelligent cockpit data security solution based on in-vehicle voice recognition and driver monitoring system is of great significance to protecting the driver's privacy.

[0063] Therefore, an embodiment of the present invention provides a privacy protection scheme for an in-vehicle information system. When it is detected that a user is in the driver's seat, identity authentication is performed based on the user's voice command and facial information. If the identity authentication fails, the corresponding control method is selected according to the privacy level of the voice command issued by the user to perform privacy shielding on the current vehicle driver, thereby protecting the privacy information of the vehicle owner and ensuring the normal use of the basic functions of the in-vehicle information system, with greater flexibility.

[0064] According to an embodiment of the present invention, an embodiment of a privacy protection method for an in-vehicle information system is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0065] In this embodiment, a privacy protection method for an in-vehicle information system is provided, which can be used in devices that require privacy protection, such as vehicles, vehicle controllers, etc. Figure 1 is a flow chart of a privacy protection method for an in-vehicle information system according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0066] Step S101, receiving a voice command from a user in the vehicle.

[0067] Specifically, the driver and passengers can use the voice interaction function of the smart cockpit in the cockpit, and receive audio information such as voice commands from the driver and passengers through the microphone in the car. When the cockpit receives the voice command, the system first performs pre-processing, including noise elimination and voice enhancement, to improve the accuracy of subsequent voice recognition.

[0068] Exemplarily, the voice recognition module of the vehicle information system receives the driver's voice command "play music" and sends the "play music" command to a subsequent data processing module for preprocessing.

[0069] Step S102, when it is determined that the user who issues the voice command is in the main driver's seat, the user's facial information is obtained.

[0070] Specifically, since passengers in the front passenger seat or back seat in the cockpit will also send out audio information, in order to prevent the system from incorrectly responding to the voice commands of these persons, the location from which the voice commands are sent must be identified. Sound source localization information can be output based on the audio information analysis to facilitate identification of whether the driver and passenger interacting with the in-vehicle information system is in the main driver's seat.

[0071] Specifically, the in-vehicle information system may include a driver monitoring system, which can obtain video image information of the driver and passengers through the DMS / IMS camera of the driver monitoring system in the cockpit, and analyze the video image information to output the facial information of the driver and passengers.

[0072] Step S103, based on the voice command and the facial information, determine whether the user is the vehicle owner.

[0073] Specifically, it is possible to determine whether the user is the vehicle owner based on facial information and voiceprint information in voice commands.

[0074] It should be noted that the vehicle owner in the embodiment of the present invention can be the registered vehicle owner (i.e. the owner himself) and related users who are allowed to use all functions of the vehicle (such as the owner's relatives), as long as the relevant personnel information is registered in the identity information database.

[0075] In the embodiment of the present invention, it is ensured that after successful identity authentication, the user can smoothly operate the various modules of the central control system through voice commands; when identity authentication fails, the system can give clear prompts and restrict access to sensitive functions to ensure the safety of the vehicle and the user.

[0076] Step S104: if the user is not the vehicle owner, determine the privacy level of the voice command, and control the vehicle information system to shield the vehicle owner's private information from the user based on the privacy level.

[0077] It should be understood that even if the vehicle is not used by the owner, some basic instructions need to be issued, such as basic safety instructions, emergency call instructions, etc. If it is detected that the current driver is not the owner, these basic instructions will be restricted in function or information will be blocked, which is likely to affect the driver's personal safety and driving experience.

[0078] In an embodiment of the present invention, by determining the privacy level of the voice command and selecting the corresponding control method according to the privacy level to shield the user's privacy, it can not only achieve the effect of privacy protection, but also ensure the driver's basic car use needs, thereby improving the flexibility of privacy protection and the user's driving experience.

[0079] The in-vehicle information system privacy protection method provided in this embodiment, when it is detected that the user who issues the voice command is in the main driver's seat, then authenticates the identity based on the user's voice command and facial information to prevent the system from erroneously responding to the voice command of a non-driver in the vehicle. If the identity authentication fails, the corresponding control method is selected according to the privacy level of the voice command issued by the user to perform privacy shielding on the current vehicle driver, thereby protecting the privacy information of the vehicle owner and ensuring the normal use of the basic functions of the in-vehicle information system, with greater flexibility.

[0080] In this embodiment, a privacy protection method for an in-vehicle information system is provided, which can be used in devices that require privacy protection, such as vehicles, vehicle controllers, etc. Figure 2 is a flow chart of a privacy protection method for an in-vehicle information system according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0081] Step S201, receiving a voice command from a user in the vehicle.

[0082] Specifically, the sound source is located based on the voice command, and the transmission distance between the user and the sound receiving device is determined. When it is detected that the transmission distance is less than the preset transmission distance, it is determined that the user who issued the voice command is located in the main driver's seat. Exemplarily, multiple microphone arrays are deployed in the vehicle, each array includes multiple microphones, to achieve sound source positioning in different directions and areas. By measuring the time difference or phase difference of the sound signals received by different microphones, the direction and distance of the sound source can be calculated.

[0083] In an embodiment of the present invention, by locating the sound source of the voice command, it is determined whether the user who issues the voice command is in the main driver's seat, thereby preventing the system from erroneously responding to the command requirements of a non-driver and affecting the driving experience of the main driver.

[0084] Step S202: When it is determined that the user who issued the voice command is in the main driver's seat, the user's face information is obtained. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0085] Step S203, based on the voice command and the facial information, determine whether the user is the vehicle owner.

[0086] Specifically, voiceprint recognition is performed based on voice commands to obtain the user's voiceprint information. Then, it is determined whether the voiceprint information and face information exist in the identity information database of the vehicle owner. If the voiceprint information or face information does not exist in the identity information database, it is determined that the user is not the vehicle owner.

[0087] For example, after the sound source positioning is used to identify the user who issued the command, the voiceprint information in the pre-processed voice command is extracted and compared with the driver voiceprint database pre-stored in the system. If the sound source positioning and voiceprint comparison preliminarily determine that the driver is the vehicle owner, the system further captures the driver's facial image through the vehicle camera, uses facial recognition technology to extract facial information, and compares it with the driver's facial database to assist in verifying the authenticity of the identity. The results of sound source positioning, voiceprint comparison and facial recognition are comprehensively analyzed. If all verifications are passed, it is determined that the verification is successful, that is, the user is the vehicle owner; if any verification fails, it is determined that the verification fails.

[0088] In an embodiment of the present application, the driver's identity is comprehensively verified by combining voiceprint recognition and face recognition to improve the accuracy of identity verification.

[0089] Step S204: If the user is not the vehicle owner, determine the privacy level of the voice command, and control the vehicle information system to shield the vehicle owner's private information from the user based on the privacy level.

[0090] Specifically, the above step S204 includes:

[0091] Step S2041, if the user is not the vehicle owner, determine the privacy level of the voice command.

[0092] Specifically, the voice command is semantically recognized to determine the target operation of the vehicle information system, and the privacy level of the voice command is obtained based on the permission level corresponding to the target operation. Exemplarily, the text (keywords) and semantic information related to the output command are analyzed semantically to determine the target operation that the system needs to perform, and the permission level is determined according to the permission setting information of the target operation.

[0093] For example, for "playing favorite music", the extracted keywords can be "playing music", "favorite music", etc. The system needs to query the favorite music and play it, and the highest authority level in a series of operations that the system needs to perform is used as the privacy level of the voice command. It should be noted that the authority level and privacy level can be set according to actual conditions. Some basic commands, such as emergency call commands, have a lower privacy level, while commands involving user privacy have a higher privacy level.

[0094] In an embodiment of the present invention, a series of operations that the system needs to perform are determined by performing semantic analysis on voice commands, and the privacy level of the voice commands is obtained based on the maximum authority level corresponding to these operations, which facilitates the subsequent selection of a privacy protection strategy corresponding to the privacy level.

[0095] Step S2042, when it is detected that the privacy level is lower than the preset privacy level, respond to the voice command and control the vehicle information system to display system information corresponding to the current privacy level to the user.

[0096] Specifically, the voice command includes at least one of a media command, a navigation command, and a communication command.

[0097] In some optional embodiments, it is possible to respond to media instructions and control the in-vehicle information system to display first system information corresponding to the current privacy level to the user, wherein the first system information is system information that filters out the vehicle owner's media privacy information, and the media privacy information includes at least one of media collection records, media playback records, and media usage information.

[0098] For example, if the privacy level of the media command is lower, for example, in response to the voice command "play song", the default top songs will be played; in response to the voice command "switch song", if the vehicle owner's collection or playlist is currently playing, the default top songs will be switched to play; if the song is not currently playing, the default top songs will be played directly, and the default song information can be displayed at the same time.

[0099] In some optional embodiments, in response to navigation instructions, the vehicle-mounted information system is controlled to display second system information corresponding to the current privacy level to the user, wherein the second system information is system information that filters out the navigation privacy information of the vehicle owner, and the navigation privacy information includes at least one of historical navigation records, navigation mark locations, and historical navigation routes.

[0100] For example, if the privacy level of the navigation instruction is relatively low, such as for "navigation to the hospital", the detailed navigation route can be displayed and navigation can be started.

[0101] In some optional embodiments, in response to communication instructions, the vehicle information system is controlled to display third system information corresponding to the current privacy level to the user, wherein the third system information is system information that filters out the vehicle owner's communication privacy information, and the communication privacy information includes at least one of an address book list, historical call records, and contact information.

[0102] For example, if the privacy level of the communication instruction is relatively low, such as for "call emergency help", the system can be controlled to make an emergency call and display a corresponding call page.

[0103] It should be noted that the amount of private information filtered out by different privacy levels may be different. The higher the privacy level, the greater the amount of private information that needs to be filtered out. The specific amount can be set according to actual application conditions.

[0104] In an embodiment of the present invention, when the privacy level corresponding to the voice commands such as media commands, navigation commands and communication commands issued by the user is lower than the preset privacy level, the basic vehicle use needs of the driver are guaranteed by responding to the commands and displaying the system information after filtering out the privacy information.

[0105] Step S2043, when it is detected that the privacy level is not less than the preset privacy level, refuse to respond to the voice command.

[0106] For example, if the privacy level of the media instruction is relatively high, such as the voice command "play favorite songs" or "play self-built playlist", the instruction will be refused to be executed, and the reply will be "this operation is not supported in the current state".

[0107] For example, if the privacy level of the navigation command is high, the navigation interface will not display the user's historical navigation information. In response to the user's voice commands "navigate home" or "navigate to the company", the interface will reply "the operation is not supported in the current state". In response to voice commands such as "navigate to XX" that involve multiple rounds of dialogue, the interface will not display or recommend the user's historical high-frequency navigation information, and will directly enter the secondary user's location interaction logic.

[0108] For example, if the privacy level of the communication command is higher, such as the voice command "turn on / off Bluetooth phone", the reply is "the operation is not supported in the current state"; the voice command "call **(contact)", the reply is "the operation is not supported in the current state"; the voice command "view recent contact call records", etc., the reply is "the operation is not supported in the current state"; the voice command "answer / hang up", the reply is "the operation is not supported in the current state".

[0109] In an embodiment of the present invention, the privacy level of the voice command is compared with the preset privacy level. If the privacy level of the command is lower, a response is made and system information after filtering out the privacy information is displayed to ensure the driver's basic vehicle needs and personal safety; if the privacy level of the command is higher, the command is refused to be executed, thereby protecting the privacy of the vehicle owner.

[0110] The in-vehicle information system privacy protection method provided in this embodiment performs identity authentication based on the user's voice command and facial information when it is detected that the user who issues the voice command is in the main driver's seat, so as to prevent the system from erroneously responding to the voice command of a non-driver in the vehicle. If the identity authentication fails, the privacy level of the voice command issued by the user is compared with the preset privacy level based on the privacy level of the voice command issued by the user. If the privacy level of the command is relatively low, a response is made and system information after filtering out the privacy information is displayed, so as to ensure the basic vehicle use needs and personal safety of the driver, and the flexibility is enhanced. If the privacy level of the command is relatively high, the execution is refused, thereby protecting the privacy of the vehicle owner.

[0111] In this embodiment, a privacy protection method for an in-vehicle information system is provided, which can be used in devices that require privacy protection, such as vehicles, vehicle controllers, etc. Figure 3 is a flow chart of a privacy protection method for an in-vehicle information system according to an embodiment of the present invention. Figure 3 As shown, the process includes the following steps:

[0112] Step S301, receiving a voice command from a user in the vehicle. Figure 2 Step S201 of the illustrated embodiment will not be described in detail here.

[0113] Step S302: When it is determined that the user who issued the voice command is in the main driver's seat, the user's face information is obtained. Figure 2 Step S202 of the illustrated embodiment will not be described in detail here.

[0114] Step S303: Based on the voice command and face information, determine whether the user is the vehicle owner. Figure 2 Step S203 of the illustrated embodiment will not be described in detail here.

[0115] Step S304: If the user is not the vehicle owner, determine the privacy level of the voice command, and control the vehicle information system to shield the vehicle owner's private information from the user based on the privacy level.

[0116] Specifically, the above step S304 includes:

[0117] Step S3041: If the user is not the vehicle owner, determine the privacy level of the voice command. Figure 2 Step S2041 of the illustrated embodiment will not be described in detail here.

[0118] Step S3042: When it is detected that the privacy level is lower than the preset privacy level, the current login account of the vehicle information system is switched to a first preset account corresponding to the current privacy level.

[0119] Among them, the first preset accounts with different privacy levels correspond to different numbers of permissions enabled.

[0120] Exemplarily, when it is detected that the privacy level is lower than the preset privacy level, the Android multi-user system interface is called to switch to the first preset account of the corresponding level of the system. The higher the privacy level, the smaller the number of permissions enabled by the first preset account.

[0121] Step S3043, when it is detected that the privacy level is not less than the preset privacy level, the current login account of the vehicle information system is switched to a second preset account.

[0122] Among them, the number of permissions enabled for the second preset account is less than the number of permissions enabled for the first preset account.

[0123] Exemplarily, when it is detected that the privacy level is not less than the preset privacy level, the multi-user system interface of Android is called to switch to the default user account of the default initialization system, and all applications and usage records are initialized state data.

[0124] In an embodiment of the present invention, by comparing the privacy level of the voice command with the preset privacy level, if the privacy level of the command is lower, the system account is switched to a preset account with a larger number of permissions enabled, thereby ensuring the normal use of basic functions and improving the user's driving experience; if the privacy level of the command is higher, the system account is switched to a preset account with a smaller number of permissions enabled, thereby protecting the privacy of the vehicle owner.

[0125] Step S305: If the user is the vehicle owner, the vehicle information system is controlled to respond to the voice command, and the vehicle information system is controlled to display system information corresponding to the voice command to the user.

[0126] For example, if the user is a vehicle owner, the collection, favorites, and playlist songs created by the media login account can be displayed and played.

[0127] For example, if the user is the vehicle owner, the system will normally display detailed navigation routes, estimated arrival time, current location and other information on the central control screen for all navigation instructions.

[0128] For example, if the user is the vehicle owner, all communication commands, all UI / UE interfaces for executing interactive voice commands on the central control display in the cockpit can display information such as the name, phone number and call log of the phone contact, and the central control screen displays the call status in real time.

[0129] For example, if the user is the vehicle owner, the Android multi-user system interface is called to switch to the user account system registered by the system vehicle owner, and all permission setting information, application data and usage records are usage information corresponding to the user.

[0130] In the embodiment of the present invention, when the user identity authentication is passed, the user voice command is responded to and the corresponding central control information is displayed to the user to meet the user's diverse driving needs.

[0131] Step S306: If the user is the vehicle owner, based on the user's privacy information, the vehicle information system is controlled to recommend personalized information to the user.

[0132] For example, in the case of random media playback, songs can be recommended to the user based on the user's past playback preferences to enhance the user experience.

[0133] The privacy protection method for the in-vehicle information system provided in this embodiment, when it is detected that the user who issued the voice command is in the main driving seat, then the identity verification is performed based on the user's voice command and facial information to prevent the system from erroneously responding to the voice command of non-drivers in the car. If the identity verification fails, the privacy level of the voice command issued by the user is compared with the preset privacy level. If the privacy level of the command is low, the system account is switched to a preset account with a large number of permissions to ensure the normal use of basic functions, improve the user's driving experience and system flexibility; if the privacy level of the command is high, the system account is switched to a preset account with a small number of permissions to protect the privacy of the vehicle owner. If the identity verification passes, the user's voice command is responded to, and the corresponding central control information is displayed to the user to meet the user's diverse driving needs, or personalized information recommendations can be made based on the user's privacy information to improve the user's use experience.

[0134] The privacy protection of the in-vehicle information system of the present invention is described in detail below with reference to a specific application example. The differentiated data during voice interaction is comprehensively determined based on the voiceprint information of the in-vehicle voice recognition, the sound source localization information, and the face recognition information of the driver monitoring system, to ensure the privacy data security of the smart cockpit of the driver and passengers who own the vehicle.

[0135] The main functional modules of this application example include the following parts: a speech recognition module, which is responsible for receiving and processing the driver's voice commands and controlling the operation of the cockpit software; a speech voiceprint module, which is responsible for voice audio voiceprint processing and distinguishing the identity of the person speaking in the car; a speech sound source localization module, which is responsible for analyzing the voice audio sound source signal and distinguishing the location information of the speaker; a driver monitoring system, including cameras and facial recognition algorithms, is used to identify people in the car; a data processing module, which receives and processes data from the speech recognition module and the driver monitoring system and controls the display of information according to preset rules.

[0136] like Figure 4 As shown, when the people in the cockpit use the commands in the voice interactive smart cockpit to execute operations, the voice assistant module outputs the voiceprint information and sound source positioning information of the person initiating the command, and combines the facial information recognized by the DMS camera to unify the data display of the decision interaction. If the person is the vehicle owner, the user's personal historical usage record data is displayed. If the person is not the current vehicle owner, the system default data is presented to protect the user's personal vehicle privacy information.

[0137] like Figure 5As shown, this application example, through the collaborative work of the above modules (the main functional algorithms rely on: ASR recognition algorithm, voiceprint recognition algorithm, sound source positioning recognition algorithm, face recognition and lip movement recognition algorithm), confirms the main driver's operation interaction information through voice sound source positioning information, and confirms the driver's identity information through voice voiceprint information and driver monitoring system face recognition information, thereby realizing the intelligent display and protection of the driver's private information to ensure that when the current vehicle owner uses the vehicle cockpit voice interaction, the user's login information and usage records and other historical personal information are displayed. When non-current vehicle owners use the voice cockpit function, the system default data is displayed to ensure the vehicle owner's vehicle privacy data.

[0138] The present invention realizes intelligent display of information by recognizing the voice and facial features of specific persons, thereby protecting the driver's private information. Compared with traditional in-vehicle information systems, the present invention better protects the driver's privacy (such as the broadcast records and preferences of media application users, the address records and favorites of navigation applications, the contact information and phone control of phone applications, and other private information) while ensuring the use of functions, avoiding the possibility of information being seen by other passengers, and improving the security of the in-vehicle information system. At the same time, the present invention realizes accurate identification of the driver through the combination of voice recognition and driver monitoring system, improves the accuracy of information processing, and makes the driver more convenient and comfortable when using the in-vehicle information system.

[0139] In this embodiment, a privacy protection device for an in-vehicle information system is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and will not be repeated hereafter. As used below, the term "module" may be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation in hardware, or a combination of software and hardware, is also possible and conceivable.

[0140] This embodiment provides a privacy protection device for an in-vehicle information system. Figure 6 As shown, including:

[0141] The acquisition module 601 is used to receive the voice command of the user in the car;

[0142] The processing module 602 is used to obtain the user's facial information when it is determined that the user who issued the voice command is in the main vehicle;

[0143] A detection module 603, for determining whether the user is the vehicle owner based on the voice command and the face information;

[0144] The control module 604 is used to determine the privacy level of the voice command if the user is not the vehicle owner, and control the vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level.

[0145] In some optional implementations, after receiving the voice command of the user in the vehicle, the device is further used to:

[0146] Based on voice commands, the sound source is located to determine the transmission distance between the user and the sound receiving device;

[0147] When it is detected that the transmission distance is less than the preset transmission distance, it is determined that the user who issues the voice command is located in the main driver's seat.

[0148] In some optional embodiments, the device is also used for:

[0149] Perform voiceprint recognition based on voice commands to obtain the user's voiceprint information;

[0150] Determine whether the voiceprint information and the face information exist in the identity information database of the vehicle owner;

[0151] If the voiceprint information or face information does not exist in the identity information database, it is determined that the user is not the vehicle owner.

[0152] In some optional implementations, the control module 604 is further configured to:

[0153] Perform semantic recognition on voice commands to determine the target operation of the vehicle information system;

[0154] Based on the permission level corresponding to the target operation, the privacy level of the voice command is obtained.

[0155] In some optional implementations, the control module 604 is further configured to:

[0156] When it is detected that the privacy level is less than the preset privacy level, respond to the voice command and control the vehicle information system to display system information corresponding to the current privacy level to the user;

[0157] When it is detected that the privacy level is not less than the preset privacy level, the voice command is refused to be responded.

[0158] In some optional implementations, the voice command includes at least one of a media command, a navigation command, and a communication command; the control module 604 is further configured to:

[0159] Responding to the media instruction, and controlling the vehicle information system to display first system information corresponding to the current privacy level to the user, wherein the first system information is system information that filters out the media privacy information of the vehicle owner, and the media privacy information includes at least one of media collection records, media playback records, and media usage information;

[0160] and / or, responding to a navigation instruction and controlling the vehicle information system to display second system information corresponding to the current privacy level to the user, wherein the second system information is system information that filters out navigation privacy information of the vehicle owner, and the navigation privacy information includes at least one of historical navigation records, navigation mark locations, and historical navigation routes;

[0161] And / or, respond to communication instructions and control the in-vehicle information system to display third system information corresponding to the current privacy level to the user, wherein the third system information is system information that filters out the vehicle owner's communication privacy information, and the communication privacy information includes at least one of an address book list, historical call records, and contact information.

[0162] In some optional implementations, the control module 604 is further configured to:

[0163] When it is detected that the privacy level is lower than the preset privacy level, the current login account of the vehicle information system is switched to a first preset account corresponding to the current privacy level; first preset accounts with different privacy levels correspond to different numbers of permissions to be enabled;

[0164] When it is detected that the privacy level is not less than the preset privacy level, the current login account of the vehicle information system is switched to a second preset account, and the number of permissions enabled for the second preset account is less than the number of permissions enabled for the first preset account.

[0165] In some optional embodiments, the device is also used for:

[0166] If the user is the vehicle owner, the in-vehicle information system is controlled to respond to the voice command, and the in-vehicle information system is controlled to display system information corresponding to the voice command to the user.

[0167] In some optional embodiments, the device is also used for:

[0168] If the user is the vehicle owner, based on the user's privacy information, the vehicle information system is controlled to recommend personalized information to the user.

[0169] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0170] The privacy protection device of the vehicle information system in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0171] The embodiment of the present invention further provides a vehicle having the above Figure 6 The privacy protection device of the vehicle information system is shown.

[0172] See also Figure 7 , Figure 7 is a schematic diagram of the structure of a vehicle provided by an optional embodiment of the present invention, such as Figure 7 As shown, the vehicle includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses for communication, and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed in the vehicle, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 7 A processor 10 is taken as an example.

[0173] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0174] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0175] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store data created according to the use of the vehicle, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the vehicle via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0176] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0177] The vehicle further includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Figure 7 The example of connecting through bus is taken in the following.

[0178] The input device 30 can receive input digital or character information and generate key signal input related to the user settings and function control of the vehicle, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device may be a touch screen.

[0179] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0180] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0181] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A privacy protection method for an in-vehicle information system, characterized in that: The method comprises: Receive voice commands from users in the car; When it is determined that the user who issued the voice command is in the main driver's seat, obtaining the user's facial information; Based on the voice command and the facial information, determining whether the user is a vehicle owner; If the user is not the vehicle owner, a privacy level of the voice command is determined, and based on the privacy level, the vehicle information system is controlled to shield the vehicle owner's private information from the user.

2. The method according to claim 1, characterized in that The controlling the in-vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level includes: When it is detected that the privacy level is less than the preset privacy level, responding to the voice command, and controlling the vehicle information system to display system information corresponding to the current privacy level to the user; When it is detected that the privacy level is not less than the preset privacy level, the voice command is refused to be responded.

3. The method according to claim 2, characterized in that The voice command includes at least one of a media command, a navigation command, and a communication command; the responding to the voice command and controlling the vehicle information system to display system information corresponding to the current privacy level to the user includes: responding to the media instruction and controlling the in-vehicle information system to display first system information corresponding to the current privacy level to the user, wherein the first system information is system information that filters out the media privacy information of the vehicle owner, and the media privacy information includes at least one of media collection records, media playback records, and media usage information; and / or, responding to the navigation instruction and controlling the vehicle information system to display second system information corresponding to the current privacy level to the user, wherein the second system information is system information from which navigation privacy information of the vehicle owner is filtered out, and the navigation privacy information includes at least one of historical navigation records, navigation mark locations, and historical navigation routes; And / or, respond to the communication instruction and control the in-vehicle information system to display third system information corresponding to the current privacy level to the user, wherein the third system information is system information that filters out the vehicle owner's communication privacy information, and the communication privacy information includes at least one of an address book list, historical call records, and contact information.

4. The method according to claim 1, characterized in that: The controlling the in-vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level includes: When it is detected that the privacy level is lower than the preset privacy level, the current login account of the vehicle information system is switched to a first preset account corresponding to the current privacy level; first preset accounts with different privacy levels correspond to different numbers of permissions to be enabled; When it is detected that the privacy level is not less than the preset privacy level, the current login account of the vehicle information system is switched to a second preset account, and the number of permissions enabled for the second preset account is less than the number of permissions enabled for the first preset account.

5. The method according to claim 2 or 4, characterized in that: Determining the privacy level of the voice command includes: Performing semantic recognition on the voice command to determine a target operation of the vehicle information system; Based on the permission level corresponding to the target operation, a privacy level of the voice command is obtained.

6. The method according to claim 2 or 4, characterized in that: The method further comprises: If the user is the vehicle owner, the vehicle information system is controlled to respond to the voice command, and the vehicle information system is controlled to display system information corresponding to the voice command to the user.

7. The method according to claim 6, characterized in that The method further comprises: If the user is the vehicle owner, based on the user's privacy information, the vehicle information system is controlled to recommend personalized information to the user.

8. The method according to claim 2 or 4, characterized in that: After receiving the voice command from the user in the vehicle, the method further includes: Based on voice commands, the sound source is located to determine the transmission distance between the user and the sound receiving device; When it is detected that the transmission distance is less than the preset transmission distance, it is determined that the user who issues the voice command is located in the main driver's seat.

9. The method according to claim 8, characterized in that The determining whether the user is a vehicle owner based on the voice command and the facial information includes: Perform voiceprint recognition based on the voice command to obtain the user's voiceprint information; Determine whether the voiceprint information and face information exist in the identity information database of the vehicle owner; If the voiceprint information or face information does not exist in the identity information database, it is determined that the user is not the vehicle owner.

10. A privacy protection device for an in-vehicle information system, characterized in that: The device comprises: An acquisition module, used to receive voice commands from users in the car; A processing module, configured to obtain facial information of the user after determining that the user who issued the voice command is located in the main vehicle; A detection module, used for determining whether the user is a vehicle owner based on the voice command and the face information; The control module is used to determine the privacy level of the voice command if the user is not the vehicle owner, and control the vehicle information system to shield the private information of the vehicle owner from the user based on the privacy level.

11. A vehicle, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the privacy protection method for the in-vehicle information system according to any one of claims 1 to 9 by executing the computer instructions.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the privacy protection method for the in-vehicle information system according to any one of claims 1 to 9.

13. A computer program product, characterized in that It includes computer instructions, and the computer instructions are used to enable a computer to execute the privacy protection method of the in-vehicle information system according to any one of claims 1 to 9.

Citation Information

Cited By

  • Information display method and apparatus

    WO2026123382A1