Vehicle privacy protection method and device and storage medium

Abstract

The invention provides a vehicle privacy protection method and device and a storage medium, and the method comprises the steps: obtaining a driver face image, carrying out the driver face recognition of the driver face image, and obtaining the riding state of each passenger seat if a driver face recognition result is a target driver; if the sitting state of the passenger seat is a manned state, acquiring a passenger face image; the passenger face image is compared with a preset passenger relation face database to obtain a passenger relation, the authority level of the vehicle is determined according to the passenger relation, and the authority level is used for determining the access authority of function application and data display of the vehicle so as to prevent leakage of privacy information of the vehicle; through the method, the technical problem that the vehicle privacy mode cannot be started intelligently is solved.

Description

Technical Field

[0001] The present application relates to the field of intelligent vehicle technology, and in particular to a vehicle privacy protection method, device and storage medium. Background Art

[0002] As cars enter the era of intelligence, more and more smart applications are running on the car system, and the user information collected on the car system is increasing. The data privacy on the car system is becoming more and more important. Compared with mobile devices such as mobile phones, the car system is open and uncontrollable. That is, when the vehicle is driving, passengers in the car can observe the content of the car screen without hindrance, which increases the risk of privacy leakage of car owners.

[0003] In the related technologies, the vehicle privacy protection solutions provided by automobile manufacturers mainly rely on manually turning on or presetting the privacy mode, but such solutions have obvious limitations. First, manually turning on the privacy mode can be embarrassing in certain social situations and may even cause misunderstandings. In addition, turning on the privacy mode all the time usually limits or disables the functions of some smart applications, which greatly reduces the intelligence of the vehicle system and affects the user's driving experience. Summary of the invention

[0004] In view of the shortcomings of the related technologies mentioned above, the present application provides a vehicle privacy protection method, device and storage medium to solve the technical problem that the vehicle privacy mode cannot be turned on intelligently.

[0005] The present application provides a vehicle privacy protection method, device and storage medium, the method comprising: obtaining a driver's facial image, performing driver facial recognition on the driver's facial image, and if the driver's facial recognition result is a target driver, obtaining the seating status of each passenger seat; if the seating status of a passenger seat is occupied, obtaining the passenger's facial image; comparing the passenger's facial image with a preset passenger relationship facial library to obtain the passenger relationship, and determining the vehicle's authority level based on the passenger relationship, the authority level being used to determine the vehicle's functional application and data display access rights to prevent leakage of vehicle privacy information.

[0006] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the vehicle's authority level is determined based on the passenger relationship, including: comparing the passenger facial image with a preset passenger relationship face library to obtain the passenger relationship, the passenger relationship including relative relationship, friend relationship, ordinary relationship and stranger relationship; if the passenger relationship obtained after the comparison of the passenger facial image is a relative relationship, the authority level is determined as the first-level authority; if the passenger relationship obtained after the comparison of the passenger facial image is a friend relationship, the authority level is determined as the second-level authority; if the passenger relationship obtained after the comparison of the passenger facial image is an ordinary relationship, the authority level is determined as the third-level authority; if the passenger relationship obtained after the comparison of the passenger facial image is a stranger relationship, the authority level is determined as the fourth-level authority; if the comparison of the passenger facial image with the preset passenger relationship face library fails, the authority level is determined as the fourth-level authority.

[0007] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship facial library to obtain the passenger relationship, and the vehicle's authority level is determined based on the passenger relationship. It also includes: if there are multiple different passenger relationships matched by multiple passenger facial images, then determining the vehicle's authority level based on the passenger relationship includes determining the final authority level from the authority levels corresponding to the multiple different passenger relationships based on preset priorities, and the preset priorities are in the order of four-level authority, three-level authority, two-level authority, and one-level authority from high to low.

[0008] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the vehicle's authority level is determined based on the passenger relationship. It also includes: periodically collecting passenger audio, performing voice recognition on the passenger audio to obtain text to be analyzed; performing semantic understanding on the text to be analyzed to obtain the relationship between the new passenger and the target driver; updating the preset passenger relationship face library based on the relationship between the new passenger and the target driver, and re-determining the authority level based on the updated preset passenger relationship face library.

[0009] In one embodiment of the present application, if the permission level is a first-level permission, the access rights determined according to the permission level include: permission to access the vehicle's call records, text message records, and travel records; permission to access the vehicle's search records and personal applications; permission to allow access to the vehicle's customized driving settings; and wallpaper corresponding to the vehicle's display interface being a first-level permission.

[0010] In one embodiment of the present application, if the permission level is a secondary permission, the access rights are determined according to the permission level, including: the permission for the vehicle's call records, text message records, and travel records is prohibited; the permission for the vehicle's search records and personal applications is allowed; the permission for the vehicle's driving custom settings is allowed; and the vehicle's display interface is a wallpaper corresponding to the secondary permission.

[0011] In one embodiment of the present application, if the permission level is the third level permission, the access rights are determined according to the permission level, including: the permission of the vehicle's call records, text message records and travel records is prohibited from access; the permission of the vehicle's search records and personal applications is prohibited from access; the permission of the vehicle's driving custom settings is allowed to access; the display interface of the vehicle is the wallpaper corresponding to the third level permission.

[0012] In one embodiment of the present application, if the permission level is level four, the access rights are determined according to the permission level, including: the permission of the vehicle's call records, text message records and travel records is prohibited from access; the permission of the vehicle's search records and personal applications is prohibited from access; the permission of the vehicle's driving custom settings is prohibited from access; the display interface of the vehicle is the wallpaper corresponding to the level four permission.

[0013] An embodiment of the present application also provides a vehicle privacy protection device, which includes: an information input module, used to obtain a driver's facial image, perform driver facial recognition on the driver's facial image, and if the driver's facial recognition result is a target driver, obtain the occupancy status of each passenger seat; a state recognition module, used to obtain a passenger facial image if the occupancy status of a passenger seat is occupied; an authority management module, used to compare the passenger facial image with a preset passenger relationship face library to obtain the passenger relationship, and determine the vehicle's authority level based on the passenger relationship, the authority level is used to determine the access rights to the vehicle's functional applications and data displays to prevent the leakage of vehicle privacy information.

[0014] An embodiment of the present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of a computer, the computer is enabled to execute the vehicle privacy protection method as described in any of the above embodiments.

[0015] Beneficial effects of the present application: The embodiments of the present application provide a vehicle privacy protection method, device and storage medium. The method obtains a driver's facial image and performs driver facial recognition on the driver's facial image. If the driver's facial recognition result is the target driver, the seating status of each passenger seat is obtained; if the seating status of a passenger seat is occupied, the passenger facial image is obtained; the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the vehicle's authority level is determined according to the passenger relationship. The authority level is used to determine the vehicle's functional application and data display access rights to prevent vehicle privacy information leakage. By performing privacy grading on the vehicle's authority level, intelligent protection of vehicle privacy is achieved. The relationship between the passenger and the driver is intelligently identified through facial recognition, so that the privacy level corresponding to the adaptation relationship is applied to the entire vehicle to avoid driver privacy leakage.

[0016] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a schematic diagram of an implementation environment of a vehicle privacy protection method shown in an exemplary embodiment of the present application;

[0018] Figure 2 is a flow chart of a vehicle privacy protection method shown in an exemplary embodiment of the present application;

[0019] Figure 3 is a schematic diagram of a front camera of a car shown in an exemplary embodiment of the present application;

[0020] Figure 4 is a schematic diagram of a rear-row camera of a car shown in an exemplary embodiment of the present application;

[0021] Figure 5 is a working timing diagram of a vehicle privacy protection system shown in an exemplary embodiment of the present application;

[0022] Figure 6 is a block diagram of a vehicle privacy protection device shown in an exemplary embodiment of the present application;

[0023] Figure 7 It is a structural schematic diagram of an electronic device shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0024] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0025] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.

[0026] It should be noted that in this application, "first", "second", etc. are only used to distinguish similar objects, and are not used to limit the order or precedence of similar objects. The variations of "including", "having", etc. described above indicate that the scope covered by the subject of the word is not exclusive except for the examples shown by the word.

[0027] It is understood that the various numbers, step numbers, and other reference numerals recorded in this application are distinguished for the convenience of description and are not intended to limit the scope of this application. The size of the reference numerals in this application does not mean the order of execution. The execution order of each process should be determined by its function and internal logic.

[0028] In the following description, a large number of details are discussed to provide a more thorough explanation of the embodiments of the present application. However, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present application difficult to understand.

[0029] The embodiments of the present application respectively propose a vehicle privacy protection method, a vehicle privacy protection device, an electronic device, a computer-readable storage medium, and a computer program product, which will be described in detail below.

[0030] See also Figure 1 , Figure 1 It is a schematic diagram of an implementation environment of a vehicle privacy protection method shown as an exemplary embodiment of the present application.

[0031] like Figure 1As shown, the implementation environment may include camera A, camera B, pressure sensor A, pressure sensor B, camera C, camera D, pressure sensor C and vehicle central control. Since the number of passengers in the rear row of the vehicle is not fixed, the overall pressure sensor C may be used. The three pressure sensors and four cameras are respectively connected to the vehicle system to transmit the collected data to the privacy management service in the vehicle central control in real time.

[0032] In one embodiment of the present application, when the pressure value collected by pressure sensor A is greater than or equal to the preset pressure threshold, it is judged that the seat corresponding to pressure sensor A is occupied at this time, then the camera A corresponding to the passenger seat is turned on, and the image collected by camera A is sent to the vehicle central control as the driver's face image. When the pressure value collected by pressure sensor B or pressure sensor C is greater than or equal to the preset pressure threshold, it is judged that the seat corresponding to pressure sensor B or pressure sensor C is occupied at this time, then the camera B or camera C, D corresponding to the passenger seat is turned on, and the collected image is sent to the vehicle central control as the passenger face image. The vehicle central control will send the face image collected by camera ABCD to the big data server to compare the face image with the preset driver face library and the preset passenger relationship face library, so as to perform driver face recognition and passenger relationship determination, and determine the vehicle's authority level based on the passenger relationship.

[0033] See also Figure 2 , Figure 2 is a flowchart of a vehicle privacy protection method shown in an exemplary embodiment of the present application. The method can be applied to Figure 1 The implementation environment shown is as follows. The method may also be applicable to other exemplary implementation environments and be specifically executed by devices in other implementation environments. This embodiment does not limit the implementation environment to which the method is applicable.

[0034] like Figure 2 As shown, in an exemplary embodiment, the vehicle privacy protection method includes at least steps S210 to S230, which are described in detail as follows:

[0035] Step S210, obtaining a driver's facial image, performing driver facial recognition on the driver's facial image, and if the driver's facial recognition result is the target driver, obtaining the seating status of each passenger seat.

[0036] In one embodiment of the present application, a driver's facial image is collected by a camera in front of the front driver's seat of the vehicle, and driver facial recognition is performed on the driver facial image to identify whether the current driver is a target driver. Driver facial recognition on the driver facial image includes comparing the driver facial image with a preset driver face library. If the comparison is successful, the driver facial recognition result is the target driver.

[0037] In one embodiment of the present application, multiple driver face images can be stored in a preset driver face library, and a corresponding preset passenger relationship face library can be established for each driver. After the driver face image of the current driver is collected, it is compared with the faces stored in the preset driver face library. If the comparison with one of the faces is successful, the driver face recognition result of the current driver is the target driver, and the preset passenger relationship face library corresponding to the driver who successfully compared in the preset driver face library is used as the face library for determining the passenger relationship this time.

[0038] In one embodiment of the present application, if the driver facial image of the current driver fails to match the preset driver facial library, the vehicle's authority level is determined to be level four authority.

[0039] Step S220: If the passenger seat is occupied, obtain the passenger's facial image.

[0040] In one embodiment of the present application, the seating state corresponding to each passenger seat is determined based on the pressure sensors on each passenger seat. If the pressure value output by the pressure sensor of the passenger seat is greater than or equal to a preset pressure threshold, the seating state corresponding to the passenger seat is an unoccupied state. If the pressure value output by the pressure sensor of the passenger seat is less than the preset pressure threshold, the seating state corresponding to the passenger seat is an occupied state.

[0041] In one embodiment of the present application, if the occupancy status of all passenger seats is unoccupied, it is considered that there are no passengers in the current vehicle, that is, there is only the target driver in the current vehicle, and the vehicle's authority level is determined to be level one authority.

[0042] In one embodiment of the present application, a facial image of a passenger corresponding to each passenger seat is acquired through a camera in front of each passenger seat.

[0043] In one embodiment of the present application, see Figure 3 and Figure 4 , Figure 3 is a schematic diagram of a front-row camera of a car shown in an exemplary embodiment of the present application, Figure 4 This is a schematic diagram of a car rear camera shown in an exemplary embodiment of the present application. A camera is set in front of each seat to collect facial images corresponding to each position. The driver's facial image is collected by camera A, the facial image of the passenger sitting on the front passenger seat is collected by camera B, and the facial images of the passengers in the back row are collected by cameras C and D.

[0044] Step S230, compare the passenger face image with a preset passenger relationship face database to obtain the passenger relationship, and determine the vehicle's authority level based on the passenger relationship. The authority level is used to determine the access rights to the vehicle's functional applications and data displays to prevent leakage of vehicle privacy information.

[0045] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the passenger relationship includes relative relationship, friend relationship, ordinary relationship and stranger relationship; if the passenger relationship obtained after the passenger facial image comparison is a relative relationship, the authority level is determined to be the first-level authority; if the passenger relationship obtained after the passenger facial image comparison is a friend relationship, the authority level is determined to be the second-level authority; if the passenger relationship obtained after the passenger facial image comparison is an ordinary relationship, the authority level is determined to be the third-level authority; if the passenger relationship obtained after the passenger facial image comparison is a stranger relationship, the authority level is determined to be the fourth-level authority; if the comparison of the passenger facial image with the preset passenger relationship face library fails, the authority level is determined to be the fourth-level authority.

[0046] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the vehicle's authority level is determined based on the passenger relationship. It also includes: if there are multiple different passenger relationships matched by multiple passenger facial images, then determining the vehicle's authority level based on the passenger relationship includes determining the final authority level from the authority levels corresponding to the multiple different passenger relationships based on preset priorities, and the preset priorities are in the order of four-level authority, three-level authority, two-level authority, and one-level authority from high to low.

[0047] In one embodiment of the present application, if there are different permission levels corresponding to different passenger facial images, the lowest permission level is used as the final permission level, that is, the permission level is selected in the order of four-level permission, three-level permission, two-level permission and one-level permission from high to low priority as the final permission level. For example, when there are passengers who are relatives and passengers who are strangers on the vehicle at the same time, the four-level permission corresponding to the stranger relationship is used as the final permission level to protect the privacy information of the vehicle from being leaked.

[0048] In one embodiment of the present application, the passenger facial image is compared with a preset passenger relationship face library to obtain the passenger relationship, and the vehicle authority level is determined based on the passenger relationship, and also includes: periodically collecting passenger audio, performing voice recognition on the passenger audio to obtain text to be analyzed; performing semantic understanding on the text to be analyzed to obtain the relationship between the new passenger and the target driver; updating the preset passenger relationship face library based on the relationship between the new passenger and the target driver, and redetermining the authority level based on the updated preset passenger relationship face library.

[0049] In one embodiment of the present application, semantic understanding of the text to be analyzed to obtain the relationship between the newly added passenger and the target driver includes: segmenting the text to be analyzed to obtain multiple phrases or short sentences, analyzing the part of speech of each word or short sentence in the text to be analyzed, and in this embodiment, the words or short sentences with titles are used as keywords, and the keywords include but are not limited to relatives' titles (such as father, mother, uncle, etc.), friends' titles (names), and common titles (such as Miss X, Mr. X, etc.). If the keyword of the relative title is identified, the relationship between the passenger and the target driver is determined to be a relative relationship; if the keyword of the friend title is identified and the keyword of the relative title is not identified, the relationship between the passenger and the target driver is determined to be a friend relationship; if the keyword of the common title is identified and the relative title or friend title is not identified, the relationship between the passenger and the target driver is determined to be a common relationship; if the keyword of the relative title, friend title or common title is not identified, the relationship between the passenger and the target driver is determined to be a stranger relationship.

[0050] In one embodiment of the present application, performing semantic understanding on the text to be analyzed to obtain the relationship between the newly added passenger and the target driver also includes: performing semantic understanding on the text to be analyzed to infer the passenger's intentions, emotions, and goals, and inferring the relationship between the passenger and the target driver based on the passenger's intentions, emotions, and goals, which relationship includes kinship, friendship, ordinary relationship, and stranger relationship.

[0051] In one embodiment of the present application, the vehicle collects one minute of passenger audio every five minutes and uploads it to a big data server. After receiving the passenger audio, the big data server learns the passenger audio based on the AI ​​model and determines and infers the passenger relationship between the passenger and the target driver.

[0052] In one embodiment of the present application, when the passenger face image is compared with the preset passenger relationship face database, the passenger relationship and accuracy rate corresponding to the passenger face image will be returned. If the accuracy rate returned is less than 80%, it is considered that the comparison has failed, and it is necessary to collect the passenger audio to infer the relationship between the passenger and the target driver to obtain the passenger relationship corresponding to the passenger face image.

[0053] In one embodiment of the present application, when the comparison between a passenger facial image and a preset passenger relationship face library fails (the passenger facial image does not exist in the preset passenger relationship face library or the comparison accuracy is less than 80%, which is considered a comparison failure), the relationship between the new passenger and the target driver is determined through the passenger audio, and the preset passenger relationship face library is updated based on the relationship between the new passenger and the target driver, and the authority level is re-determined based on the updated preset passenger relationship face library.

[0054] In one embodiment of the present application, if the permission level is level one, the access rights are determined according to the permission level, including: the permission for the vehicle's call records, text message records, and travel records is allowed to access; the permission for the vehicle's search records and personal applications is allowed to access; the permission for the vehicle's driving custom settings is allowed to access; and the vehicle's display interface is the wallpaper corresponding to the level one permission.

[0055] In one embodiment of the present application, if the permission level is level 2 permission, the access rights are determined according to the permission level, including: the permission for the vehicle's call records, text message records, and travel records is prohibited; the permission for the vehicle's search records and personal applications is allowed; the permission for the vehicle's driving custom settings is allowed; and the vehicle's display interface is the wallpaper corresponding to the level 2 permission.

[0056] In one embodiment of the present application, if the permission level is level three, the access rights are determined according to the permission level, including: the vehicle's call records, text message records, and travel records are prohibited from access; the vehicle's search records and personal application permissions are prohibited from access; the vehicle's driving custom settings permissions are allowed to access; the vehicle's display interface is the wallpaper corresponding to the level three permission.

[0057] In one embodiment of the present application, if the permission level is level four, the access rights are determined according to the permission level, including: the vehicle's call records, text message records, and travel records are prohibited from access; the vehicle's search records and personal application permissions are prohibited from access; the vehicle's driving custom settings permissions are prohibited from access; and the vehicle's display interface is a wallpaper corresponding to level four permissions.

[0058] In one embodiment of the present application, when the privacy management service of the vehicle receives the permission level, it saves the permission level in the memory, and calls back the permission level to the application that supports privacy grading through the listener registered by the application, so that the application locks the function of the corresponding permission based on the permission level.

[0059] In one embodiment of the present application, personal applications that need to be hidden or prohibited from use at level 3 and level 4 permissions can be customized through user configuration. Wallpapers corresponding to each permission level can also be customized through user configuration.

[0060] In one embodiment of the present application, when the vehicle desktop application receives level 3 or level 4 permission, it will read the user configuration through the method provided by the SDK, hide or disable the personal APP that the user needs to hide or disable, and will not be displayed on the application list page, thereby prohibiting access to personal applications.

[0061] In one embodiment of the present application, after the car wallpaper application receives the permission level, the wallpaper corresponding to each permission level in the user configuration is obtained through the method provided by the SDK, and the wallpaper is displayed according to the corresponding permission level. For example, if the permission level is level 1, red wallpaper is displayed; if the permission level is level 2, yellow wallpaper is displayed; if the permission level is level 3, blue wallpaper is displayed; if the permission level is level 4, green wallpaper is displayed, so that the driver can know what permission level he is currently in by distinguishing the wallpaper colors.

[0062] In one embodiment of the present application, because the vehicle desktop application and the vehicle wallpaper application are resident applications (running at all times), they can receive the permission level issued by the privacy management service in real time and perform real-time display updates based on the permission level. However, there are two scenarios for other non-resident applications when they receive the permission level. One scenario is that when the permission level is received, the vehicle application is running, and the corresponding data can be hidden or the function can be disabled according to the permission level. Another scenario is that when the permission level is received, the vehicle application is not running, and it is impossible to hide the corresponding data or disable the function in real time according to the received permission level. In this case, the vehicle application will save the permission level in the memory first, and then hide the data or disable the function based on the permission level when it is running.

[0063] In one embodiment of the present application, taking the display of the vehicle's call records as an example, the vehicle's call records are allowed to be accessed under the first-level authority, and are prohibited to be accessed under the second, third, and fourth-level authorities. If the current vehicle phone application is on the call record list page, the call record has been displayed, and the permission level received at this time is the first-level authority, the vehicle's call record will continue to be displayed normally. If the permission level received at this time is the second, third, or fourth-level authority, the call record list will be set to empty and refreshed. If the current vehicle phone application is not on the call record list page, the permission level received at this time will not be processed first, and the permission level will be saved in the memory. When the user switches to the call record list page, before displaying the call record list, the permission level in the memory is read. If the permission level is the first level, the vehicle's call record is read and displayed normally. If the permission level is the second, third, or fourth level authority, the call record list will be displayed as empty.

[0064] In one embodiment of the present application, SMS records are displayed in grades based on permission levels by the vehicle-mounted SMS application, travel records are displayed in grades based on permission levels by the vehicle-mounted navigation application, search records are displayed in grades based on permission levels by the vehicle-mounted search application, and driving custom settings are displayed in grades based on permission levels by the vehicle-mounted driving application.

[0065] In one embodiment of the present application, applications that support hierarchical management of access rights need to access the SDK provided by the privacy management service and register hierarchical monitoring of permissions. The privacy management service has a listener list to store all car applications that have registered hierarchical monitoring of permissions and their callback instances. In addition, the SDK can also implement permission level query, wallpaper list, and the access permission level corresponding to each car application. When the privacy management service obtains the permission level through the passenger relationship, it will traverse the listener list and send the permission level to each car application through the callback instance.

[0066] In one embodiment of the present application, if it is detected that a passenger gets on or off the vehicle midway, step S230 is repeated to obtain a new authority level, and the access rights to the vehicle are determined based on the new authority level.

[0067] See also Figure 5 , Figure 5 This is a working sequence diagram of a vehicle privacy protection system shown in an exemplary embodiment of the present application. The vehicle privacy protection system includes a camera, an application that supports privacy grading, a privacy service manager, a privacy service, and a big data server. The application that supports privacy grading is added to the listener list in the privacy service by registering a listener. When the camera collects portrait information, the collected data is sent to the privacy service. The privacy service sends the face information to the big data server. The big data server calculates the final permission level through the face image and returns the permission level to the privacy service. The privacy service sends the permission level to each application by traversing the listener list. After receiving the permission level, each application obtains the user configuration item, and determines the access rights of data display and functional application according to different user configuration items and permission levels. If the accuracy of the calculated final permission level is insufficient, the passenger audio is collected and uploaded to the big data server, so that the big data server obtains the passenger relationship based on the passenger audio, and obtains the corresponding permission level according to the passenger relationship.

[0068] In one embodiment of the present application, different user configurations for each application are uploaded and stored in a privacy service manager through user-defined configurations, and uploaded to a privacy service and a big data server when needed.

[0069] In one embodiment of the present application, different user configurations for various applications are configured through user customization, including permission classification settings, passenger relationship settings, permission wallpaper settings, and personal application settings in the setting application of the vehicle system. When the permission level is level one, the page will be displayed and the user configuration will be customized.

[0070] In the permission classification settings, there are four permission levels and a list of applications that support permission classification. Users can configure the restricted access functional applications corresponding to each permission level.

[0071] In the passenger relationship settings, all passenger relationship names are displayed, as well as the passenger information and authority levels corresponding to historical passengers obtained from the big data server. Users can customize the relationship between each passenger and themselves, as well as the authority level corresponding to the passenger relationship, and upload the configured passenger relationship to the big data server to update the preset passenger relationship face library.

[0072] In one embodiment of the present application, after the user-defined configuration is completed, all user configuration information will be uploaded to the big data server to save the user's personalized settings in the cloud. At the same time, the user configuration will be saved to the hard disk in the form of a key-value pair, where the key is the function name and the value is the permission level for accessing the function. For example, if the second-level permission is set to prohibit access to call records, the format stored locally is: key: call record value: level one (because the second level restricts access to call records, the third and fourth levels are definitely not accessible, and only the first level can access it). If the third-level permission is set to prohibit access to search records, the format stored locally is: key: search record value: level one, level two (because the third level restricts access to search records, the fourth level is definitely not accessible, and the first and second levels can access it).

[0073] In one embodiment of the present application, in the permission wallpaper setting, the permission level and the system default color wallpaper will be displayed. Users can customize the wallpaper pictures of each color system, and can also customize different permission levels to correspond to different color wallpapers. After the user clicks Save, the options will be saved locally. For example: Level 1 corresponds to red + 3 custom pictures. When saving, the following logic will be executed: read the system default red wallpaper, get the picture list, get the 3 pictures customized by the user, combine the obtained pictures into the same picture list, and save the obtained picture list to the hard disk in the form of a key-value pair, where the key is the first-level permission and the value is the picture list.

[0074] In one embodiment of the present application, in the personal application settings, all the car-machine applications of the car-machine system will be listed. If the user checks the box, it will be considered a personal application, otherwise it will be a shared application (a shared application is a car-machine application that can be displayed and used at any permission level). After clicking Save, the APP package names of all selected personal applications (the unique identifier of the car-machine application) will be stored in the hard disk in the form of a string.

[0075] See also Figure 6 , Figure 6 is a block diagram of a vehicle privacy protection device shown in an exemplary embodiment of the present application. The device can be applied to Figure 1The implementation environment shown is that the device can also be applicable to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the device is applicable.

[0076] like Figure 6 As shown, the exemplary vehicle privacy protection device includes: an information input module 601 , a state recognition module 602 and a permission management module 603 .

[0077] The information input module 601 is used to obtain the driver's face image, perform driver face recognition on the driver's face image, and if the driver's face recognition result is the target driver, obtain the sitting status of each passenger seat;

[0078] The state recognition module 602 is used to obtain a passenger face image if the passenger seat is occupied.

[0079] The authority management module 603 is used to compare the passenger face image with the preset passenger relationship face library to obtain the passenger relationship, and determine the vehicle's authority level based on the passenger relationship. The authority level is used to determine the access rights to the vehicle's functional applications and data displays to prevent the leakage of vehicle privacy information.

[0080] Figure 7 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 7 The computer system 700 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0081] like Figure 7 As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703, such as executing the method described in the above embodiment. In the RAM 703, various programs and data required for system operation are also stored. The CPU 701, ROM 702 and RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0082] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed so that a computer program read therefrom is installed into the storage section 708 as needed.

[0083] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 709, and / or installed from a removable medium 711. When the computer program is executed by a central processing unit (CPU) 701, various functions defined in the system of the present application are executed.

[0084] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0085] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0086] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0087] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the vehicle privacy protection method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0088] Another aspect of the present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the vehicle privacy protection method provided in each of the above embodiments.

[0089] The above embodiments are merely illustrative of the principles and effects of the present application, and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A vehicle privacy protection method, characterized in that: The vehicle privacy protection method comprises: Acquire a driver's face image, perform driver face recognition on the driver's face image, and if the driver's face recognition result is a target driver, acquire the seating status of each passenger seat; If the seat status of the passenger seat is occupied, obtain the passenger's facial image; The passenger facial image is compared with a preset passenger relationship facial database to obtain the passenger relationship, and the vehicle's authority level is determined based on the passenger relationship. The authority level is used to determine the access rights to the vehicle's functional applications and data displays to prevent leakage of vehicle privacy information.

2. The vehicle privacy protection method according to claim 1, characterized in that: Comparing the passenger face image with a preset passenger relationship face database to obtain the passenger relationship, and determining the vehicle authority level according to the passenger relationship includes: Comparing the passenger face image with a preset passenger relationship face database to obtain the passenger relationship, wherein the passenger relationship includes a relative relationship, a friend relationship, a common relationship, and a stranger relationship; If the passenger relationship obtained after the comparison of the passenger's facial images is a relative relationship, the authority level is determined to be level one authority; If the passenger relationship obtained after the comparison of the passenger face images is a friend relationship, the permission level is determined as a secondary permission; If the passenger relationship obtained after the comparison of the passenger's facial images is a normal relationship, the authority level is determined to be level three authority; If the passenger relationship obtained after the passenger face image comparison is a stranger relationship, the authority level is determined as level 4 authority; If the passenger facial image fails to be compared with the preset passenger relationship facial database, the authority level is determined to be level four authority.

3. The vehicle privacy protection method according to claim 2, characterized in that: The passenger face image is compared with a preset passenger relationship face database to obtain the passenger relationship, and the authority level of the vehicle is determined according to the passenger relationship, further comprising: If there are multiple different passenger relationships that match multiple passenger facial images, determining the vehicle's authority level based on the passenger relationships includes determining a final authority level from the authority levels corresponding to the multiple different passenger relationships based on preset priorities, and the preset priorities are in the order of level four authority, level three authority, level two authority, and level one authority from high to low.

4. The vehicle privacy protection method according to claim 1 or 2, characterized in that: The passenger face image is compared with a preset passenger relationship face database to obtain the passenger relationship, and the authority level of the vehicle is determined according to the passenger relationship, further comprising: Periodically collecting passenger audio, and performing speech recognition on the passenger audio to obtain text to be analyzed; Performing semantic understanding on the text to be analyzed to obtain the relationship between the newly added passenger and the target driver; The preset passenger relationship face database is updated based on the relationship between the new passenger and the target driver, and the authority level is re-determined based on the updated preset passenger relationship face database.

5. The vehicle privacy protection method according to claim 1 or 2, characterized in that: If the permission level is level one, determining the access rights according to the permission level includes: The permission for access to the vehicle's call records, text message records and trip records is allowed; The search history of the vehicle and the permissions of personal applications are allowed to access; The permission for the vehicle's driving custom settings is to allow access; The display interface of the vehicle is a wallpaper corresponding to the first-level authority.

6. The vehicle privacy protection method according to claim 1 or 2, characterized in that: If the permission level is level 2, determining the access rights according to the permission level includes: Access to the vehicle's call records, text message records, and trip records is prohibited; The search history of the vehicle and the permissions of personal applications are allowed to access; The permission for the vehicle's driving custom settings is to allow access; The display interface of the vehicle is a wallpaper corresponding to the secondary authority.

7. The vehicle privacy protection method according to any one of claims 1 or 2, characterized in that: If the permission level is level three, determining the access rights according to the permission level includes: Access to the vehicle's call records, text message records, and trip records is prohibited; The search history of the vehicle and the permissions of personal applications are prohibited from access; The permission for the vehicle's driving custom settings is to allow access; The display interface of the vehicle is a wallpaper corresponding to the third level of authority.

8. The vehicle privacy protection method according to claim 1 or 2, characterized in that: If the permission level is level 4, determining the access rights according to the permission level includes: Access to the vehicle's call records, text message records, and trip records is prohibited; The search history of the vehicle and the permissions of personal applications are prohibited from access; The permission for the vehicle's driving custom settings is prohibited from access; The display interface of the vehicle is a wallpaper corresponding to the fourth level of authority.

9. A vehicle privacy protection device, characterized in that: The device comprises: An information input module, used to obtain a driver's face image, perform driver face recognition on the driver's face image, and if the driver's face recognition result is a target driver, obtain the seating status of each passenger seat; A state recognition module, used for obtaining a passenger face image if the passenger seat is occupied; The authority management module is used to compare the passenger facial image with a preset passenger relationship facial library to obtain the passenger relationship, and determine the vehicle's authority level based on the passenger relationship. The authority level is used to determine the access rights for the vehicle's functional applications and data display to prevent the leakage of vehicle privacy information.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the vehicle privacy protection method as described in any one of claims 1 to 8.

Images