Display control method, system, electronic device and storage medium of in-vehicle display screen

By setting the correspondence between the face information and command information of the vehicle's personnel and the display mode of the on-board display screen interface, combined with voice and manual command verification, the problem of insufficient privacy protection of the on-board display screen is solved, and privacy protection and information security are achieved in multiple scenarios.

CN115366804BActive Publication Date: 2025-08-01SHANGHAI QINGGAN INTELLIGENT TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110541199.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-18
Publication Date
2025-08-01
Estimated Expiration
2041-05-18

AI Technical Summary

Technical Problem

The existing on-board display screen lacks a privacy protection mechanism, which makes it difficult to ensure the driver's information security, especially when there is a variety of people in the car, information is easily leaked.

Method used

By setting the correspondence between the face information and command information of the vehicle's personnel and the display mode of the on-board display screen, combining voice and manual command verification, the display mode of the display screen is automatically controlled to ensure privacy protection.

Benefits of technology

It realizes privacy protection for people in the car in various scenarios, prevents information leakage, and improves the safety and operational convenience of driver information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115366804B_ABST
    Figure CN115366804B_ABST
Patent Text Reader

Abstract

The present invention discloses a display control method, system, electronic device and storage medium for an in-vehicle display screen. The method includes the following steps: setting a first correspondence relationship, where the first correspondence relationship includes the correspondence relationship between the face information of the in-vehicle personnel, the instruction information and the interface display mode of the in-vehicle display screen; obtaining the current face information of the in-vehicle personnel and the current instruction information; and determining the interface display mode corresponding to the current face information of the in-vehicle personnel and the current instruction information according to the first correspondence relationship. The present invention can automatically control the interface display of the in-vehicle display screen, avoid privacy leakage and ensure the information security of the driver.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of control of in-vehicle displays, and particularly relates to a display control method, system, electronic device and storage medium for an in-vehicle display. Background Art

[0002] Currently, in-vehicle displays are commonly installed in vehicles. Displaying some information through the in-vehicle display, such as music lyrics, navigation routes, received messages, etc., has become a user habit.

[0003] Since the in-vehicle display is usually installed in the middle of the front row of the vehicle, all the people in the vehicle can see the content displayed on the in-vehicle display, including the co-driver or the people in the back row other than the driver. For some chat messages or other sensitive information, the driver may not want other people to see it. However, since the existing in-vehicle display does not have a privacy protection mechanism, these information will be directly displayed on the in-vehicle display, resulting in poor privacy and inability to ensure the information security of the driver. Summary of the Invention

[0004] An object of the present invention is to provide a display control method for an in-vehicle display. Its advantage lies in that the face information and instruction information of the people in the vehicle are corresponded to the interface display mode of the in-vehicle display through a set first correspondence relationship. The interface display mode corresponding thereto is determined by the obtained current face information of the people in the vehicle and the current instruction information, and the interface display of the in-vehicle display is automatically controlled. The interface display mode is adapted to the people in the vehicle and the control operation in the current scenario, which can avoid privacy leakage and ensure the information security of the driver.

[0005] Another object of the present invention is to provide a display control method for an in-vehicle display. Its advantage lies in that multiple situations of the people in the vehicle are distinguished according to whether the face information of the people in the vehicle contains the face information of the whitelist personnel and whether it contains the face information of the non-whitelist personnel, and different instruction information is also distinguished according to whether the instruction information contains voice instruction information and whether it contains manual instruction information. According to the first correspondence relationship set for different combinations of the face information of the people in the vehicle and the instruction information, it can be suitable for the interface display control in multiple scenarios, so as to play a role in comprehensively protecting privacy and preventing information leakage.

[0006] Another object of the present invention is to provide a display control method for an in-vehicle display screen. The advantage lies in that a better first correspondence is given, which defines the corresponding interface display modes when the face information of the in-vehicle personnel is only the face information of the whitelist personnel and the instruction information includes the voice instruction information, and when the face information of the in-vehicle personnel is only the face information of the whitelist personnel and the instruction information includes the manual instruction information. Among them, the fact that the face information of the in-vehicle personnel is only the face information of the whitelist personnel indicates that there are likely only whitelist personnel in the vehicle. At this time, it is relatively safe to perform interface display, and the risk of privacy leakage is relatively low. The interface can be displayed according to the voice instruction information or the manual instruction information to meet the user's needs.

[0007] Another object of the present invention is to provide a display control method for an in-vehicle display screen. The advantage lies in that the specific process of displaying the interface of the in-vehicle display screen according to the voice instruction information is further defined. It judges whether to display the interface of the in-vehicle display screen according to whether the voice instruction information is the voice instruction information sent by the whitelist personnel. On the basis of verifying the face information of the in-vehicle personnel, a verification step of the voice instruction information is added, and the interface is only displayed when the voice instruction information is sent by the whitelist personnel, thereby excluding the possibility of displaying the interface by the non-whitelist sending the voice instruction information in the case of only whitelist personnel, and further improving the security of the display.

[0008] Another object of the present invention is to provide a display control method for an in-vehicle display screen. The advantage lies in that a better first correspondence is given, which defines the corresponding interface display modes when the face information of the in-vehicle personnel simultaneously includes the face information of the whitelist personnel and the face information of the non-whitelist personnel, or the face information of the in-vehicle personnel is only the face information of the non-whitelist personnel, or the face information of the in-vehicle personnel simultaneously does not include the face information of the whitelist personnel and the face information of the non-whitelist personnel. Considering that there is a risk of information leakage as long as there are non-whitelist personnel in the vehicle, no matter what instruction information is obtained, the interface of the in-vehicle display screen is not displayed. Also considering that in the case where the in-vehicle personnel do not include the whitelist personnel and the non-whitelist personnel at the same time, it is impossible to determine exactly who is in the vehicle. If the interface of the in-vehicle display screen is displayed, there is also a risk of information leakage. Therefore, no matter what instruction information is obtained, the interface of the in-vehicle display screen is not displayed.

[0009] Another object of the present invention is to provide a display control method for an in-vehicle display screen. Its advantage lies in that, through a set second correspondence, the command information when the interface of the in-vehicle display screen is not displayed is corresponded to the command response method, and the command response method corresponding to the obtained command information is determined according to the second correspondence, realizing command response without displaying the interface, having the advantages of neither leaking privacy nor affecting user operation.

[0010] Another object of the present invention is to provide a display control method for an in-vehicle display screen. Its advantage lies in that a better second correspondence is given, which defines the command response methods corresponding when the command information includes voice command information or manual command information. Considering that the voice command information may be sent by a whitelist person, the voice command information can be responded to in the background without displaying the interface. By responding to the voice command information, voice control of background programs can be realized, improving operation convenience. By not responding to manual command information, non-whitelist persons can neither see privacy information nor control the display screen and background programs, improving operation safety.

[0011] Another object of the present invention is to provide a display control method for an in-vehicle display screen. Its advantage lies in that it is judged whether to respond to the voice command information in the background according to whether the voice command information is the voice command information sent by the whitelist person, realizing background response only to the voice command information sent by the whitelist person, bringing operation convenience to the whitelist person while avoiding privacy leakage.

[0012] Another object of the present invention is to provide a display control method for an in-vehicle display screen. Its advantage lies in that the information obtained and how to perform interface display are controlled by turning on and off the privacy protection switch, facilitating the user to switch between the two modes of privacy protection and non-protection.

[0013] Another object of the present invention is to provide a display control system. Its advantage lies in that it is cooperated by a camera, a command receiving device, an in-vehicle display screen, a processor and a memory. The face information of the people in the vehicle, the command information and the interface display method of the in-vehicle display screen are corresponded through a set first correspondence, and the corresponding interface display method is determined by the obtained current face information of the people in the vehicle and the current command information, automatically controlling the interface display of the in-vehicle display screen. This interface display method adapts to the people in the vehicle and control operations in the current scenario, can avoid privacy leakage and ensure the information security of the driver.

[0014] Another object of the present invention is to provide a display control system. Its advantage lies in that the current voice command information is obtained through a voice receiver, facilitating user command input.

[0015] Another object of the present invention is to provide a display control system, which has the advantage that the current manual instruction information can be obtained through buttons or a touch screen, enriching the instruction input form and increasing the ways to control the display of the in-vehicle display screen.

[0016] Another object of the present invention is to provide a display control system, which has the advantage that by arranging the display control system in a vehicle, it is convenient to obtain relevant information in the vehicle (such as the current in-vehicle personnel face information and the current instruction information).

[0017] Another object of the present invention is to provide an electronic device, which has the advantage that a processor is used to execute a computer program to correspond the in-vehicle personnel face information, instruction information with the interface display mode of the in-vehicle display screen through a set first correspondence relationship, determine the corresponding interface display mode according to the obtained current in-vehicle personnel face information and current instruction information, and automatically control the interface display of the in-vehicle display screen. This interface display mode is adapted to the in-vehicle personnel and control operations in the current scenario, can avoid privacy leakage, and ensure the information security of the driver.

[0018] Another object of the present invention is to provide a computer-readable storage medium, which has the advantage that a computer program executed by a processor is used to correspond the in-vehicle personnel face information, instruction information with the interface display mode of the in-vehicle display screen through a set first correspondence relationship, determine the corresponding interface display mode according to the obtained current in-vehicle personnel face information and current instruction information, and automatically control the interface display of the in-vehicle display screen. This interface display mode is adapted to the in-vehicle personnel and control operations in the current scenario, can avoid privacy leakage, and ensure the information security of the driver.

[0019] The present invention solves the above technical problems through the following technical solutions:

[0020] The first aspect of the present invention provides a display control method for an in-vehicle display screen, including the following steps:

[0021] Set a first correspondence relationship, where the first correspondence relationship includes the correspondence relationship between the in-vehicle personnel face information, instruction information and the interface display mode of the in-vehicle display screen;

[0022] Obtain the current in-vehicle personnel face information and the current instruction information;

[0023] According to the first correspondence relationship, determine the interface display mode corresponding to the current in-vehicle personnel face information and the current instruction information.

[0024] The second aspect of the present invention provides a display control system, including:

[0025] A camera;

[0026] Instruction receiving device;

[0027] In-vehicle display screen;

[0028] One or more processors, the one or more processors communicating with the camera, the instruction receiving device, and the in-vehicle display screen; and

[0029] A memory configured to store instructions that, when executed by the one or more processors, cause the one or more processors to perform steps including:

[0030] Set a first correspondence relationship, the first correspondence relationship including the correspondence relationship between the face information of the vehicle occupants, the instruction information, and the interface display mode of the in-vehicle display screen;

[0031] Obtain the current face information of the vehicle occupants from the camera;

[0032] Obtain the current instruction information from the instruction receiving device;

[0033] Determine the interface display mode corresponding to the current face information of the vehicle occupants and the current instruction information according to the first correspondence relationship.

[0034] The third aspect of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the steps of the display control method of the in-vehicle display screen as described above are implemented.

[0035] The fourth aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored. The computer program is characterized in that when executed by a processor, the steps of the display control method of the in-vehicle display screen as described above are implemented.

[0036] On the basis of conforming to the common knowledge in the art, the above preferred conditions can be combined arbitrarily to obtain various preferred examples of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a flowchart of a display control method of an in-vehicle display screen according to Embodiment 1 of the present invention.

[0038] Figure 2 It is an alternative flowchart of a display control method of an in-vehicle display screen according to Embodiment 1 of the present invention.

[0039] Figure 3 It is another alternative flowchart of a display control method of an in-vehicle display screen according to Embodiment 1 of the present invention.

[0040] Figure 4It is a schematic structural diagram of a display control system according to Embodiment 2 of the present invention.

[0041] Figure 5 It is an alternative schematic structural diagram of a display control system according to Embodiment 2 of the present invention.

[0042] Figure 6 It is a schematic structural diagram of an electronic device according to Embodiment 3 of the present invention. Detailed implementation manners

[0043] The present invention will be further described below by way of embodiments, but the present invention is not limited to the scope of the described embodiments.

[0044] Embodiment 1

[0045] Figure 1 A display control method for an in-vehicle display screen in this embodiment is shown. Among them, the in-vehicle display screen refers to the display screen in the vehicle, which can specifically be the display screen originally installed at the factory of the vehicle, or the display screen installed after the vehicle leaves the factory, or the display screen of user terminals such as mobile phones and tablet computers placed in the vehicle. The in-vehicle display screen is usually fixedly installed or installed on the vehicle front part by using a bracket, and specifically can be located in the middle of the front row of the vehicle. As Figure 1 shown, the display control method includes the following steps:

[0046] Step 11: Set a first correspondence relationship, which includes the correspondence relationship between the face information of the in-vehicle personnel, the instruction information and the interface display mode of the in-vehicle display screen.

[0047] Step 12: Obtain the current face information of the in-vehicle personnel and the current instruction information.

[0048] Step 13: Determine the interface display mode corresponding to the current face information of the in-vehicle personnel and the current instruction information according to the first correspondence relationship.

[0049] In Step 11, the face information of the in-vehicle personnel reflects the specific personnel in the vehicle, the instruction information represents the control operation to be performed on the in-vehicle display screen, and the interface display mode includes whether to display the interface, or how to display the interface (such as full-screen or zoomed display of the interface), or what kind of interface to display (such as displaying the interface of a certain application program or the operating system desktop), etc. The first correspondence relationship can be fixed, or variable according to the actual application scenario, or customized according to user requirements. The first correspondence relationship can be stored in the form of a table, and the table includes combinations of different face information of in-vehicle personnel and instruction information and the corresponding interface display modes. In Step 13, the interface display mode corresponding to the current face information of the in-vehicle personnel and the current instruction information can be specifically determined by looking up the table.

[0050] In step 12, a real-time in-vehicle image can be collected by an in-vehicle camera, and the camera's field of view covers or basically covers the driver's seat, the front passenger seat, and the rear seats of the vehicle. Of course, it is very likely that the camera's field of view does not completely cover every corner of the vehicle, and there may be a situation where there are people in the vehicle but the face information is not captured. The camera can be a separately installed camera in the vehicle, or a camera integrated into the in-vehicle display screen (such as an in-vehicle device integrating a camera and a display screen), or a camera of an in-vehicle user terminal. Through communication with the camera, the collected real-time in-vehicle image can be obtained from the camera, and the current in-vehicle personnel face information can be obtained from the real-time in-vehicle image using face recognition technology, or the current in-vehicle personnel face information can be directly obtained from the camera with face recognition.

[0051] In step 12, an instruction receiving device can be used to receive instruction information. Different types of instruction receiving devices can receive different types of instruction information. For example, a voice receiver can receive voice instruction information, and a button or a touch screen can receive manual instruction information. The instruction receiving device can be a separately installed instruction receiving device in the vehicle, or an instruction receiving device integrated into the in-vehicle display screen (such as an in-vehicle device integrating a voice receiver, a button, and a display screen, or an in-vehicle device integrating a voice receiver and a touch screen), or an instruction receiving device of an in-vehicle user terminal. Through communication with the instruction receiving device, the current instruction information can be obtained from the instruction receiving device.

[0052] The method of this embodiment corresponds the in-vehicle personnel face information, the instruction information, and the interface display mode of the in-vehicle display screen through a set first correspondence relationship. By determining the corresponding interface display mode based on the obtained current in-vehicle personnel face information and the current instruction information, the interface display of the in-vehicle display screen is automatically controlled. This interface display mode is adapted to the in-vehicle personnel and control operations in the current scenario, can avoid privacy leakage, and ensure the information security of the driver.

[0053] In an optional manner, the in-vehicle personnel face information includes: whether it contains the face information of whitelist personnel, and whether it contains the face information of non-whitelist personnel. The whitelist personnel can be set by the driver himself / herself, and the number of whitelist personnel is not limited to 1. For example, it includes the driver himself / herself and the people trusted by the driver. The face information of the whitelist personnel can be pre-entered by scanning, taking pictures, etc., and can be added, deleted, or modified according to actual needs. If a person does not belong to the whitelist personnel, then he / she belongs to the non-whitelist personnel. It can be determined whether the in-vehicle personnel face information contains the face information of whitelist personnel and whether it contains the face information of non-whitelist personnel by comparing the face information contained in the real-time in-vehicle image with the face information of the whitelist personnel. The in-vehicle personnel face information can specifically include the following 4 types:

[0054] There is only the face information of whitelist personnel, that is, it contains the face information of whitelist personnel and does not contain the face information of non-whitelist personnel;

[0055] There is only the face information of non-whitelist personnel, that is, it contains the face information of non-whitelist personnel and does not contain the face information of whitelist personnel;

[0056] It contains both the face information of whitelist personnel and the face information of non-whitelist personnel;

[0057] It contains neither the face information of whitelist personnel nor the face information of non-whitelist personnel.

[0058] The instruction information includes whether it contains voice instruction information and whether it contains manual instruction information. Among them, the voice instruction information is received by a voice receiver, which can be an operation described by voice, such as the user directly saying "open a certain application", or a specified voice password, and the user only saying "a certain application" means that the application needs to be opened. The manual instruction information can be received through buttons or a touch screen, and is a manually input operation to be performed, such as the user pressing the display power key or clicking an interface display button on the touch screen. By monitoring the voice receiver, buttons and touch screen, it can be judged whether voice instruction information or manual instruction information is received. The instruction information can specifically include:

[0059] It contains voice instruction information;

[0060] It contains manual instruction information;

[0061] It does not contain voice instruction information and manual instruction information.

[0062] This method distinguishes multiple situations of in-vehicle personnel according to whether the face information of in-vehicle personnel contains the face information of whitelist personnel and whether it contains the face information of non-whitelist personnel, and also distinguishes different instruction information according to whether the instruction information contains voice instruction information and whether it contains manual instruction information. According to the first corresponding relationship set based on different combinations of in-vehicle personnel face information and instruction information, it can be suitable for interface display control in multiple scenarios, thus playing a role in comprehensively protecting privacy and preventing information leakage.

[0063] In an optional method, the first corresponding relationship can be as shown in Table 1:

[0064] Table 1

[0065]

[0066] The first corresponding relationship includes Relationship 1, which is as follows: when the face information of the in-vehicle personnel is exactly the face information of the whitelist personnel and the instruction information includes voice instruction information, the corresponding interface display method is to display the interface of the in-vehicle display screen according to the voice instruction information. The above Relationship 1 gives the interface display method corresponding to the situation where the face information of the in-vehicle personnel is exactly the face information of the whitelist personnel and the instruction information includes voice instruction information. This corresponding relationship takes into account the characteristics of this scenario: the fact that the face information of the in-vehicle personnel is exactly the face information of the whitelist personnel indicates that there are probably only whitelist personnel in the vehicle, and the voice instruction information is probably issued by the whitelist personnel. Therefore, it is relatively safe to perform interface display, and the risk of privacy leakage is relatively low. The interface can be displayed according to the voice instruction information to meet the user's needs.

[0067] However, considering that there may be a situation where there are actually non-whitelist personnel in the vehicle but they are not recognized, in order to further ensure privacy security, the interface of the in-vehicle display screen displayed according to the voice instruction information preferably includes:

[0068] Judge whether to display the interface of the in-vehicle display screen according to whether the voice instruction information is the voice instruction information issued by the whitelist personnel. Among them, if the voice instruction information is the voice instruction information issued by the whitelist personnel, then display the interface of the in-vehicle display screen; if the voice instruction information is not the voice instruction information issued by the whitelist personnel, then do not display the interface of the in-vehicle display screen. Specifically, it can be judged whether the voice instruction information is the voice instruction information issued by the whitelist personnel by comparing the voiceprint of the voice instruction information with the voiceprint of the whitelist personnel. If the comparison is successful, the voice instruction information is the voice instruction information issued by the whitelist personnel; if the comparison is unsuccessful, the voice instruction information is not the voice instruction information issued by the whitelist personnel. The voiceprints of the whitelist personnel can be pre-recorded and stored.

[0069] This method adds a verification step for the voice instruction information on the basis of verifying the face information of the in-vehicle personnel, and only displays the interface when the voice instruction information is issued by the whitelist personnel, thus eliminating the possibility of displaying the interface by non-whitelist personnel issuing voice instruction information in the case of only whitelist personnel, and further improving the security of the display.

[0070] The above table also shows Relationship 2 included in the first correspondence relationship. Relationship 2 is as follows: When the face information of the person in the vehicle only contains the face information of the whitelist personnel and the instruction information contains manual instruction information, the corresponding interface display method is to display the interface of the in-vehicle display screen according to the manual instruction information. Among them, displaying the interface of the in-vehicle display screen according to the manual instruction information may include displaying the interface of the in-vehicle display screen according to the object, gesture, action, etc. operated according to the manual instruction information. Relationship 2 gives the corresponding interface display method when the face information of the person in the vehicle only contains the face information of the whitelist personnel and the instruction information contains manual instruction information. This kind of correspondence relationship takes into account the characteristics of this scenario: The fact that the face information of the person in the vehicle only contains the face information of the whitelist personnel indicates that there are probably only whitelist personnel in the vehicle, and the manual instruction information is probably issued by the whitelist personnel. Therefore, it is relatively safe to perform interface display, and the risk of privacy leakage is relatively low. The interface can be displayed according to the manual instruction information to meet the user's needs.

[0071] The above table also shows Relationship 3 included in the first correspondence relationship. Relationship 3 is as follows: When the face information of the person in the vehicle contains both the face information of the whitelist personnel and the face information of the non-whitelist personnel, the corresponding interface display method is not to display the interface of the in-vehicle display screen.

[0072] The above table also shows Relationship 4 included in the first correspondence relationship. Relationship 4 is as follows: When the face information of the person in the vehicle only contains the face information of the non-whitelist personnel, the corresponding interface display method is not to display the interface of the in-vehicle display screen.

[0073] The above table also shows Relationship 5 included in the first correspondence relationship. Relationship 5 is as follows: When the face information of the person in the vehicle does not contain both the face information of the whitelist personnel and the face information of the non-whitelist personnel, the corresponding interface display method is not to display the interface of the in-vehicle display screen.

[0074] In the above Relationships 3, 4, and 5, only the face information of the person in the vehicle is limited. That is to say, as long as the face information of the person in the vehicle contains both the face information of the whitelist personnel and the face information of the non-whitelist personnel, or the face information of the person in the vehicle only contains the face information of the non-whitelist personnel, or the face information of the person in the vehicle does not contain both the face information of the whitelist personnel and the face information of the non-whitelist personnel, then regardless of whether the instruction information contains voice instruction information or whether it contains manual instruction information, the interface of the in-vehicle display screen will not be displayed.

[0075] Relationships 3 and 4 above take into account the risk of information leakage as long as the occupants include non-whitelisted individuals. Therefore, no matter what command information is obtained, the vehicle display screen interface will not be displayed. Relationship 5 above takes into account the situation where the occupants do not include both whitelisted and non-whitelisted individuals. It is impossible to determine who is actually in the vehicle. If the vehicle display screen interface is displayed, there is also the risk of information leakage. Therefore, no matter what command information is obtained, the vehicle display screen interface will not be displayed.

[0076] The above optional methods provide a variety of preferred first correspondences, but the first correspondence of this embodiment is not limited thereto. Other first correspondences can also be set according to actual needs or to adapt to different scenarios, such as relaxing the conditions for displaying the interface of the vehicle display screen. For example, when the facial information of the people in the car includes both the facial information of the white-listed people and the facial information of the non-white-listed people and the command information includes voice command information, if the voice command information is the voice command information issued by the white-listed people, the interface of the vehicle display screen will be displayed, otherwise the interface of the vehicle display screen will not be displayed.

[0077] In one alternative, Figure 2 An optional process of the method of this embodiment is shown, which includes the following steps before step 12:

[0078] Step 111: Setting a second correspondence when the interface of the vehicle display screen is not displayed, the second correspondence includes a correspondence between command information and a command response method.

[0079] After step 13, if the interface display mode corresponding to the current facial information of the person in the vehicle and the current command information is an interface without displaying the vehicle display screen, the following further includes:

[0080] Step 14: Determine the instruction response mode corresponding to the acquired instruction information according to the second corresponding relationship.

[0081] The command response mode includes responding in the background and not responding. The second correspondence relationship can be fixed, variable according to the actual application scenario, or customized according to user needs. The second correspondence relationship can be stored in the form of a table, which includes different command information and corresponding command response modes. In step 14, the command response mode corresponding to the obtained command information can be determined by looking up the table.

[0082] This method matches the command information and the command response method when the interface of the vehicle display screen is not displayed through a set second correspondence relationship, and determines the command response method corresponding to the obtained command information based on the second correspondence relationship, thereby realizing the command response without displaying the interface, which has the advantages of neither leaking privacy nor affecting user operations.

[0083] In an alternative manner, the second correspondence may be as shown in Table 2:

[0084] Table 2

[0085]

[0086] The above shows Relationship 1 included in the second correspondence. Relationship 1 is: when the instruction information includes voice instruction information, the voice instruction information is responded to in the background according to the voice instruction information. Considering that the voice instruction information may be sent by a whitelisted person, the voice instruction information can be responded to in the background without displaying the interface.

[0087] However, in order to verify whether the voice instruction information is sent by a whitelisted person, the step of responding to the voice instruction information in the background according to the voice instruction information preferably includes: judging whether to respond to the voice instruction information in the background according to whether the voice instruction information is the voice instruction information sent by a whitelisted person, wherein, if the voice instruction information is the voice instruction information sent by a whitelisted person, the voice instruction information is responded to in the background, and if the voice instruction information is not the voice instruction information sent by a whitelisted person, the voice instruction information is not responded to in the background.

[0088] This method only responds to the voice instruction information sent by whitelisted persons, which brings operational convenience to whitelisted persons while avoiding privacy leakage.

[0089] The above table also shows Relationship 2 included in the second correspondence. Relationship 2 is: when the instruction information includes manual instruction information, the manual instruction information is not responded to. By not responding to the manual instruction information, non-whitelisted persons can neither see the privacy information nor control the display screen and the background program, which can improve the operation security.

[0090] In an alternative manner, Figure 3 shows another alternative process of the method of this embodiment. Before step 12, it further includes the following steps:

[0091] Step 112: Judge whether the privacy protection switch is turned on. If the privacy protection switch is turned on, execute step 12 and its subsequent steps; if the privacy protection switch is not turned on, execute step 15.

[0092] Step 15: Obtain the current instruction information.

[0093] Step 16: Determine the interface display mode of the in-vehicle display screen according to the current instruction information.

[0094] In step 112, the privacy protection switch can be a physical switch or a virtual switch, and the user can choose to turn it on or off according to actual needs.

[0095] Step 16 may specifically include displaying or not displaying the interface of the in-vehicle display screen according to the current instruction information.

[0096] In this method, the information obtained and the interface display method are controlled by turning on and off the privacy protection switch, which facilitates the user to switch between the two modes of privacy protection and non-protection.

[0097] It should be noted that the interface of the in-vehicle display screen mentioned in this embodiment refers to the specific interface required to be displayed by the instruction information. For example, if the voice instruction information requires opening a certain application, the interface of that application is displayed. As for before the specific interface required to be displayed by the instruction information, the display screen may be in the off state or display a locked interface, the system desktop, or other interfaces. The non-display of the interface of the in-vehicle display screen mentioned in this embodiment means not displaying the specific interface required to be displayed by the instruction information. For example, if the voice instruction information requires opening a certain application, the interface of that application is not displayed. As for after not displaying the specific interface required to be displayed by the instruction information, the display screen may enter the off state or enter the state of displaying a locked interface, the system desktop, or other interfaces.

[0098] Embodiment 2

[0099] Figure 4 A display control system of this embodiment is shown. It includes: a camera 21; an instruction receiving device 22; an in-vehicle display screen 23; one or more processors 24, where one or more processors 24 communicate with the camera 21, the instruction receiving device 22, and the in-vehicle display screen 23; and a memory 25, where the memory 25 is configured to store instructions, and when the instructions are executed by one or more processors 24, the one or more processors 24 perform steps, and the steps include:

[0100] Set a first correspondence relationship, where the first correspondence relationship includes the correspondence relationship between the face information of the occupants in the vehicle, the instruction information, and the interface display method of the in-vehicle display screen;

[0101] Obtain the current face information of the occupants in the vehicle from the camera;

[0102] Obtain the current instruction information from the instruction receiving device;

[0103] According to the first correspondence relationship, determine the interface display method corresponding to the current face information of the occupants in the vehicle and the current instruction information.

[0104] The system of this embodiment is cooperated by a camera 21, an instruction receiving device 22, an in-vehicle display screen 23, a processor 24 and a memory 25. The in-vehicle personnel face information, instruction information and the interface display mode of the in-vehicle display screen are corresponded through a set first correspondence relationship. The corresponding interface display mode is determined by the currently obtained in-vehicle personnel face information and the currently obtained instruction information, and the interface display of the in-vehicle display screen is automatically controlled. This interface display mode is adapted to the in-vehicle personnel and control operations in the current scenario, which can avoid privacy leakage and ensure the information security of the driver.

[0105] In an alternative manner, Figure 5 An alternative structure of the system of this embodiment is shown, in which the instruction receiving device 22 includes a voice receiver 221. Obtaining the current instruction information from the instruction receiving device includes obtaining the current voice instruction information from the voice receiver. In this way, the current voice instruction information is obtained through the voice receiver, which is convenient for the user to input instructions.

[0106] In an alternative manner, as Figure 5 shown, the instruction receiving device 22 includes a button or a touch screen 222. Obtaining the current instruction information from the instruction receiving device includes obtaining the current manual instruction information from the button or the touch screen. In this way, the current manual instruction information is obtained through the button or the touch screen, which enriches the form of instruction input and increases the ways to control the display of the in-vehicle display screen.

[0107] In an alternative manner, the display control system is arranged inside the vehicle. In this way, by arranging the display control system inside the vehicle, it is convenient to obtain relevant information inside the vehicle (such as the currently obtained in-vehicle personnel face information and the currently obtained instruction information).

[0108] In an alternative manner, the in-vehicle personnel face information includes: whether it includes the face information of whitelist personnel, and whether it includes the face information of non-whitelist personnel; and / or, the instruction information includes whether it includes voice instruction information, and whether it includes manual instruction information.

[0109] In an alternative manner, the first correspondence relationship includes: when the in-vehicle personnel face information has only the face information of whitelist personnel and the instruction information includes voice instruction information, the corresponding interface display mode is to display the interface of the in-vehicle display screen according to the voice instruction information; when the in-vehicle personnel face information has only the face information of whitelist personnel and the instruction information includes manual instruction information, the corresponding interface display mode is to display the interface of the in-vehicle display screen according to the manual instruction information.

[0110] In an alternative manner, displaying the interface of the in-vehicle display screen according to the voice command information includes: determining whether to display the interface of the in-vehicle display screen based on whether the voice command information is the voice command information issued by a whitelisted person. Among them, if the voice command information is the voice command information issued by a whitelisted person, the interface of the in-vehicle display screen is displayed; if the voice command information is not the voice command information issued by a whitelisted person, the interface of the in-vehicle display screen is not displayed.

[0111] In an alternative manner, the first correspondence includes: when the face information of the in-vehicle personnel simultaneously includes the face information of a whitelisted person and the face information of a non-whitelisted person, or the face information of the in-vehicle personnel has and only has the face information of a non-whitelisted person, or the face information of the in-vehicle personnel simultaneously does not include the face information of a whitelisted person and the face information of a non-whitelisted person, the corresponding interface display method is not to display the interface of the in-vehicle display screen.

[0112] In an alternative manner, before the step of obtaining the current face information of the in-vehicle personnel and the command information, the following steps are further included: setting a second correspondence when the interface of the in-vehicle display screen is not displayed, and the second correspondence includes the correspondence between the command information and the command response method; after the step of determining the interface display method corresponding to the current face information of the in-vehicle personnel and the current command information according to the first correspondence, if the interface display method corresponding to the current face information of the in-vehicle personnel and the current command information is not to display the interface of the in-vehicle display screen, the following is further included: determining the command response method corresponding to the obtained command information according to the second correspondence.

[0113] In an alternative manner, the second correspondence includes: when the command information includes voice command information, responding to the voice command information in the background; when the command information includes manual command information, not responding to the manual command information.

[0114] In an alternative manner, the step of responding to the voice command information in the background according to the voice command information includes: determining whether to respond to the voice command information in the background based on whether the voice command information is the voice command information issued by a whitelisted person. Among them, if the voice command information is the voice command information issued by a whitelisted person, respond to the voice command information in the background; if the voice command information is not the voice command information issued by a whitelisted person, do not respond to the voice command information in the background.

[0115] In an alternative manner, before the step of obtaining the current in-vehicle personnel face information and instruction information, the following steps are further included: determining whether the privacy protection switch is turned on; if the privacy protection switch is turned on, then performing the steps of obtaining the current in-vehicle personnel face information and the current instruction information, and determining the interface display mode corresponding to the current in-vehicle personnel face information and the current instruction information according to the first correspondence relationship; if the privacy protection switch is not turned on, then obtaining the current instruction information and determining the interface display mode of the vehicle-mounted display screen according to the current instruction information.

[0116] Embodiment 3

[0117] Figure 6 FIG. is a schematic structural diagram of an electronic device provided in Embodiment 3 of the present invention. The electronic device includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the steps of the display control method of the vehicle-mounted display screen in Embodiment 1. Figure 6 The displayed electronic device 30 is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present invention.

[0118] As Figure 6 shown, the electronic device 30 may be presented in the form of a general-purpose computing device, for example, it may be a server device. The components of the electronic device 30 may include, but are not limited to: the at least one processor 31 described above, the at least one memory 32 described above, and a bus 33 connecting different system components (including the memory 32 and the processor 31).

[0119] The bus 33 includes a data bus, an address bus, and a control bus.

[0120] The memory 32 may include volatile memory, such as a random access memory (RAM) 321 and / or a cache memory 322, and may further include a read-only memory (ROM) 323.

[0121] The memory 32 may further include a program / utilities 325 having a set (at least one) of program modules 324. Such program modules 324 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment.

[0122] The processor 31 executes various functional applications and data processing by running the computer program stored in the memory 32, such as the display control method of the vehicle-mounted display screen in Embodiment 1 of the present invention.

[0123] The electronic device 30 can also communicate with one or more external devices 34 (such as a keyboard, a pointing device, etc.). Such communication can be carried out through the input / output (I / O) interface 35. Moreover, the electronic device 30 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 36. As Figure 6 shown, the network adapter 36 communicates with other modules of the electronic device 30 through the bus 33. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the electronic device 30, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID (redundant array of independent disks) systems, tape drives, and data backup storage systems, etc.

[0124] It should be noted that, although several units / modules or sub-units / modules of the electronic device are mentioned in the above detailed description, this division is merely exemplary and not mandatory. In fact, according to the embodiments of the present invention, the features and functions of two or more of the above-described units / modules can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided and embodied by multiple units / modules.

[0125] Embodiment 4

[0126] This embodiment provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the steps in the display control method of the in-vehicle display screen in Embodiment 1 are implemented.

[0127] Among them, the more specific forms that the readable storage medium can adopt can include but are not limited to: portable disks, hard disks, random access memories, read-only memories, erasable programmable read-only memories, optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0128] In a possible implementation manner, the present invention can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to enable the terminal device to execute the steps in the display control method of the in-vehicle display screen in Embodiment 1.

[0129] Among them, the program code for executing the present invention can be written in any combination of one or more programming languages. The program code can be executed entirely on the user device, partially on the user device, executed as an independent software package, partially on the user device and partially on a remote device, or executed entirely on a remote device.

[0130] Although the specific embodiments of the present invention have been described above, those skilled in the art should understand that this is only an example, and the protection scope of the present invention is defined by the appended claims. Without departing from the principle and essence of the present invention, those skilled in the art can make various changes or modifications to these embodiments, but these changes and modifications all fall within the protection scope of the present invention.

Claims

1. A display control method for an in-vehicle display screen, characterized in that, Including the following steps: Set a first correspondence relationship, where the first correspondence relationship includes the correspondence relationship between the face information of the vehicle occupants, the instruction information, and the interface display mode of the vehicle-mounted display screen; Obtain the current face information of the vehicle occupants and the current instruction information; According to the first correspondence relationship, determine the interface display mode corresponding to the current face information of the vehicle occupants and the current instruction information; Before the step of obtaining the current face information of the vehicle occupants and the current instruction information, the following steps are further included: Set a second correspondence relationship when the interface of the vehicle-mounted display screen is not displayed, where the second correspondence relationship includes the correspondence relationship between the instruction information and the instruction response mode; After the step of determining the interface display mode corresponding to the current face information of the vehicle occupants and the current instruction information according to the first correspondence relationship, if the interface display mode corresponding to the current face information of the vehicle occupants and the current instruction information is not to display the interface of the vehicle-mounted display screen, the following is further included: According to the second correspondence relationship, determine the instruction response mode corresponding to the obtained instruction information; The second correspondence relationship includes: When the instruction information includes voice instruction information, respond to the voice instruction information in the background according to the voice instruction information; When the instruction information includes manual instruction information, do not respond to the manual instruction information.

2. The display control method of the in-vehicle display screen according to claim 1, wherein the in-vehicle personnel face information includes: Whether it includes the face information of the whitelist personnel and whether it includes the face information of the non-whitelist personnel; And / or, the instruction information includes whether it includes voice instruction information and whether it includes manual instruction information.

3. The display control method of the vehicle-mounted display screen according to claim 2, where the first correspondence relationship includes: When the face information of the vehicle occupants has only the face information of the whitelist personnel and the instruction information includes the voice instruction information, the corresponding interface display mode is to display the interface of the vehicle-mounted display screen according to the voice instruction information; When the face information of the vehicle occupants has only the face information of the whitelist personnel and the instruction information includes the manual instruction information, the corresponding interface display mode is to display the interface of the vehicle-mounted display screen according to the manual instruction information.

4. The display control method of the vehicle-mounted display screen according to claim 3, where displaying the interface of the vehicle-mounted display screen according to the voice instruction information includes: Judge whether to display the interface of the vehicle-mounted display screen according to whether the voice instruction information is the voice instruction information issued by the whitelist personnel. Among them, if the voice instruction information is the voice instruction information issued by the whitelist personnel, display the interface of the vehicle-mounted display screen; if the voice instruction information is not the voice instruction information issued by the whitelist personnel, do not display the interface of the vehicle-mounted display screen.

5. The display control method of the vehicle-mounted display screen according to claim 2, where the first correspondence relationship includes: When the face information of the person in the vehicle simultaneously includes the face information of the whitelist person and the face information of the non-whitelist person, or the face information of the person in the vehicle has and only has the face information of the non-whitelist person, or the face information of the person in the vehicle simultaneously does not include the face information of the whitelist person and the face information of the non-whitelist person, the corresponding interface display method is to not display the interface of the in-vehicle display screen.

6. The display control method of the in-vehicle display screen according to claim 1, the step of responding to the voice command information in the background according to the voice command information includes: Judging whether to respond to the voice command information in the background according to whether the voice command information is the voice command information issued by the whitelist person. Among them, if the voice command information is the voice command information issued by the whitelist person, then respond to the voice command information in the background. If the voice command information is not the voice command information issued by the whitelist person, then do not respond to the voice command information in the background.

7. The display control method of the in-vehicle display screen according to claim 1, before the step of obtaining the current face information of the person in the vehicle and the current command information, further includes the following steps: Judging whether the privacy protection switch is turned on; If the privacy protection switch is turned on, then execute the steps of obtaining the current face information of the person in the vehicle and the current command information, and determining the interface display method corresponding to the current face information of the person in the vehicle and the current command information according to the first corresponding relationship; If the privacy protection switch is not turned on, then obtain the current command information, and determine the interface display method of the in-vehicle display screen according to the current command information.

8. A display control system, characterized in that, Including: Camera; Command receiving device; In-vehicle display screen; One or more processors, the one or more processors communicate with the camera, the command receiving device and the in-vehicle display screen; And A memory, the memory is configured to store instructions, when the instructions are executed by the one or more processors, the one or more processors execute steps, and the steps include: Setting a first corresponding relationship, the first corresponding relationship includes the corresponding relationship between the face information of the person in the vehicle, the command information and the interface display method of the in-vehicle display screen; Obtaining the current face information of the person in the vehicle from the camera; Obtaining the current command information from the command receiving device; Determining the interface display method corresponding to the current face information of the person in the vehicle and the current command information according to the first corresponding relationship; Before the step of obtaining the current face information of the person in the vehicle and the current command information, further includes the following steps: Setting a second corresponding relationship when the interface of the in-vehicle display screen is not displayed, the second corresponding relationship includes the corresponding relationship between the command information and the command response method; After the step of determining the interface display mode corresponding to the current in-vehicle occupant face information and the current instruction information according to the first corresponding relationship, if the interface display mode corresponding to the current in-vehicle occupant face information and the current instruction information is not to display the interface of the in-vehicle display screen, the method further includes: Determining an instruction response mode corresponding to the obtained instruction information according to the second corresponding relationship; The second corresponding relationship includes: When the instruction information includes voice instruction information, responding to the voice instruction information in the background according to the voice instruction information; When the instruction information includes manual instruction information, not responding to the manual instruction information.

9. The display control system according to claim 8, wherein the instruction receiving device comprises: Voice receiver; Obtaining the current instruction information from the instruction receiving device includes obtaining the current voice instruction information from the voice receiver.

10. The display control system according to claim 8, wherein the instruction receiving device includes a button or a touch screen; Obtaining the current instruction information from the instruction receiving device includes obtaining the current manual instruction information from the button or the touch screen.

11. The display control system according to claim 8, wherein the display control system is disposed inside a vehicle.

12. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, the steps of the display control method of the in-vehicle display screen according to any one of claims 1 to 7 are implemented.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the steps of the display control method of the in-vehicle display screen according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Privacy information control system and method

    CN107465678A

  • Vehicle-mounted identity recognition method and system

    CN110712621A