Copilot screen control method and device of vehicle, vehicle and storage medium method

Abstract

The invention relates to the technical field of intelligent cabins, in particular to a copilot screen control method and device of a vehicle, the vehicle and a storage medium method.The method comprises the steps that under the condition that the vehicle enters a copilot screen memory mode, face information of a user is obtained; obtaining a target identity label of the user based on the face information, and matching historical operation information by using the target identity label; and determining at least one associated application data based on the historical operation information, generating an application response action of the co-driver screen according to the at least one associated application data, and controlling the co-driver screen to execute the application response action so as to recover the historical operation state of the co-driver screen under the target identity identification condition. According to the embodiment of the invention, identity authentication can be carried out through face recognition, so that the historical operation information of the corresponding user on the co-driver screen is obtained, the historical page of the user on the co-driver screen is further restored, personalized co-driver screen use experience is provided, automatic adjustment of the co-driver screen is realized, and the intelligent level of the vehicle is improved.

Description

Technical Field

[0001] The present application relates to the field of smart cockpit technology, and in particular to a method and device for controlling a passenger screen of a vehicle, a vehicle, and a storage medium method. Background Art

[0002] With the continuous development of smart vehicles and cloud computing technology, in-vehicle screens have become a common configuration of cars. In related technologies, the co-pilot screen is a commonly used in-vehicle screen that can provide passengers with entertainment, navigation and other diversified services while improving the driving experience.

[0003] However, in the related technologies, the application data management of the existing co-pilot screen lacks personalized functional design, and it is difficult to combine the vehicle's limited local storage and the cloud for intelligent control of the co-pilot screen, which limits the functional expansion of the co-pilot screen, making it difficult for users to memorize and restore historical operations, and unable to meet the diverse needs of users. The practicality is insufficient and needs to be solved urgently. Summary of the invention

[0004] The present application provides a vehicle passenger screen control method, device, vehicle and storage medium method to solve the problems in the related technology that the application data management of the existing passenger screen lacks personalized function design, it is difficult to combine the limited local storage of the vehicle and the cloud to perform intelligent control of the passenger screen, which limits the function expansion of the passenger screen, makes it difficult for users to memorize and restore historical operations, cannot meet the diverse needs of users, and is insufficient in practicality.

[0005] A first aspect of the present application provides a method for controlling a passenger screen of a vehicle, which is applied to a cloud server and includes the following steps: when the vehicle enters a passenger screen memory mode, obtaining facial information of a user; obtaining a target identity of the user based on the facial information, and matching historical operation information with the target identity; confirming at least one associated application data based on the historical operation information, generating an application response action of the passenger screen according to the at least one associated application data, and controlling the passenger screen to execute the application response action to restore the historical operation state of the passenger screen under the target identity condition.

[0006] Optionally, in one embodiment of the present application, obtaining the target identity of the user based on the facial information includes: based on a pre-built user face database, detecting whether there is a corresponding identity for the facial information; if the corresponding identity exists in the facial information, determining that the corresponding identity is the target identity, otherwise, creating the current identity of the user based on the facial information, and updating the pre-built user face database according to the current identity.

[0007] Optionally, in one embodiment of the present application, after controlling the co-pilot screen to execute the application response action, it also includes: collecting the user's manual operation instructions, and generating current associated application data according to the manual operation instructions; at preset intervals, updating the user's historical operation information based on the current associated application data until the vehicle exits the co-pilot screen memory mode.

[0008] Optionally, in one embodiment of the present application, before confirming at least one associated application data based on the historical operation information, it also includes: detecting whether the update interval of the historical operation information is greater than or equal to a preset time threshold; if the update interval is greater than or equal to the preset time threshold, clearing the historical operation information.

[0009] Optionally, in one embodiment of the present application, before obtaining the user's facial information, it also includes: detecting whether the vehicle has a target command object and at least one passenger screen memory command; when it is detected that the vehicle has the target command object and the at least one passenger screen memory command, controlling the vehicle to enter the passenger screen memory mode.

[0010] A second aspect of the present application provides a co-pilot screen control device for a vehicle, which is applied to a cloud server, including: an acquisition module, used to acquire user facial information when the vehicle enters the co-pilot screen memory mode; a matching module, used to obtain a target identity identifier of the user based on the facial information, and use the target identity identifier to match historical operation information; a control module, used to confirm at least one associated application data based on the historical operation information, generate an application response action of the co-pilot screen according to the at least one associated application data, and control the co-pilot screen to execute the application response action to restore the historical operation state of the co-pilot screen under the target identity identifier condition.

[0011] Optionally, in one embodiment of the present application, the matching module includes: a detection unit, used to detect whether the facial information has a corresponding identity identifier based on a pre-built user face database; a judgment unit, used to determine that the corresponding identity identifier is the target identity identifier when the corresponding identity identifier exists in the facial information, otherwise, create the current identity identifier of the user based on the facial information, and update the pre-built user face database according to the current identity identifier.

[0012] Optionally, in one embodiment of the present application, the device also includes: a collection module, used to collect the user's manual operation instructions after controlling the co-pilot screen to execute the application response action, and generate current associated application data according to the manual operation instructions; an update module, used to update the user's historical operation information based on the current associated application data at preset intervals until the vehicle exits the co-pilot screen memory mode.

[0013] Optionally, in one embodiment of the present application, the device also includes: a first detection module, used to detect whether the update interval of the historical operation information is greater than or equal to a preset time threshold before confirming at least one associated application data based on the historical operation information; and a clearing module, used to clear the historical operation information when the update interval is greater than or equal to the preset time threshold.

[0014] Optionally, in one embodiment of the present application, the device also includes: a second detection module, used to detect whether the vehicle has a target command object and at least one passenger screen memory command before obtaining the user's facial information; a start module, used to control the vehicle to enter the passenger screen memory mode when it is detected that the vehicle has the target command object and the at least one passenger screen memory command.

[0015] The third aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle's co-pilot screen control method as described in the above embodiment.

[0016] The fourth aspect of the present application provides a computer-readable storage medium, which stores a computer program. When the program is executed by a processor, it implements the above-mentioned method for controlling the passenger screen of the vehicle.

[0017] The fifth aspect of the present application provides a computer program, which, when executed, implements the above-mentioned method for controlling the passenger screen of a vehicle.

[0018] The sixth aspect of the present application provides a cloud server for implementing the above-mentioned method for controlling the passenger screen of a vehicle.

[0019] The embodiment of the present application can perform identity authentication through facial recognition, thereby obtaining the historical operation information of the corresponding user on the co-pilot screen, so as to further restore the historical page of the user on the co-pilot screen, provide a personalized co-pilot screen usage experience, realize the automatic adjustment of the co-pilot screen, and improve the intelligence level of the vehicle. Therefore, it solves the problems in the related technology that the application data management of the existing co-pilot screen lacks personalized function design, it is difficult to combine the limited local storage of the vehicle and the cloud to perform intelligent control of the co-pilot screen, which limits the function expansion of the co-pilot screen, makes it difficult for users to memorize and restore historical operations, cannot meet the diverse needs of users, and is insufficient in practicality.

[0020] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0022] Figure 1 A flowchart of a method for controlling a passenger screen of a vehicle provided according to an embodiment of the present application;

[0023] Figure 2 A schematic diagram of the process of uploading biological information to the cloud according to an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the process of uploading historical operation information of an embodiment of the present application;

[0025] Figure 4 A schematic diagram of a process for sending historical operation information according to an embodiment of the present application;

[0026] Figure 5 This is a schematic diagram of the co-pilot screen control architecture of an embodiment of the present application;

[0027] Figure 6 Schematic diagram of the structure of a co-pilot screen control device of a vehicle according to an embodiment of the present application;

[0028] Figure 7 It is a schematic diagram of the structure of a vehicle according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0030] The following describes the vehicle's co-pilot screen control method, device, vehicle and storage medium method of the embodiment of the present application with reference to the accompanying drawings. In view of the related technologies mentioned in the above background technology, the existing co-pilot screen application data management lacks personalized function design, it is difficult to combine the limited local storage of the vehicle and the cloud to perform intelligent control of the co-pilot screen, which limits the function expansion of the co-pilot screen, resulting in users being difficult to memorize and restore historical operations, unable to meet the diverse needs of users, and insufficient practicality. The present application provides a vehicle co-pilot screen control method, in which identity authentication can be performed through facial recognition, so as to obtain the corresponding user's historical operation information on the co-pilot screen, so as to further restore the user's historical page on the co-pilot screen, provide a personalized co-pilot screen usage experience, realize the automatic adjustment of the co-pilot screen, and improve the vehicle's intelligence level. Therefore, the problem that the existing co-pilot screen application data management lacks personalized function design in the related technology, it is difficult to combine the limited local storage of the vehicle and the cloud to perform intelligent control of the co-pilot screen, which limits the function expansion of the co-pilot screen, resulting in users being difficult to memorize and restore historical operations, unable to meet the diverse needs of users, and insufficient practicality is solved.

[0031] Specifically, Figure 1 A schematic flow chart of a method for controlling a passenger screen of a vehicle provided in an embodiment of the present application.

[0032] like Figure 1 As shown, the vehicle's co-pilot screen control method includes the following steps:

[0033] In step S101, when the vehicle enters the passenger screen memory mode, the user's facial information is obtained.

[0034] It can be understood that in the embodiment of the present application, the specific function of the co-pilot screen memory mode can be manifested as allowing the vehicle's co-pilot display screen to automatically adjust the display content and layout according to the preferences and habits of different users. The user's facial information may refer to the user's facial feature data or facial pictures captured by a camera or other visual sensors.

[0035] Optionally, in one embodiment of the present application, before obtaining the user's facial information, it also includes: detecting whether the vehicle has a target command object and at least one passenger screen memory command; when it is detected that the vehicle has a target command object and at least one passenger screen memory command, controlling the vehicle to enter the passenger screen memory mode.

[0036] In the actual execution process, the passenger screen memory command may be a command issued by the user to activate the passenger screen memory mode, such as a voice command or a button operation, etc. The target command object may be an identified passenger screen operator, such as a user in the passenger seat.

[0037] In step S102, the target identity of the user is obtained based on the facial information, and the target identity is used to match the historical operation information.

[0038] It is understandable that in the embodiment of the present application, the target identity identifier can be an identifier obtained by matching the user's facial information, so as to identify and distinguish different users. The historical operation information can be the user's past behavior data when using the co-pilot screen, such as application usage records, preference settings, etc. By matching the facial information with the user information in the database, the user's identity is determined, and the user's historical operation information is retrieved.

[0039] Optionally, in one embodiment of the present application, obtaining a target identity of a user based on facial information includes: based on a pre-built user face database, detecting whether there is a corresponding identity for the facial information; if there is a corresponding identity for the facial information, determining the corresponding identity as the target identity, otherwise, creating a current identity of the user based on the facial information, and updating the pre-built user face database according to the current identity.

[0040] In the actual implementation process, the user face database includes pre-stored user facial feature data and identity tags, which are used to identify and verify the user's identity. If it is detected that the face information matches an identity tag in the database, the identity tag is determined to be the target identity tag. If the face information does not match the record in the database, the user is determined to be a new user and a new identity tag is created based on the face information. For example, Figure 2 FIG. 1 is a flow chart of uploading biological information to the cloud in one embodiment of the present application, wherein:

[0041] Step S201: Capture the portrait of the front passenger user through the camera recognition module.

[0042] Among them, after the passenger seat user gets on the car, the biometric recognition module takes a picture of the user and collects the user's biometric information.

[0043] Step S202: The host obtains the portrait information recognized by the camera.

[0044] Among them, after the biometric module sends the biometric information to the vehicle-mounted host system, the host system converts the biometric information into data in String format.

[0045] Step S203: Upload the portrait information to the cloud via the vehicle-mounted Tbox.

[0046] Among them, the host system uploads the user's biometric information data to the cloud server through the on-board TBOX module via the HTTP interface.

[0047] Step S204: The cloud obtains the portrait information and compares it with the database.

[0048] The user's biological data is obtained from the cloud server and compared with the database to see whether there is the user's biological information.

[0049] Step S205: After the cloud compares the information, if there is no such person information, a new user ID is created to associate with the application data.

[0050] If the user's biometric information is not matched, a new user ID is created using the user information and stored in the cloud database.

[0051] In step S103, at least one associated application data is confirmed based on the historical operation information, an application response action of the co-pilot screen is generated according to the at least one associated application data, and the co-pilot screen is controlled to execute the application response action to restore the historical operation state of the co-pilot screen under the target identity identification conditions.

[0052] It can be understood that in the embodiment of the present application, the associated application data may be the historical records of application usage and preference settings related to the user, such as the user's frequently used navigation application or preferred music playback, etc. An application response action is obtained based on at least one associated application data, and the application response action is executed to restore the co-pilot screen to the usage state when the user last closed it.

[0053] Optionally, in one embodiment of the present application, after controlling the co-pilot screen to execute the application response action, it also includes: collecting the user's manual operation instructions, and generating current associated application data according to the manual operation instructions; updating the user's historical operation information based on the current associated application data at preset intervals until the vehicle exits the co-pilot screen memory mode.

[0054] It should be noted that the preset interval time can be set by those skilled in the art according to actual conditions and is not specifically limited here.

[0055] In the actual execution process, the manual operation instruction can be a direct operation of the user on the application on the co-pilot screen, such as touching the screen, using physical buttons or voice commands, etc. The current associated application data can be the application data currently used or configured by the user obtained according to the manual operation instruction, such as navigation settings, music playlists, etc. By obtaining the associated application data, the user's historical operation information is updated with the current associated application data at preset intervals until the vehicle is powered off or the memory mode is exited, so as to obtain the user's latest historical data.

[0056] For example, Figure 3 The figure shows a schematic diagram of the process of uploading historical operation information of an embodiment of the present application, wherein:

[0057] Step S301: The user manually opens the application, and the page currently opened by the user and the data are recorded.

[0058] Among them, when the user manually operates the application, such as opening the navigation, opening the video playback platform, or using the music software, the car system saves the current user's application behavior every 15 seconds.

[0059] Step S302: Store in a local database through the host system.

[0060] The host system stores the data in a local database every 15 seconds.

[0061] Step S303: When the car is in a power-off state, the host system uploads the last piece of user behavior data in the database.

[0062] Among them, when the car's ignition off button is pressed and the onboard system is in a power-off state, the user's application operation behavior data in the data is sent to the cloud through the interface.

[0063] Step S304: The cloud obtains the uploaded user behavior data through the interface and associates it with the current user ID for storage.

[0064] After the cloud obtains the user's application operation behavior data, it associates the data with the current user's ID and stores it in the cloud database.

[0065] Optionally, in one embodiment of the present application, before confirming at least one associated application data based on historical operation information, it also includes: detecting whether the update interval of the historical operation information is greater than or equal to a preset time threshold; if the update interval is greater than or equal to the preset time threshold, clearing the historical operation information.

[0066] It should be noted that the preset time threshold can be set by those skilled in the art according to actual conditions and is not specifically limited here.

[0067] In actual execution, the update interval of historical operation information can be the length of time from the last time the co-pilot screen updated the user's historical operation information to the current time point. If the update interval is greater than or equal to the preset time threshold, the system will perform a zeroing operation to prevent the accumulation of outdated data in the historical operation information.

[0068] The working content of the embodiment of the present application is described in detail below with a specific embodiment. Figure 4 FIG. 1 is a flow chart of sending historical operation information according to an embodiment of the present application, wherein:

[0069] Step S401: The cloud associates the application habits and data used by the user through the user ID.

[0070] Among them, the cloud obtains the current user's application usage behavior data in the database according to the user ID.

[0071] Step S402: The cloud returns the user's application data habits through an interface.

[0072] Among them, the user's application usage behavior data is returned through the interface callback form.

[0073] Step S403: Feedback the data to the host system through the vehicle-mounted Tbox module.

[0074] Among them, the information is transmitted to the host system through Tbox.

[0075] Step S404: The host obtains the application data used by the user in the cloud, starts the application corresponding to the secondary screen, and opens the page used last time.

[0076] Among them, after the host system obtains the user behavior data sent from the cloud, it can be applied in: Scenario 1, user A last used a certain playback software and was playing the first episode of a certain video. When the progress bar was at 40 minutes, the corresponding application on the secondary screen was automatically started and opened to the page node that was opened last time; Scenario 2, user B is a child, and the last behavior data when he was in the co-pilot seat was the second lesson in a certain English APP. This time, the application will be automatically started and jump to the page of the second lesson to continue playing.

[0077] Figure 5 This is a schematic diagram of the co-pilot screen control architecture of an embodiment of the present application, which is composed of a user, an identification component, an onboard host system, a communication component Tbox, a cloud server, an onboard co-pilot screen, and a host system database. The co-pilot screen is used to display the current application interface and connect to the onboard system; the identification component is used to identify the passenger identity and send the identification result to the onboard system; the cloud server is used to store the user ID and the application information used by the user after getting on the car, thereby realizing the above co-pilot screen control process.

[0078] According to the vehicle co-pilot screen control method proposed in the embodiment of the present application, identity authentication can be performed through facial recognition, thereby obtaining the historical operation information of the corresponding user on the co-pilot screen, so as to further restore the user's historical page on the co-pilot screen, provide a personalized co-pilot screen usage experience, realize the automatic adjustment of the co-pilot screen, and improve the intelligence level of the vehicle. Therefore, the problem in the related technology that the application data management of the existing co-pilot screen lacks personalized function design, it is difficult to combine the limited local storage of the vehicle and the cloud for intelligent control of the co-pilot screen, which limits the function expansion of the co-pilot screen, makes it difficult for users to memorize and restore historical operations, cannot meet the diverse needs of users, and is insufficient in practicality is solved.

[0079] Next, the passenger screen control device of a vehicle proposed in an embodiment of the present application will be described with reference to the accompanying drawings.

[0080] Figure 6 It is a schematic diagram of the structure of the passenger screen control device of the vehicle according to an embodiment of the present application.

[0081] like Figure 6 As shown, the co-pilot screen control device 10 of the vehicle includes: an acquisition module 100, a matching module 200 and a control module 300.

[0082] Among them, the acquisition module 100 is used to obtain the user's facial information when the vehicle enters the co-pilot screen memory mode.

[0083] The matching module 200 is used to obtain the target identity of the user based on the face information, and use the target identity to match the historical operation information.

[0084] The control module 300 is used to confirm at least one associated application data based on historical operation information, generate an application response action of the co-pilot screen according to the at least one associated application data, and control the co-pilot screen to execute the application response action to restore the historical operation state of the co-pilot screen under the target identity identification conditions.

[0085] Optionally, in one embodiment of the present application, the matching module 200 includes:

[0086] A detection unit, used to detect whether the facial information has a corresponding identity identifier based on a pre-built user face database;

[0087] The determination unit is used to determine that the corresponding identity identifier is the target identity identifier when there is a corresponding identity identifier for the facial information; otherwise, the current identity identifier of the user is created based on the facial information, and a pre-built user face database is updated according to the current identity identifier.

[0088] Optionally, in one embodiment of the present application, the device 10 further includes:

[0089] A collection module, used to collect the user's manual operation instructions after controlling the co-pilot screen to execute the application response action, and generate current associated application data according to the manual operation instructions;

[0090] The update module is used to update the user's historical operation information based on the current associated application data at preset intervals until the vehicle exits the co-pilot screen memory mode.

[0091] Optionally, in one embodiment of the present application, the device 10 further includes:

[0092] A first detection module, used for detecting whether an update interval of the historical operation information is greater than or equal to a preset time threshold before confirming at least one associated application data based on the historical operation information;

[0093] The clearing module is used to clear the historical operation information when the update interval is greater than or equal to the preset time threshold.

[0094] Optionally, in one embodiment of the present application, the device 10 further includes:

[0095] The second detection module is used to detect whether there is a target instruction object and at least one co-pilot screen memory instruction in the vehicle before obtaining the user's face information;

[0096] The starting module is used to control the vehicle to enter the co-pilot screen memory mode when it is detected that the vehicle has a target instruction object and at least one co-pilot screen memory instruction.

[0097] It should be noted that the above explanation of the embodiment of the vehicle's passenger screen control method is also applicable to the vehicle's passenger screen control device of this embodiment, and will not be repeated here.

[0098] According to the vehicle's co-pilot screen control device proposed in the embodiment of the present application, identity authentication can be performed through facial recognition, thereby obtaining the corresponding user's historical operation information on the co-pilot screen, so as to further restore the user's historical page on the co-pilot screen, provide a personalized co-pilot screen usage experience, realize the automatic adjustment of the co-pilot screen, and improve the vehicle's intelligence level. As a result, the problem in the related technology that the application data management of the existing co-pilot screen lacks personalized functional design, it is difficult to combine the vehicle's limited local storage and the cloud for intelligent control of the co-pilot screen, which limits the function expansion of the co-pilot screen, making it difficult for users to memorize and restore historical operations, unable to meet the diverse needs of users, and insufficient practicality is solved.

[0099] Figure 7 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0100] A memory 701 , a processor 702 , and a computer program stored in the memory 701 and executable on the processor 702 .

[0101] When the processor 702 executes the program, the vehicle's co-pilot screen control method provided in the above embodiment is implemented.

[0102] Furthermore, the vehicle also includes:

[0103] The communication interface 703 is used for communication between the memory 701 and the processor 702 .

[0104] The memory 701 is used to store computer programs that can be executed on the processor 702 .

[0105] The memory 701 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0106] If the memory 701, the processor 702 and the communication interface 703 are implemented independently, the communication interface 703, the memory 701 and the processor 702 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0107] Optionally, in a specific implementation, if the memory 701, the processor 702 and the communication interface 703 are integrated on a chip, the memory 701, the processor 702 and the communication interface 703 can communicate with each other through an internal interface.

[0108] The processor 702 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0109] This embodiment also provides a computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, the above-mentioned method for controlling the passenger screen of the vehicle is implemented.

[0110] This embodiment also provides a computer program, which implements the above-mentioned vehicle passenger screen control method when executed.

[0111] This embodiment also provides a cloud server for implementing the above-mentioned vehicle passenger screen control method.

[0112] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0113] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0114] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0115] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways as necessary and then storing it in a computer memory.

[0116] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0117] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0118] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0119] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for controlling a passenger screen of a vehicle, characterized in that: Applied to cloud servers, including the following steps: When the vehicle enters the co-pilot screen memory mode, obtain the user's facial information; Obtaining a target identity of the user based on the facial information, and matching historical operation information using the target identity; Based on the historical operation information, at least one associated application data is confirmed, an application response action of the co-pilot screen is generated according to the at least one associated application data, and the co-pilot screen is controlled to execute the application response action to restore the historical operation state of the co-pilot screen under the target identity identification condition.

2. The method according to claim 1, characterized in that The obtaining the target identity of the user based on the facial information includes: Based on a pre-built user face database, detecting whether the face information has a corresponding identity identifier; If the facial information has the corresponding identity identifier, the corresponding identity identifier is determined to be the target identity identifier; otherwise, the current identity identifier of the user is created based on the facial information, and the pre-built user face database is updated according to the current identity identifier.

3. The method according to claim 1, characterized in that: After controlling the co-pilot screen to execute the application response action, the method further includes: Collecting manual operation instructions of the user, and generating current associated application data according to the manual operation instructions; At preset intervals, the historical operation information of the user is updated based on the currently associated application data until the vehicle exits the co-pilot screen memory mode.

4. The method according to claim 1, characterized in that Before confirming at least one associated application data based on the historical operation information, the method further includes: Detecting whether the update interval of the historical operation information is greater than or equal to a preset time threshold; If the update interval is greater than or equal to the preset time threshold, the historical operation information is cleared.

5. The method according to claim 1, characterized in that: Before obtaining the user's face information, it also includes: Detecting whether the vehicle has a target command object and at least one passenger screen memory command; When it is detected that the vehicle has the target instruction object and the at least one passenger screen memory instruction, the vehicle is controlled to enter the passenger screen memory mode.

6. A vehicle co-pilot screen control device, characterized in that: Applied to cloud servers, including: The acquisition module is used to obtain the user's facial information when the vehicle enters the co-pilot screen memory mode; A matching module, used to obtain a target identity of the user based on the face information, and match historical operation information using the target identity; A control module is used to confirm at least one associated application data based on the historical operation information, generate an application response action of the co-pilot screen according to the at least one associated application data, and control the co-pilot screen to execute the application response action to restore the historical operation state of the co-pilot screen under the target identity identification condition.

7. The device according to claim 6, characterized in that The matching module comprises: A detection unit, configured to detect whether the facial information has a corresponding identity identifier based on a pre-built user facial database; A determination unit is used to determine that the corresponding identity identifier is the target identity identifier when the corresponding identity identifier exists in the facial information; otherwise, create the current identity identifier of the user based on the facial information, and update the pre-built user face database according to the current identity identifier.

8. A cloud server, characterized in that: Used to implement the passenger screen control method of a vehicle as described in any one of claims 1-5.

9. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle's co-pilot screen control method as described in any one of claims 1 to 5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the passenger screen control method of a vehicle as described in any one of claims 1-5.

Images