Vehicle control method and vehicle

Abstract

The present disclosure relates to the field of vehicle technology, and discloses a vehicle control method and a vehicle, the method comprising: obtaining target interaction information of a target vehicle in multiple interaction modes; performing fusion analysis on each target interaction information to determine a vehicle control instruction; and controlling the target vehicle based on the vehicle control instruction. The present disclosure can solve the problem of difficulty in meeting vehicle control requirements in different scenarios.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to a vehicle control method and a vehicle. Background Art

[0002] Human-Computer Interaction (HCI) is a discipline that studies the interactive relationship between a system and a user. In related technologies, it is proposed to collect images taken by a camera on a vehicle, determine vehicle control instructions based on the human posture in the image, and control the vehicle according to the vehicle control instructions, thereby realizing human-computer interaction of the vehicle. However, this vehicle control method is difficult to meet the vehicle control requirements in different scenarios. Summary of the invention

[0003] In view of this, the present disclosure provides a vehicle control method and a vehicle to solve the problem that it is difficult to meet vehicle control requirements in different scenarios.

[0004] In a first aspect, the present disclosure provides a vehicle control method, the method comprising:

[0005] Obtain target interaction information of target vehicles in multiple interaction modes;

[0006] Performing fusion analysis on each target interaction information to determine vehicle control instructions;

[0007] The target vehicle is controlled based on the vehicle control instruction.

[0008] In this method, multiple interaction modes are used to obtain target interaction information, and then different target interaction information is fused and analyzed to determine vehicle control instructions. Therefore, different interaction modes can be used to interact in different scenarios to generate vehicle control instructions to control the target vehicle, thereby meeting vehicle control requirements in different scenarios.

[0009] In an optional embodiment, the method further includes:

[0010] Acquiring at least one vehicle operation information of the target vehicle;

[0011] Performing fusion analysis on the at least one vehicle operation information to obtain operation scene information of the target vehicle;

[0012] The display device of the target vehicle is controlled to display the operation scenario information, and the target interaction information is fed back based on the operation scenario information.

[0013] In this method, the operation scenario information is obtained by fusion analysis of different vehicle operation information of the target vehicle. Therefore, the operation scenario information can be used to provide more accurate and comprehensive vehicle status and environment information. The operation scenario information is displayed using a display device so that the driver and other passengers can send target interaction information through the operation scenario information, thereby improving the accuracy of vehicle control.

[0014] In an optional implementation, the performing fusion analysis on each of the target interaction information to determine the vehicle control instruction includes:

[0015] Performing intent analysis on each of the target interaction information based on the operation scenario information to determine the interaction intent corresponding to each of the target interaction information;

[0016] A fusion analysis is performed on each of the interaction intentions to determine the vehicle control instructions.

[0017] In this method, the intention analysis of each target interaction information is performed based on the operation scenario information to determine the interaction intention corresponding to each target interaction information. Therefore, the interaction intention represented by each target interaction information can be accurately identified in combination with the operation scenario information. Then, each interaction intention is fused and analyzed to determine the vehicle control command. Therefore, the stability of the vehicle control command can be ensured and conflicting vehicle control commands can be avoided.

[0018] In an optional implementation, the performing fusion analysis on each of the interaction intentions to determine the vehicle control instruction includes:

[0019] Acquire an interactive function configuration, where the interactive function configuration includes trigger instructions for multiple vehicle functions, where the trigger instructions are related to the interactive intention;

[0020] Analyze each of the interaction intentions based on the interaction function configuration, and determine a target vehicle function corresponding to each of the interaction intentions;

[0021] A fusion analysis is performed on each of the target vehicle-mounted functions to obtain the vehicle control instruction.

[0022] In this method, the target vehicle functions to be executed by each interaction intention are analyzed based on the interaction function configuration. Then, each target vehicle function is integrated and analyzed to obtain the vehicle control instruction. Therefore, the accuracy of vehicle control can be further improved.

[0023] In an optional implementation manner, the interactive function configuration is obtained by configuring the following steps:

[0024] In response to an interaction configuration instruction for an in-vehicle application, an interaction configuration page is displayed, wherein the interaction configuration page displays at least one interaction configuration item, wherein the interaction configuration item includes a function configuration item for configuring an in-vehicle function and an instruction configuration item for configuring a trigger instruction;

[0025] In response to a configuration operation on the at least one interaction configuration item, the interaction function configuration is determined and displayed.

[0026] In this method, in response to the interactive configuration instruction for the vehicle-mounted application, the interactive configuration page is displayed. Therefore, the vehicle-mounted functions of the vehicle-mounted application and their corresponding trigger instructions can be configured according to actual needs, thereby meeting the vehicle control needs in different scenarios.

[0027] In an optional implementation, controlling the display device of the target vehicle to display the operation scene information includes:

[0028] Obtaining access rights for passengers in the target vehicle, wherein the passengers include a driver;

[0029] If there are multiple access rights for the occupant, determining the lowest authority among the access rights;

[0030] Determine the displayable information in the running scenario information based on the minimum permission;

[0031] The display device of the target vehicle is controlled to display the displayable information.

[0032] In this method, the displayable information in the operating scenario information is displayed according to the lowest authority in the occupant's access rights. Therefore, it is possible to avoid the leakage of unauthorized information during human-computer interaction with the target vehicle, thereby ensuring the data security of the human-computer interaction.

[0033] In an optional embodiment, the method further includes:

[0034] Acquire first image information of a driver in the target vehicle;

[0035] Performing fatigue status analysis on the driver based on the first image information, and determining a fatigue status analysis result;

[0036] If the fatigue state analysis result indicates that the driver is fatigued, generating a prompt message;

[0037] The target vehicle is controlled to issue a reminder based on the prompt information.

[0038] In the method, the driver's fatigue state is monitored, and when the driver is fatigued, the target vehicle is controlled to issue a reminder, thereby preventing the driver from driving in fatigue and improving driving safety.

[0039] In an optional embodiment, the method further includes:

[0040] Acquire second image information of the driver in the target vehicle;

[0041] Tracking the driver's sight line based on the second image information to determine a target sight line;

[0042] The display position of the vehicle information is adjusted based on the target line of sight, and the vehicle information includes vehicle operation information and / or operation scene information.

[0043] In the method, the display position of the vehicle information is adjusted based on the target sight line of the driver, so that the driver can better obtain the vehicle information and improve driving safety.

[0044] In an optional embodiment, the method further includes:

[0045] Obtain user behavior data;

[0046] A display interface of a display device is adjusted based on the user behavior data, the display interface being used to display vehicle information, the vehicle information including vehicle operation information, operation scenario information, and at least one of vehicle-mounted applications.

[0047] In this method, the display interface of the display device is adjusted according to the user behavior data, so that the display interface can be more in line with the actual needs of the user, the display effect of the vehicle information is improved, and the user satisfaction is further improved.

[0048] In a second aspect, the present disclosure provides a vehicle, comprising:

[0049] Vehicle body;

[0050] A vehicle control system is used to execute any of the vehicle control methods described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0052] Figure 1 is a flow chart of a vehicle control method according to an embodiment of the present disclosure;

[0053] Figure 2is a structural block diagram of a vehicle control system according to an embodiment of the present disclosure;

[0054] Figure 3 is a structural block diagram of a hardware system according to an embodiment of the present disclosure;

[0055] Figure 4 It is a structural block diagram of a software system according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0057] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0058] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0059] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0060] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0061] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0062] Human-Computer Interaction (HCI) is a discipline that studies the interactive relationship between a system and a user. In related technologies, it is proposed to collect images taken by a camera on a vehicle, determine vehicle control instructions based on the human posture in the image, and control the vehicle according to the vehicle control instructions, thereby realizing human-computer interaction of the vehicle. However, this vehicle control method is difficult to meet the vehicle control requirements in different scenarios.

[0063] In view of this, according to an embodiment of the present disclosure, a vehicle control method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0064] In this embodiment, a vehicle control method is provided, which can be used in a vehicle control system of a target vehicle. Figure 1 is a flow chart of a vehicle control method according to an embodiment of the present disclosure, such as Figure 1 As shown, the process includes the following steps:

[0065] Step S101, obtaining target interaction information of a target vehicle in multiple interaction modes.

[0066] Specifically, vehicle interaction requirements are obtained through market research and user demand analysis. The introduction and finalization acceptance of vehicle interaction requirements are evaluated from a platform perspective, and carried out simultaneously with vehicle R&D, and the vehicle interaction requirements are converted into design goals to obtain the conceptual design of the target vehicle. After the functional definition and product development are agreed upon, the details and specific processes are designed. For example, subdivided modules such as product function configuration, interior design, market competitive product benchmarking, human factor analysis, hardware constraints, software constraints, functional requirement definition, interaction design, and visual design. Then, experience verification and design iteration are carried out through bench simulation testing or by providing specific evaluation vehicles and training vehicles. After system development, hardware development, software development, vehicle testing and evaluation, mass production trials are started, with "people-vehicle-environment" as the overall design, and scenario-driven vehicle interior design towards customization. Furthermore, based on multi-channel human-computer interaction such as touch, hearing, and vision, the integration of multiple forms of interaction such as visual interaction, voice interaction, and gesture interaction is realized, and collaborative interaction of different functions is realized according to different scenarios. The target vehicle is endowed with some biological-like perception capabilities by using biometric recognition and perception technology, and can interact with the passengers in the vehicle in a more humane way. By collecting passenger information and real-time monitoring of passenger status, the perception capabilities of the target vehicle are quickly realized, and the target vehicle is enabled to have human-like perception functions, thinking functions, and behavioral functions. Therefore, the target interaction information can be obtained by using interaction modes such as touch, hearing, and vision.

[0067] Specifically, the target vehicle includes an interaction system among a visual interaction system, an auditory interaction system, a gesture interaction system and a posture interaction system.

[0068] In actual applications, the visual perception interface elements of the visual interaction system are clicked and slid to obtain the target interaction information of the visual interaction mode. And / or, the auditory interaction system is used to respond to the voice commands issued by the user to obtain the target interaction information of the auditory interaction mode. And / or, the target interaction information of the tactile interaction mode is obtained by touching the central control screen, rear screen, etc. of the tactile interaction system. And / or, the gesture interaction system is used to respond to the user's gestures to obtain the target interaction information of the gesture interaction mode, for example, waving to control music playback, tracking the user's eye movement to achieve interaction, etc. And / or, the gesture interaction system is used to identify the user's gesture changes to obtain the target interaction information of the gesture interaction mode.

[0069] Step S102: performing fusion analysis on each target interaction information to determine the vehicle control instruction.

[0070] Specifically, an intention analysis may be performed on each target interaction information to determine the interaction intention corresponding to each target interaction information so as to determine the vehicle control instruction.

[0071] Step S103: Control the target vehicle based on the vehicle control instruction.

[0072] Specifically, the function module to be controlled and the vehicle function to be executed are determined based on the vehicle control instruction. The function module is controlled to execute the corresponding vehicle function, for example, turning on the air conditioner.

[0073] The vehicle control method provided in this embodiment uses multiple interaction modes to obtain target interaction information, and then performs fusion analysis on different target interaction information to determine vehicle control instructions. Therefore, different interaction modes can be used for interaction in different scenarios to generate vehicle control instructions to control the target vehicle, thereby meeting vehicle control requirements in different scenarios.

[0074] In some optional implementations, the vehicle control method of the present disclosure further includes:

[0075] Step a1, obtaining at least one vehicle operation information of the target vehicle.

[0076] Specifically, the vehicle operation information includes at least one of environmental information, vehicle status information, and image information of an occupant (such as a driver). The environmental information includes light information, temperature information, etc. In addition, the vehicle operation information may also include other information related to the vehicle operation.

[0077] Optionally, the target vehicle is equipped with a sensor module, which includes at least one of an environmental sensor, a driver status monitoring sensor, and a vehicle status sensor. The sensor module can be used to collect information inside and outside the vehicle to obtain vehicle operation information.

[0078] In addition, vehicle operation information can be obtained by acquiring various data such as vehicle data, in-vehicle and out-of-vehicle information interaction data, surrounding vehicle information, etc. through environmental perception devices, in-vehicle equipment detection systems, on-vehicle mobile networks, etc.

[0079] Step a2: performing fusion analysis on at least one vehicle operation information to obtain the operation scenario information of the target vehicle.

[0080] It can be understood that the operating scenario information can help the driver judge the current state and environmental conditions of the target vehicle.

[0081] Specifically, a data fusion algorithm is used to fuse and analyze vehicle operation information from different sensors and / or different data sources to obtain operation scenario information, which is used to provide more accurate and comprehensive vehicle status and environment information.

[0082] Step a3, controlling the display device of the target vehicle to display the operation scenario information, and the target interaction information is based on the feedback of the operation scenario information.

[0083] Specifically, the display device includes at least one of an instrument panel, a central control screen, a head-up display device, and a rear screen. The central control screen is used to display vehicle information such as navigation information, entertainment content, and vehicle status. The head-up display device is used to project vehicle information onto the windshield to reduce the driver's line of sight.

[0084] In actual applications, users can interact with the target vehicle through running scenario information, thereby obtaining target interaction information of the target vehicle in multiple interaction modes.

[0085] The vehicle control method provided in this embodiment obtains operation scene information by fusing and analyzing different vehicle operation information of the target vehicle. Therefore, the operation scene information can be used to provide more accurate and comprehensive vehicle status and environment information. The operation scene information is displayed using a display device so that the driver and other passengers can send target interaction information through the operation scene information, thereby improving the accuracy of vehicle control.

[0086] In some optional implementations, the above step a3 includes:

[0087] Step a31, obtaining access rights of passengers in the target vehicle, including the driver.

[0088] Specifically, role-based access control (RBAC) limits the access rights of different users (users referred to in this disclosure include passengers) to prevent unauthorized access and operations. A strict access control mechanism is established using access rights to ensure that users with different access rights can only access the vehicle information corresponding to their access rights, and the vehicle information that does not have access rights is shielded to prevent unauthorized access and data leakage.

[0089] In practical applications, the access rights of passengers can be determined by collecting passenger image information and using facial recognition technology. Alternatively, the access rights of passengers can be determined by collecting passenger voice commands and using voiceprint recognition technology. In addition, the access rights of passengers can also be determined by other recognition technologies, such as iris recognition technology, which are not limited here.

[0090] Step a32: If there are multiple occupants' access rights, determine the lowest authority among the access rights.

[0091] In the case where there are multiple passengers in the target vehicle, in order to avoid displaying the operation scenario information that other passengers do not have access rights to because of the high access rights of individual passengers in the vehicle, the access rights of different passengers in the target vehicle can be collected, and the operation scenario information can be displayed according to the lowest authority.

[0092] Step a33, determining the displayable information in the running scenario information based on the minimum authority.

[0093] The displayable information under each access right can be preset by the user with the highest authority. The non-displayable information in the running scene information is not displayed in the display device.

[0094] Step a34, controlling the display device of the target vehicle to display displayable information.

[0095] The vehicle control method provided in this embodiment displays the displayable information in the operating scenario information according to the lowest authority in the occupant's access rights. Therefore, it is possible to avoid the leakage of unauthorized information during human-computer interaction with the target vehicle, thereby ensuring the data security of the human-computer interaction.

[0096] In some optional implementations, the above step S102 includes:

[0097] Step b1, performing intent analysis on each target interaction information based on the operation scenario information, and determining the interaction intent corresponding to each target interaction information.

[0098] Specifically, deep learning algorithms, natural language processing technology, large models, etc. can be used to perform intent analysis on each target interaction information based on the operating scenario information to determine the interaction intention corresponding to each target interaction information.

[0099] Step b2: perform fusion analysis on each interaction intention and determine the vehicle control command.

[0100] It should be noted that in actual applications, the occupants of the target vehicle may express different interaction intentions, and each interaction intention may correspond to a different control instruction. Therefore, it is necessary to perform a fusion analysis on each interaction intention. If the control instructions corresponding to each interaction intention are different and there is no conflict, the control instructions corresponding to each interaction intention are used as the vehicle control instructions. If the control instructions corresponding to each interaction intention are different and there is a conflict, the vehicle control instruction can be determined from the control instructions corresponding to the conflicting interaction intentions according to the preset configuration. If the control instructions corresponding to each interaction intention are the same, only one identical vehicle control instruction is determined.

[0101] The vehicle control method provided in this embodiment performs intention analysis on each target interaction information based on the operation scenario information to determine the interaction intention corresponding to each target interaction information. Therefore, the interaction intention represented by each target interaction information can be accurately identified in combination with the operation scenario information. Then, each interaction intention is fused and analyzed to determine the vehicle control instruction. Therefore, the stability of the vehicle control instruction can be ensured to avoid the occurrence of conflicting vehicle control instructions.

[0102] In some optional implementations, the above step b2 includes:

[0103] Step b21, obtaining the interactive function configuration, the interactive function configuration includes trigger instructions for various vehicle functions, and the trigger instructions are related to the interactive intention.

[0104] Specifically, the in-vehicle functions supported by different in-vehicle applications and the triggering instructions of the in-vehicle functions can be configured through the interactive configuration pages of different in-vehicle applications.

[0105] Step b22, analyzing each interaction intention based on the interaction function configuration, and determining the target vehicle function corresponding to each interaction intention.

[0106] Exemplarily, assuming that the in-vehicle function is a music playing function, the interaction intention is to play music, and the trigger instruction of the music playing function is to play music, then it is determined that the target in-vehicle function corresponding to this interaction intention is the music playing function.

[0107] Step b23, performing fusion analysis on each target vehicle function to obtain vehicle control instructions.

[0108] Specifically, if there is no conflict among the target vehicle functions, a vehicle control instruction is generated based on different target vehicle functions among the target vehicle functions. If there is a conflict among the target vehicle functions, a first control instruction is generated for the target vehicle function that does not conflict. And, for the target vehicle function that conflicts, a second control instruction is generated based on the target vehicle function with the highest priority to obtain a vehicle control instruction, which includes a first control instruction and a second control instruction.

[0109] The vehicle control method provided in this embodiment analyzes the target vehicle functions to be executed by each interaction intention based on the interaction function configuration. Then, each target vehicle function is integrated and analyzed to obtain the vehicle control instruction. Therefore, the accuracy of vehicle control can be further improved.

[0110] In some optional implementations, the interactive function configuration is configured by the following steps:

[0111] Step c1, in response to an interaction configuration instruction for an in-vehicle application, an interaction configuration page is displayed, the interaction configuration page displays at least one interaction configuration item, the interaction configuration item includes a function configuration item for configuring an in-vehicle function and an instruction configuration item for configuring a trigger instruction.

[0112] Specifically, the target vehicle supports at least one in-vehicle application, and there are different interactive configuration pages for different in-vehicle applications. Enter the interactive configuration page of the corresponding in-vehicle application, and you can make detailed configurations through interactive configuration items on the interactive configuration page. For example, configure the icon and function name of the in-vehicle function displayed in the in-vehicle application. Specifically, you can select from the icon library or upload a local picture to configure the icon of the in-vehicle function.

[0113] Specifically, a network configuration guide page is configured in the vehicle application, including a network configuration guide map and related prompt texts. The user can perform configuration operations in the interactive configuration page according to the network configuration guide map and related prompt texts.

[0114] Furthermore, the interactive configuration page also displays configuration items for the panel display in the vehicle application. You can select a blank panel or create one from a template, or upload a custom panel.

[0115] Furthermore, the command configuration item in the interaction configuration page also supports voice control, which enables and views the voice control commands of the in-vehicle application. In actual applications, the in-vehicle application uses the control command corpus revealed by the platform for voice semantic training. Furthermore, the in-vehicle application can collect voice interaction information through the voice input device and parse and process the voice interaction information. Then, the parsed voice information is assembled by protocol and output to the voice engine of the in-vehicle application through the access layer. The voice engine normalizes and differentiates the parsed voice information, parses the user's true intentions, and transmits key information to the back-end service module that processes the user's intentions to generate vehicle control commands for the in-vehicle application.

[0116] In addition, as needed, configuration items of other parameters of other in-vehicle applications can be displayed on the interaction configuration page to configure other parameters of the in-vehicle applications to meet human-computer interaction requirements in different scenarios.

[0117] Step c2: determining and displaying an interactive function configuration in response to a configuration operation on at least one interactive configuration item.

[0118] The vehicle control method provided in this embodiment displays an interactive configuration page in response to an interactive configuration instruction for an in-vehicle application. Therefore, the in-vehicle functions of the in-vehicle application and their corresponding trigger instructions can be configured according to actual needs, thereby meeting vehicle control needs in different scenarios.

[0119] In some optional implementations, the vehicle control method of the present disclosure further includes:

[0120] Step d1, obtaining first image information of the driver in the target vehicle.

[0121] Specifically, first image information of a driver in the target vehicle is acquired through an image acquisition device of the target vehicle.

[0122] Step d2: analyzing the fatigue status of the driver based on the first image information to determine a fatigue status analysis result.

[0123] Specifically, the fatigue status of the driver is analyzed through the fatigue monitoring sensor of the target vehicle and the first image information to determine the fatigue status analysis result.

[0124] Step d3: if the fatigue status analysis result indicates that the driver is fatigued, a prompt message is generated.

[0125] Specifically, the prompt information is used to control a prompt device of the target vehicle to issue a prompt.

[0126] Step d4, controlling the target vehicle to issue a reminder based on the prompt information.

[0127] For example, when the driver is fatigued, voice reminders are issued, seat vibrations are controlled, or warning lights in the car flash.

[0128] The vehicle control method provided in this embodiment monitors the driver's fatigue state and controls the target vehicle to issue a reminder when the driver is fatigued. Therefore, it can avoid the driver's fatigue driving and improve driving safety.

[0129] In some optional implementations, the vehicle control method of the present disclosure further includes:

[0130] Step e1, obtaining second image information of the driver in the target vehicle.

[0131] Specifically, the second image information of the driver in the target vehicle is acquired by an image acquisition device of the target vehicle.

[0132] Step e2: Track the driver's sight line based on the second image information to determine the target sight line.

[0133] Specifically, the driver's eye movement is tracked through the sight line tracking sensor and the second image information to determine the target sight line.

[0134] Step e3, adjusting the display position of the vehicle information based on the target line of sight, the vehicle information including vehicle operation information and / or operation scene information.

[0135] Specifically, the sight range is determined based on the target sight, and the target display position within the sight range is determined, for example, the target display position includes the target position of the target display device for displaying the vehicle information or the display interface of the target display device. The display position of the vehicle information is adjusted based on the target display position.

[0136] The vehicle control method provided in this embodiment adjusts the display position of the vehicle information based on the target sight line of the driver, thereby enabling the driver to better obtain the vehicle information and improving driving safety.

[0137] In some optional embodiments, the vehicle control method of the present invention also includes: obtaining user behavior data; adjusting a display interface of a display device based on the user behavior data, wherein the display interface is used to display vehicle information, and the vehicle information includes vehicle operation information, operation scenario information, and at least one of vehicle-mounted applications.

[0138] Specifically, by analyzing user behavior data, the user's actual operating habits and preferences are understood, so as to adjust the display interface of the display device.

[0139] The vehicle control method provided in this embodiment adjusts the display interface of the display device according to the user behavior data, so that the display interface can be more in line with the actual needs of the user, the display effect of the vehicle information can be improved, and the user satisfaction can be improved.

[0140] In addition, in order to reduce the conflict of in-vehicle functions when executing human-computer interaction functions in different scenarios, when designing the target vehicle, users can be involved in the design process to better understand the actual needs and usage habits of users, so as to balance the design of user needs and vehicle control systems, thereby reducing vehicle control conflicts caused by improper design. Alternatively, an iterative design method can be adopted to gradually optimize the interactive interface of the target vehicle through continuous prototype testing and user feedback to ensure that the vehicle control system can both efficiently complete the interactive tasks (refer to the above target interaction information) and provide a good user experience. Alternatively, when designing the interactive interface, consider the differences in needs of different user groups and adopt a flexible design method to allow users to customize the interface according to their personal preferences and habits, thereby meeting the contradictory needs of different users to a certain extent. Alternatively, through the analysis of user behavior data, understand the actual operating habits and preferences of users, and adjust the interface design to make it more in line with the actual needs of users and improve user satisfaction. Alternatively, during the driving of the vehicle, limit the functions that require the driver to stare for a long time on the central control screen and instrument screen to reduce driving distraction and improve driving safety. Alternatively, test whether the vehicle control effect is different when voice interaction information is sent from different positions, to ensure that passengers at different positions in the vehicle can effectively interact with the vehicle control system and reduce interaction conflicts caused by different positions. Alternatively, minimize errors by changing the design. For example, design a Universal Serial Bus (USB) slot in the hardware. In the interface interaction design, gray buttons are used to represent the failure of vehicle functions to avoid misoperation.

[0141] In the vehicle control system of the target vehicle, a complete network security protection system can be established to target network security risks, including firewalls, intrusion detection, etc. Alternatively, the encryption and authentication mechanism of the vehicle information system can be strengthened. Alternatively, loopholes can be checked regularly and patched in a timely manner. Alternatively, network security training for drivers and maintenance personnel can be strengthened. Alternatively, emergency plans and accident response mechanisms can be established.

[0142] As for software and hardware failures, strictly control the quality of components and systems to ensure reliability. Alternatively, establish a complete fault diagnosis and remote monitoring system. Alternatively, formulate a detailed maintenance plan to detect and repair problems in a timely manner. Alternatively, fully consider the occurrence of failures in the design to ensure that the vehicle control system can transition smoothly. Alternatively, establish a diversified fault emergency plan to ensure rapid response and processing.

[0143] As for the problem of vehicle control system vulnerabilities, a sound system testing and security audit mechanism should be established to regularly check and patch vulnerabilities. Alternatively, the optimization and verification of algorithms and traffic rule recognition models should be strengthened. Alternatively, an open and transparent information sharing mechanism should be established to allow more professionals to participate in vulnerability patching. Alternatively, the application of artificial intelligence technology in target vehicles should be strengthened to improve the adaptive ability of vehicle control systems.

[0144] As for the human-machine interaction problem in the target vehicle, strengthen the driver's status monitoring and warning to detect abnormal situations in time. Alternatively, optimize the human-machine interaction interface to improve the convenience and comprehensibility of operation. Alternatively, fully consider the driver's psychological needs and behavioral characteristics in the design of the vehicle control system. Alternatively, establish a driver training mechanism to improve safety awareness and operating skills. Alternatively, formulate a comprehensive emergency plan to ensure that human-machine collaboration can effectively respond to emergencies.

[0145] The vehicle control method disclosed in the present invention aims at the risk of data leakage in human-computer interaction, and adopts the following means to prevent data leakage during interaction: 1. Static data encryption: Encrypt data stored on hard disks, databases and other media to prevent unauthorized access to the data. 2. Transmission data encryption: Use protocols such as SSL / TLS to encrypt the transmission of data in the network to ensure that the data is not intercepted or tampered with during the transmission process. 3. Authentication: Verify the identity of the user through methods such as passwords, two-factor authentication, and biometrics to ensure that only legitimate users can access the data. 4. Permission management: Role-based access control limits users (including passengers) to access only the data they need for their work, preventing unauthorized access and operations. 5. Establish a strict access control mechanism to ensure that only authorized personnel can access sensitive data, and shield sensitive data to prevent unauthorized access and leakage.

[0146] The embodiment of the present disclosure also provides a vehicle, comprising a vehicle body and a vehicle control system, wherein the vehicle control system is used to execute the above-mentioned vehicle control method.

[0147] See also Figure 2 , Figure 2 is a structural block diagram of a vehicle control system provided by an optional embodiment of the present disclosure, such as Figure 2 As shown, a vehicle control system includes a hardware system and a software system. Among them, the touch screen, physical buttons or voice input devices of the hardware system are used for users to input operation requests and obtain target interaction information of multiple interaction modes. The vehicle operating system and application software system of the software system receive and parse the target interaction information, identify the user's intention, and schedule the corresponding vehicle application or functional module according to the user's intention. The middleware / driver module of the software system converts the target interaction information into a vehicle control instruction that can be recognized by the hardware in the hardware system, and the hardware system performs the corresponding operation according to the received vehicle control instruction.

[0148] like Figure 3 As shown, the hardware system includes at least one of a display device, an input device, a sensor module, a controller module, a communication module and other hardware.

[0149] Optionally, the display device includes at least one of an instrument panel, a central control screen, a head-up display device, and a rear screen. The central control screen is used to display navigation information, entertainment content, and vehicle status. The head-up display device is used to project vehicle information onto the windshield to reduce the driver's line of sight.

[0150] Optionally, the input device includes at least one of a physical control (such as a button and a knob), a voice input device (microphone), an image acquisition device (camera), and a user input module. Among them, the physical control is used to quickly access some vehicle functions, such as volume adjustment and air conditioning control. The voice input device is used to receive the user's voice command. The image acquisition device is used to recognize the user's gesture command, for example, waving gesture to control music playback. The user input module is used to respond to the control command input by the user through a hardware device (such as a central control screen, physical controls, voice input device, etc.).

[0151] Optionally, the sensor module includes at least one of an environmental sensor, a driver status monitoring sensor, and a vehicle status sensor. The environmental sensor includes a light sensor and a temperature sensor. The light sensor is used to assist in adjusting the screen brightness. The temperature sensor is used to assist in adjusting the air conditioning temperature. The driver status monitoring sensor includes a fatigue monitoring sensor and a sight tracking sensor. The fatigue monitoring sensor is used to monitor the driver's fatigue state and issue a reminder when the driver's fatigue is detected. The sight tracking sensor is used to monitor the driver's sight to assist in optimizing the display position of the vehicle information.

[0152] Optionally, the controller module includes at least one of an onboard processor, a domain processor, a hardware control module, a task execution module, and a user feedback module. The hardware control module is used to control the hardware device according to the vehicle control instruction. The task execution module is used to coordinate with other hardware devices in the software system and the hardware system to complete the vehicle control instruction. The user feedback module is used to control other hardware devices according to the feedback information to present the feedback information to the user.

[0153] The communication module includes a Bluetooth module, a wireless communication module (such as a Wifi module) and a navigation and positioning module (such as a GPS module).

[0154] Other hardware includes a sound system and vibration feedback device.

[0155] like Figure 4 As shown, the software system includes an on-board operating system, a user interface system, an application software system, an interactive logic system, a data processing and algorithm system, a security and privacy system, and a networking and updating system.

[0156] Optionally, the in-vehicle operating system includes at least one type of operating system.

[0157] Optionally, the user interface system includes at least one of a graphical user interface and a voice user interface. The graphical user interface is used to display vehicle information and receive user input instructions. The voice user interface is used to achieve voice interaction through voice recognition and synthesis technology.

[0158] Optionally, the application software system includes at least one of a navigation system, a multimedia playback system and a vehicle setting system, wherein the vehicle setting system includes a lane keeping assist subsystem, a collision warning subsystem and a blind spot monitoring subsystem.

[0159] Optionally, the interactive logic system includes at least one of a user interaction design system and a multimodal interaction system. Among them, the multimodal interaction system includes a visual interaction system, an auditory interaction system, a tactile interaction system, a gesture interaction system and a posture interaction system. The visual interaction system is used to click and slide visual perception interface elements, and provide visual feedback through visual interaction methods such as color and animation. The auditory interaction system is used to interact with the user in response to voice commands, and output information through voice, such as navigation instructions and warning prompts. The tactile interaction system is used to operate by touching the central control screen, the rear screen, etc. The gesture interaction system is used to control the vehicle in response to user gestures, for example, waving to control music playback, and tracking the user's eye movements to achieve interaction. The posture interaction system is used to identify changes in the user's posture and achieve interaction.

[0160] Optionally, the data processing and algorithm system includes at least one of a data fusion algorithm, a machine learning algorithm, and an image processing algorithm. The data fusion algorithm is used to integrate information from different sensors and / or different data sources to obtain more accurate and comprehensive vehicle status and environmental information. The machine learning algorithm is used to learn patterns and features from a large amount of data so that the data processing and algorithm system can automatically improve and adapt. The image processing algorithm is used to process and analyze image information and extract useful features from the image information.

[0161] Optionally, the security and privacy system includes a data encryption system and an access control system. The data encryption system is used to protect the security of data during storage and transmission to prevent unauthorized access and data leakage. The access control system is used to control the access rights of users and the data encryption system to vehicle resources to ensure that only authorized users and systems can access sensitive data and services.

[0162] Optionally, the networking and updating system includes Internet of Vehicles service software and an Over-The-Air technology (OTA) update module. The Internet of Vehicles service software is used to connect to external services through the vehicle network to provide various vehicle services for the driver and passengers. The OTA update module is used to remotely update the vehicle application through the wireless network.

[0163] Furthermore, the software system also includes an input processing module, an input parsing module, a middleware / driver module, a task execution module, a feedback generation module and an output processing module. Among them, the input processing module receives and preliminarily processes the control instructions (i.e., target interaction information) input by the user, and the input parsing module is used to parse the user's intention of the input control instructions, determine the tasks to be performed, and obtain the vehicle control instructions. The middleware / driver module is used to communicate with the hardware device through the middleware and the driver. The feedback generation module is used to generate feedback information of the vehicle control results. The output processing module is used to process and format the feedback information.

[0164] The embodiments of the present disclosure also provide a computer-readable storage medium. The above-mentioned method according to the embodiments of the present disclosure can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium and downloaded through a network, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0165] A part of the present disclosure may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present disclosure through the operation of the computer. Those skilled in the art should understand that the existence of computer program instructions in computer-readable media includes, but is not limited to, source files, executable files, installation package files, etc., and accordingly, the way in which computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to the computer.

[0166] Although the embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A vehicle control method, characterized in that: The method comprises: Obtain target interaction information of target vehicles in multiple interaction modes; Performing fusion analysis on each of the target interaction information to determine vehicle control instructions; The target vehicle is controlled based on the vehicle control instruction.

2. The vehicle control method according to claim 1, characterized in that: The method further comprises: Acquiring at least one vehicle operation information of the target vehicle; Performing fusion analysis on the at least one vehicle operation information to obtain operation scene information of the target vehicle; The display device of the target vehicle is controlled to display the operation scenario information, and the target interaction information is fed back based on the operation scenario information.

3. The vehicle control method according to claim 2, characterized in that: The step of fusing and analyzing the target interaction information to determine the vehicle control command includes: Performing intent analysis on each of the target interaction information based on the operation scenario information to determine the interaction intent corresponding to each of the target interaction information; A fusion analysis is performed on each of the interaction intentions to determine the vehicle control instructions.

4. The vehicle control method according to claim 3, characterized in that: The step of fusing and analyzing each of the interaction intentions to determine the vehicle control instruction includes: Acquire an interactive function configuration, where the interactive function configuration includes trigger instructions for multiple vehicle functions, where the trigger instructions are related to the interactive intention; Analyzing each of the interaction intentions based on the interaction function configuration, and determining a target vehicle function corresponding to each of the interaction intentions; A fusion analysis is performed on each of the target vehicle-mounted functions to obtain the vehicle control instruction.

5. The vehicle control method according to claim 4, characterized in that: The interactive function configuration is obtained by configuring the following steps: In response to an interaction configuration instruction for an in-vehicle application, an interaction configuration page is displayed, wherein the interaction configuration page displays at least one interaction configuration item, wherein the interaction configuration item includes a function configuration item for configuring an in-vehicle function and an instruction configuration item for configuring a trigger instruction; In response to a configuration operation on the at least one interaction configuration item, the interaction function configuration is determined and displayed.

6. The vehicle control method according to claim 2, characterized in that: The controlling the display device of the target vehicle to display the operation scene information includes: Obtaining access rights for passengers in the target vehicle, wherein the passengers include a driver; If there are multiple access rights for the occupant, determining the lowest authority among the access rights; Determine the displayable information in the running scenario information based on the minimum permission; The display device of the target vehicle is controlled to display the displayable information.

7. The vehicle control method according to claim 1, characterized in that: The method further comprises: Acquire first image information of a driver in the target vehicle; Performing fatigue status analysis on the driver based on the first image information, and determining a fatigue status analysis result; If the fatigue state analysis result indicates that the driver is fatigued, generating a prompt message; The target vehicle is controlled to issue a reminder based on the prompt information.

8. The vehicle control method according to claim 1, characterized in that: The method further comprises: Acquire second image information of the driver in the target vehicle; Tracking the driver's sight line based on the second image information to determine a target sight line; The display position of the vehicle information is adjusted based on the target line of sight, and the vehicle information includes vehicle operation information and / or operation scene information.

9. The vehicle control method according to claim 1, characterized in that: The method further comprises: Obtain user behavior data; A display interface of a display device is adjusted based on the user behavior data, the display interface being used to display vehicle information, the vehicle information including vehicle operation information, operation scenario information, and at least one of vehicle-mounted applications.

10. A vehicle, characterized in that: include: Vehicle body; A vehicle control system, used to execute the vehicle control method described in any one of claims 1-9.

Images