Vehicle control method, device and vehicle

Abstract

The application discloses a vehicle control method, device and vehicle. The method comprises the following steps: in response to a dangerous driving event of an object vehicle detected by a current vehicle, controlling the current vehicle to activate a cabin interaction function; and in response to an interaction control operation performed on the current vehicle, displaying an interaction special effect in an augmented reality HUD of the current vehicle according to a target display path, wherein the target display path is determined according to a corresponding rendering position of the object vehicle in the augmented reality HUD and an operation parameter of the interaction control operation. The application solves the technical problem that an interactive game is not combined with the real world and the user experience is poor.

Description

Technical Field

[0001] This invention relates to the field of vehicles, and more specifically, to a vehicle control method, apparatus, and vehicle. Background Technology

[0002] While driving, users often encounter various scenarios that can easily trigger road rage, such as a car cutting in front, a slow-moving car ahead, a car suddenly braking, or a car changing lanes recklessly. In these road rage scenarios, engaging in fun interactions with the vehicle can help calm the user and provide them with sufficient emotional support.

[0003] In existing technologies, vehicles often include some stress-relieving and interactive mini-games, such as tapping a wooden fish or playing with prayer beads. However, all of these games are created digitally in a virtual environment, resulting in a lack of integration between the interactive games in the vehicle and the real world, and a poor user experience.

[0004] There is currently no effective solution to the problem that interactive games in vehicles are not integrated with the real world and have a poor user experience. Summary of the Invention

[0005] This invention provides a vehicle control method, device, and vehicle to at least address the technical problem that interactive games are not integrated with the real world and result in a poor user experience.

[0006] According to one aspect of the present invention, a vehicle control method is provided, applied to a current vehicle, comprising: in response to the current vehicle detecting a dangerous driving event of an object vehicle, controlling the current vehicle to activate a cockpit interaction function; and in response to an interaction control operation performed on the current vehicle, displaying interactive effects in the current vehicle's augmented reality HUD according to a target display path, wherein the target display path is determined by the rendering position of the object vehicle in the augmented reality HUD and the operation parameters of the interaction control operation.

[0007] Furthermore, dangerous driving events include at least one of the following: collision warning events, lane cutting events, lane departure events, and emergency deceleration events.

[0008] Furthermore, controlling the activation of the cockpit interaction function of the current vehicle includes one of the following: activating the cockpit interaction function based on the activation response duration and the detection time of the dangerous driving event; or activating the cockpit interaction function in response to an activation control operation performed on the activation option control, wherein the activation option control is an operation control determined when the current vehicle detects a dangerous driving event.

[0009] Furthermore, activating the cockpit interaction function includes at least one of the following: switching the control function of the target cockpit control of the current vehicle to respond to interactive control operations; controlling the augmented reality HUD to switch to the special effects display interface corresponding to the cockpit interaction function; controlling the cockpit camera of the current vehicle to be in the gesture monitoring state corresponding to the cockpit interaction function; controlling the cockpit microphone of the current vehicle to be in the voice monitoring state corresponding to the cockpit interaction function.

[0010] Furthermore, the interactive control operations include at least one of the following: combined control operations performed on target cockpit controls; gesture control operations recognized by cockpit cameras; and voice control operations recognized by cockpit microphones.

[0011] Furthermore, the cockpit interaction function is a throwing interaction function based on virtual projectiles in the augmented reality HUD, and the interactive effect is the throwing effect of virtual projectiles. The vehicle control method also includes: determining the target display path according to the rendering position and operation parameters, wherein the target display path is used to represent the target throwing direction and target throwing distance of the virtual projectiles in the throwing effect; and generating the target style throwing effect using the operation parameters and the special effect material corresponding to the virtual projectiles, wherein the target style is used to represent the target size and target quantity of the virtual projectiles in the throwing effect.

[0012] Furthermore, determining the target display path based on the rendering position and operation parameters includes: determining the initial throwing direction and initial throwing distance based on the preset throwing start position and rendering position in the augmented reality HUD; adjusting the initial throwing direction using the operation direction in the operation parameters to obtain the target throwing direction; adjusting the initial throwing distance using the operation duration in the operation parameters to obtain the target throwing distance; and generating the target display path based on the target throwing direction and target throwing distance.

[0013] Furthermore, by utilizing the operation parameters and the special effects materials corresponding to the virtual projectiles, the throwing effects of the target style are generated as follows: the target size is determined based on the operation duration in the operation parameters and the initial size of the special effects materials; the target quantity is determined based on the operation duration and the preset quantity accumulation rules; and the throwing effects of the target style are generated based on the target size, the target quantity, and the special effects materials.

[0014] Furthermore, displaying interactive effects in the augmented reality HUD of the current vehicle according to the target display path includes: in response to the completion of the interactive control operation, displaying a throwing effect in the augmented reality HUD according to the target display path, so as to display an effect animation in the augmented reality HUD of throwing virtual objects of target size and target quantity from the throwing start position onto the virtual vehicle corresponding to the target vehicle.

[0015] Furthermore, the vehicle control method also includes: in response to the current vehicle detecting a dangerous driving event of the target vehicle, if the current vehicle meets safety conditions, controlling the current vehicle to activate the cockpit interaction function, wherein the safety conditions include: the current vehicle is not in reverse gear, and there is no other information to be displayed in the current vehicle's augmented reality HUD with a higher display priority than the interactive effect.

[0016] According to another aspect of the present invention, a vehicle control device is also provided, configured in a current vehicle, comprising: a control module, configured to control the current vehicle to activate a cockpit interaction function in response to the current vehicle detecting a dangerous driving event of an object vehicle; and a display module, configured to display interactive effects in the augmented reality HUD of the current vehicle according to a target display path in response to an interactive control operation performed on the current vehicle, wherein the target display path is determined by the rendering position of the object vehicle in the augmented reality HUD and the operation parameters of the interactive control operation.

[0017] According to another aspect of the present invention, an electronic device is also provided, comprising: a memory storing an executable program; and a processor for running the program, wherein the program executes the vehicle control method described above when it runs.

[0018] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is executed, the device on which the computer-readable storage medium is located executes the vehicle control method of any one of the above.

[0019] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements the vehicle control method described above.

[0020] According to another aspect of the present invention, a computer program product is also provided, including a non-volatile computer-readable storage medium storing a computer program, which, when executed by a processor, implements the vehicle control method described above.

[0021] According to another aspect of the present invention, a computer program is also provided, which, when executed by a processor, implements the vehicle control method described above.

[0022] According to another aspect of the embodiments of this application, a vehicle is also provided, including: a memory storing an executable program; and a processor for running the program, wherein the program executes the vehicle control method of any one of the above-mentioned methods when it runs.

[0023] In this embodiment of the invention, in response to the current vehicle detecting a dangerous driving event of the target vehicle, the current vehicle is controlled to activate its cockpit interaction function; in response to an interactive control operation performed on the current vehicle, interactive effects are displayed in the current vehicle's augmented reality HUD according to a target display path, wherein the target display path is determined by the rendering position of the target vehicle in the augmented reality HUD and the operation parameters of the interactive control operation. That is, by detecting a dangerous driving event of the target vehicle, if the current vehicle detects such an event, it is controlled to activate its cockpit interaction function, and then, according to the interactive control operation performed by the current vehicle, interactive effects corresponding to the interactive control operation are displayed in the current vehicle's augmented reality HUD according to the target display path. Because it is considered that when the target vehicle triggers a dangerous driving event, the cockpit interaction function of the current vehicle is activated, and the user generates user control commands according to the current needs to control the current vehicle to perform interactive control operations, thereby displaying interactive effects corresponding to the above-mentioned interactive control operations in the current vehicle according to the target display path, the purpose of interacting with the vehicle according to user control commands is achieved. This realizes the technical effect of combining interactive games with the real world and improving the user experience, thus solving the technical problem of interactive games not being combined with the real world and having a poor user experience. Attached Figure Description

[0024] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0025] Figure 1 This is a hardware structure block diagram of an optional computing terminal for implementing a vehicle control method according to an embodiment of this application;

[0026] Figure 2 This is a flowchart of a vehicle control method according to an embodiment of the present invention;

[0027] Figure 3 This is a schematic diagram of a vehicle control device according to an embodiment of the present invention. Detailed Implementation

[0028] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0029] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0030] According to an embodiment of the present invention, a method embodiment of a vehicle control method is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0031] This application provides a vehicle control method. The vehicle control method can be used to provide user-vehicle interaction functions for preset application scenarios. These preset application scenarios can include the following scenarios in the vehicle field: autonomous driving scenarios for commuting, artificial intelligence (AI) assisted driving scenarios for family cars, automatic parking assistance (APA) scenarios (such as memory parking for self-owned parking spaces in garages, intelligent parking for designated parking spaces in parking lots, etc.), and navigation-guided pilot (NGP) scenarios in urban or highway areas. Furthermore, the preset application scenarios may also include, but are not limited to: vehicle control scenarios for intelligent driving trucks or unmanned trucks in the logistics and transportation field, vehicle control scenarios for autonomous agricultural vehicles in the agricultural machinery field, vehicle control scenarios for unmanned aerial vehicles (UAVs), and vehicle control scenarios for intelligent robots (such as cleaning robots, service robots, delivery robots, etc.).

[0032] When the aforementioned preset application scenario is a scenario in a field other than the vehicle field, those skilled in the art should understand that the vehicle in the above vehicle control method can be replaced with other objects (such as agricultural machinery, drones, robots, etc.), and correspondingly, the user controlling the vehicle can be replaced with an executor related to other objects. Based on this, this application embodiment takes the vehicle field as an example to illustrate the specific implementation of the above vehicle control method.

[0033] First, the operating environment of the above method embodiments will be described by way of example. Figure 1 This is a hardware structure block diagram of an optional computing terminal for implementing a vehicle control method according to an embodiment of this application, such as... Figure 1 As shown, the computing terminal 10 (e.g., a computer terminal, a mobile smart terminal, a vehicle terminal, or a cloud computing virtual terminal) may include: one or more processors 102, a memory 104 for storing data, and a transmission device 106 for implementing communication functions. Each processor 102 may include, but is not limited to, a processing component such as a microprocessor (MCU) or a field programmable gate array (FPGA).

[0034] The aforementioned computing terminal 10 may further include: a display device 110, an input / output device 108, a Universal Serial Bus (USB) port (which can be used as one of the ports of a computer bus, not shown in the figure), a network interface (not shown in the figure), a power supply (not shown in the figure), and a camera (not shown in the figure). Those skilled in the art will understand that... Figure 1 The structure of the computing terminal 10 shown is for illustrative purposes only and does not impose strict limitations on the structure of the computing terminal 10 described above. For example, the computing terminal 10 may also include components that are larger than... Figure 1 The more or fewer components shown, or the computing terminal 10 may have the same Figure 1 The components are shown in different categories.

[0035] It should be noted that one or more processors 102 and / or other data processing circuits in the aforementioned computing terminal 10 may be wholly or partially embodied in software, hardware, firmware, or any other combination thereof. Furthermore, the data processing circuitry may be a single, independent processing module, or may be wholly or partially integrated into any other element in the vehicle terminal (or mobile device).

[0036] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the vehicle control method in this embodiment. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, thereby realizing the aforementioned vehicle control method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the vehicle terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0037] The transmission device 106 is used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the vehicle terminal's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 may be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0038] Figure 2 This is a flowchart of a vehicle control method according to an embodiment of the present invention, such as... Figure 2 As shown, the method includes the following steps:

[0039] Step S202: In response to the current vehicle detecting a dangerous driving event of the target vehicle, control the current vehicle to activate the cockpit interaction function;

[0040] Step S204: In response to the interactive control operation performed on the current vehicle, display interactive effects in the augmented reality HUD of the current vehicle according to the target display path, wherein the target display path is determined by the rendering position of the object vehicle in the augmented reality HUD and the operation parameters of the interactive control operation.

[0041] The current vehicle mentioned above can be the vehicle itself. The target vehicle can be the vehicle ahead of the current vehicle. Dangerous driving events are used to characterize behaviors that pose potential risks or safety hazards during driving, such as the current vehicle issuing a forward collision warning, the vehicle ahead cutting in, the vehicle ahead deviating from its lane, or the vehicle ahead suddenly decelerating.

[0042] The aforementioned interactive control operations are used to represent communication actions between the user and the vehicle, and can be referred to as interactive control actions. These can include: steering wheel scroll wheel control operations, steering wheel button control operations, and gesture control operations, where gesture control operations can include actions such as throwing forward. The user can be the driver of the currently operating vehicle. Gesture control operations can be captured by cameras within the vehicle.

[0043] The aforementioned target display path can be called the throwing display path, which may include: throwing direction, throwing position, throwing force, and the size of the virtual projectile. It should be noted that this is only an example of the contents of the throwing display path, and no specific limitation is made on the contents of the throwing display path.

[0044] The aforementioned interactive effects can be interactive effects for virtual projectiles, where the virtual projectiles can be throwing props. For example, after the driver makes a throwing motion, the interactive effects of the virtual projectile can be displayed on the vehicle's augmented reality display (HUD) according to the throwing path, allowing the driver to more intuitively obtain the interactive effects obtained after performing the throwing motion, improving the driver's user experience and calming the driver's emotions.

[0045] The augmented reality HUD in the aforementioned vehicles projects important information into the user's field of vision without requiring them to look down at other devices. With the support of augmented reality (AR) technology, HUDs can combine virtual information with the real environment, overlaying more information onto the view of the real world. The augmented reality HUD used in vehicles can be called an ARHUD.

[0046] In this embodiment of the application, if the current vehicle detects a dangerous driving event of the target vehicle, it can control the current vehicle to activate the cockpit interaction function. Based on this, according to the interactive control operation performed by the current vehicle, interactive effects can be displayed on the augmented reality display of the current vehicle according to the target real path, so as to achieve the purpose of the current vehicle user interacting with the vehicle.

[0047] For example, when a vehicle ahead of the current vehicle decelerates rapidly, the driver of the current vehicle may become angry and agitated. This can activate the vehicle's cockpit interaction function, allowing the driver to interact with the vehicle. Specifically, the driver can make a throwing motion forward. When the vehicle recognizes this motion, the HUD can adaptively map the throwing direction, location, and force, along with a real-world object, onto the control screen, displaying a virtual throwing effect corresponding to the action. This attracts the driver's attention, helps stabilize their emotions, and solves the technical problem of in-vehicle interactive games not integrating with the real world, resulting in a poor user experience.

[0048] For another example, while the driver of the current vehicle is interacting with their vehicle, some buttons on the steering wheel will temporarily release their focus to a stress-relieving interactive game. By clicking, the user can continuously throw virtual props at the vehicle in front or to the side in the HUD, thereby displaying interactive effects and realizing the interaction between the user and the vehicle.

[0049] The technical solution provided in steps S202 to S204 above detects dangerous driving events of the target vehicle. If the current vehicle detects such an event, it activates the cockpit interaction function. Then, based on the interactive control operation performed by the current vehicle, interactive effects corresponding to the control operation are displayed in the augmented reality HUD of the current vehicle according to the target display path. By considering that the cockpit interaction function of the current vehicle is activated when the target vehicle triggers a dangerous driving event, and that the user generates user control commands based on current needs to control the current vehicle to perform interactive control operations, thus displaying interactive effects corresponding to the control operations in the current vehicle according to the target display path, the goal of interacting with the vehicle based on user control commands is achieved. This realizes the technical effect of combining interactive games with the real world and improving the user experience, thereby solving the technical problem of interactive games not being integrated with the real world and having a poor user experience.

[0050] As an optional implementation, dangerous driving events include at least one of the following: collision warning events, lane-cutting events, lane departure events, and emergency deceleration events.

[0051] The aforementioned collision warning event is used to indicate that the current vehicle is colliding with another vehicle. It can be called a forward collision warning event, or simply a forward collision warning. For example, the current vehicle is colliding with the vehicle in front.

[0052] The aforementioned lane-cutting event is used to characterize a situation where the current vehicle is cut off by another vehicle while it is in motion. This can be called a front vehicle lane-cutting event, or simply front vehicle lane-cutting. For example, when the current vehicle is cut off by the vehicle in front of it while it is in motion.

[0053] The lane departure event described above is used to characterize a situation where a vehicle deviates from its lane while the vehicle is currently in motion; it can be simply referred to as lane departure. For example, while the vehicle is in motion, a vehicle in front of it deviates from its original lane.

[0054] The aforementioned emergency deceleration event is used to characterize a situation where, while the current vehicle is in motion, the target vehicle rapidly decelerates. This can be referred to as a preceding vehicle emergency deceleration event, or simply preceding vehicle emergency deceleration. For example, it could be a situation where, while the current vehicle is in motion, the vehicle in front suddenly brakes and rapidly decelerates.

[0055] It is understood that this is only an example of a dangerous driving event, and the specific type of dangerous driving event is not limited. Any driving event that occurs on the target vehicle and poses a danger to the current vehicle is within the scope of protection of this application, and will not be listed here.

[0056] As an optional implementation, controlling the activation of the cockpit interaction function of the current vehicle includes one of the following: activating the cockpit interaction function based on the activation response duration and the detection time of the dangerous driving event; or activating the cockpit interaction function in response to an activation control operation performed on an activation option control, wherein the activation option control is an operation control determined when the current vehicle detects a dangerous driving event.

[0057] The activation response time mentioned above is used to characterize the reaction time of activating a specific function of the vehicle, for example, 10 seconds (s). The activation option control mentioned above is used for users to perform different operations, such as a pop-up window when the vehicle is in manual control mode. It should be noted that this is only an example of the activation option control, and does not specifically limit the display method of the activation option control.

[0058] The aforementioned activation option control can be generated by the vehicle's augmented reality HUD or selected from multiple hardware controls within the vehicle, where each hardware control has a specific function. For example, the activation option control can pop up in the center console, be generated within the augmented reality HUD, or be selected from functional hardware controls. For instance, the selected interaction buttons should ideally be functional buttons (multimedia control buttons), avoiding driving-related buttons (such as speed adjustment buttons) to minimize their impact on driving safety.

[0059] The above activation control operation is used to perform different control operations according to the user's selection. For example, after the pop-up window is displayed, the driver can click the activation button or the start button on the pop-up window. It should be noted that this is only an example of the control operation and does not specifically limit the operation type of the control operation.

[0060] After activating the cockpit interaction function, the interaction between the user and the vehicle needs to automatically end after a specified time, and the pop-up window will always be displayed on the central control, allowing the user to actively choose to start or end it.

[0061] In this embodiment, the cockpit's interactive function can be activated based on the activation response time and the detection of dangerous driving events. When the user performs an activation control operation in the activation option control, the cockpit interactive function can be activated. For example, if the vehicle's activation response time is within 10 seconds and the detection time of a dangerous driving event is also within a preset range, the cockpit interactive function can be activated simultaneously, and the vehicle will display an interactive pop-up window in manual control mode. The user can then click the activation button on the pop-up window to activate the cockpit interactive function, granting the user interactive permissions.

[0062] As an optional implementation, activating the cockpit interaction function includes at least one of the following: switching the control function of the target cockpit control of the current vehicle to respond to interactive control operations; controlling the augmented reality HUD to switch to the special effects display interface corresponding to the cockpit interaction function; controlling the cockpit camera of the current vehicle to be in the gesture monitoring state corresponding to the cockpit interaction function; and controlling the cockpit microphone of the current vehicle to be in the voice monitoring state corresponding to the cockpit interaction function.

[0063] The aforementioned target cockpit controls are hardware controls within the vehicle's cockpit, such as steering wheel buttons or scroll wheels. The special effects display interface can be a preset display interface, which can be called a "throwing preparation interface," for example, a throwing interface displaying special effects when the driver makes a throwing motion.

[0064] The aforementioned cockpit camera is used to recognize user actions, such as recognizing throwing motions made by the driver. The aforementioned cockpit microphone is used to recognize user voice, such as recognizing the driver's interactive voice.

[0065] In this embodiment, when activating the cockpit interaction function, at least one of the following control contents is required: switching the control function of the target cockpit control of the current vehicle to respond to interactive control operations, or controlling the augmented reality HUD to switch to the special effects display interface corresponding to the cockpit interaction function, or controlling the cockpit camera of the current vehicle to be in the gesture monitoring state corresponding to the cockpit interaction function, and controlling the cockpit microphone of the current vehicle to be in the voice monitoring state corresponding to the cockpit interaction function. This ensures that when the cockpit interaction function is activated, the relevant devices can be correctly and effectively put into the preparation state for starting the interactive game, so that the user can successfully interact with the vehicle.

[0066] For example, when the driver makes a forward throwing motion, activating the cockpit interaction function requires switching the functions of the vehicle's steering wheel buttons or scroll wheel to the functions corresponding to the forward throwing motion, or switching the augmented reality HUD to the throwing preparation interface corresponding to the cockpit interaction function, or controlling the vehicle's cockpit camera to be in gesture detection mode that can recognize the driver's interactive gestures, or controlling the vehicle's cockpit microphone to be in voice detection mode that can recognize the driver's interactive voice, in order to complete the preparation work before the user interacts with the vehicle.

[0067] In this embodiment, after the cockpit interaction function is activated, when the user needs to end the cockpit interaction function, they can manually restore the normal function of the vehicle buttons through a pop-up window. Alternatively, if the automatic restoration of the vehicle buttons' normal function cannot be activated, the user can only wait until the game interaction ends.

[0068] As an optional implementation, the interactive control operation includes at least one of the following: a combined control operation performed on a target cockpit control; a gesture control operation recognized by a cockpit camera; or a voice control operation recognized by a cockpit microphone.

[0069] The aforementioned combined control operations are used to characterize the target cockpit controls requiring simultaneous completion of multiple control operations, including: tapping and scrolling operations, which can be simply referred to as tapping and scrolling, respectively. For example, tapping a button on the steering wheel while simultaneously scrolling the scroll wheel. The aforementioned gesture control operations can be simply referred to as gesture control. The aforementioned voice control operations can be simply referred to as voice control.

[0070] In the embodiments of this application, the interactive control operation includes at least one of the following: a combined control operation performed on a target cockpit control; a gesture control operation recognized by a cockpit camera; and a voice control operation recognized by a cockpit microphone. For example, the interactive control operation includes at least one of the following: pressing a button on the steering wheel while scrolling the scroll wheel; a gesture action made by the user recognized by the cockpit camera; and a voice issued by the user recognized by the cockpit microphone.

[0071] Furthermore, users can interact with and control the vehicle through multiple modalities, including buttons (tactile), gestures (visual), and voice (auditory), allowing them to choose the most suitable interaction method based on the current environment and personal preferences. For example, while driving, users can interact with the vehicle through voice control, enabling them to keep their eyes and hands on the road, thereby improving driving safety.

[0072] As an optional implementation, the cockpit interaction function is a virtual projectile throwing interaction function based on the augmented reality HUD, and the interaction effect is the virtual projectile throwing effect. The vehicle control method further includes the following execution steps:

[0073] Step S221: Determine the target display path based on the rendering position and operation parameters, wherein the target display path is used to represent the target throwing direction and target throwing distance of the virtual projectile in the throwing effect;

[0074] Step S222: Using the operation parameters and the special effects material corresponding to the virtual projectile, generate a target style throwing effect, wherein the target style is used to represent the target size and target quantity of the virtual projectile in the throwing effect.

[0075] The aforementioned target display path is used to represent the target throwing direction, target throwing distance, and target throwing speed of the virtual projectile in the throwing effect. The target throwing speed is determined by the duration of the interactive effect and the target throwing distance. The target throwing direction can be simply referred to as the throwing direction. The target throwing distance can be simply referred to as the throwing distance. The target throwing speed can be simply referred to as the throwing speed. The aforementioned effect material can be an icon of the virtual projectile.

[0076] In this embodiment of the application, after obtaining the rendering position and operation parameters, the target display path can be determined, and by using the operation parameters and the special effects material corresponding to the virtual projectile at this time, the target-style throwing effect can be generated to realize the interaction between the user and the vehicle.

[0077] For example, based on the rendering location and the obtained operation parameters, the throwing path of the virtual projectile is determined, namely the throwing direction, throwing distance, and throwing speed. Based on the operation parameters and the icon corresponding to the virtual projectile at this time, the throwing effect of the virtual projectile is generated, namely the target size and target quantity of the virtual projectile. This makes the virtual projectile have a sense of realism in the interactive game with the user, thereby improving the user experience.

[0078] Through the technical solutions provided in steps S221 to S222 above, this application determines the target display path based on the rendering position and operation parameters, and generates throwing effects based on the operation parameters and special effects materials of virtual objects, so that the throwing effects of the generated virtual objects are more in line with the user's game needs and increase the realism with the real world.

[0079] As an optional implementation, in step S221, the target display path is determined based on the rendering location and operation parameters, including the following execution steps:

[0080] Step S2211: Determine the initial throwing direction and initial throwing distance based on the preset throwing start position and rendering position in the augmented reality HUD;

[0081] Step S2212: Adjust the initial throwing direction using the operation direction in the operation parameters to obtain the target throwing direction;

[0082] Step S2213: Adjust the initial throwing distance using the operation duration in the operation parameters to obtain the target throwing distance;

[0083] Step S2214: Generate the target display path based on the target throwing direction and target throwing distance.

[0084] The aforementioned operation duration can be determined by the duration of the user's specific action, such as the duration of the user's key press, where the key press duration can be referred to as the charging time. It should be noted that this is only an example of operation duration and does not specify the time consumed by the type of action represented by the operation time.

[0085] The initial throwing distance is adjusted based on the operation time to obtain the target throwing distance. The operation time and the target throwing distance are directly proportional, and the target throwing distance can be the furthest possible throwing distance. For example, the longer the user presses the button to charge, the farther the throwing distance.

[0086] In this embodiment, the initial throwing method and initial throwing example are determined based on the preset throwing start position and rendering position. Then, the initial throwing direction can be adjusted using the operation direction in the operation parameters to obtain the target throwing selection. The initial throwing distance can be adjusted using the operation duration in the operation parameters to obtain the target throwing distance. Based on the target throwing direction and target throwing distance obtained above, the purpose of generating the target display path is achieved.

[0087] Optionally, in determining the target throwing direction, the initial throwing direction is adjusted using the operation direction in the operation parameters to obtain a first adjustment result and a first initial throwing direction. The first adjustment result indicates that the initial throwing direction is not within a preset throwing range. Based on the first adjustment result and the operation direction, the first initial throwing direction is adjusted again to obtain a second adjustment result and a second initial throwing direction. The second adjustment result indicates whether the first initial throwing direction is within a preset throwing range. In response to the second adjustment result indicating that the first initial throwing direction is within the preset throwing range, the second initial throwing direction is determined as the target throwing direction. In response to the second adjustment result indicating that the first initial throwing direction is not within the preset throwing range, the following steps are repeated: adjusting the initial throwing direction using the operation direction in the operation parameters to obtain the first adjustment result and the first initial throwing direction. For example, the initial throwing direction can be adjusted multiple times using the operation direction to obtain a more accurate target throwing direction.

[0088] For example, based on the preset throwing start position and rendering position, the initial throwing direction and initial throwing distance can be determined. The initial throwing direction can be adjusted multiple times according to the operation direction so that the final target throwing direction meets the preset throwing range. The initial throwing distance can be adjusted and updated according to the charging time to obtain the target throwing distance. That is, the longer the charging time, the farther the throwing distance. In this way, the throwing path of the virtual projectile can be generated, so that users can successfully improve their interaction with the vehicle through interactive games.

[0089] Furthermore, after obtaining the initial throwing direction and initial throwing distance, the target display path is determined based on the initial throwing direction and initial throwing distance. For example, when the vehicle's interactive game is in fully automatic throwing mode, the display path can be determined directly according to the initial throwing direction and initial throwing distance, thereby reducing the amount of computation required to support the normal operation of the interactive game.

[0090] In this embodiment of the application, when the user does not want to actively adjust the initial throwing direction, a throwing direction can be automatically determined based on the position of the target vehicle, which is the initial throwing direction; when the user needs to actively adjust the initial throwing direction, it can be determined by operating the steering wheel scroll wheel or the button.

[0091] Through the technical solutions provided in steps S2211 to S2214 above, after determining the initial throwing direction and initial throwing distance by setting the preset throwing start position and rendering position, this application adjusts the initial throwing direction and initial throwing distance respectively in combination with the operation direction and operation duration in the operation parameters, so as to achieve the purpose of generating the target display path, thereby obtaining the optimal display path and improving the user's visual experience.

[0092] As an optional implementation, in step S222, the target style throwing effect is generated using the operation parameters and the special effects material corresponding to the virtual projectile, including the following execution steps:

[0093] Step S2221: Determine the target size based on the operation duration and the initial size of the special effects material in the operation parameters;

[0094] Step S2222: Determine the target quantity based on the operation time and the preset quantity accumulation rules;

[0095] Step S2223: Based on the target size, target quantity, and special effects materials, generate a throwing effect for the target style.

[0096] The target size mentioned above can be the maximum size. The target size can be determined by adjusting the initial size based on the operation time. The operation time and the target size are directly proportional, that is, the longer the operation time, the larger the target size. For example, the longer the user presses the button to charge, the larger the size of the virtual projectile will be.

[0097] The target quantity is determined based on the operation time and the preset quantity accumulation rules. The operation time and the target quantity can be directly proportional, that is, the longer the operation time, the larger the target size. For example, the longer the user presses the button to charge up, the more virtual projectiles will be thrown.

[0098] In this embodiment, the target size is determined based on the operation time and the initial size, and the target quantity is determined based on the operation time and a preset quantity accumulation rule. Then, based on the obtained target size, target quantity, and special effects materials, the goal of generating a throwing effect of the target style can be achieved. For example, the longer the charging time, the larger and more numerous the virtual projectiles in the generated throwing effect will be.

[0099] Through the technical solutions provided in steps S2221 to S2223 above, this application can determine the target size based on the user's operation time and initial size, and determine the target quantity based on the operation time and quantity accumulation rules. After obtaining the target size, target quantity, and special effects materials, a throwing effect can be generated. By utilizing the charging time to control the quantity and size of virtual projectiles, a stunning visual effect is provided to the user, thereby offering emotional value and improving vehicle driving safety.

[0100] As an optional implementation, displaying interactive effects in the augmented reality HUD of the current vehicle according to the target display path includes: in response to the completion of the interactive control operation, displaying a throwing effect in the augmented reality HUD according to the target display path, so as to display an effect animation in the augmented reality HUD of throwing virtual objects of target size and target quantity from the throwing start position onto the virtual vehicle corresponding to the target vehicle.

[0101] In this embodiment of the application, when the interactive control operation is completed, the throwing effect can be displayed in the augmented reality HUD according to the target display path, so that the special effect animation of throwing virtual objects of target size and target quantity from the throwing starting position to the virtual vehicle corresponding to the target vehicle can be displayed in the augmented reality HUD. The special effect animation can be an effect produced by imitating the scene in the real world, and can be the final special effect animation.

[0102] For example, after a user makes a forward throwing motion, the corresponding throwing effect can be displayed in the augmented reality HUD according to the throwing path, thus obtaining the final special effect animation, which displays the size, quantity, etc. of the virtual thrown object.

[0103] For another example, users can adjust the specific direction of the virtual projectile using the steering wheel or buttons; they can also control the force and size of the virtual projectile by long-pressing to charge it up. The longer the charge time, the larger and more numerous the virtual projectile will be, and the farther the throwing distance will be. Ultimately, special effects animations can be generated to reflect the user's interaction. These special effects animations are based on a real-world mapping of the vehicle's response to the user's actions, making it appear as if the projectile has actually hit the corresponding object from the user's perspective, thus improving the realism from the user's point of view.

[0104] As an optional implementation, the vehicle control method further includes: in response to the current vehicle detecting a dangerous driving event of the target vehicle, if the current vehicle meets safety conditions, controlling the current vehicle to activate the cockpit interaction function, wherein the safety conditions include: the current vehicle is not in reverse gear, and there is no other information to be displayed in the current vehicle's augmented reality HUD with a higher display priority than the interactive effect.

[0105] If there is no other information to be displayed in the current vehicle's augmented reality HUD that has a higher priority than interactive effects, meaning that no textual prompts related to driving safety appear in the vehicle, it indicates that the vehicle is in a safe state.

[0106] In this embodiment of the application, when the current vehicle detects a dangerous driving event of the target vehicle, it is necessary to determine whether the current vehicle meets the safety conditions. If the current vehicle meets the safety conditions, the current vehicle can be controlled to activate the cockpit interaction function.

[0107] For example, when the vehicle detects a dangerous driving time from the vehicle ahead, if no textual prompts related to driving safety appear in the vehicle, then the display priority of safety-related textual prompts is higher than that of interactive games. In this case, the cockpit interaction function can be activated, allowing users to interact with the vehicle safely, relieving stress, improving the driving experience, and overcoming fatigue. It should be noted that because the virtual projectiles are displayed below the textual prompts and may be obscured by them, the cockpit interaction function can still be activated even when virtual projectiles are displayed.

[0108] Optionally, safety conditions may also include: the interactive function can be activated only when the vehicle is in a non-reverse gear.

[0109] It should be noted that this application requires determining whether the current vehicle meets safety conditions when the current vehicle detects a dangerous driving event of the target vehicle, and only performs other operations when the current vehicle meets the safety conditions. In other words, it provides entertainment to users through interaction with the vehicle while ensuring safe driving.

[0110] In the embodiments of this application, dangerous driving events of the target vehicle are detected. If the current vehicle detects a dangerous driving event, it activates the cockpit interaction function. Then, based on the interactive control operation performed by the current vehicle, interactive effects corresponding to the interactive control operation are displayed in the augmented reality HUD of the current vehicle according to the target display path. Considering that the cockpit interaction function of the current vehicle is activated when the target vehicle triggers a dangerous driving event, and that the user generates user control commands according to current needs to control the current vehicle to perform interactive control operations, thereby displaying interactive effects corresponding to the aforementioned interactive control operations in the current vehicle according to the target display path, the purpose of interacting with the vehicle based on user control commands is achieved. This realizes the technical effect of combining interactive games with the real world and improving the user experience, thus solving the technical problem of interactive games not being integrated with the real world and having a poor user experience.

[0111] According to an embodiment of the present invention, a device embodiment for a vehicle control device is provided. Figure 3 This is a schematic diagram of a vehicle control device according to an embodiment of the present invention. It should be noted that this device can be used to execute the vehicle control method described above. The device includes:

[0112] Control module 301 is used to control the current vehicle to activate the cockpit interaction function in response to the current vehicle detecting a dangerous driving event of the target vehicle;

[0113] Display module 302 is used to respond to interactive control operations performed on the current vehicle and display interactive effects in the augmented reality HUD of the current vehicle according to the target display path, wherein the target display path is determined by the rendering position of the object vehicle in the augmented reality HUD and the operation parameters of the interactive control operation.

[0114] It should be noted that the control module 301 and the display module 302 mentioned above correspond to steps S202 to S204 in the embodiments. The two modules and the corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in the foregoing embodiments.

[0115] Optionally, a dangerous driving event includes at least one of the following: a collision warning event, a lane-cutting event, a lane departure event, and an emergency deceleration event.

[0116] Optionally, controlling the activation of the cockpit interaction function of the current vehicle includes one of the following: activating the cockpit interaction function based on the activation response duration and the detection time of the dangerous driving event; or activating the cockpit interaction function in response to an activation control operation performed on the activation option control, wherein the activation option control is an operation control determined when the current vehicle detects a dangerous driving event.

[0117] Optionally, activating the cockpit interaction function includes at least one of the following: switching the control function of the target cockpit control of the current vehicle to respond to interactive control operations; controlling the augmented reality HUD to switch to the special effects display interface corresponding to the cockpit interaction function; controlling the cockpit camera of the current vehicle to be in the gesture monitoring state corresponding to the cockpit interaction function; and controlling the cockpit microphone of the current vehicle to be in the voice monitoring state corresponding to the cockpit interaction function.

[0118] Optionally, the interactive control operation includes at least one of the following: a combination control operation performed on a target cockpit control; a gesture control operation recognized by a cockpit camera; or a voice control operation recognized by a cockpit microphone.

[0119] Optionally, the cockpit interaction function is a throwing interaction function based on virtual projectiles in the augmented reality HUD, and the interactive effect is the throwing effect of the virtual projectiles. The device is also used to determine the target display path according to the rendering position and operation parameters, wherein the target display path is used to represent the target throwing direction and target throwing distance of the virtual projectiles in the throwing effect; and to generate the target style throwing effect using the operation parameters and the special effect material corresponding to the virtual projectiles, wherein the target style is used to represent the target size and target quantity of the virtual projectiles in the throwing effect.

[0120] Optionally, the device is also used to: determine the initial throwing direction and initial throwing distance based on the preset throwing start position and rendering position in the augmented reality HUD; adjust the initial throwing direction using the operation direction in the operation parameters to obtain the target throwing direction; adjust the initial throwing distance using the operation duration in the operation parameters to obtain the target throwing distance; and generate a target display path based on the target throwing direction and target throwing distance.

[0121] Optionally, the device is also used to determine the target size based on the operation duration and the initial size of the special effects material in the operation parameters; determine the target quantity based on the operation duration and the preset quantity accumulation rule; and generate a throwing effect of the target style based on the target size, the target quantity and the special effects material.

[0122] Optionally, the device is also used to display a throwing effect in the augmented reality HUD according to the target display path in response to the completion of the interactive control operation, so as to display an effect animation in the augmented reality HUD of throwing virtual projectiles of target size and target quantity from the throwing starting position onto the virtual vehicle corresponding to the target vehicle.

[0123] Optionally, the device is also used to, in response to the current vehicle detecting a dangerous driving event of the target vehicle, control the current vehicle to activate the cockpit interaction function if the current vehicle meets safety conditions, wherein the safety conditions include: the current vehicle is not in reverse gear, and there is no other information to be displayed in the current vehicle's augmented reality HUD with a higher display priority than the interactive effect.

[0124] In this embodiment of the invention, the control module responds to the current vehicle detecting a dangerous driving event of the target vehicle by activating the cockpit interaction function; the display module responds to the interactive control operation performed on the current vehicle by displaying interactive effects in the augmented reality HUD of the current vehicle according to the target display path. The target display path is determined by the rendering position of the target vehicle in the augmented reality HUD and the operation parameters of the interactive control operation. This achieves the technical effect of combining interactive games with the real world and improving the user experience, thereby solving the technical problem that interactive games are not combined with the real world and have a poor user experience.

[0125] Embodiments of this application also provide a vehicle, including: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods of various embodiments of the present invention during runtime.

[0126] Embodiments of this application also provide a computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the computer-readable storage medium is located to perform the methods of various embodiments of the present invention.

[0127] Embodiments of this application also provide a computer program product, including a computer program that, when executed by a processor, implements the methods of various embodiments of the present invention.

[0128] Embodiments of this application also provide a computer program product, including a non-volatile computer-readable storage medium for storing a computer program that, when executed by a processor, implements the methods in various embodiments of the present invention.

[0129] Embodiments of this application also provide a computer program that, when executed by a processor, implements the methods described in the various embodiments of the present invention.

[0130] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0131] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0132] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0133] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0134] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0135] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A vehicle control method, characterized in that, Applied to the current vehicle, the vehicle control method includes: In response to the current vehicle detecting a dangerous driving event of the target vehicle, the current vehicle is controlled to activate the cockpit interaction function; In response to an interactive control operation performed on the current vehicle, interactive effects are displayed in the augmented reality HUD of the current vehicle according to a target display path. The target display path is determined by the rendering position of the target vehicle in the augmented reality HUD and the operation parameters of the interactive control operation. The interactive control operation is used to represent the communication action between the user and the vehicle, and the interactive effects are used to calm the driver's emotions.

2. The vehicle control method according to claim 1, characterized in that, The dangerous driving events include at least one of the following: collision warning events, lane cutting events, lane departure events, and emergency deceleration events.

3. The vehicle control method according to claim 1, characterized in that, Controlling the activation of the cockpit interaction function in the current vehicle includes one of the following: The cockpit interaction function is activated based on the activation response duration and the detection time of the dangerous driving event. The cockpit interaction function is activated in response to an activation control operation performed on an activation option control, wherein the activation option control is an operation control determined when the current vehicle detects the dangerous driving event.

4. The vehicle control method according to claim 3, characterized in that, Activating the cockpit interaction function includes at least one of the following: Switch the control function of the target cockpit control of the current vehicle to respond to the interactive control operation; Control the augmented reality HUD to switch to the special effects display interface corresponding to the cockpit interaction function; Control the cockpit camera of the current vehicle to be in the gesture monitoring state corresponding to the cockpit interaction function; Control the current vehicle's cockpit microphone to be in the voice monitoring state corresponding to the cockpit interaction function.

5. The vehicle control method according to claim 1, characterized in that, The interactive control operation includes at least one of the following: Combined control operations performed on the target cockpit controls; Gesture control operations recognized by the cockpit camera; Voice control operations recognized by the cockpit microphone.

6. The vehicle control method according to claim 1, characterized in that, The cockpit interaction function is a throwing interaction function based on the virtual projectile in the augmented reality HUD, and the interactive effect is the throwing effect of the virtual projectile. The vehicle control method further includes: The target display path is determined based on the rendering position and the operation parameters, wherein the target display path is used to characterize the target throwing direction and target throwing distance of the virtual projectile in the throwing effect; Using the operation parameters and the special effects material corresponding to the virtual projectile, the throwing effect of the target style is generated, wherein the target style is used to characterize the target size and target quantity of the virtual projectile in the throwing effect.

7. The vehicle control method according to claim 6, characterized in that, Determining the target display path based on the rendering location and the operation parameters includes: The initial throwing direction and initial throwing distance are determined based on the preset throwing start position in the augmented reality HUD and the rendering position; By adjusting the initial throwing direction using the operation direction in the operation parameters, the target throwing direction is obtained; The initial throwing distance is adjusted using the operation duration in the operation parameters to obtain the target throwing distance; The target display path is generated based on the target throwing direction and the target throwing distance.

8. The vehicle control method according to claim 6, characterized in that, Using the operation parameters and the special effects material corresponding to the virtual projectile, generating the throwing effect of the target style includes: The target size is determined based on the operation duration in the operation parameters and the initial size of the special effects material; The target quantity is determined based on the operation duration and the preset quantity accumulation rules; Based on the target size, the target quantity, and the special effects material, the throwing effect of the target style is generated.

9. The vehicle control method according to claim 6, characterized in that, The interactive effects displayed in the augmented reality HUD of the current vehicle according to the target display path include: In response to the completion of the interactive control operation, the throwing effect is displayed in the augmented reality HUD according to the target display path, so as to show the special effect animation of throwing virtual projectiles of the target size and target quantity from the throwing starting position onto the virtual vehicle corresponding to the target vehicle in the augmented reality HUD.

10. The vehicle control method according to claim 1, characterized in that, The vehicle control method further includes: In response to the current vehicle detecting the dangerous driving event of the target vehicle, when the current vehicle meets safety conditions, the current vehicle is controlled to activate the cockpit interaction function, wherein the safety conditions include: the current vehicle is not in reverse gear, and there is no other information to be displayed in the augmented reality HUD of the current vehicle with a display priority higher than the interactive effects.

11. A vehicle control device, characterized in that, Configured in the current vehicle, the vehicle control device includes: The control module is used to control the current vehicle to activate the cockpit interaction function in response to the current vehicle detecting a dangerous driving event of the target vehicle; The display module is configured to respond to an interactive control operation performed on the current vehicle and display interactive effects in the augmented reality HUD of the current vehicle according to a target display path. The target display path is determined by the rendering position of the target vehicle in the augmented reality HUD and the operation parameters of the interactive control operation. The interactive control operation is used to represent the communication action between the user and the vehicle, and the interactive effects are used to calm the driver's emotions.

12. A vehicle, characterized in that, include: Memory, which stores executable programs; A processor for running the program, wherein the program, when running, executes the vehicle control method according to any one of claims 1 to 10.

Images