Vehicle control method and device, electronic equipment, vehicle and storage medium

Abstract

The invention discloses a vehicle control method and device, electronic equipment, a vehicle and a storage medium, and the method comprises the steps: responding to an activation operation for a control knob of the vehicle, and determining a current activation mode of the control knob; under the condition that the current mode is the unmanned aerial vehicle mode, in response to a control operation for the control knob, a vehicle-mounted unmanned aerial vehicle of the vehicle is controlled to execute a preset operation, and the preset operation at least comprises one of the following items: the vehicle-mounted unmanned aerial vehicle is controlled to execute a flight accompanying operation; controlling the vehicle-mounted unmanned aerial vehicle to execute shooting operation; in the steps, the control knob is arranged in the vehicle, so that the user can control the unmanned aerial vehicle conveniently, the user can control the unmanned aerial vehicle through the control knob, an unmanned aerial vehicle remote controller is not needed, the driving safety is improved, and the flexibility is high.

Description

Technical Field

[0001] This application belongs to the field of vehicle technology, and particularly relates to a vehicle control method, device, electronic equipment, vehicle, and storage medium. Background Technology

[0002] With the rapid development of drone technology and the continuous growth of market demand, the integration of drones with vehicles has become a new trend in the industry, and more and more vehicles are beginning to be equipped with or integrate drone functions.

[0003] Currently, the main control method for drones is the remote controller. This type of control generally requires the operator to hold the remote controller with both hands to ensure the stability and accuracy of the operation. Typically, the left hand is responsible for adjusting the drone's flight direction and altitude, while the right hand is responsible for controlling the flight speed, start and stop, and shooting. Operating a drone remotely while driving a vehicle poses serious safety hazards and is not flexible enough. Summary of the Invention

[0004] This application provides a vehicle control method, device, electronic device, vehicle, and storage medium. By setting a control knob in the vehicle, it is convenient for users to operate. Users can control the drone by controlling the control knob without the need for a drone remote controller, which improves driving safety and provides high flexibility.

[0005] In a first aspect, embodiments of this application provide a vehicle control method, the method being applied to a vehicle, the method comprising: In response to an activation operation of a control knob for the vehicle, determine the current activation mode of the control knob; When the current mode is drone mode, in response to a control operation on the control knob, the vehicle's onboard drone is controlled to perform a preset operation, which includes at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

[0006] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform preset operations, in response to the interactive operation of the control knob, the target flight parameters matched by the interactive operation are determined, and the target flight parameters include at least one of the following: target flight direction and target flight altitude; Control the vehicle-mounted drone to perform corresponding flight operations according to the target flight parameters.

[0007] In one embodiment of this application, the control operation includes a flight escort operation; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a flight operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. The vehicle-mounted drone is controlled to fly within a preset range based on the vehicle's driving data.

[0008] In one embodiment of this application, the control operation includes a shooting operation; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a shooting operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. During the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data, the vehicle-mounted drone is controlled to perform shooting operations to obtain shooting data.

[0009] In one embodiment of this application, after controlling the vehicle-mounted drone to perform a shooting operation, the method further includes: In response to an image extraction operation on the control knob, multiple initial images are displayed. These initial images are extracted from the captured data. The multiple initial images include images of the vehicle cornering, images of the vehicle climbing hills, and images of terrain changes. In response to an image selection operation on the control knob, a target image is determined from multiple frames of the initial images; In response to a video generation operation on the control knob, target video data is generated based on the target image. The target video data includes background audio and subtitle information. The subtitle information includes at least one of the following: altitude information of the area where the vehicle is located, the vehicle's waypoints, and the vehicle's speed.

[0010] In one embodiment of this application, the control operation includes a pathfinding operation; The step of controlling the vehicle's onboard drone to perform preset operations in response to a pathfinding operation on the control knob includes: In response to a pathfinding operation on the control knob, the navigation route of the vehicle is obtained; Control the vehicle-mounted drone to perform a route exploration operation based on the navigation route.

[0011] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform a pathfinding operation, in response to the rotation operation of the control knob, the rotation angle corresponding to the rotation operation is determined. The rotation angle includes at least one preset angle, which is the minimum rotation unit pre-configured for the control knob. The pathfinding distance of the vehicle-mounted drone is displayed based on the rotation angle. In response to a confirmation operation on the control knob, the vehicle-mounted drone is controlled to perform a pathfinding operation based on the vehicle's navigation route and the pathfinding distance.

[0012] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform the route exploration operation, in response to the shooting operation of the control knob, the vehicle-mounted drone is controlled to shoot the target road conditions to obtain the road condition information of the target road conditions, including abnormal road conditions. The displayed navigation map is updated based on the road condition information of the target road.

[0013] Secondly, embodiments of this application provide a vehicle control device, the device comprising: A determination module is used to determine the current activation mode of the control knob in response to an activation operation of the control knob for the vehicle; The control module is configured to, when the current mode is drone mode, control the vehicle-mounted drone to perform a preset operation in response to a control operation on the control knob, wherein the preset operation includes at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

[0014] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, it implements the vehicle control method as described in the first aspect.

[0015] Fourthly, embodiments of this application provide a vehicle including the electronic equipment described in the third aspect.

[0016] Fifthly, embodiments of this application provide a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the vehicle control method as described in the first aspect.

[0017] In a sixth aspect, embodiments of this application provide a computer program product in which instructions, when executed by a processor of an electronic device, cause the electronic device to perform the vehicle control method as described in the first aspect.

[0018] This application provides a vehicle control method, device, electronic device, vehicle, and storage medium. In response to an activation operation of a control knob on a vehicle, the current activation mode of the control knob is determined. If the current mode is a drone mode, in response to a control operation on the control knob, the vehicle-mounted drone is controlled to perform a preset operation. The preset operation includes at least one of the following: controlling the vehicle-mounted drone to perform a flight companion operation; controlling the vehicle-mounted drone to perform a shooting operation; controlling the vehicle-mounted drone to perform a route exploration operation. In the above steps, by setting a control knob in the vehicle, it is convenient for the user to operate. The user can control the drone directly through the control knob without the need for a drone remote controller, improving driving safety and providing high flexibility. Attached Figure Description

[0019] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic flowchart of a vehicle control method provided in an embodiment of this application; Figure 2 This is a schematic diagram of the functional modes provided in the embodiments of this application; Figure 3 This is a schematic diagram of the control knob provided in an embodiment of this application; Figure 4 This is a schematic diagram of the vehicle control device provided in the embodiments of this application; Figure 5 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0021] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are intended only to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0022] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0023] In all specific embodiments of this application, when processing data related to user identity or characteristics, such as user information, user behavior data, user historical data, and user location information, user permission or consent is obtained first. Furthermore, the collection, use, and processing of this data comply with relevant laws, regulations, and standards. Additionally, when embodiments of this application require access to sensitive personal information, separate permission or consent from the user is obtained through pop-ups or redirects to confirmation pages. Only after obtaining the user's separate permission or consent is the necessary user-related data required for the proper functioning of these embodiments obtained.

[0024] The vehicles can be private cars, such as sedans, SUVs, MPVs, or pickup trucks. They can also be commercial vehicles, such as vans, buses, small trucks, or large semi-trailers. Vehicles can be either gasoline-powered or new energy vehicles. When a vehicle is a new energy vehicle, it can be a hybrid or a pure electric vehicle.

[0025] To address the problems of the prior art, embodiments of this application provide a vehicle control method, apparatus, electronic device, vehicle, and storage medium. The vehicle control method provided in this application embodiment will be described first below.

[0026] Figure 1 A flowchart illustrating a vehicle control method provided in an embodiment of this application is shown. Figure 1 As shown, the vehicle control method provided in this application embodiment is applied to a vehicle and includes the following steps 101-102, wherein: Step 101: In response to the activation operation of the control knob for the vehicle, determine the current mode of activation of the control knob.

[0027] The execution subject in this embodiment can be an electronic device, which is installed in a vehicle. A control knob is pre-configured in the vehicle and is communicatively connected to the vehicle. The control knob is located on the center console of the vehicle. This location is for the convenience of user operation, especially for the driver to operate the control knob, and can be considered as a shortcut key for the vehicle.

[0028] In this embodiment, the user operates the control knob, such as pressing the vehicle's control knob, thereby activating the vehicle's control knob. In response to the activation operation of the vehicle's control knob, the vehicle determines the current mode of the control knob activation. The pre-configured modes include intelligent assisted driving mode, parking mode, drone mode, air conditioning mode, multimedia mode, etc., and the current mode is one of the pre-configured modes.

[0029] In intelligent assisted driving mode, the vehicle's driving functions can be controlled via the control knob; in drone mode, the onboard drone can be controlled via the control knob; in air conditioning mode, the vehicle's air conditioning can be controlled via the control knob; in multimedia mode, the vehicle's multimedia system can be controlled via the control knob; and in parking mode, the vehicle's parking function can be controlled via the control knob.

[0030] Step 102: When the current mode is drone mode, in response to the control operation of the control knob, control the vehicle's onboard drone to perform a preset operation, the preset operation including at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

[0031] In this embodiment, when the current mode is drone mode, the user operates the control knob to trigger a control operation. In response to the trigger operation of the control knob, the vehicle-mounted drone is controlled to perform a preset operation. The vehicle-mounted drone is connected to the vehicle and is set at a preset position on the vehicle, such as the roof. The preset operation includes at least one of the following: controlling the vehicle-mounted drone to perform a flight escort operation, controlling the vehicle-mounted drone to perform a shooting operation, and controlling the vehicle-mounted drone to perform a road exploration operation.

[0032] In this embodiment, in response to the activation operation of the control knob on the vehicle, the current mode of the control knob activation is determined. When the current mode is drone mode, the vehicle-mounted drone is controlled to perform preset operations, including at least one of the following: controlling the vehicle-mounted drone to perform a flight escort operation, controlling the vehicle-mounted drone to perform a shooting operation, and controlling the vehicle-mounted drone to perform a route exploration operation. In the above steps, by setting a control knob in the vehicle, it is convenient for users to operate. Users can control the drone by controlling the control knob without the need for a drone remote controller, which improves driving safety and provides high flexibility.

[0033] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform preset operations, in response to the interactive operation of the control knob, the target flight parameters matched by the interactive operation are determined, and the target flight parameters include at least one of the following: target flight direction and target flight altitude; Control the vehicle-mounted drone to perform corresponding flight operations according to the target flight parameters.

[0034] In this embodiment, the control knob is configured with multiple interaction methods, including pressing, moving, and rotating. Users can trigger interactive operations by pressing, moving, or rotating the control knob. The corresponding interactive operations include pressing, moving, and rotating operations. In the process of controlling the vehicle-mounted drone to perform preset operations, in response to the interactive operation on the control knob, the target flight parameters matched by the interactive operation are determined, including at least one of the target flight direction and target flight altitude.

[0035] Optionally, if the interaction method corresponding to the interactive operation is pressing, such as... Figure 3 As shown, users can press within the control area to determine the pressing position and the flight direction based on the pressing position. For example, if the pressing position is on the front side of the control knob, the corresponding flight direction is forward flight. The forward flight is set as the target flight parameter for the interactive operation, and the vehicle-mounted drone is controlled to perform the corresponding flight operation according to the target flight parameter.

[0036] Optionally, if the interaction method corresponding to the interactive operation is movement, such as... Figure 3 As shown, users can move the control knob forward, backward, left, and right to determine the direction of movement. The direction of movement determines the flight direction. For example, if the direction of movement is left, the corresponding flight direction is to fly to the left. The leftward flight is set as the target flight parameter for the interactive operation, and the vehicle-mounted drone is controlled to perform the corresponding flight operation according to the target flight parameter.

[0037] Optionally, for example, if the interaction method corresponding to the interactive operation is rotation, such as Figure 3As shown, users can rotate the control knob to the right or left to determine the rotation direction and angle. For example, if the rotation direction is to the right, the corresponding flight direction is upward. The rotation angle is then determined, and the flight altitude is determined based on the rotation angle. For example, every 15° rotation corresponds to a flight altitude of 3 meters. The upward flight and the flight altitude of 3 meters are set as the target flight parameters for the interactive operation, and the vehicle-mounted drone is controlled to perform the corresponding flight operation according to the target flight parameters.

[0038] Existing drone control typically uses the drone's built-in remote controller, which has a joystick. Drone flight is controlled by moving the joystick, requiring two hands to operate. However, this method is unsuitable for vehicle-mounted drones. This application proposes a control knob located on the vehicle's center console. Users can control the drone simply by rotating the knob, making it convenient and easy to use. Furthermore, it allows for one-handed operation, ensuring driving safety. The driver can also control the vehicle-mounted drone via the knob, enhancing user experience and making operation more convenient.

[0039] In one embodiment of this application, determining the current activation mode of the control knob in response to an activation operation of the control knob for the vehicle includes: In response to a wake-up operation of the vehicle's control knob, the display shows at least one pre-configured functional mode of the vehicle. In response to a mode selection operation on the control knob of the vehicle, a selected function mode is determined from at least one of the function modes; The selected function mode is set as the current mode activated by the control knob.

[0040] In this embodiment, to avoid accidental triggering, the control knob is activated by a long press and click. In response to this activation, at least one functional mode configured for the vehicle is displayed, such as... Figure 2 As shown, when a user presses and holds the control knob, at least one functional mode of the vehicle configuration will be displayed on the vehicle's central control screen. These modes include drone mode, intelligent assisted driving mode, suspension height mode, air conditioning mode, multimedia mode, and parking mode. Each mode corresponds to a different function: intelligent assisted driving mode corresponds to driving-related functions, parking mode corresponds to parking-related functions, drone mode corresponds to in-vehicle drone-related functions, air conditioning mode corresponds to air conditioning-related functions, and multimedia mode corresponds to multimedia-related functions.

[0041] It should be noted that the functional mode is not limited to the above modes, and can also be other modes.

[0042] Furthermore, the user manipulates the vehicle's control knob, such as by rotating the vehicle's control knob, to select a function mode from at least one function mode. That is, in response to the mode selection operation of the vehicle's control knob, the selected function mode is determined from at least one function mode, and the selected function mode is used as the current mode activated by the control knob.

[0043] The control knob has different functions in different modes. It is pre-configured with multiple function modes, and users can select the desired mode to meet their different operation needs.

[0044] In one embodiment of this application, the control operation includes a flight escort operation; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a flight operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. The vehicle-mounted drone is controlled to fly within a preset range based on the vehicle's driving data.

[0045] In this embodiment, the control operation includes a flight companion operation. When the current mode is drone mode, in response to the flight companion operation on the control knob, the vehicle's driving data is acquired. The vehicle's driving data includes the vehicle's driving speed and driving route. The driving route can be a navigation route. The vehicle-mounted drone is controlled to fly within a preset range based on the vehicle's driving data. The preset range can be set according to actual needs.

[0046] Optionally, in the initial flight phase, the vehicle-mounted drone is controlled to fly according to the initial escort parameters, which include horizontal distance, vertical altitude, and angle. The horizontal distance refers to the distance between the vehicle-mounted drone and the vehicle in the horizontal direction; the vertical altitude refers to the distance between the vehicle-mounted drone and the vehicle in the vertical direction; and the angle refers to the spatial orientation angle of the vehicle-mounted drone relative to the vehicle, that is, the angle between the drone and the side and rear of the vehicle when the drone is located at the side and rear of the vehicle.

[0047] After the drone flies to the designated location according to the initial accompaniment parameters, the vehicle-mounted drone is controlled to fly within a preset range based on the vehicle's driving data. Specifically, when the vehicle's speed is greater than the preset speed, the vehicle-mounted drone is controlled to fly within the preset range while following the driving route, according to the adjusted accompaniment parameters. The adjusted accompaniment parameters are adjustments to the initial accompaniment parameters, such as increasing the horizontal distance from the initial 50m to 80m, and the altitude from the initial 15m to 20m. The angle can remain unchanged, and the increased values ​​are not limited to the above values ​​and can be set in advance according to needs. When the vehicle's speed is less than or equal to the preset speed, the step of controlling the vehicle-mounted drone to fly according to the initial accompaniment parameters is executed.

[0048] Optionally, if the altitude of the vehicle changes by more than or equal to a preset altitude, such as 5m, the vehicle-mounted drone can be controlled to adjust its vertical relative altitude with the vehicle to ensure that the vertical distance between the two always remains at a preset threshold.

[0049] Optionally, when a turning road is detected in front of the vehicle, the vehicle-mounted drone is controlled to adjust its flight angle when there is a preset distance from the turning road to ensure continuous footage during the turning process.

[0050] Optionally, during the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data, the vehicle-mounted drone can be adjusted by moving forward and backward, or left and right. See [link to relevant documentation]. Figure 3 In response to a forward movement of the control knob, the vehicle-mounted drone flies forward; in response to a backward movement of the control knob, it flies backward; in response to a left movement of the control knob, it flies left; in response to a right movement of the control knob, it flies right; and in response to a retracting movement of the control knob, it returns to a preset position on the vehicle. The functions are not limited to the above; the control knob can also be configured according to requirements.

[0051] The drone can be operated by using the control knob located on the vehicle, which solves the problem of requiring two hands in the traditional control mode, making it easier for users to operate and ensuring higher safety.

[0052] In one embodiment of this application, the control operation includes a shooting operation; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a shooting operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. During the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data, the vehicle-mounted drone is controlled to perform shooting operations to obtain shooting data.

[0053] In this embodiment, the user operates the control knob, such as pressing the knob to trigger a shooting operation. In response to the shooting operation of the control knob, the vehicle's driving data is acquired. The vehicle's driving data includes the vehicle's driving speed and driving route, and the driving route can be a navigation route.

[0054] During the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data, the vehicle-mounted drone is controlled to perform shooting operations to obtain shooting data, and the drone transmits the shooting data back to the vehicle.

[0055] The drone can be operated by using the control knob located on the vehicle, making it convenient and flexible for users to shoot. It eliminates the need to operate the drone remote control, thus improving the user experience.

[0056] In one embodiment of this application, after controlling the vehicle-mounted drone to perform a shooting operation, the method further includes: In response to an image extraction operation on the control knob, multiple initial images are displayed. These initial images are extracted from the captured data. The multiple initial images include images of the vehicle cornering, images of the vehicle climbing hills, and images of terrain changes. In response to an image selection operation on the control knob, a target image is determined from multiple frames of the initial images; In response to a video generation operation on the control knob, target video data is generated based on the target image. The target video data includes background audio and subtitle information. The subtitle information includes at least one of the following: altitude information of the area where the vehicle is located, the vehicle's waypoints, and the vehicle's speed.

[0057] In this embodiment, the user operates the control knob. For example, double-clicking the knob triggers an image extraction operation, which can obtain exciting clips from the captured data. In response to the image extraction operation of the control knob, multiple initial images are displayed. The initial images are extracted from the captured data. The initial images include images taken by the onboard human-machine interface when the vehicle is going through a curve, images taken by the onboard human-machine interface when the vehicle is climbing a hill, and images when the terrain where the parking space is located changes. The initial images are not limited to the above images and may also include other images.

[0058] Furthermore, users can select a target image from multiple initial images by manipulating the control knob. For example, users can select several initial images as the target image, or they can select all the multiple initial images as the target image. Users can also press and hold the control knob to confirm the multiple initial images as the target image.

[0059] Furthermore, in response to the video generation operation of the control knob, target video data is generated based on the target image. The target video data includes background audio and subtitle information. The background audio can be selected to match the scene in the target image. The subtitle information includes the altitude information of the area where the vehicle is located, the vehicle's waypoints, and the vehicle's speed.

[0060] By operating the control knob, videos can be automatically generated based on exciting clips, enhancing the user experience.

[0061] In one embodiment of this application, the control operation includes a pathfinding operation; The step of controlling the vehicle's onboard drone to perform preset operations in response to a pathfinding operation on the control knob includes: In response to a pathfinding operation on the control knob, the navigation route of the vehicle is obtained; Control the vehicle-mounted drone to perform a route exploration operation based on the navigation route.

[0062] In this embodiment, the user manipulates the control knob, such as by pressing and holding the control knob to trigger a pathfinding operation. In response to the pathfinding operation of the control knob, the navigation route of the vehicle is obtained, and the vehicle-mounted drone is controlled to perform a pathfinding operation based on the navigation route.

[0063] The drone can be used for navigation by means of a control knob located on the vehicle, which solves the problem of requiring two hands in the traditional control mode, making it easier for users to operate and safer.

[0064] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform a pathfinding operation, in response to the rotation operation of the control knob, the rotation angle corresponding to the rotation operation is determined. The rotation angle includes at least one preset angle, which is the minimum rotation unit pre-configured for the control knob. The pathfinding distance of the vehicle-mounted drone is displayed based on the rotation angle. In response to a confirmation operation on the control knob, the vehicle-mounted drone is controlled to perform a pathfinding operation based on the vehicle's navigation route and the pathfinding distance.

[0065] In this embodiment, during the process of controlling the vehicle-mounted drone to perform the pathfinding operation, the user can operate the control knob, such as rotating the control knob. In response to the rotation operation of the control knob, the rotation angle corresponding to the rotation operation is determined. The rotation angle includes at least one preset angle. Each preset angle is the minimum rotation unit pre-configured by the control knob, such as 15°. For each preset angle rotated by the user, the pathfinding distance increases by a preset value. For example, rotating 15° increases the pathfinding distance by 5m, and rotating another 15° increases the pathfinding distance by another 5m.

[0066] The system displays the pathfinding distance of the vehicle-mounted drone based on the rotation angle for user confirmation. The user can operate the control knob; pressing the control knob triggers a confirmation operation. In response to the confirmation operation on the control knob, the system controls the vehicle-mounted drone to perform pathfinding operations based on the vehicle's navigation route and the pathfinding distance.

[0067] The rotation allows for adjustment of the exploration distance, making it easier for users to explore road conditions and improving driving safety.

[0068] In one embodiment of this application, the method further includes: Each time the preset angle is rotated, a preset operation is performed. The preset operation includes at least one of the following: controlling the motor inside the control knob to vibrate, controlling the vehicle to play a prompt sound, and highlighting the candidate parking space corresponding to the preset angle.

[0069] In this embodiment, a preset operation is performed every time the preset angle is rotated. The preset operation includes at least one of the following: controlling the vibration of the motor inside the control knob, controlling the vehicle parking prompt sound, and displaying the exploration distance corresponding to the preset angle. The vibration feedback allows the user to quickly determine whether the control knob has been successfully triggered, avoiding misoperation. The prompt sound is also to make the user clearer about their operation. Displaying the exploration distance makes the user clearer about their operation more intuitively.

[0070] Multiple cues, including tactile, visual, and auditory cues, can enhance the user experience.

[0071] In one embodiment of this application, the method further includes: During the process of controlling the vehicle-mounted drone to perform the route exploration operation, in response to the shooting operation of the control knob, the vehicle-mounted drone is controlled to shoot the target road conditions to obtain the road condition information of the target road conditions, including abnormal road conditions. The displayed navigation map is updated based on the road condition information of the target road.

[0072] In this embodiment, during the process of controlling the vehicle-mounted drone to perform the route exploration operation, the navigation information can be updated by acquiring road condition information of the road ahead. The user can operate the control knob, such as pressing the knob to trigger a shooting operation. In response to the shooting operation of the control knob, the vehicle-mounted drone is controlled to shoot the target road condition to obtain the road condition information of the target road condition. The vehicle-mounted drone transmits the road condition information of the target road condition back to the vehicle. The target road condition includes abnormal road conditions.

[0073] Based on the road condition information of the target road, the displayed navigation map is updated. For example, abnormal road conditions ahead are captured in real time and risk areas are marked. High-risk areas, such as steep slopes / potholes, are marked with red boxes, and medium-risk areas, such as gentle slopes and gravel roads, are marked with yellow boxes. These are then overlaid on the navigation map on the central control display screen to highlight abnormal road conditions.

[0074] By operating the control knob, abnormal road conditions can be photographed, thereby updating the navigation map, improving driving safety, and making it easier for users to operate.

[0075] Figure 4 A structural diagram of the vehicle control device provided in an embodiment of this application is shown. Figure 4 As shown, the vehicle control device 400 includes: The determination module 401 is configured to determine the current activation mode of the control knob in response to an activation operation of the control knob for the vehicle. Control module 402 is configured to, when the current mode is drone mode, control the vehicle-mounted drone to perform a preset operation in response to a control operation on the control knob, the preset operation including at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

[0076] In one embodiment of this application, the control module is further configured to, in response to an interactive operation on the control knob, determine the target flight parameters matching the interactive operation during the process of controlling the vehicle-mounted drone to perform a preset operation, wherein the target flight parameters include at least one of the following: target flight direction and target flight altitude; and control the vehicle-mounted drone to perform the corresponding flight operation according to the target flight parameters.

[0077] In one embodiment of this application, the control operation includes a flight escort operation; the control module 402 includes a first acquisition module and a first control submodule; The first acquisition module is used to acquire the vehicle's driving data in response to the accompanying operation of the control knob, the driving data including the vehicle's driving speed and the vehicle's driving route. The first control submodule is used to control the vehicle-mounted drone to fly within a preset range based on the vehicle's driving data.

[0078] In one embodiment of this application, the control operation includes a flight escort operation; the control module 402 includes a second acquisition module and a second control submodule; The second acquisition module is used to acquire the vehicle's driving data in response to the shooting operation of the control knob, the driving data including the vehicle's speed and the vehicle's driving route. The second control submodule is used to control the vehicle-mounted drone to perform shooting operations to obtain shooting data during the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data.

[0079] In one embodiment of this application, the device includes a display module, an image determination module, and a video generation module; The display module is configured to display multiple initial images in response to an image extraction operation on the control knob. The initial images are extracted from the captured data, and the multiple initial images include images of the vehicle cornering, images of the vehicle climbing hills, and images of terrain changes. An image determination module is configured to determine a target image from multiple frames of the initial images in response to an image selection operation on the control knob; A video generation module is configured to generate target video data based on the target image in response to a video generation operation on the control knob. The target video data includes background audio and subtitle information. The subtitle information includes at least one of the following: altitude information of the area where the vehicle is located, the points the vehicle has traveled through, and the vehicle's speed.

[0080] In one embodiment of this application, the control operation includes a pathfinding operation; the control module 402 includes a third acquisition module and a third control submodule; The third acquisition module is used to acquire the navigation route of the vehicle in response to the pathfinding operation of the control knob; The third control submodule is used to control the vehicle-mounted drone to perform a pathfinding operation based on the navigation route.

[0081] In one embodiment of this application, the third control submodule includes a first determining subunit, a display subunit, and a control subunit; The first determining subunit is used to determine the rotation angle corresponding to the rotation operation in response to the rotation operation of the control knob during the process of controlling the vehicle-mounted drone to perform the pathfinding operation. The rotation angle includes at least one preset angle, which is the minimum rotation unit pre-configured by the control knob. The display subunit is used to display the pathfinding distance of the vehicle-mounted drone according to the rotation angle; A control subunit is configured to control the vehicle-mounted UAV to perform a pathfinding operation based on the vehicle's navigation route and the pathfinding distance in response to a confirmation operation of the control knob.

[0082] In one embodiment of this application, the third control submodule includes an acquisition subunit and an update subunit; The acquisition subunit is used to control the vehicle-mounted drone to take pictures of the target road conditions in response to the shooting operation of the control knob during the process of controlling the vehicle-mounted drone to perform the road exploration operation, so as to obtain the road condition information of the target road conditions, including abnormal road conditions. The update subunit is used to update the displayed navigation map based on the road condition information of the target road condition.

[0083] The vehicle control device provided in this application embodiment can realize the various processes implemented in the aforementioned vehicle control method embodiment and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0084] Figure 5 A schematic diagram of the hardware structure of the electronic device provided in an embodiment of this application is shown.

[0085] The electronic device may include a processor 501 and a memory 502 storing computer program instructions.

[0086] Specifically, the processor 501 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0087] Memory 502 may include mass storage for data or instructions. For example, and not limitingly, memory 502 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 502 may include removable or non-removable (or fixed) media. Where appropriate, memory 502 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 502 is non-volatile solid-state memory.

[0088] Memory may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, and electrical, optical, or other physical / tangible memory storage devices. Therefore, typically, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to the first aspect of this disclosure.

[0089] The processor 501 implements any of the methods described above in the above embodiments by reading and executing computer program instructions stored in the memory 502.

[0090] In one example, the electronic device may also include a communication interface 503 and a bus 510. Wherein, as... Figure 5 As shown, the processor 501, memory 502, and communication interface 503 are connected through bus 510 and complete communication with each other.

[0091] The communication interface 503 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0092] Bus 510 includes hardware, software, or both, that couples components of a method or electronic device as described above together. For example, and not as a limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 510 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, any suitable bus or interconnect is contemplated herein.

[0093] In addition, this application provides a vehicle that includes the aforementioned electronic equipment.

[0094] Alternatively, embodiments of this application can be implemented using a computer storage medium. This computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the vehicle control methods described in the above embodiments.

[0095] Alternatively, this application embodiment can provide a computer program product for implementation, wherein the instructions in the computer program product, when executed by the processor of an electronic device, cause the electronic device to implement any of the vehicle control methods in the above embodiments.

[0096] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described as examples. However, the method process of this application is not limited to the specific steps described. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0097] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0098] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0099] The aspects of this disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0100] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A vehicle control method, characterized in that, The method is applied to a vehicle, and the method includes: In response to an activation operation of a control knob for the vehicle, determine the current activation mode of the control knob; When the current mode is drone mode, in response to a control operation on the control knob, the vehicle's onboard drone is controlled to perform a preset operation, which includes at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

2. The vehicle control method according to claim 1, characterized in that, The method further includes: During the process of controlling the vehicle-mounted drone to perform preset operations, in response to the interactive operation of the control knob, the target flight parameters matched by the interactive operation are determined, and the target flight parameters include at least one of the following: target flight direction and target flight altitude; Control the vehicle-mounted drone to perform corresponding flight operations according to the target flight parameters.

3. The vehicle control method according to claim 1, characterized in that, The control operations include escort operations; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a flight operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. The vehicle-mounted drone is controlled to fly within a preset range based on the vehicle's driving data.

4. The vehicle control method according to claim 1, characterized in that, The control operations include shooting operations; The control of the vehicle's onboard drone to perform preset operations in response to a control operation on the control knob includes: In response to a shooting operation on the control knob, the vehicle's driving data is acquired, including the vehicle's speed and driving route. During the process of controlling the vehicle-mounted drone to fly based on the vehicle's driving data, the vehicle-mounted drone is controlled to perform shooting operations to obtain shooting data.

5. The vehicle control method according to claim 4, characterized in that, After controlling the vehicle-mounted drone to perform the shooting operation, the method further includes: In response to an image extraction operation on the control knob, multiple initial images are displayed. These initial images are extracted from the captured data. The multiple initial images include images of the vehicle cornering, images of the vehicle climbing hills, and images of terrain changes. In response to an image selection operation on the control knob, a target image is determined from multiple frames of the initial images; In response to a video generation operation on the control knob, target video data is generated based on the target image. The target video data includes background audio and subtitle information. The subtitle information includes at least one of the following: altitude information of the area where the vehicle is located, the vehicle's waypoints, and the vehicle's speed.

6. The vehicle control method according to claim 1, characterized in that, The control operations include pathfinding operations; The step of controlling the vehicle's onboard drone to perform preset operations in response to a pathfinding operation on the control knob includes: In response to a pathfinding operation on the control knob, the navigation route of the vehicle is obtained; Control the vehicle-mounted drone to perform a route exploration operation based on the navigation route.

7. The vehicle control method according to claim 6, characterized in that, The method further includes: During the process of controlling the vehicle-mounted drone to perform a pathfinding operation, in response to the rotation operation of the control knob, the rotation angle corresponding to the rotation operation is determined. The rotation angle includes at least one preset angle, which is the minimum rotation unit pre-configured for the control knob. The pathfinding distance of the vehicle-mounted drone is displayed based on the rotation angle. In response to a confirmation operation on the control knob, the vehicle-mounted drone is controlled to perform a pathfinding operation based on the vehicle's navigation route and the pathfinding distance.

8. The vehicle control method according to claim 6, characterized in that, The method further includes: During the process of controlling the vehicle-mounted drone to perform the route exploration operation, in response to the shooting operation of the control knob, the vehicle-mounted drone is controlled to shoot the target road conditions to obtain the road condition information of the target road conditions, including abnormal road conditions. The displayed navigation map is updated based on the road condition information of the target road.

9. A vehicle control device, characterized in that, The device includes: A determination module is used to determine the current activation mode of the control knob in response to an activation operation of the control knob for the vehicle; The control module is configured to, when the current mode is drone mode, control the vehicle-mounted drone to perform a preset operation in response to a control operation on the control knob, wherein the preset operation includes at least one of the following: Control the vehicle-mounted drone to perform escort operations; Control the vehicle-mounted drone to perform shooting operations; Control the vehicle-mounted drone to perform pathfinding operations.

10. An electronic device, characterized in that, include: Processor and memory storing computer program instructions; When the processor executes the computer program instructions, it implements the vehicle control method as described in any one of claims 1-8.

11. A vehicle, characterized in that, Including the electronic device as described in claim 10.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processor, implement the vehicle control method as described in any one of claims 1-8.

Images