Perception enhancement control method, device, equipment and storage medium

Abstract

The present invention belongs to the technical field of assisted driving, and discloses a perception enhancement control method, device, equipment and storage medium. The method comprises: responding to a perception enhancement input instruction, determining a target function and input parameters; determining a target display device according to the target function; and displaying an augmented reality image of the current road in the target display device according to the input enhancement parameters. Through the above scheme, image enhancement is performed on different target display devices (such as HUD, rearview mirror and other display functions, etc.) through user input instructions to compensate for the insufficient sensor detection function, improve the safety of the vehicle, and optimize the user experience.

Description

Technical Field

[0001] The present invention relates to the field of assisted driving technology, and in particular to a perception enhancement control method, device, equipment and storage medium. Background Art

[0002] Current smart driving vehicles can achieve safe driving in most situations on highways, but lack response measures for special situations, such as various forms of faulty vehicles, road repairs, and vehicle diversion devices ahead. For vehicles with low configuration or sensor failure, they may not be able to effectively perceive the road conditions ahead.

[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present invention is to provide a perception enhancement control method, device, equipment and storage medium, aiming to solve the technical problem of insufficient vehicle perception ability in the prior art.

[0005] To achieve the above object, the present invention provides a perception enhancement control method, the method comprising the following steps:

[0006] Respond to sensory enhancement input instructions and determine target functions and input parameters;

[0007] determining a target display device according to the target function;

[0008] An augmented reality image of the current road is displayed in the target display device according to the input augmentation parameters.

[0009] Optionally, the method further includes:

[0010] Obtain sensor perception information;

[0011] Analyze the perception state according to the sensor perception information to determine the current perception level;

[0012] When the perception level is lower than a preset perception level, insufficient perception capability prompt information is generated.

[0013] Optionally, the method further includes:

[0014] Obtain sensor perception information;

[0015] Determine the sensing distance of each type of sensor according to the sensor sensing information;

[0016] Generate a perception range schematic image according to the perception distance corresponding to the sensor;

[0017] The perception range augmented reality image of the current road is displayed according to the perception range schematic image.

[0018] Optionally, the method is applied to a perception enhancement interaction interface, wherein the perception enhancement interaction interface includes a perception display area and a plurality of perception input controls;

[0019] The responding to the perception enhancement input instruction and determining the target function and input parameters also includes:

[0020] Obtain sensor perception information;

[0021] Displaying a current road status image in the perception display area according to the sensor perception information;

[0022] Responding to the perceived input control operation instruction, generating parameter information corresponding to the input control and control response information;

[0023] A perception enhancement input instruction is generated according to the parameter information and the control response information.

[0024] Optionally, generating the perception enhancement input instruction according to the parameter information and the control response information includes:

[0025] determining a perception-enhanced image parameter according to the parameter information;

[0026] Determining the perception enhancement image coordinates according to the control response information;

[0027] A perception enhancement input instruction is generated according to the perception enhancement image parameters and the perception enhancement image coordinates.

[0028] Optionally, the perception-enhanced interaction interface also includes: a control input control; the method also includes: responding to a perception input control operation instruction, generating corresponding user operation parameters and control response information; and generating a vehicle control instruction based on the user operation parameters and control response information.

[0029] Optionally, after displaying the current road status image in the perception display area according to the sensor perception information, it also includes: responding to a long press command of the perception display area, determining the perception information corresponding to the long press position; generating a perception enhancement deletion command according to the perception information; and deleting the corresponding augmented reality image according to the perception enhancement deletion command.

[0030] Optionally, after displaying the current road state image in the perception display area according to the sensor perception information, the method further includes:

[0031] Respond to the long press command in the perception display area and determine the perception information corresponding to the long press position;

[0032] generating a perception enhancement deletion instruction according to the perception information;

[0033] According to the perception enhancement deletion instruction, the corresponding augmented reality image is deleted.

[0034] In addition, to achieve the above-mentioned purpose, the present invention further proposes a perception enhancement control device, the perception enhancement control device comprising:

[0035] A processing module, for responding to the perception enhancement input command and determining the target function and input parameters;

[0036] The processing module is further used to determine a target display device according to the target function;

[0037] The display module is used to display an augmented reality image of the current road in a target display device according to the input augmentation parameters.

[0038] In addition, to achieve the above-mentioned purpose, the present invention also proposes a perception enhancement control device, which includes: a memory, a processor, and a perception enhancement control program stored in the memory and executable on the processor, and the perception enhancement control program is configured to implement the steps of the perception enhancement control method described above.

[0039] In addition, to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which a perception enhancement control program is stored, and when the perception enhancement control program is executed by a processor, the steps of the perception enhancement control method described above are implemented.

[0040] The present invention responds to the perception enhancement input command, determines the target function and input parameters; determines the target display device according to the target function; and displays the augmented reality image of the current road in the target display device according to the input enhancement parameters. Through the above scheme, it is realized that the image enhancement is performed on different target display devices (such as HUD, rearview mirror and other display functions, etc.) through the user's input command to make up for the insufficient sensor detection function, improve the safety of the vehicle, and optimize the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a structural diagram of a perception enhancement control device for a hardware operating environment involved in an embodiment of the present invention;

[0042] Figure 2 It is a flowchart of the first embodiment of the perception enhancement control method of the present invention;

[0043] Figure 3 It is a flow chart of the second embodiment of the perception enhancement control method of the present invention;

[0044] Figure 4A schematic diagram of an interactive interface of an embodiment of a perception enhancement control method of the present invention;

[0045] Figure 5 This is a structural block diagram of the first embodiment of the perception enhancement control device of the present invention.

[0046] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0048] Reference Figure 1 , Figure 1 It is a schematic diagram of the structure of a perception enhancement control device for a hardware operating environment involved in an embodiment of the present invention.

[0049] like Figure 1 As shown, the perception enhancement control device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (Wireless-Fidelity, Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0050] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation of the perception enhancement control device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0051] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a perception enhancement control program.

[0052] exist Figure 1In the perception enhancement control device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the perception enhancement control device of the present invention can be set in the perception enhancement control device, and the perception enhancement control device calls the perception enhancement control program stored in the memory 1005 through the processor 1001, and executes the perception enhancement control method provided by the embodiment of the present invention.

[0053] The embodiment of the present invention provides a perception enhancement control method, referring to Figure 2 , Figure 2 It is a flowchart of a first embodiment of a perception enhancement control method of the present invention.

[0054] In this embodiment, the perception enhancement control method includes the following steps:

[0055] Step S10: responding to the perception enhancement input instruction and determining the target function and input parameters.

[0056] It should be noted that the executor of this embodiment is a smart terminal, which can be a vehicle control device, or a vehicle-mounted computer, a tablet, a mobile terminal, etc. It can also be other devices that are the same or similar to the vehicle control device. This embodiment does not limit this and only takes the vehicle control device as an example for explanation.

[0057] It is understandable that this embodiment is applied to scenarios where the vehicle's perception ability is insufficient, such as in foggy weather. The system can display the targets it perceives in the passenger's field of vision through the HUD in an enhanced display manner, and simultaneously display the perceived targets on the passenger's operating device. It is convenient for users to make judgments, that is, the targets that are not enhanced are the targets that the system does not perceive. Or the system can project the perception range on the HUD, and the targets outside the perception range are the targets that the system cannot recognize. Or in certain sensor-restricted scenarios, such as rain and fog, strong electromagnetic interference, backlight, etc., when the sensor is blind, the occupants are actively requested to perform auxiliary perception. If the sensor failure in a certain direction, such as the side rear radar failure, the occupants can be requested to perform auxiliary input on the targets within a certain range of the side rear. When the sensor fails, the vehicle may not detect the target, but the co-pilot can observe it. In order to improve the user experience, the co-pilot can perceive it and input some perception enhancement input instructions to enhance the vision of the main driver and complete the reminder. This function works well in some special working conditions. For example, in foggy weather, the onboard radar can detect the distance of the vehicle in front, but the high-definition camera cannot work well and cannot determine the type of the target. At this time, the co-pilot can use the observation to mark the target type to help the driver perceive it. Or, when a sensor fails,

[0058] It should be noted that the perception enhancement input instruction refers to the control instruction generated by the user's guidance when there is a discrepancy between the perception ability and the user's expectation. When determining the perception enhancement input instruction, it is necessary to determine what the corresponding adjustment function in the instruction is, such as: target type labeling, target distance, side target position, etc., as well as input parameters such as: distance value, target type, etc.

[0059] Step S20: determining a target display device according to the target function.

[0060] It should be noted that the target display device may include a HUD (Head-Up Display), a rearview mirror, images displayed by cameras in the vehicle, or a user's wearable device (head-mounted display), etc. Different target functions need to be displayed in different locations.

[0061] Step S30: displaying an augmented reality image of the current road in a target display device according to the input augmentation parameters.

[0062] It should be noted that the process of displaying the target display device according to the input enhancement parameter can be: the system can display the target it perceives in the passenger's field of vision through the HUD in an enhanced display manner, and simultaneously display the perceived target on the passenger's operating device. It is convenient for users to make judgments, that is, the target without enhanced display is the target that the system does not perceive. Or the system can project the perception range on the HUD, and the target outside the perception range is the target that the system cannot recognize. In some scenes where the sensor is limited, such as rain and fog, strong electromagnetic interference, backlight, etc., which cause the sensor to be blind, the occupants are actively requested to perform auxiliary perception. If the sensor failure in a certain direction is detected, such as a side rear radar failure, the occupants can be requested to perform auxiliary input on the target within a certain range of the side rear. For the perception of the side rear target, the distance perception can be assisted by marking the distance on the display image of the rearview camera (some vehicles now use cameras instead of exterior rearview mirrors). Or the target perceived by the system can be directly matched to the screen of the electronic exterior rearview mirror, so that the user can confirm the target that has not been recognized by the system. The system classifies and summarizes the target types and scenes with weak perception or inability to perceive, and puts them on the user input interface for easy selection. For example, vehicles with abnormal postures, special vehicles, vehicles with special colors, long trucks, gates, whether variable lanes are passable, outside the sensing range (usually the effective sensing distance is only 150 meters), animals, children, roadblocks, extra-wide lane route selection, merging, etc. The content input by the user is displayed on the HUD, such as lane markings, distance markings, target markings, etc.

[0063] In this embodiment, sensor perception information is acquired; the perception state is analyzed according to the sensor perception information to determine the current perception level; when the perception level is less than a preset perception level, insufficient perception capability prompt information is generated.

[0064] It should be noted that the sensor perception information can be obtained by using appropriate sensors (such as cameras, radars, lidars, etc.) to obtain environmental data, such as road conditions, traffic conditions, obstacle locations, etc. The perception state is analyzed, and the information obtained by the sensor is processed and analyzed using an algorithm to determine the current perception state. This may involve technologies such as object detection, tracking, and scene analysis. Based on the results of the analysis, the current perception level is determined. This can be a qualitative level (such as good, average, poor) or a quantitative score. For example: the camera perception level can be scored based on the camera perception distance, and the level can be determined based on the perception range of the millimeter wave radar. When the sensor fails or the sensor perception capability is insufficient, a perception capability insufficient prompt message is generated to prompt other members in the vehicle to perform the perceived perception auxiliary operation. If the current perception level is less than the preset perception level, a perception capability insufficient prompt message is generated. This prompt message can be in the form of text, sound, or graphics to remind the driver that the current perception state may not be sufficient to ensure safe driving.

[0065] In this embodiment, sensor perception information is obtained; the perception distance of each type of sensor is determined based on the sensor perception information; a perception range schematic image is generated based on the perception distance corresponding to the sensor; and an augmented reality image of the perception range of the current road is displayed based on the perception range schematic image.

[0066] It should be noted that various sensors (such as cameras, radars, lidars, etc.) are used to obtain environmental information, such as the location of obstacles, the speed of the vehicle, the shape of the road, etc. For each sensor, its perception range or distance is determined according to its technical specifications and current environmental conditions. This may require consideration of factors such as the resolution, accuracy, and working conditions of the sensor. The sensor information and perception distance obtained are used to generate a perception range schematic image of each sensor. This can be a simple geometric figure or a virtual simulation based on actual environmental data. The generated perception range schematic image is superimposed with the camera image of the current road or the image transmitted through the HUD or rearview mirror to display the perception range augmented reality image of the current road. This can be achieved through computer vision technology, which fuses the sensor perception information with the camera image. The augmented reality image in the perception range is displayed in front of the user for assisted driving. The user who performs perception enhancement input can adjust or add the image on this basis to improve the efficiency of auxiliary image enhancement, and the passenger who assists in vehicle perception can be given a reference to improve the effect of perception enhancement control.

[0067] This embodiment responds to the perception enhancement input command, determines the target function and input parameters; determines the target display device according to the target function; and displays the augmented reality image of the current road in the target display device according to the input enhancement parameters. Through the above scheme, it is possible to perform image enhancement on different target display devices (such as HUD, rearview mirror and other display functions, etc.) through the user's input command to make up for the lack of sensor detection function, improve vehicle safety, and optimize user experience.

[0068] refer to Figure 3 , Figure 3 This is a flow chart of a second embodiment of a perception enhancement control method of the present invention.

[0069] Based on the first embodiment, the perception enhancement control method of this embodiment further includes, before step S10:

[0070] The method is applied to a perception enhancement interaction interface, which includes a perception display area and a plurality of perception input controls.

[0071] It should be noted that the perception enhancement interactive interface is an interface used to provide input content to the user, for example: Figure 4 As shown, the perception display area 1001 is used to display the current status of the vehicle, which can be an image or text information, and the perception input control 1002 is used to provide the user with an operation method. However, it should be noted that this embodiment is not used to limit the display form of the perception display area and multiple perception input controls. The perception input control can be a button, a slider, an input box, a drag box, a selection box, etc., or it can be hidden in the interface and not displayed, and only requires a specific method to operate, such as long pressing, sliding a certain track, double-clicking, etc. This embodiment does not limit the display form of the perception input control.

[0072] Step S01: Acquire sensor perception information.

[0073] It should be noted that sensor perception information refers to the various physical quantities or characteristics of the surrounding environment detected, measured or perceived by the sensor equipment on the vehicle, and then converted into digital or analog signals for processing, analysis or control by computers or other systems. This information can include various parameters such as temperature, humidity, pressure, light intensity, sound, movement, etc.

[0074] Step S02: Displaying a current road status image in the perception display area according to the sensor perception information.

[0075] It should be noted that the perception display area is used to display the current perception situation, mainly to provide some reference for the operating user, such as: the sensing range of the sensor, the surrounding vehicles or obstacles, the current road conditions, lane lines, grid lines and some current working parameters of the vehicle, etc. According to the information perceived by the sensor, the current road status can be displayed by converting it into images or graphics to help drivers or traffic managers understand the current road conditions. This display can be achieved through traffic monitoring screens, vehicle displays or mobile applications.

[0076] Step S03: Responding to the perceived input control operation instruction, generating parameter information and control response information corresponding to the input control.

[0077] It can be explained that, in response to the perception input control operation instructions, the system will generate corresponding parameter information, and then the system will make corresponding control responses according to the user's operation instructions. For example, if the user instructs the sensor to increase a certain perception value corresponding to the sensor, the display value of the value on the target device will be increased, and the corresponding control response information will indicate that the operation has been successfully executed or provide relevant feedback information. The interaction can be achieved through a graphical interface, command line interface or other user interface.

[0078] It should be noted that the parameter information generated corresponding to the input control is the operation made based on the information perceived by the user. The parameter information corresponds to the user's operation method. For example, the co-pilot perceives the type of target object in front and inputs the target object type through vehicle-computer interaction to help the vehicle perceive it. Finally, the target box corresponding to the target object is marked on the HUD. The input process is to drag a space to a fixed position, so the parameter information is the information generated by the user's dragging process. The control response information indicates the response of the input control, because different controls correspond to different targets, and different controls may interact with each other. The response status can determine the control object, thereby determining which target or targets are the object of the operation.

[0079] Step S04: Generate a perception enhancement input instruction according to the parameter information and the control response information.

[0080] It is understandable that, in combination with parameter information and control response information, the system can analyze the user's intentions and operation results, and generate corresponding perception enhancement input instructions to further optimize or enhance the perception process.

[0081] In some embodiments, perception-enhanced image parameters are determined based on the parameter information; perception-enhanced image coordinates are determined based on the control response information; and perception-enhanced input instructions are generated based on the perception-enhanced image parameters and the perception-enhanced image coordinates.

[0082] It should be noted that based on the parameter information, the system can determine the parameters of the perception-enhanced image, which may include the resolution, color space, filter parameters, etc. of the image. Based on the control response information, the system can determine the coordinate position of the target object in the perception-enhanced image. These coordinate information may be the position or area of ​​the target object in the image, as well as the relationship with the image boundary or other specific reference points, and then render the corresponding display-enhanced image in the target display device (such as HUD) for the driver to view and refer to.

[0083] In some embodiments, in response to a long press instruction in the perception display area, perception information corresponding to the long press position is determined; a perception enhancement deletion instruction is generated based on the perception information; and according to the perception enhancement deletion instruction, the corresponding augmented reality image is deleted.

[0084] It should be noted that the perception target is corrected. The perception target input by the user will be presented in the user's HUD field of view for enhanced display. The user can adjust the position of the input target according to the difference between the displayed target and the actual target. Deletion of misidentified targets. When the system misidentifies a target in a location where there is no target, the user can long press the target in the perception display area to delete it. Or click the delete button in the perception input area, and then click the target in the perception display area to delete it.

[0085] In some embodiments, the perception-enhanced interaction interface also includes: a control input control; the method also includes: responding to the perception input control operation instruction, generating corresponding user operation parameters and control response information; generating a vehicle control instruction based on the user operation parameters and control response information.

[0086] It is understandable that, based on enhanced perception, the vehicle can also be controlled on the interface, such as Figure 4As shown, by controlling the input control 1003, a simple control of the vehicle is performed, for example, controlling the start and stop of some auxiliary functions and the control of the vehicle's motion function. Because in some vehicle scenarios where the sensor fails, the use of many auxiliary driving functions is limited, and the observation of the passenger can make up for the sensor subsidy to ensure the use of some auxiliary driving. Therefore, it is more flexible to manually select the start and stop of the auxiliary driving function by the user. For example, the occupant can input the perceived target by first clicking the target type in the perception input area, and then selecting the area box in the perception display area, or directly dragging the target in the perception input area into the area box corresponding to the perception display area. Or click the area box first, and then select the target. Two boxes can be selected horizontally together, indicating that the target crosses the line. Multiple area boxes can be selected vertically, indicating that the area occupies the road. The occupant can click the acceleration and deceleration of the control input area to make a control request. The driving route can also be planned by dragging the self-vehicle model, such as dragging to the left to indicate immediate left, dragging to the left front according to the block diagram trajectory to indicate changing lanes at a certain distance, sliding forward to indicate acceleration, sliding backward to indicate deceleration, dragging to the left in the lane to indicate driving on the left (avoidance), and other instructions. When the system detects that the operation request conflicts with general driving requirements (changing lanes on a solid line, occupying the emergency lane, etc.), or more stringent operation instructions (such as braking, etc.) require the user to confirm again. For some specific control instructions, the number of operations within a certain time, mileage, and start cycle needs to be limited.

[0087] Furthermore, the input method can be jointly input by multiple passengers, and after receiving the input of other passengers, the passenger can also correct the input result. In addition, the input of other passengers can be reviewed by a certain passenger according to the passenger's points, authority and other indicators to avoid misoperation. In this way, driving can be carried out like a game. For example: during the ride, the adult gives the child input authority, and the child's input instructions and input perception are confirmed by the adult, and then the system makes a confirmation judgment. Before the child's instructions are confirmed by the adult, they are only used as some projection basis and are not judged as real targets. In this way, children can draw on the vehicle, or achieve the purpose of learning by classifying targets.

[0088] This embodiment obtains sensor perception information; displays the current road state image in the perception display area according to the sensor perception information; generates parameter information and control response information corresponding to the input control in response to the perception input control operation instruction; generates the perception enhancement input instruction according to the parameter information and control response information. Through the above method, it is realized to predict the user's perception intention by identifying the user's operation action, display the current perception situation through the perception display area, and predict the user's perception enhancement intention through the perception input control, thereby improving the convenience of user operation.

[0089] In addition, an embodiment of the present invention further proposes a storage medium, on which a perception enhancement control program is stored. When the perception enhancement control program is executed by a processor, the steps of the perception enhancement control method described above are implemented.

[0090] Reference Figure 5 , Figure 5 This is a structural block diagram of the first embodiment of the perception enhancement control device of the present invention.

[0091] like Figure 5 As shown, the perception enhancement control device proposed in the embodiment of the present invention includes:

[0092] The processing module 10 is used to respond to the perception enhancement input instruction and determine the target function and input parameters;

[0093] The processing module 10 is further used to determine a target display device according to the target function;

[0094] The display module 20 is used to display an augmented reality image of the current road in a target display device according to the input augmentation parameters.

[0095] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.

[0096] In this embodiment, the processing module 10 responds to the perception enhancement input command and determines the target function and input parameters; the processing module 10 determines the target display device according to the target function; the display module 20 displays the augmented reality image of the current road in the target display device according to the input enhancement parameters. Through the above scheme, it is realized that the image enhancement is performed on different target display devices (such as HUD, rearview mirror and other display functions, etc.) through the user's input command to make up for the insufficient sensor detection function, improve the safety of the vehicle, and optimize the user experience.

[0097] In some embodiments, the processing module 10 is also used to obtain sensor perception information;

[0098] Analyze the perception state according to the sensor perception information to determine the current perception level;

[0099] When the perception level is lower than a preset perception level, insufficient perception capability prompt information is generated.

[0100] In some embodiments, the processing module 10 obtains sensor perception information;

[0101] Determine the sensing distance of each type of sensor according to the sensor sensing information;

[0102] Generate a perception range schematic image according to the perception distance corresponding to the sensor;

[0103] The perception range augmented reality image of the current road is displayed according to the perception range schematic image.

[0104] In some embodiments, the processing module 10 obtains sensor perception information;

[0105] Displaying a current road status image in the perception display area according to the sensor perception information;

[0106] Responding to the perceived input control operation instruction, generating parameter information corresponding to the input control and control response information;

[0107] A perception enhancement input instruction is generated according to the parameter information and the control response information.

[0108] In some embodiments, the processing module 10 determines the perception enhanced image parameters according to the parameter information;

[0109] Determining the perception enhancement image coordinates according to the control response information;

[0110] A perception enhancement input instruction is generated according to the perception enhancement image parameters and the perception enhancement image coordinates.

[0111] In some embodiments, the processing module 10 generates corresponding user operation parameters and control response information in response to the sensed input control operation instruction;

[0112] A vehicle control instruction is generated according to the user operation parameters and the control response information.

[0113] In some embodiments, the processing module 10 responds to the long-press instruction of the perception display area and determines the perception information corresponding to the long-press position;

[0114] generating a perception enhancement deletion instruction according to the perception information;

[0115] According to the perception enhancement deletion instruction, the corresponding augmented reality image is deleted.

[0116] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.

[0117] In addition, for technical details not fully described in this embodiment, please refer to the perception enhancement control method provided in any embodiment of the present invention, and will not be repeated here.

[0118] In addition, it should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0119] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0120] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory (ROM) / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0121] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A perception enhancement control method, characterized in that: The perception enhancement control method comprises: Respond to sensory enhancement input instructions and determine target functions and input parameters; determining a target display device according to the target function; Displaying an augmented reality image of the current road in a target display device according to the input parameters; The method is applied to a perception enhancement interactive interface, wherein the perception enhancement interactive interface includes a perception display area and a plurality of perception input controls; The responding to the perception enhancement input instruction and determining the target function and input parameters also includes: Obtain sensor perception information; Displaying a current road status image in the perception display area according to the sensor perception information; In response to the sensing input control operation instruction, generate parameter information and control response information corresponding to the sensing input control; Generate a perception enhancement input instruction according to the parameter information and the control response information; The perception enhancement input instruction is a control instruction generated by user operation; The responding to the perception enhancement input instruction and determining the target function and input parameters include: When determining the perception enhancement input instruction, determining the target function and input parameters corresponding to the adjustment in the instruction, wherein the target function includes target type labeling, target distance detection, or side target position detection; The perception enhancement interaction interface is used to provide an interface for users to input content; The perception display area is used to display the current status of the vehicle; The perception input control is used to provide an operation mode for the user; The parameter information corresponding to the perception input control is information of an operation mode determined based on information perceived by the user; The control response information is used to indicate that the operation has been executed or to provide relevant feedback information.

2. The method according to claim 1, characterized in that The method further comprises: Obtain sensor perception information; Analyze the perception state according to the sensor perception information to determine the current perception level; When the perception level is lower than a preset perception level, insufficient perception capability prompt information is generated.

3. The method according to claim 1, characterized in that The method further comprises: Obtain sensor perception information; Determine the sensing distance of each type of sensor according to the sensor sensing information; Generate a perception range schematic image according to the perception distance corresponding to the sensor; The perception range augmented reality image of the current road is displayed according to the perception range schematic image.

4. The method according to claim 1, characterized in that The generating the perception enhancement input instruction according to the parameter information and the control response information includes: determining a perception-enhanced image parameter according to the parameter information; Determining the perception enhancement image coordinates according to the control response information; A perception enhancement input instruction is generated according to the perception enhancement image parameters and the perception enhancement image coordinates.

5. The method according to claim 1, characterized in that The perception enhancement interaction interface also includes: control input controls; The method further comprises: Respond to the perceived input control operation instruction and generate corresponding user operation parameters and control response information; A vehicle control instruction is generated according to the user operation parameters and the control response information.

6. The method according to claim 1, characterized in that After displaying the current road state image in the perception display area according to the sensor perception information, the method further includes: Respond to the long press command in the perception display area and determine the perception information corresponding to the long press position; generating a perception enhancement deletion instruction according to the perception information; According to the perception enhancement deletion instruction, the corresponding augmented reality image is deleted.

7. A perception enhancement control device, characterized in that: The perception enhancement control device comprises: A processing module, for responding to the perception enhancement input command and determining the target function and input parameters; The processing module is further used to determine a target display device according to the target function; A display module, configured to display an augmented reality image of the current road in a target display device according to the input parameters; The processing module is also used to obtain sensor perception information; The processing module is further used to display the current road state image in the perception display area according to the sensor perception information; The processing module is further used to respond to the perceived input control operation instruction and generate parameter information and control response information corresponding to the input control; The processing module is further used to generate a perception enhancement input instruction according to the parameter information and the control response information; The perception enhancement input instruction is a control instruction generated by user operation; The responding to the perception enhancement input instruction and determining the target function and input parameters include: When determining the perception enhancement input instruction, determining the target function and input parameters corresponding to the adjustment in the instruction, wherein the target function includes target type labeling, target distance detection, or side target position detection; The perception enhancement interaction interface is used to provide an interface for users to input content; The perception display area is used to display the current status of the vehicle; The perception input control is used to provide an operation mode for the user; The parameter information corresponding to the perception input control is information of an operation mode determined based on information perceived by the user; The control response information is used to indicate that the operation has been executed or to provide relevant feedback information.

8. A perception enhancement control device, characterized in that: The device comprises: a memory, a processor, and a perception enhancement control program stored in the memory and executable on the processor, wherein the perception enhancement control program is configured to implement the steps of the perception enhancement control method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium stores a perception enhancement control program, and when the perception enhancement control program is executed by the processor, the steps of the perception enhancement control method according to any one of claims 1 to 6 are implemented.

Images