Interactive authentication method, carrier device and vehicle
Patent Information
- Application Number
- CN202511507114.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-21
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2045-10-21
AI Technical Summary
[0004]有鉴于此,本申请实施例的目的在于提供一种交互验证方法、载体设备及车辆,以改善现有技术中存在的智能驾驶模式效果较差的问题
[0025] In summary, the embodiments of this application provide an interactive verification method, carrier device, and vehicle that can achieve random verification through random time and random location, thereby improving the effectiveness of detection and verification, ensuring that the user being verified can concentrate on driving, optimizing the user experience during verification, improving the safety of the driving process, and meeting the verification needs of various scenarios.
Smart Images

Figure CN121375800B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of intelligent driving technology, and more specifically, to an interactive verification method, a carrier device, and a vehicle. Background Technology
[0002] With the development of intelligent driver assistance technology, more and more vehicles are equipped with semi-autonomous driving functions. In the process of semi-autonomous driving, in order to ensure driving safety, existing vehicles usually use methods such as steering wheel torque sensors, capacitive detection, and camera monitoring to determine whether the driver is holding the steering wheel.
[0003] However, existing detection methods allow drivers to place objects like water bottles, weights, or straps on the steering wheel to deceive the system, causing detection to fail. Furthermore, current safety detection methods require drivers to maintain a fixed grip on the steering wheel, which can easily lead to muscle stiffness and driver fatigue. Relying solely on passive detection makes it difficult to ensure driver concentration, posing a safety hazard. Therefore, current detection methods for semi-autonomous driving modes have low effectiveness, poor user experience, and low safety, failing to meet the application requirements of current semi-autonomous driving modes. Summary of the Invention
[0004] In view of this, the purpose of this application is to provide an interactive verification method, carrier device and vehicle to improve the problem of poor performance of intelligent driving mode in the prior art.
[0005] To address the above problems, a first solution, according to an embodiment of this application, is to provide an interactive verification method, the method comprising: In assisted driving mode, verification commands are generated based on random time intervals; Based on the verification command, a random portion of the area on the verification device is determined as the current verification area; The verification result is determined based on the operations performed on the current verification area within the preset feedback time.
[0006] In the aforementioned implementation process, under assisted driving modes such as semi-autonomous driving that enable intelligent driving, to improve the effectiveness of verification, time-randomized verification commands can be generated based on random time intervals to reduce the rigidity and adverse effects of timed verification. Based on the verification command, a random area is determined on the verification device as the current verification area. The verification result is determined based on the operations performed on the current verification area within a preset feedback time. This randomized area approach reduces the possibility of deceptive verification caused by placing objects such as water bottles, weights, or straps in fixed verification areas. By achieving randomized verification through both time and location, the effectiveness of detection and verification is improved, ensuring that the user being verified can concentrate on driving, optimizing the user experience during verification, enhancing driving safety, and meeting the verification needs of various scenarios.
[0007] Optionally, in assisted driving mode, generating verification instructions based on random time intervals includes: Determine the time range for triggering verification under the assisted driving mode; Within the stated time range, the random time interval is randomly determined; Based on the random time interval, a verification instruction is generated to interactively verify the verification target.
[0008] In the above implementation process, to achieve the effect of randomized verification, the overall time range that can trigger verification in assisted driving mode can be determined first. Then, within this time range, a random time interval for the current verification can be randomly determined, and a verification command for interactive verification of the target can be generated based on the random time interval. Determining the random time interval between two interactive verifications within a suitable time range effectively reduces the rigid and detrimental effects of time-interval verification on interactive verification.
[0009] Optionally, determining the time range for triggering verification in the assisted driving mode includes: Obtain visual detection data of the verification target in the assisted driving mode; Based on the visual detection data, the driving status of the verification target is determined; The time range for triggering verification is determined based on the driving status.
[0010] In the above implementation process, to determine a reasonable time range that aligns with the actual situation of the verification target, visual detection data of the verification target in assisted driving mode can be acquired. Based on this data, the current driving state of the verification target can be determined, and thus, a time range for triggering verification that aligns with the actual situation of the verification target can be determined. The ability to determine or adjust a suitable time range based on the actual driving state of the verification target effectively improves the relevance and reliability of interactive verification.
[0011] Optionally, determining a random portion of the area as the current verification area on the verification device based on the verification instruction includes: The interactive area of the verification device is divided into multiple partial areas; Based on the verification instruction, a random partial region is determined as the current verification region from among the multiple partial regions.
[0012] In the above implementation process, to achieve randomized verification, the interaction area of the verification device that interacts with the verification target can be divided into multiple sub-regions. Based on the generated verification command, a random sub-region is randomly selected from these sub-regions as the current verification area. This allows for the selection of a random area for interactive verification within the verification device's interaction area, effectively reducing the possibility of deception caused by users placing objects such as water bottles, weights, or straps in fixed verification areas, thus improving the effectiveness and reliability of interactive verification.
[0013] Optionally, determining the verification result based on the operations performed on the current verification area within a preset feedback time period includes: Based on the current verification area, a verification prompt is generated; wherein the verification prompt includes at least one of visual prompts, voice prompts, and haptic prompts. Within the preset feedback time, the interaction between the verification target and the current verification area is detected, and the verification result is determined.
[0014] In the above implementation process, when determining the verification result, to prompt the verification target to interact, various types of verification prompts, such as visual prompts, voice prompts, and haptic prompts, can be generated based on the determined current verification area to indicate the location of the current verification area and the situation requiring verification. Furthermore, to ensure the timeliness of interactive verification, a preset feedback duration can be determined. The interaction between the verification target and the current verification area can be detected within the preset feedback duration. The interaction status can characterize the operation performed on the current verification area, thereby determining the verification result based on the interaction status. The ability to generate corresponding prompts to indicate the location and verification requirements during verification, and to determine the verification result within the effective preset feedback duration, effectively improves the timeliness and effectiveness of the verification result and reduces the adverse detection situation of the verification target remaining unresponsive for a long time.
[0015] Optionally, detecting the interaction between the verification target and the current verification area to determine the verification result includes: The interaction duration between the verification target and the current verification area is detected using sensors. If the interaction duration is determined to be greater than or equal to a preset time threshold, the verification result is that the interaction status of the verification target is normal. If the interaction duration is determined to be less than a preset time threshold, the verification result is that the interaction state of the verification target is abnormal; wherein, the preset time threshold is less than the preset feedback duration.
[0016] In the above implementation process, to ensure the effectiveness of the interaction, sensors installed within the verification device can detect the interaction duration between the verification target and the current verification area. A preset time threshold is used to determine whether the interaction is effective. When the interaction duration is greater than or equal to the preset time threshold, it indicates that the interaction between the verification target and the current verification area has a longer duration, the interaction is effective, and the verification result is that the interaction status of the verification target is normal. When the interaction duration is less than the preset time threshold, it indicates that the interaction between the verification target and the current verification area has a shorter duration, the verification target has not interacted with the current verification area, or the interaction time is too short, such as accidental touch, and the verification result is that the interaction status of the verification target is abnormal. Being able to determine the effectiveness of the interaction based on the interaction duration, thereby determining the corresponding verification result, improves the effectiveness and reliability of the verification result and reduces the adverse effects of accidental touches on the verification result.
[0017] Optionally, the method further includes: Within the set verification period, based on each of the first number of verification results representing anomalies, a first type of anomaly prompt is generated; Based on each of the verification results representing the first number of anomalies, and the verification results representing the second number of consecutive anomalies, a second type of anomaly prompt is generated; The intensity of the second type of error message is higher than that of the first type of error message.
[0018] In the above implementation process, after determining the verification results, considering the differences in the actual situation represented by multiple verification results, a corresponding verification period can be set. Within the verification period, if there are a first number of verification results representing anomalies, a first-type anomaly prompt can be generated to provide a low-intensity prompt for the earlier anomalies. Within the verification period, if there are still verification results representing anomalies after the first number (i.e., a large number of anomalies), or if there are a second consecutive number of verification results representing anomalies (i.e., a prolonged interactive anomaly), a second-type anomaly prompt with a higher intensity than the first-type anomaly prompt can be generated to provide a higher-intensity prompt for frequent and prolonged anomalies. This tiered prompting process for different anomalies effectively alerts users to anomalies in interactive verification, improving the safety of the driving process.
[0019] Optionally, the method further includes: If the number of consecutive verification results indicating anomalies exceeds a preset anomaly threshold, the assisted driving mode is downgraded, or the vehicle is driven to a safe area based on the assisted driving mode.
[0020] In the above implementation process, when the number of consecutive verification results representing an anomaly exceeds the preset anomaly threshold, it indicates that the verification target has a long-term unresponsive condition. In order to ensure the safety of the driving process, the assisted driving mode can be downgraded accordingly, or the vehicle equipment can be driven to a safe area and stopped directly based on the assisted driving mode.
[0021] Secondly, embodiments of this application also provide a carrier device, the carrier device comprising: a verification device and a processor; The verification device and the processor are communicatively connected; The processor is used to generate verification instructions based on random time intervals in assisted driving mode; determine a random portion of the area on the verification device as the current verification area based on the verification instructions; and determine the verification result based on the operation of the current verification area within a preset feedback time.
[0022] In the aforementioned implementation process, under assisted driving modes such as semi-autonomous driving of the carrier device that enable intelligent driving, in order to improve the effectiveness of verification, the processor can generate time-randomized verification instructions based on random time intervals to reduce the rigidity caused by timed verification. Based on the verification instructions, a random area is determined on the verification device as the current verification area. The verification result for interactive verification is determined based on the operations performed on the current verification area within a preset feedback time. By using randomized areas, the deceptive verification situation caused by placing objects such as water bottles, weights, or straps in fixed verification areas can be reduced.
[0023] Thirdly, embodiments of this application also provide a vehicle, the vehicle including: a steering wheel and a processor; The steering wheel and the processor are communicatively connected; the interactive area of the steering wheel is divided into multiple partial areas; The processor is used to generate verification instructions based on random time intervals in assisted driving mode; determine a random area on the steering wheel as the current verification area based on the verification instructions; and determine the verification result based on the operation of the current verification area within a preset feedback time.
[0024] In the aforementioned implementation process, under assisted driving modes such as semi-autonomous driving that enable intelligent driving, to improve the effectiveness of verification, the processor can generate time-randomized verification instructions based on random time intervals, thereby reducing the rigid and detrimental effects of timed verification. The interaction area on the steering wheel can be divided into multiple regions. The processor can determine a random region on the steering wheel as the current verification region based on the verification instructions. The verification result of user interaction with the steering wheel, such as gripping, is determined based on the operations performed on the current verification region within a preset feedback time. By using randomized regions, the deceptive verification caused by placing objects such as water bottles, weights, or straps on the steering wheel can be reduced.
[0025] In summary, the embodiments of this application provide an interactive verification method, carrier device, and vehicle that can achieve random verification through random time and random location, thereby improving the effectiveness of detection and verification, ensuring that the user being verified can concentrate on driving, optimizing the user experience during verification, improving the safety of the driving process, and meeting the verification needs of various scenarios. Attached Figure Description
[0026] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.
[0027] Figure 1 A flowchart illustrating an interactive verification method provided in an embodiment of this application; Figure 2 A detailed flowchart of step S100 provided for an embodiment of this application; Figure 3 A detailed flowchart of step S110 provided for an embodiment of this application; Figure 4 A detailed flowchart of step S200 provided for an embodiment of this application; Figure 5 A detailed flowchart of step S300 provided for an embodiment of this application; Figure 6 A detailed flowchart of step S320 provided for an embodiment of this application; Figure 7 A flowchart illustrating another interactive verification method provided in an embodiment of this application; Figure 8 This is a schematic diagram of the structure of a carrier device provided in an embodiment of this application; Figure 9 This is a structural schematic diagram of a vehicle provided in an embodiment of this application.
[0028] Icons: 500 - Carrier device; 510 - Verification device; 520 - Processor; 600 - Vehicle; 610 - Steering wheel. Detailed Implementation
[0029] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of the embodiments of this application.
[0030] In assisted driving modes, existing methods for determining whether a driver is holding the steering wheel can be circumvented by the driver placing objects like water bottles, weights, or straps on the steering wheel to deceive the system and cause detection to fail. Furthermore, current safety assessment methods require the driver to maintain a fixed grip on the steering wheel, which can easily lead to muscle stiffness and driver fatigue. Relying solely on passive detection makes it difficult to ensure driver concentration, posing a safety hazard. Therefore, current detection methods for semi-autonomous driving modes have low effectiveness, poor user experience, and low safety, failing to meet the application requirements of current semi-autonomous driving modes.
[0031] To address the aforementioned issues, this application provides an interactive verification method, carrier device, and vehicle that enables random verification through random time and location, thereby improving the effectiveness of detection and verification, ensuring that the user being verified can concentrate on driving, optimizing the user experience during verification, enhancing driving safety, and meeting verification needs in various scenarios.
[0032] Please see Figure 1 , Figure 1 This is a flowchart illustrating an interactive verification method provided in an embodiment of this application. The method may include steps S100-S300.
[0033] Step S100: In assisted driving mode, a verification command is generated based on a random time interval.
[0034] Among them, various types of carrier equipment such as vehicles, ships, and aircraft are equipped with corresponding semi-autonomous driving, fully autonomous driving and other assisted driving modes that can realize intelligent driving. When the carrier equipment is in the corresponding assisted driving mode, in order to improve the effectiveness of the verification, time-randomized verification instructions can be generated according to random time intervals to reduce the adverse effects of rigidity caused by timed verification.
[0035] Optionally, the random time interval can be any time interval between 60s and 120s, and the selection range of the random time interval can be set according to the actual situation and needs.
[0036] Step S200: Based on the verification command, a random portion of the area on the verification device is determined as the current verification area.
[0037] Optionally, the verification device can be a device that interacts with the user and controls the driving of the carrier device, such as a steering wheel or control panel operated by the user. Taking the steering wheel as an example, the steering wheel wheel is the interactive area that interacts with the user. The wheel wheel can be divided into multiple areas, for example, the wheel wheel can be divided into six equal parts, and a corresponding random part area can be randomly determined from multiple parts.
[0038] Step S300: Determine the verification result based on the operations performed on the current verification area within the preset feedback time.
[0039] Among them, a random area can be determined on the verification device as the current verification area according to the verification instruction. The verification result of interactive verification is determined based on the operation of the current verification area within the preset feedback time. By randomly selecting the area, the deceptive verification situation caused by setting objects such as water bottles, weights, and straps in fixed verification areas can be reduced.
[0040] Optionally, the current verification area can be manipulated by whether the user is holding the current verification area or whether the user is in contact with the current verification area.
[0041] It should be noted that if the verification target is detected performing other driving operations within the preset feedback time, such as steering, shifting gears, braking, acceleration and deceleration, or controlling the functional devices such as lights, wipers, and air conditioning on the carrier equipment, it indicates that the verification target is in a normal driving state. In order to reduce the interference of interactive verification on the verification target in a normal driving state, the current interactive verification can be stopped directly or the current interactive verification can be invalidated directly.
[0042] exist Figure 1 In the illustrated embodiment, random verification can be achieved through random time and random location, which improves the effectiveness of detection and verification, ensures that the user being verified can concentrate on driving, optimizes the user experience during verification, improves the safety of the driving process, and meets the verification needs of various scenarios.
[0043] Optionally, please refer to Figure 2 , Figure 2 The following is a detailed flowchart of step S100 provided in an embodiment of this application. Step S100 may include steps S110-S130.
[0044] Step S110: Determine the time range for triggering verification in assisted driving mode.
[0045] In order to achieve a randomized verification effect, the overall time range that can trigger verification in the assisted driving mode can be determined first.
[0046] For example, to reduce the adverse effects of frequent verification and excessively long verification intervals, a reasonable time range can be set, such as 30s-120s. The time range can also be adjusted according to the user's actual needs.
[0047] Optionally, the time range can be dynamically adjusted based on the external environment of the carrier device. For example, the imaging sensor installed on the carrier device can collect images of the external environment, and based on image recognition technology, determine the current environmental conditions of the carrier device from the environmental images, such as the lane type, traffic volume, and number of pedestrians. Combined with the actual geographical location of the carrier device, a suitable time range can be determined. For example, when the carrier device is on a highway and there are few vehicles around, the complexity of the environment is low, and the need for the target to intervene in driving is low. A relatively long time range of 80s-120s can be selected. When the carrier device is in a busy urban area with a large number of vehicles and pedestrians, the complexity of the environment is high, and the need for the target to intervene in driving is high. Considering the adverse effects of frequent verification on the operation of the target, a prompt can be generated to switch from assisted driving mode to manual driving mode, so that the target can manually drive in complex environmental conditions.
[0048] Step S120: Within the time range, randomly determine a random time interval.
[0049] One approach is to use a random timer to randomly determine a time interval within a given time range. This random time interval is the time interval between the current verification and the previous verification, such as 50 seconds. After the current interactive verification is completed, the random timer is reset to zero and starts timing again, thus enabling multiple consecutive interactive verifications.
[0050] Step S130: Generate a verification instruction for interactive verification of the verification target according to a random time interval.
[0051] When the random timer reaches a random time interval, a verification command is generated to perform interactive verification on the verification target. The verification command can control the verification device. The verification target can be a user who interacts with the verification device, such as a driver. The verification device can detect the interaction of the verification target to verify whether the verification target can provide normal feedback, that is, whether the verification target can concentrate on driving in the assisted driving mode.
[0052] exist Figure 2 In the illustrated embodiment, a random time interval between two interactive verifications can be determined within a suitable time range, effectively reducing the rigid and adverse effects of timed interval verification on interactive verification.
[0053] Optionally, please refer to Figure 3 , Figure 3The following is a detailed flowchart of step S110 provided in an embodiment of this application. Step S110 may include steps S111-S113.
[0054] Step S111: Obtain visual detection data of the verification target in assisted driving mode.
[0055] In order to determine a reasonable time range that conforms to the actual situation of the verification target, visual detection data of the verification target in assisted driving mode can be obtained.
[0056] Optionally, the carrier device may be equipped with corresponding visual detection equipment, such as an infrared camera, which can still clearly capture facial images and obtain corresponding visual detection data in environments with drastic changes in lighting conditions, such as at night or in strong light / backlight, and send the visual detection data to the connected processor for processing.
[0057] Step S112: Determine the driving status of the verification target based on visual detection data.
[0058] The processor can perform image recognition based on visual detection data to determine the actual driving state of the target being verified. Driving state can be divided into normal driving state and fatigued driving state.
[0059] Optionally, the visual detection data can be analyzed based on image recognition algorithms, such as computer vision algorithms, face detection algorithms, and deep learning algorithms, to determine whether the verification target in the visual detection data shows signs of fatigue, such as blinking frequency, yawning, and head posture. If the blinking frequency is greater than or equal to a preset frequency threshold, or the single eye-closing time is greater than or equal to a preset eye-closing time threshold, or the number of yawns is greater than or equal to a yawning number threshold, or the head is kept in a drooping posture for a greater than or equal to a preset drooping time threshold, then the driving state of the verification target is determined to be a state of fatigued driving.
[0060] Step S113: Determine the time range for triggering verification based on the driving status.
[0061] Among these, the time range for triggering verification can be determined based on the driving status and the actual situation of the verification target.
[0062] Optionally, if the target's driving state is normal, a longer time range (e.g., 80-120 seconds) can be used to indicate that the target's current state is normal, thus reducing frequent verifications and improving the user experience. If the target's driving state is fatigued, a shorter time range (e.g., 30-60 seconds) can be used to continuously alert the target and keep it alert. Once updated visual detection data confirms that the target has recovered from fatigue to normal driving, the time range can be switched from shorter to longer. This allows for dynamic adjustment of the time range based on changes in the target's driving state, better reflecting the actual situation.
[0063] exist Figure 3 In the embodiments shown, an appropriate time range can be determined or adjusted according to the actual driving state of the verification target, which effectively improves the pertinence and reliability of interactive verification.
[0064] Optionally, please refer to Figure 4 , Figure 4 The following is a detailed flowchart of step S200 provided in an embodiment of this application. Step S200 may include steps S210-S220.
[0065] Step S210: Divide the interaction area of the verification device into multiple partial areas.
[0066] In order to achieve a randomized verification effect, the interactive area in the verification device that interacts with the verification target can be divided into multiple parts. For example, when the verification device is a steering wheel, the steering wheel can be divided into 4, 6 or 8 parts.
[0067] Optionally, considering the differences in user experience, multiple partial areas can be determined based on the user's actual needs. For example, users can select a frequently used area in the interactive area, and multiple partial areas can be divided within the frequently used area to meet the personalized needs of different users.
[0068] Step S220: Based on the verification instruction, a random partial region is determined as the current verification region from multiple partial regions.
[0069] Among them, based on the generated verification instructions, a corresponding random partial area can be randomly determined from multiple partial areas as the current verification area for verification.
[0070] Optionally, for each partial area, a unique identity identifier, such as a numerical code, can be determined to represent the identity of that partial area. A partial area can be randomly selected from multiple partial areas using a random number function or a random selector, and then used as the current verification area when performing interactive verification. For example, if the steering wheel is divided into four partial areas, the current verification area can be the randomly selected upper left, lower left, upper right, or lower right partial area.
[0071] exist Figure 4 In the illustrated embodiment, a random area can be selected for interactive verification within the interactive area of the verification device. This effectively reduces the possibility of deceptive verification caused by users placing objects such as water bottles, weights, or straps in the fixed verification area under the fixed area verification method, thereby improving the effectiveness and reliability of interactive verification.
[0072] Optionally, please refer to Figure 5 , Figure 5 This is a detailed flowchart of step S300 provided in an embodiment of the present application. Step S300 may include steps S310-S320.
[0073] Step S310: Generate a verification prompt based on the current verification area.
[0074] In order to prompt the verification target to interact when determining the verification result, various types of verification prompts, such as visual prompts, voice prompts, and haptic prompts, can be generated based on the current verification area to indicate the location of the current verification area and the situation that needs to be verified. The duration of the verification prompts is consistent with the preset feedback duration to ensure effective prompting.
[0075] It should be noted that the verification prompts can include various types of prompts that can draw the user's attention to the current verification area, such as visual prompts, voice prompts, and haptic prompts. They can also be comprehensive prompts that combine multiple different types of prompts. For example, when a haptic prompt of vibration occurs in the current verification area, a visual prompt of lighting up the current verification area is generated at the same time, and a voice prompt is generated to prompt the user to grasp the vibrating area.
[0076] Optionally, various devices can be installed on the verification device to provide different functional prompts. For example, corresponding vibrators and indicator lights can be installed in each area to provide prompts. Each vibrator and indicator light in each area can be independently controlled to provide localized prompts for the current area, such as localized lighting or vibration. Prompts can also be provided through voice broadcasts, such as saying "Please grip the upper left area of the steering wheel" or "Please grip the vibrating area of the steering wheel." Prompts can also be provided through regional visual prompts generated within the instrument panel, such as displaying unselected areas in green and the selected current verification area in red.
[0077] Step S320: Within a preset feedback time, detect the interaction between the verification target and the current verification area, and determine the verification result.
[0078] In order to ensure the timeliness of interactive verification, a preset feedback time can be determined. The interaction between the verification target and the current verification area within the preset feedback time can be detected. The interaction can characterize the operation of the current verification area, and the verification result of interactive verification can be determined based on the interaction.
[0079] Optionally, the preset feedback duration can be set according to the user's actual situation and timeliness requirements. For example, to ensure the timeliness of interactive verification, it is stipulated that the verification target must provide normal feedback within 6 seconds after the verification prompt is generated. Considering that different verification targets have different reaction speeds, in order to further optimize the user experience of different users, a shorter preset feedback duration, such as 3s-4s, can be set for users with faster reactions, and a longer preset feedback duration, such as 5s-6s, can be set for users with slower reactions. It can be set according to the user's historical reaction speed or according to the user's actual choice.
[0080] Optionally, the interaction can be of various types, such as the target touching the current verification area, holding the current verification area, or interacting with buttons or other controls within the current verification area. The specific interaction can be determined based on the actual situation of the verification device.
[0081] It should be noted that, since the vehicle device can achieve automatic intelligent driving in assisted driving mode, the need for manual control by the user is low. Therefore, the timing of verification triggering in assisted driving mode has lower safety requirements. Interactive verification can be triggered at multiple times to enable the user to still control the verification device in assisted driving mode, thereby improving driving safety.
[0082] Optionally, since the current verification area is randomly determined, the verification target cannot maintain a fixed posture during verification. This can reduce fatigue caused by maintaining the same posture when the verification target interacts with the same area for a long time, reduce the adverse effects of user muscle stiffness, and improve user comfort while driving. Furthermore, the verification target needs to continuously participate in verification in a dynamic interactive manner throughout the entire assisted driving mode, which can effectively improve the effectiveness of the verification target in maintaining attention.
[0083] exist Figure 5 In the illustrated embodiment, corresponding prompts can be generated to indicate the area location and verification requirements during verification, and the verification result can be determined within an effective preset feedback time. This effectively improves the timeliness and effectiveness of the verification result and reduces the adverse detection situation where the verification target does not respond for a long time.
[0084] Optionally, please refer to Figure 6 , Figure 6 The following is a detailed flowchart of step S320 provided in an embodiment of this application. Step S320 may include steps S321-S323.
[0085] Step S321: The interaction duration between the verification target and the current verification area is detected by the sensor.
[0086] In situations involving steering wheel gripping or touching, to ensure the effectiveness of the interaction, sensors within the verification device can detect the duration of the interaction between the verification target and the current verification area. The interaction duration can be the duration the user holds or touches the current verification area, and a preset time threshold is determined to judge whether the interaction is effective.
[0087] Alternatively, the sensor can be a capacitance / pressure sensor located in various areas of the verification device, capable of rapidly responding to interactions and performing detection.
[0088] It should be noted that the preset time threshold is less than the preset feedback duration. For example, if the preset feedback duration is 5 seconds, the preset time threshold can be set to 2 seconds to ensure that the user has enough time to interact normally within the preset feedback duration.
[0089] Step S322: If the interaction duration is determined to be greater than or equal to the preset time threshold, the verification result is that the target interaction state is normal.
[0090] When the interaction duration is greater than or equal to the preset time threshold, it indicates that the interaction between the verification target and the current verification area has a longer duration, the interaction is effective, and the verification result is that the interaction status of the verification target is normal.
[0091] Step S323: If the interaction duration is determined to be less than the preset time threshold, the verification result is that the target interaction state is abnormal.
[0092] Specifically, when the interaction duration is less than the preset time threshold, it indicates that the interaction between the verification target and the current verification area is too short, the verification target has not interacted with the current verification area or the interaction time is too short, such as accidental touch, etc. The verification result is that the interaction state of the verification target is abnormal, which effectively reduces the erroneous judgment that the interaction state of the verification target is normal due to short-term accidental touch.
[0093] It should be noted that after the target completes a single interactive verification, the target can still choose its preferred operating method to interact with the verification device.
[0094] It should be noted that the sensor can also detect the area image of the verification device, obtain the corresponding interactive image, and use image recognition algorithms to identify whether the verification target interacts with the verification device within the preset feedback time for each interactive verification. For example, it can identify whether the verification target's hand is on the steering wheel within the preset feedback time. The verification result can be determined by combining the interaction recognition result and the interaction time. If the interaction time is greater than or equal to the preset time threshold, but the interaction recognition result is that the verification target's hand is not on the steering wheel, it indicates that there may be other objects on the steering wheel, which may affect driving. The determined verification result is that the interaction state of the verification target is abnormal, which further improves the accuracy of the verification result.
[0095] exist Figure 6 In the illustrated embodiment, the validity of the interaction can be determined based on the interaction duration, thereby determining the corresponding verification result, which improves the validity and reliability of the verification result and reduces the adverse effects of accidental touches on the verification result.
[0096] Optionally, please refer to Figure 7 , Figure 7 This is a flowchart illustrating another interactive verification method provided in an embodiment of this application. The method may further include steps S410-S420.
[0097] Step S410: Within the set verification period, generate a first type of anomaly prompt based on each verification result of the first number of anomalies.
[0098] After determining the verification results, considering the differences in the actual situation represented by multiple verification results, a corresponding verification period can be set. Within the verification period, if there are a first number of verification results that represent anomalies, a first type of anomaly prompt can be generated to provide a low-intensity prompt for the anomalies in the early stage.
[0099] Optionally, the first type of abnormality prompt can be a low-intensity prompt such as a single voice prompt, seat vibration prompt, or buzzer prompt.
[0100] It should be noted that the verification period can also be set according to the actual situation and needs. For example, it can be set to 10 minutes, or 10 interactive verifications can be used as a verification period. The first number can be set according to the actual number of interactive verifications within the verification period. For example, if there are 10 interactive verifications within the verification period, the first number can be set to 3.
[0101] Step S420: Based on each verification result of the first number of subsequent anomalies and the verification results of the second number of consecutive anomalies, generate a second type of anomaly prompt.
[0102] Within the verification period, if there are still verification results indicating anomalies after the first number, such as the 4th or 5th verification result indicating anomalies (i.e., a relatively large number of anomalies), or if there are a second consecutive number of verification results indicating anomalies, the second number can be set according to the actual number of interactive verifications within the verification period. For example, if there are 10 interactive verifications within the verification period, the second number can be set to 3. If the verification results of 3 consecutive interactive verifications indicate anomalies (i.e., a long-term interactive anomaly), a second type of anomaly prompt with a higher prompt intensity than the first type of anomaly prompt can be generated to provide a stronger prompt for frequent and long-term anomalies.
[0103] Optionally, the intensity of the second type of abnormality prompt is higher than that of the first type of abnormality prompt. The second type of abnormality prompt can be a prompt message with a higher intensity, such as multiple consecutive or continuous voice prompts, seat vibration prompts, or buzzer prompts.
[0104] Optionally, if both types of exception prompts are met, both types of exception prompts can be generated simultaneously for a combined prompt.
[0105] exist Figure 7 In the illustrated embodiment, tiered prompts can be provided for different abnormal situations to effectively alert users to abnormal situations during interactive verification, thereby improving the safety of the driving process.
[0106] It should be noted that if the number of consecutive verification results indicating anomalies exceeds a preset anomaly threshold, the assisted driving mode will be downgraded, or the vehicle will be driven to a safe area based on the assisted driving mode. The preset anomaly threshold can be set and modified according to actual conditions. For example, it can be set to 5 times. When the number of consecutive verification results indicating anomalies exceeds the preset anomaly threshold, it indicates that the verification target has experienced a prolonged period of unresponsiveness. To ensure the safety of the driving process, the assisted driving mode can be downgraded accordingly. Downgrading can include deceleration, pulling over, or directly driving the vehicle to a safe area and stopping based on the assisted driving mode. Alternatively, the assisted driving mode can be forcibly exited, and the vehicle can enter normal driving mode, which is manually controlled by the verification target.
[0107] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of a carrier device provided in an embodiment of the present application. The carrier device 500 may include: a verification device 510 and a processor 520; The verification device 510 and the processor 520 are communicatively connected; The processor 520 is used to generate verification instructions based on random time intervals in assisted driving mode; based on the verification instructions, it determines a random portion of the area on the verification device 510 as the current verification area; and determines the verification result based on the operation of the current verification area within a preset feedback time.
[0108] Optionally, the carrier device 500 can be various types of mobile transportation equipment such as vehicles, ships, and aircraft, and the processor 520 can be an integrated circuit chip with signal processing capabilities. The processor 520 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The verification device 510 can be a device on the carrier device 500 that interacts with users such as drivers, allowing drivers to perform driving operations, such as a steering wheel or control panel.
[0109] In an optional implementation, the processor 520 is specifically configured to: determine the time range for triggering verification in the assisted driving mode; randomly determine a random time interval within the time range; and generate a verification instruction for interactively verifying the verification target based on the random time interval.
[0110] In an optional implementation, the processor 520 is specifically configured to: acquire visual detection data of the verification target in assisted driving mode; determine the driving state of the verification target based on the visual detection data; and determine the time range for triggering verification based on the driving state.
[0111] In an optional implementation, the processor 520 is specifically configured to: divide the interaction area of the verification device 510 into multiple partial areas; and, based on the verification instructions, determine a random partial area as the current verification area within the multiple partial areas.
[0112] In an optional implementation, the verification device 510 is specifically used to: generate a verification prompt based on the current verification area; wherein the verification prompt includes at least one of visual prompts, voice prompts, and haptic prompts; and the processor 520 is specifically used to: detect the interaction between the verification target and the current verification area within a preset feedback time and determine the verification result.
[0113] In an optional implementation, the processor 520 is specifically used to: detect the interaction duration between the verification target and the current verification area using a sensor; if the interaction duration is determined to be greater than or equal to a preset time threshold, the verification result is that the interaction state of the verification target is normal; if the interaction duration is determined to be less than the preset time threshold, the verification result is that the interaction state of the verification target is abnormal; wherein, the preset time threshold is less than the preset feedback duration.
[0114] In an optional implementation, the processor 520 is further configured to: generate a first type of exception prompt based on each verification result of the first first number of exceptions within a set verification period; generate a second type of exception prompt based on each verification result of the first number of subsequent exceptions and the verification results of a second consecutive number of exceptions; wherein the prompt intensity of the second type of exception prompt is higher than the prompt intensity of the first type of exception prompt.
[0115] In an optional implementation, the processor 520 is further configured to: downgrade the assisted driving mode if the number of consecutive verification results indicating an anomaly exceeds a preset anomaly threshold, or drive to a safe area based on the assisted driving mode.
[0116] Optionally, the carrier device 500 may also include a display unit connected to the processor 520. The display unit can be a liquid crystal display (LCD) or a touch screen. If it is a touch screen, it can be a capacitive touchscreen or a resistive touchscreen that supports single-point and multi-point touch operations. Supporting single-point and multi-point touch operations means that the touch screen can sense touch operations generated simultaneously from one or more locations on the touch screen and pass the sensed touch operations to the processor 520 for calculation and processing. In this embodiment, the display unit can display the specific details of the verification result and various generated prompts.
[0117] Since the principle of the carrier device 500 in this embodiment of the application is similar to that of the aforementioned interactive verification method embodiment, the implementation of the carrier device 500 in this embodiment can refer to the description in the above-mentioned interactive verification method embodiment, and the repeated parts will not be described again.
[0118] Please see Figure 9 , Figure 9 This application provides a schematic diagram of the structure of a vehicle 600, which includes a steering wheel 610 and a processor 520. The steering wheel 610 and the processor 520 are connected in communication; the interactive area of the steering wheel 610 is divided into multiple partial areas; The processor 520 is used to generate verification instructions based on random time intervals in assisted driving mode; based on the verification instructions, determine a random area on the steering wheel 610 as the current verification area; and determine the verification result based on the operation of the current verification area within a preset feedback time.
[0119] Since the principle of the vehicle 600 in this embodiment of the application is similar to that of the aforementioned interactive verification method embodiment, the implementation of the vehicle 600 in this embodiment can refer to the description in the above-mentioned interactive verification method embodiment, and the repeated parts will not be repeated.
[0120] This application also provides a computer program product, which includes a computer program / instruction. When the computer program / instruction is executed by a processor, it implements the steps of any one of the interactive verification methods provided in this application.
[0121] In the several embodiments provided in this application, it should be understood that the disclosed device can also be implemented in other ways. The device embodiments described above are merely illustrative; for example, the block diagrams in the accompanying drawings illustrate the possible architecture, functions, and operations of the device according to various embodiments of this application. In this regard, each block in the block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagram, and combinations of block diagrams, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0122] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.
[0123] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0124] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.
[0125] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application.
[0126] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.
Claims
1. An interactive verification method, characterized in that, The method includes: In assisted driving mode, verification commands are generated based on random time intervals; Based on the verification command, a random portion of the area on the verification device is determined as the current verification area; The verification result is determined based on the operations performed on the current verification area within the preset feedback time. The step of determining a random partial area as the current verification area on the verification device based on the verification instruction includes: dividing the interaction area of the verification device into multiple partial areas; and determining the random partial area as the current verification area among the multiple partial areas based on the verification instruction.
2. The method according to claim 1, characterized in that, In the assisted driving mode, verification instructions are generated based on random time intervals, including: Determine the time range for triggering verification under the assisted driving mode; Within the stated time range, the random time interval is randomly determined; Based on the random time interval, a verification instruction is generated to interactively verify the verification target.
3. The method according to claim 2, characterized in that, Determining the time range for triggering verification in the assisted driving mode includes: Obtain visual detection data of the verification target in the assisted driving mode; Based on the visual detection data, the driving status of the verification target is determined; The time range for triggering verification is determined based on the driving status.
4. The method according to claim 1, characterized in that, The step of determining the verification result based on the operations performed on the current verification area within a preset feedback time period includes: Based on the current verification area, a verification prompt is generated; wherein the verification prompt includes at least one of visual prompts, voice prompts, and haptic prompts. Within the preset feedback time, the interaction between the verification target and the current verification area is detected, and the verification result is determined.
5. The method according to claim 4, characterized in that, The step of detecting the interaction between the verification target and the current verification area to determine the verification result includes: The interaction duration between the verification target and the current verification area is detected using sensors. If the interaction duration is determined to be greater than or equal to a preset time threshold, the verification result is that the interaction status of the verification target is normal. If the interaction duration is determined to be less than a preset time threshold, the verification result is that the interaction state of the verification target is abnormal; wherein, the preset time threshold is less than the preset feedback duration.
6. The method according to any one of claims 1-5, characterized in that, The method further includes: Within the set verification period, based on each of the first number of verification results representing anomalies, a first type of anomaly prompt is generated; Based on each of the verification results representing the first number of anomalies, and the verification results representing the second number of consecutive anomalies, a second type of anomaly prompt is generated; The intensity of the second type of error message is higher than that of the first type of error message.
7. The method according to any one of claims 1-5, characterized in that, The method further includes: If the number of consecutive verification results indicating anomalies exceeds a preset anomaly threshold, the assisted driving mode is downgraded, or the vehicle is driven to a safe area based on the assisted driving mode.
8. A carrier device, characterized in that, The carrier device includes: a verification device and a processor; The verification device and the processor are communicatively connected; The processor is used to generate verification instructions based on random time intervals in assisted driving mode; determine a random portion of the area on the verification device as the current verification area based on the verification instructions; and determine the verification result based on the operation of the current verification area within a preset feedback time. The processor is specifically configured to: divide the interaction area of the verification device into multiple partial areas; and, based on the verification instruction, determine a random partial area as the current verification area from among the multiple partial areas.
9. A vehicle, characterized in that, The vehicle includes: a steering wheel and a processor; The steering wheel and the processor are communicatively connected; the interactive area of the steering wheel is divided into multiple partial areas; The processor is used to generate verification instructions based on random time intervals in assisted driving mode; determine a random area on the steering wheel as the current verification area based on the verification instructions; and determine the verification result based on the operation of the current verification area within a preset feedback time. The processor is specifically configured to: divide the interactive area of the steering wheel into multiple partial areas; and, based on the verification instruction, determine a random partial area as the current verification area from among the multiple partial areas.
Citation Information
Patent Citations
Verification method, device and equipment based on human-computer interaction
CN114626047A
Estimating a degree of driver distraction
EP4284692A1