Safe riding detection method and device for electric bicycle

Abstract

The invention provides a safe riding detection method and device for an electric bicycle, and the method comprises the steps: obtaining an ear image of a user in the riding process of the electric bicycle; performing target detection on the ear image to obtain a target detection result; when the target detection result is that the wearable device exists, broadcasting a safety verification operation based on voice; and under the condition that the user response operation is not received within the preset time threshold value, braking measures are executed on the electric bicycle. According to the method provided by the invention, the ear image is acquired in the riding process and intelligent target detection is carried out, and after a suspected wearing behavior is detected, secondary confirmation is realized through safety verification operation based on voice broadcast, so that misjudgment possibly caused by purely depending on image recognition is avoided. And finally, a braking measure is taken into account for a high-risk scene which does not respond to verification, so that the traffic accident risk caused by hearing shielding due to earphone wearing is effectively reduced, and the user experience is considered through a humanized interaction process while the riding safety is guaranteed.

Description

Technical Field

[0001] This invention relates to the field of electric bicycle technology, and in particular to a method and device for detecting safe riding of electric bicycles. Background Technology

[0002] With the rapid development of urban shared mobility services, shared electric bikes have become an indispensable short-distance travel tool in daily life. However, the practice of some users wearing headphones to listen to music or make phone calls while riding not only increases traffic safety hazards but may also affect their perception of their surroundings, significantly increasing the risk of accidents. Users wearing headphones often have reduced ability to perceive external sounds, especially in busy urban environments with complex road conditions, making it difficult to notice warning sounds or emergencies in time, increasing the probability of accidents. Currently, voice reminders are typically used only to prompt users not to wear headphones while riding.

[0003] However, voice reminders are not very effective in preventing users from wearing headphones while riding shared electric bikes. Summary of the Invention

[0004] This invention provides a method and device for detecting safe riding of electric bicycles, which addresses the shortcomings of existing technologies that rely on voice reminders to prevent users from wearing headphones while riding shared electric bicycles.

[0005] This invention provides a method for detecting safe riding of electric bicycles, comprising: During the e-bike riding process, images of the user's ears are captured; Target detection is performed on the ear image to obtain the target detection result; If the target detection result indicates the presence of a wearable device, a security verification operation is performed based on voice broadcast. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

[0006] According to the present invention, a method for detecting safe riding of an electric bicycle further includes: If Bluetooth pairing with the user terminal is successful, the Bluetooth connection status of the user terminal will be continuously acquired. If the Bluetooth connection status is detected to include connection to the wearable device, the security verification operation is broadcast via voice. If no user response is received within the preset time threshold, braking measures are applied to the electric bicycle.

[0007] According to a method for detecting safe riding of an electric bicycle provided by the present invention, the step of applying braking measures to the electric bicycle when no user response operation is received within the preset time threshold includes: When the electric bicycle is not being ridden, the electric bicycle is locked. During the riding of the electric bicycle, the electric bicycle is controlled to perform a uniform speed reduction.

[0008] According to a method for detecting safe riding of an electric bicycle provided by the present invention, the step of applying braking measures to the electric bicycle when no user response operation is received within a preset time threshold includes: Repeatedly acquire the user's verification ear image; Target detection is performed on the verified ear image to obtain the verification detection result; If the verification result indicates the presence of the wearable device, the security verification operation is broadcast via voice. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

[0009] According to the present invention, a method for detecting safe riding of an electric bicycle includes a safety verification operation that includes performing braking measures multiple times and performing preset function operations; the preset function operations include at least one of turning lights on or off and sounding the horn.

[0010] According to the present invention, a method for detecting safe riding of an electric bicycle further includes: After the electric bicycle completes its initial unlocking, a pop-up notification message is generated and displayed. Upon receiving the user's pop-up click action, the security verification operation is broadcast via voice. If the user response is received within the preset time threshold, the electric bicycle will be finally unlocked.

[0011] The present invention also provides a safety riding detection device for electric bicycles, comprising: The acquisition unit acquires an image of the user's ear during the e-bike riding process; The target detection unit performs target detection on the ear image and obtains the target detection result. The verification unit performs a security verification operation based on voice broadcast when the target detection result indicates the presence of a wearable device. If the measure execution unit does not receive a user response operation within a preset time threshold, it will perform braking measures on the electric bicycle.

[0012] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the safe riding detection method for electric bicycles as described above.

[0013] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the electric bicycle safety riding detection method as described above.

[0014] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the electric bicycle safety riding detection method as described above.

[0015] The electric bicycle safety riding detection method and device provided by this invention acquires ear images and performs intelligent target detection during riding. This allows for accurate identification of headphone wearing without infringing on user privacy. Upon detecting suspected headphone wearing, a secondary confirmation is achieved through voice-based safety verification, avoiding potential misjudgments from relying solely on image recognition. Finally, forced braking measures are implemented for high-risk scenarios where verification fails to occur, effectively reducing the risk of traffic accidents caused by hearing impairment due to headphone use. While ensuring riding safety, the user-friendly interactive process also enhances the user experience. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0017] Figure 1 This is one of the flowcharts illustrating the safe riding detection method for electric bicycles provided by the present invention; Figure 2 This is the second flowchart of the electric bicycle safety riding detection method provided by the present invention; Figure 3 This is a schematic diagram of the structure of the electric bicycle safety riding detection device provided by the present invention; Figure 4 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0019] It should be noted that all actions involving the acquisition of signals, information, or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where the application is located, and with the authorization granted by the owner of the relevant device.

[0020] To address the aforementioned issues, this invention provides a method for detecting safe riding of electric bicycles, effectively preventing and restricting users from wearing headphones while riding shared electric bicycles. Figure 1 This is one of the flowcharts illustrating the safe riding detection method for electric bicycles provided by the present invention, such as... Figure 1 As shown, the method includes: Step 110: Acquire an image of the user's ear during the electric bicycle ride.

[0021] The ear image here refers to video frames or still images captured by an image acquisition device when the motorcycle is unlocked and in use by the user, which include the side of the user's face or specifically the ear area.

[0022] Specifically, an image acquisition device, such as a front-facing camera, installed on the e-bike can be activated while the e-bike is being ridden. Understandably, to balance power consumption and real-time detection, images of the rider's upper body or head can be acquired at a preset fixed frequency. Then, image preprocessing techniques can be used to extract or locate the region of interest, including the ear, from the acquired raw images, serving as the ear image to be analyzed. It should be noted that, to ensure user privacy and security, the image acquisition and processing process can employ blurring techniques, and only the ear region's contour features are extracted, avoiding the acquisition of complete, clear facial images, and omitting identity information comparison and uploading. All data processing is preferably completed on a local terminal.

[0023] Step 120: Perform target detection on the ear image to obtain the target detection result.

[0024] Here, the target detection result refers to the judgment conclusion on whether there is a specific obstruction or external object in the ear area after analysis by the algorithm model, such as "obstruction exists" or "no obstruction detected".

[0025] Specifically, the acquired ear image can be input into a pre-trained object detection model. This model analyzes the texture, shape, and edge features of the ear image to identify any object features that differ from the natural shape of a human ear. Here, the object detection model can be built on a lightweight neural network architecture to accommodate the computing power of the e-bike's onboard terminal. Understandably, if the model identifies an object in the ear region that matches the characteristics of headphones or earplugs, it outputs a target detection result indicating the presence of a wearable device; otherwise, it outputs that it does not exist. This achieves automated identification of the unsafe behavior of wearing headphones while riding.

[0026] It should be noted that the target detection model is deployed locally on the e-bike, ensuring that the original image data flows only in local memory throughout the detection process and can be discarded or overwritten after processing. On one hand, this greatly protects user privacy and security, avoiding the data leakage risks that might arise from uploading facial or environmental images to the cloud, thus alleviating user concerns. On the other hand, local computation avoids latency issues caused by unstable network signals, ensuring the real-time nature of detection results. This allows the system to react to dangerous behaviors within milliseconds, thereby more effectively ensuring riding safety.

[0027] Step 130: If the target detection result indicates the presence of a wearable device, perform a security verification operation based on voice broadcast.

[0028] Here, wearable devices specifically refer to electronic devices or items worn on a user's ears that may affect the user's auditory perception or distract the user's attention while cycling, including but not limited to in-ear headphones, over-ear headphones, ear-hook Bluetooth headphones, earplugs, etc.

[0029] Here, the security verification operation refers to an interactive confirmation process initiated by the system when it initially determines that a user may be engaging in improper wearing behavior, in order to rule out false judgments or to forcibly remind the user to correct their behavior. This process verifies whether the user has the normal perception ability of the external environment and whether they have corrected their improper behavior by issuing specific instruction signals to require the user to perform specific feedback actions.

[0030] Specifically, when the target detection result indicates that a user is suspected of wearing a wearable device, penalties can be waived immediately, and a verification process can be initiated immediately instead of penalties. For example, the vehicle's built-in voice broadcast system can issue a specific voice prompt, such as "We have detected that you are wearing headphones. For safety, please remove them and follow the instructions to confirm." This instruction can include, but is not limited to, requiring the user to perform some non-driving but detectable action while riding. By using voice-based safety verification, the system can both warn the user and give them an opportunity to correct their behavior, avoiding a decline in user experience due to algorithmic misidentification.

[0031] Step 140: If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

[0032] Here, user response action refers to a specific physical action that the user completes within a specified time, based on the prompts of the safety verification operation, and that can be clearly captured by the vehicle's sensors. This action serves as a confirmation signal that the user has received a safety warning and is in a conscious and controllable state. Braking measures here refer to vehicle control measures forcibly taken to reduce potential accident risks when the user fails the verification, aiming to limit the vehicle's driving ability or force the vehicle to stop.

[0033] Specifically, after issuing the command for a safety verification operation, a timer function can be activated. Within a preset time threshold, such as 5 seconds or the duration of continuous beeping prompts, the status signals of various vehicle components are continuously monitored to determine whether a compliant user response has been received. For example, changes in the signal of the brake lever or the signal of the headlight switch can be monitored. If no corresponding signal change is detected within the specified time, or if the user refuses to perform the operation, the current riding state is determined to be high-risk, i.e., the user is still wearing headphones and has not responded to environmental warnings, and the system automatically enters a safety mode. In this mode, the controller can gradually reduce the motor output power to reduce the vehicle speed until the vehicle comes to a slow stop, or directly cut off the power output, thereby forcing the user to notice the current violation and eliminating the safety hazard.

[0034] The electric bicycle safety riding detection method provided in this invention acquires ear images and performs intelligent target detection during riding. This allows for accurate identification of headphone wearing without infringing on user privacy. Upon detecting suspected headphone wearing, a secondary confirmation is achieved through voice-based safety verification, avoiding potential misjudgments from relying solely on image recognition. Finally, forced braking is implemented for high-risk scenarios where verification fails to occur, effectively reducing the risk of traffic accidents caused by hearing impairment due to headphone use. While ensuring riding safety, the method also considers user experience through a user-friendly interactive process.

[0035] Based on any of the above embodiments, the method further includes: If Bluetooth pairing with the user terminal is successful, the Bluetooth connection status of the user terminal will be continuously acquired. If the Bluetooth connection status is detected to include connection to the wearable device, the security verification operation is broadcast via voice. If no user response is received within the preset time threshold, braking measures are applied to the electric bicycle.

[0036] Here, "user terminal" refers to the smart mobile device, such as a smartphone, used by the user to unlock and use the e-bike. "Bluetooth connection status" refers to the current operational status of the user terminal's Bluetooth module, specifically details of connections with other Bluetooth peripherals besides the e-bike.

[0037] Specifically, after the user scans the code or clicks to unlock the e-bike, the e-bike maintains a Bluetooth communication connection with the user's terminal. During the ride, the user can interact with the application or mini-program running on the user's terminal through the e-bike's central control program to continuously monitor the Bluetooth adapter status of the user's terminal. Then, according to a preset polling cycle, the user's terminal can query the list of currently connected Bluetooth devices or the audio output routing status to obtain the real-time Bluetooth connection status.

[0038] Once a change in the Bluetooth connection status is detected, such as the detection of a new Bluetooth device connecting or the activation of a specific Bluetooth protocol, the device's attributes can be immediately analyzed. If the device is determined to be a wearable device such as a Bluetooth headset, it is considered that the user poses a risk of auditory obstruction. In this case, without needing to consider the target detection results of the ear image, a safety verification operation can be immediately performed based on voice prompts. For example, through vehicle voice prompts, the user can be asked to perform specified actions such as turning the lights on and off while riding, or repeatedly squeezing the brakes, to confirm whether the user remains alert and is willing to correct their wearing behavior.

[0039] It should be noted that by utilizing the non-line-of-sight characteristics of Bluetooth signals, the limitations of image detection in low light or when hair covers the ears are effectively compensated.

[0040] Furthermore, if no compliant changes in the vehicle's headlight or brake signals are detected within the specified time after the safety verification is triggered, the user is deemed to have failed the verification. In this case, braking measures will be applied to the electric bicycle to restrict its normal driving function. This ensures that if a user is found to be engaging in high-risk behavior and refuses to correct it, enforcement measures can be taken to intervene in the riding and protect the user's safety.

[0041] The electric bicycle safety riding detection method provided in this invention, based on image detection, further introduces a Bluetooth signal monitoring mechanism. By monitoring the connection status between the user terminal and the Bluetooth headset, it achieves multi-dimensional recognition of the behavior of wearing headsets while riding. This dual monitoring mode constructs a more rigorous monitoring network, which can not only identify visible violations but also accurately capture concealed Bluetooth connection behavior, thereby greatly reducing the false negative rate and significantly improving the ability to control unsafe riding behaviors of users.

[0042] Based on any of the above embodiments, if no user response operation is received within the preset time threshold, braking measures are applied to the electric bicycle, including: When the electric bicycle is not being ridden, the electric bicycle is locked. During the riding of the electric bicycle, the electric bicycle is controlled to perform a uniform speed reduction.

[0043] Here, "non-riding state" refers to the e-bike being stationary with zero speed, or in a preparatory stage after unlocking but before any movement has occurred. "Locking operation" refers to the motor controller of the e-bike entering locked mode, preventing the vehicle from being driven or pushed.

[0044] Specifically, the vehicle's current motion status is first determined using wheel speed sensors, GPS positioning information, or motor speed signals. If the vehicle is determined to be in a non-riding state, for example, if the user is detected wearing headphones before starting and fails verification, a locking command can be issued directly. Simultaneously, the vehicle's voice system will repeatedly announce that the user must remove the headphones and pass verification by applying the brakes before unlocking and riding. This measure controls risk at its source, effectively preventing users from forcibly taking to the road without eliminating safety hazards.

[0045] Additionally, if the user triggers braking due to a failed safety check while the vehicle is in motion, it will enter safety mode. In this mode, the controller will not immediately lock the wheels to prevent the user from falling due to inertia. Instead, it will gradually reduce the vehicle's speed in a linear and predictable manner. During this period, the vehicle will continuously issue a voice alert, reminding the user, "Entering safety mode, please stop."

[0046] It should be noted that this braking measure, while forcibly intervening in violations, fully considers the laws of physical motion, and minimizes the risk of secondary traffic accidents caused by the system's forced braking itself.

[0047] The electric bicycle safety riding detection method provided in this invention distinguishes between non-riding and riding states, employing two targeted braking measures: locking and constant-speed deceleration, respectively. This scenario-based control strategy reflects a highly humanized and safety-oriented design philosophy. Specifically, it rigorously prevents potential hazards from starting in static scenarios, while providing flexible intervention in dynamic scenarios to ensure a smooth and controllable braking process. Thus, while ensuring the enforcement of rules, it maximizes the protection of riders' personal safety and improves the safety operation level of shared mobility services.

[0048] Based on any of the above embodiments, if no user response is received within a preset time threshold, braking measures are applied to the electric bicycle, followed by: Repeatedly acquire the user's verification ear image; Target detection is performed on the verified ear image to obtain the verification detection result; If the verification result indicates the presence of the wearable device, the security verification operation is broadcast via voice. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

[0049] Here, "ear image verification" refers to the image data of the rider's ear area collected again during the continuous monitoring phase after the electric bicycle has already taken braking measures such as slowing down or locking due to the detection of improper wearing behavior.

[0050] Specifically, monitoring does not stop after the electric bicycle enters safety mode or braking state; instead, the image acquisition device remains on. It can continue to capture side-view images of the user's head at a preset frequency to confirm in real time whether the user has heeded the system's safety prompts and corrected any violations, such as removing headphones, providing data support for subsequently lifting vehicle restrictions.

[0051] Then, the newly acquired verification ear image is input again into the local object detection model for processing. The object detection model analyzes the features in the image to determine whether the occlusion, such as headphones or earplugs, has been removed from the user's ear. If the object detection model detects that the occlusion has disappeared, it outputs the result that no wearable device exists; if the occlusion still exists, it outputs the result that a wearable device exists.

[0052] Furthermore, if the verification results show that the user is still wearing the wearable device, it indicates that the safety hazard has not been eliminated. In this case, the safety verification operation can be repeated via voice prompts, for example, prompting the user to perform a specific action again. If the user still does not respond within the specified time, the current braking measures will be maintained, such as maintaining a low speed limit or keeping the vehicle locked, until the user completes the rectification and passes the verification. Conversely, if subsequent monitoring shows that the user has removed the headset and passed the behavior verification, the system can automatically release the braking measures and restore the vehicle's normal power output.

[0053] The electric bicycle safety riding detection method provided in this embodiment of the invention, by continuously acquiring and detecting images after braking measures are implemented, can not only ensure that persistent violations are effectively restricted, but also give users the opportunity to resume normal riding after correcting errors. This avoids the rigid processing of forcibly terminating the entire trip due to a single violation, thereby improving the intelligence level of the system and the user experience.

[0054] Based on any of the above embodiments, the safety verification operation includes performing braking measures multiple times and performing preset function operations; the preset function operations include at least one of turning lights on or off and sounding the horn.

[0055] Here, "multiple braking actions" refers to the user's continuous squeezing and releasing of the motorcycle brake lever, and the number of times this action is performed must meet preset requirements, such as squeezing it twice consecutively. Additionally, "preset function operation" here refers to the user operating non-core driving function switches on the motorcycle, such as the headlight switch, turn signal switch, or horn button, to generate electrical signal changes detectable by the system.

[0056] Specifically, to prevent users from merely clicking on a pop-up window on their phone screen for perfunctory confirmation, the security verification operation provided in this embodiment of the invention requires users to physically interact with the vehicle hardware. For example, when a security verification is triggered, the vehicle's voice will clearly announce instructions, such as "Please squeeze the brakes twice to confirm safety" or "Please turn the headlights on and off to verify." Thus, the user's actions can be verified by monitoring the brake power-off switch signal, changes in the level of the headlight control circuit, or the horn signal. Verification is considered successful only when the detected hardware signal sequence matches the voice command requirements.

[0057] The electric bicycle safety riding detection method provided in this invention performs safety verification by forcing users to perform multiple physical operations such as braking or switching lights on and off. First, it ensures that the user's hands are on the handlebars and that their attention is focused on controlling the vehicle. Second, this verification method effectively prevents misjudgments caused by users blindly clicking the confirmation button on their phones while still wearing headphones and unable to hear ambient sounds, thus significantly improving the authenticity and reliability of the verification results and ensuring that the user is truly in a safe state with awareness of the vehicle and the environment.

[0058] Based on any of the above embodiments, the method further includes: After the electric bicycle completes its initial unlocking, a pop-up notification message is generated and displayed. Upon receiving the user's pop-up click action, the security verification operation is broadcast via voice. If the user response is received within the preset time threshold, the electric bicycle will be finally unlocked.

[0059] Here, "initial unlocking" refers to the process where, after a user scans the e-bike's QR code or submits a usage request via their mobile device, the backend server verifies the user's identity and account status, instructing the vehicle system to enter a ready-to-start state. However, at this time, the wheel hub locks or motor controllers are not yet fully unlocked, and the vehicle is still practically unrideable. "Pop-up notification" refers to a mandatory visual interactive window that appears on the user's application interface, containing safety warnings prohibiting the use of headphones while riding, as well as an interactive button requiring the user to confirm that they have removed their headphones.

[0060] Specifically, when a user successfully scans the code to request a ride, the initial unlocking logic is executed first. At this time, the user's mobile app does not directly enter the riding navigation or timing interface, but immediately pops up a safety prompt. This prompt clearly informs the user that "wearing headphones while riding is a dangerous behavior; please remove your headphones." If a Bluetooth audio device is detected connected to the user's phone at this time, this pop-up can be a "strong reminder pop-up," which must be manually clicked by the user to be cleared, thus providing the first round of safety reminders before the ride begins.

[0061] Specifically, to prevent users from clicking the button perfunctorily just to remove the pop-up, the system does not immediately send the final unlock command through the server after receiving the user's confirmation signal. Instead, the process is redirected to the vehicle's onboard unit, where a security verification operation is performed via voice prompt. For example, the vehicle will then prompt via voice: "Please squeeze the brakes twice within 5 seconds to unlock." This transforms the user's virtual confirmation on their phone into a physical operation requirement for the vehicle, preventing users from starting to ride without actually removing their headphones.

[0062] The vehicle controller begins timing after issuing a safety verification command and monitors brake or light signals. Verification is only successful when the user accurately executes the user response, proving that the user can clearly hear the vehicle's voice prompts and is focused on the vehicle. The final unlocking operation then allows the user to ride away. If no correct response is received within the time limit, the vehicle will remain locked and prompt the user to try again.

[0063] The electric bicycle safety riding detection method provided in this invention effectively solves the problem in the prior art that relying solely on pop-up prompts cannot constrain the user's actual behavior by constructing a progressive start process of "initial unlocking - pop-up confirmation - behavior verification - final unlocking". By using behavior verification as a necessary condition for final unlocking, it forces users to prove their auditory perception ability and operational readiness before obtaining riding permission, thereby eliminating the safety hazard of users starting with headphones on from the source and significantly reducing the risk of accidents caused by lack of concentration during the starting phase.

[0064] Based on any of the above embodiments Figure 2 This is the second flowchart of the electric bicycle safety riding detection method provided by the present invention, as shown below. Figure 2 As shown, the method includes: First, a safety detection process is initiated based on the vehicle's front-facing camera monitoring device. Throughout the ride, not only is a pre-ride prompting for user behavior verification via voice prompts (e.g., repeatedly squeezing the brakes or switching lights on / off) to confirm auditory perception and rule out perfunctory actions like simply clicking a pop-up on a phone, but the front-facing camera also continuously acquires image information of the rider, with real-time detection of the ear area. If the image recognition model detects suspected earphone use, the behavior verification process is triggered again, prompting the user to perform a specified action via voice prompt to confirm the risk status. Then, it is determined whether the user has completed the required behavior verification action. If the user successfully completes the verification action within the specified time, it indicates that the user is in a safe state or has removed the earphones, and the vehicle maintains or resumes normal riding status. Conversely, if the user fails to complete the verification action, a safety risk is deemed to exist, and mandatory intervention measures are taken. Specifically, the vehicle is controlled to gradually decrease speed until it stops, while a high-frequency voice prompt continuously reminds the user until it is confirmed that the user has removed the earphones and eliminated the safety hazard, only then can the vehicle resume normal riding function. The entire process achieves closed-loop control from monitoring and verification to intervention, effectively ensuring cycling safety.

[0065] Based on any of the above embodiments Figure 3 This is a schematic diagram of the structure of the electric bicycle safety riding detection device provided by the present invention, as shown below. Figure 3 As shown, the device includes: The acquisition unit 310 acquires an image of the user's ear during the riding of the electric bicycle; The target detection unit 320 performs target detection on the ear image and obtains the target detection result; Verification unit 330 performs a security verification operation based on voice broadcast when the target detection result indicates the presence of a wearable device. If the measure execution unit 340 does not receive a user response operation within a preset time threshold, it performs braking measures on the electric bicycle.

[0066] The electric bicycle safety riding detection device provided in this invention acquires ear images and performs intelligent target detection during riding. It can accurately identify the act of wearing headphones without infringing on user privacy. Upon detecting suspected headphone use, it performs a secondary confirmation through voice-based safety verification, avoiding potential misjudgments from relying solely on image recognition. Finally, it implements forced braking measures for high-risk scenarios where verification fails to occur, effectively reducing the risk of traffic accidents caused by hearing impairment due to headphone use. While ensuring riding safety, it also considers user experience through a user-friendly interactive process.

[0067] Based on any of the above embodiments, the device is further specifically used for: If Bluetooth pairing with the user terminal is successful, the Bluetooth connection status of the user terminal will be continuously acquired. If the Bluetooth connection status is detected to include connection to the wearable device, the security verification operation is broadcast via voice. If no user response is received within the preset time threshold, braking measures are applied to the electric bicycle.

[0068] Based on any of the above embodiments, the measure execution unit is further specifically used for: When the electric bicycle is not being ridden, the electric bicycle is locked. During the riding of the electric bicycle, the electric bicycle is controlled to perform a uniform speed reduction.

[0069] Based on any of the above embodiments, a review unit is included after the measure execution unit, and the review unit is specifically used for: Repeatedly acquire the user's verification ear image; Target detection is performed on the verified ear image to obtain the verification detection result; If the verification result indicates the presence of the wearable device, the security verification operation is broadcast via voice. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

[0070] Based on any of the above embodiments, the safety verification operation includes performing braking measures multiple times and performing preset function operations; the preset function operations include at least one of turning lights on or off and sounding the horn.

[0071] Based on any of the above embodiments, the device is further specifically used for: After the electric bicycle completes its initial unlocking, a pop-up notification message is generated and displayed. Upon receiving the user's pop-up click action, the security verification operation is broadcast via voice. If the user response is received within the preset time threshold, the electric bicycle will be finally unlocked.

[0072] Figure 4 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 4As shown, the electronic device may include a processor 410, a communication interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call logical instructions in the memory 430 to execute a safe riding detection method for electric bicycles. The method includes: acquiring an image of the user's ear during electric bicycle riding; performing target detection on the ear image to obtain a target detection result; if the target detection result indicates the presence of a wearable device, performing a safety verification operation based on voice broadcast; and if no user response operation is received within a preset time threshold, performing braking measures on the electric bicycle.

[0073] Furthermore, the logical instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0074] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the electric bicycle safety riding detection method provided by the above methods. The method includes: acquiring a user's ear image during electric bicycle riding; performing target detection on the ear image to obtain a target detection result; performing a safety verification operation based on voice broadcast when the target detection result indicates the presence of a wearable device; and performing braking measures on the electric bicycle if no user response operation is received within a preset time threshold.

[0075] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements a method for detecting safe riding of an electric bicycle provided by the methods described above. The method includes: acquiring an image of a user's ear during riding the electric bicycle; performing target detection on the ear image to obtain a target detection result; performing a safety verification operation based on voice broadcast if the target detection result indicates the presence of a wearable device; and performing braking measures on the electric bicycle if no user response operation is received within a preset time threshold.

[0076] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0077] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0078] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for detecting safe riding of an electric bicycle, characterized in that, include: During the e-bike riding process, images of the user's ears are captured; Target detection is performed on the ear image to obtain the target detection result; If the target detection result indicates the presence of a wearable device, a security verification operation is performed based on voice broadcast. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

2. The method for detecting safe riding of an electric bicycle according to claim 1, characterized in that, The method further includes: If Bluetooth pairing with the user terminal is successful, the Bluetooth connection status of the user terminal will be continuously acquired. If the Bluetooth connection status is detected to include connection to the wearable device, the security verification operation is broadcast via voice. If no user response is received within the preset time threshold, braking measures are applied to the electric bicycle.

3. The method for detecting safe riding of an electric bicycle according to claim 2, characterized in that, If no user response is received within the preset time threshold, the braking measure on the electric bicycle includes: When the electric bicycle is not being ridden, the electric bicycle is locked. During the riding of the electric bicycle, the electric bicycle is controlled to perform a uniform speed reduction.

4. The method for detecting safe riding of an electric bicycle according to any one of claims 1 to 3, characterized in that, If no user response is received within a preset time threshold, the braking action on the electric bicycle is then performed, which includes: Repeatedly acquire the user's verification ear image; Target detection is performed on the verified ear image to obtain the verification detection result; If the verification result indicates the presence of the wearable device, the security verification operation is broadcast via voice. If no user response is received within a preset time threshold, braking measures are applied to the electric bicycle.

5. The method for detecting safe riding of an electric bicycle according to any one of claims 1 to 3, characterized in that, The safety verification operation includes performing braking measures multiple times and performing preset function operations; the preset function operations include at least one of turning lights on or off and sounding the horn.

6. The method for detecting safe riding of an electric bicycle according to any one of claims 1 to 3, characterized in that, The method further includes: After the electric bicycle completes its initial unlocking, a pop-up notification message is generated and displayed. Upon receiving the user's pop-up click action, the security verification operation is broadcast via voice. If the user response is received within the preset time threshold, the electric bicycle will be finally unlocked.

7. A safety riding detection device for electric bicycles, characterized in that, include: The acquisition unit acquires an image of the user's ear during the e-bike riding process; The target detection unit performs target detection on the ear image and obtains the target detection result. The verification unit performs a security verification operation based on voice broadcast when the target detection result indicates the presence of a wearable device. If the measure execution unit does not receive a user response operation within a preset time threshold, it will perform braking measures on the electric bicycle.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the safe riding detection method for electric bicycles as described in any one of claims 1 to 6.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the safe riding detection method for electric bicycles as described in any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the safe riding detection method for electric bicycles as described in any one of claims 1 to 6.

Images