Head-wearing device, communication method, apparatus, storage medium and electronic device

Abstract

The present disclosure relates to a head-mounted device, a communication method, an apparatus, a storage medium and an electronic device, the head-mounted device comprising: an AR display component, a wireless communication module, a processing module; the wireless communication module is configured to receive an operation instruction sent by a mobile terminal; the processing module is configured to generate corresponding prompt icon information according to the operation instruction, and send the prompt icon information to the AR display component; the AR display component is configured to display the prompt icon information; and a power module is configured to supply power to the AR display component, the wireless communication module and the processing module. Thus, the user can see the prompt icon information corresponding to the instruction sent by the mobile terminal through the AR display component during cycling, without needing to look at other devices, and the displayed information is in the form of an icon, which can simplify the information presented to the user, facilitate the user to focus on cycling, and improve the safety of cycling.

Description

Technical Field

[0001] This disclosure relates to the field of wearable devices, and more specifically, to a head-worn wearable device, a communication method, an apparatus, a storage medium, and an electronic device. Background Technology

[0002] With changing consumer habits, ordering takeout has become a part of many people's daily lives. As the number of takeout orders increases dramatically, more and more delivery personnel are shuttling through the streets and alleys of various cities. Since time is money for delivery personnel, they often use their mobile phones for navigation, answering calls, and processing some orders while riding to meet orders. They may even violate traffic regulations by speeding and running red lights in order to save time, which poses a great threat to the life and property safety of individuals and pedestrians. Summary of the Invention

[0003] The purpose of this disclosure is to provide a head-wearing device, a communication method for the head-wearing device, an apparatus, a computer-readable storage medium, and an electronic device to improve user safety during cycling.

[0004] To achieve the above objectives, a first aspect of this disclosure provides a head-worn device, comprising: an AR display component, a wireless communication module, a processing module, and a power module, wherein the AR display component, the wireless communication module, and the processing module are connected to the power module, and the AR display component, the wireless communication module, and the processing module are connected to the processing module;

[0005] The wireless communication module is used to receive operation commands sent by the mobile terminal;

[0006] The processing module is used to generate corresponding prompt icon information according to the operation instruction, and send the prompt icon information to the AR display component;

[0007] The AR display component is used to display the prompt icon information;

[0008] The power module is used to supply power to the AR display component, the wireless communication module, and the processing module.

[0009] Optionally, it further includes: an image acquisition device, which is connected to the power module and the processing module;

[0010] The image acquisition device is used to acquire road images;

[0011] The processing module is used to identify the road image to determine the traffic instructions corresponding to traffic lights and / or traffic signs in the road image, and generate traffic icon information corresponding to the traffic instructions;

[0012] The AR display component is also used to display the traffic icon information.

[0013] Optionally, the processing module is configured to determine the location information of the head-worn device in the road based on the road image, and determine whether the traffic order is violated based on the location information;

[0014] The processing module is also used to send a violation warning message to the AR display component when it is determined that the traffic order has been violated;

[0015] The AR display component is also used to display the violation driving warning information.

[0016] Optionally, it may also include: a positioning module;

[0017] The positioning module is used to acquire the driving trajectory of the head-mounted device and send the driving trajectory to the processing module;

[0018] The processing module is used to determine whether the traffic order has been violated based on the driving trajectory;

[0019] The processing module is also used to send a violation warning message to the AR display component when it is determined that the traffic order has been violated;

[0020] The AR display component is also used to display the violation driving warning information.

[0021] Optionally, the wireless communication module is further configured to send violation information to the mobile terminal when it is determined that the traffic order has been violated, the violation information being used to instruct the mobile terminal to report the violation information to the background server.

[0022] Optionally, the AR display component includes a microdisplay and waveguide optics.

[0023] Optionally, it further includes: an audio output module and an audio acquisition module, wherein the audio output module and the audio acquisition module are connected to the power supply module and the processing module;

[0024] The audio output module is used to output voice information corresponding to the prompt icon information when the AR display component displays the prompt icon information;

[0025] The audio acquisition module is used to collect the user's voice information.

[0026] Optionally, it further includes: at least one button, the at least one button being connected to the processing module, the button including: a touch button or a physical button;

[0027] The at least one button is used for the user of the head-wearing device to interact with the head-wearing device.

[0028] Optionally, the wireless communication module is a Bluetooth Low Energy module.

[0029] A second aspect of this disclosure provides a communication method for a head-wearing device, applied to the head-wearing device described in the first aspect, the method comprising:

[0030] Receive operation commands sent by the mobile terminal;

[0031] Generate corresponding prompt icon information according to the operation instructions;

[0032] The prompt icon information is displayed through the AR display component of the head-worn device.

[0033] Optionally, the method further includes:

[0034] Generate the voice information corresponding to the operation command;

[0035] When the prompt icon information is displayed, the voice information is output.

[0036] Optionally, the operation instruction is a call request, and the method further includes:

[0037] The system receives a call request sent by the mobile terminal. The call request carries the caller's phone number and a reminder message corresponding to the caller. The reminder message is used to indicate the order information corresponding to the phone number and / or the call type of the phone number.

[0038] Generate call notification icon information corresponding to the phone number and the reminder information;

[0039] The call notification icon information is displayed through the AR display component.

[0040] Optionally, the method further includes:

[0041] When the reminder information indicates the order information, after a preset duration of receiving the call request, respond to the call request to answer the corresponding call through the head-worn device;

[0042] When the incoming call type indicated by the reminder message is a specified type, the call request is rejected.

[0043] Optionally, the method further includes:

[0044] Receive an order request sent by the mobile terminal, the order request carrying order information;

[0045] The AR display component displays the order information, as well as a prompt indicating whether the order request is accepted.

[0046] When a first operation triggered by a button on the head-worn device is received, or a first voice command is received, an instruction to accept the order request is sent to the mobile terminal.

[0047] When a second operation triggered by a button on the head-worn device is received, or a second voice command is received, an instruction to reject the order request is sent to the mobile terminal.

[0048] Optionally, the method further includes:

[0049] Acquire road images;

[0050] The road image is identified to determine the traffic instructions corresponding to traffic lights and / or traffic signs in the road image;

[0051] Generate traffic icon information corresponding to the traffic instruction;

[0052] The traffic icon information is displayed through the AR display component.

[0053] Optionally, the method further includes:

[0054] The location information of the head-mounted device in the road is determined based on the road image;

[0055] Determine whether the traffic order has been violated based on the location information;

[0056] If a violation of the traffic order is determined, the violation warning information is displayed through the AR display component, and / or the corresponding voice information is output.

[0057] Optionally, the method further includes:

[0058] Obtain the driving trajectory of the head-wearing device;

[0059] Determine whether the traffic order has been violated based on the driving trajectory;

[0060] If a violation of the traffic order is determined, the violation warning information is displayed via an AR display component, and / or the corresponding voice information is output.

[0061] Optionally, the method further includes:

[0062] If a violation of the traffic order is determined, violation information is sent to the mobile terminal, which instructs the mobile terminal to report the violation to the backend server.

[0063] Optionally, the method further includes:

[0064] When the mobile terminal detects that the driving speed exceeds the preset speed, it receives an overspeed warning message sent by the mobile terminal;

[0065] The speeding warning information is displayed through the AR display component, and / or the corresponding voice information is output.

[0066] Optionally, the operation instructions include navigation instructions, and generating corresponding prompt icon information based on the operation instructions includes:

[0067] The corresponding navigation icon information is generated based on the navigation instructions.

[0068] A third aspect of this disclosure provides a communication device for a head-worn device, applied to the head-worn device described in the first aspect, the device comprising:

[0069] The receiving module is used to receive operation commands sent by the mobile terminal;

[0070] The generation module is used to generate corresponding prompt icon information based on the navigation instructions;

[0071] The display module is used to display the prompt icon information through the AR display component of the head-worn device.

[0072] A fourth aspect of this disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in the second aspect.

[0073] A fifth aspect of this disclosure provides an electronic device comprising:

[0074] A memory on which computer programs are stored;

[0075] A processor for executing the computer program in the memory to implement the steps of the method described in the second aspect.

[0076] The above technical solution provides a head-worn device, including: an AR display component, a wireless communication module, a processing module, and a power module. The wireless communication module is used for communication between the head-worn device and a mobile terminal; the wireless communication module is used to receive operation commands generated by the mobile terminal based on a road image; the processing module is used to generate corresponding prompt icon information based on the operation commands received from the mobile terminal by the wireless communication module, and send the prompt icon information to the AR display component; the AR display component is used to display the prompt icon information; and the power module is used to supply power to the AR display component, the wireless communication module, and the processing module. This technical solution enables the generation of relevant prompt icon information based on operation commands sent by the mobile terminal, and displays the prompt icon information through the AR display component of the head-worn device. This allows users to see the prompt icon information corresponding to the commands sent by the mobile terminal during cycling, without needing to consult other devices. Furthermore, the information is displayed in icon form, simplifying the information presented to the user, allowing the user to focus on cycling, and improving cycling safety.

[0077] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0078] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings:

[0079] Figure 1 This is a block diagram illustrating a head-wearing device according to an exemplary embodiment;

[0080] Figure 2 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment;

[0081] Figure 3 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment;

[0082] Figure 4 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment;

[0083] Figure 5 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment;

[0084] Figure 6 This is a block diagram illustrating a communication device for a head-worn device according to an exemplary embodiment;

[0085] Figure 7 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation

[0086] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure.

[0087] Figure 1 This is a block diagram illustrating a head-wearing device according to an exemplary embodiment, such as... Figure 1 As shown, the head-worn device 100 may include: an AR display component 101, a wireless communication module 102, a processing module 103, and a power module 104. The AR display component 101, the wireless communication module 102, and the processing module 103 are all connected to the power module 104, and the AR display component 101 and the wireless communication module 102 are all connected to the processing module 103.

[0088] The wireless communication module 102 is used for the head-worn device to communicate with the mobile terminal and to receive operation commands sent by the mobile terminal.

[0089] The processing module 103 is used to generate corresponding prompt icon information according to the operation instructions received by the wireless communication module 102 from the mobile terminal, and send the prompt icon information to the AR display component 101.

[0090] AR display component 101 is used to display the prompt icon information.

[0091] The power module 104 is used to supply power to the AR display component 101, the wireless communication module 102 and the processing module 103.

[0092] For example, the head-wearing device 100 can be a helmet, smart glasses, AR glasses, or other devices worn on the head. Taking a helmet as an example, the head-wearing device 100 can be a helmet used when riding a motorcycle, electric vehicle, or other means of transportation, and the aforementioned AR display component 101, wireless communication module 102, processing module 103, and power module 104 are installed inside the helmet.

[0093] Optionally, in one embodiment, the AR display component 101 may include a microdisplay and a waveguide optical element. The waveguide has good light transmittance, allowing delivery personnel to maintain their field of vision without obstruction when wearing the device. Therefore, using the waveguide optical element as a near-eye display optical element ensures safety during riding. The AR display component 101 is disposed inside the helmet and can be positioned behind the helmet's transparent visor. The AR display component 101 can be disposed independently inside the helmet or linked to the helmet's transparent visor. For example, the AR display component 101 can be connected to the inside of the helmet via a connector and not move with the helmet's transparent visor, or the AR display component 101 can be connected to the helmet's transparent visor via a connector and move with the helmet's transparent visor. The connector can be a fixed connector or a movable connector. If the connector is movable, the AR display component 101 can be independently adjusted via the movable connector regardless of whether it moves with the transparent visor. The wireless communication module 102 can be a Bluetooth Low Energy (BLE) module. The processing module 103 can be a processing chip with processing capabilities, such as an edge computing unit or a CPU. The power module 104 can be a battery module, which can be a rechargeable battery, such as a lithium battery, or it can be a battery compartment with replaceable batteries.

[0094] For example, the mobile terminal can be a mobile phone, tablet computer, other smart head-worn devices, PDA (Personal Digital Assistant), etc.

[0095] In one embodiment, the aforementioned operation instruction can be a navigation instruction. The mobile terminal may have a navigation-enabled application installed. This application can pre-store or acquire map data of the current location in real time. The mobile terminal can use its own positioning function to obtain its current geographical location, and determine the road it is currently on and its position within that road based on the current geographical location and the aforementioned map data, thereby generating a corresponding navigation instruction. Accordingly, after receiving the navigation instruction from the mobile terminal, the wireless communication module 102 sends the navigation instruction to the processing module 103. The processing module 103 generates corresponding navigation icon information based on the navigation instruction and sends the navigation icon information to the AR display component 101, whereby the AR display component 102 displays the prompt icon information.

[0096] Optionally, such as Figure 1As shown, the head-mounted wearable device 100 may also include an image acquisition device 105, which is connected to the power module 104 and the processing module 103. The image acquisition device 105 may be one or more cameras. After acquiring a road image, the image acquisition device 105 sends the road image to the mobile terminal through the wireless communication module 102. After acquiring the road image, the mobile terminal can identify the image to obtain the road information where the mobile terminal is currently located. It can also combine the positioning function of the mobile terminal to obtain the road where the mobile terminal is currently located and its position on the road. By combining the road information obtained through image recognition and the position obtained through positioning function, the mobile terminal can be positioned more accurately and navigation instructions can be determined.

[0097] For example, the navigation instructions mentioned above could be "turn left 50 meters ahead" or "turn right 100 meters ahead." After determining the navigation instructions, the mobile terminal sends the navigation instructions to the head-mounted device 100. The head-mounted device 100 can receive the navigation instructions through the wireless communication module 102, generate corresponding navigation icon information based on the navigation instructions, and then send the navigation icon information to the AR display component 101. The navigation icon information is displayed in icon form. For example, if the navigation instruction is "turn left 50 meters ahead," the generated navigation icon information could be a left-turn arrow icon and the number 50 (representing 50 meters); if the navigation instruction is "turn right 100 meters ahead," the generated navigation icon information could be a right-turn arrow icon and the number 100 (representing 50 meters). Optionally, the navigation instructions sent by the mobile terminal can be updated as the mobile terminal's position changes. For example, if the navigation instruction is "turn left 50 meters ahead," the mobile terminal can update the navigation instruction to "turn left 40 meters ahead" after moving forward 10 meters. This will display a left-turn arrow icon and the number 40 on the AR display component of the head-worn device 100. Similarly, the mobile terminal can update the navigation instruction every 10 meters it moves forward, until the left turn is completed. The icons and numbers mentioned above are merely illustrative and can be set according to actual needs.

[0098] Optionally, such as Figure 1 As shown, the head-worn device 100 may further include an audio output module 106 and an audio acquisition module 107, both of which are connected to the power module 104 and the processing module 103.

[0099] The audio output module 106 is used to output voice information corresponding to the prompt icon information when the AR display component 101 displays the prompt icon information.

[0100] The audio acquisition module 107 is used to acquire the user's voice information.

[0101] Taking navigation commands as an example, after receiving a navigation command sent while in motion, the head-mounted wearable device 100 can generate corresponding voice information. When the AR display component 101 displays the navigation icon information, it outputs the voice information corresponding to the navigation icon information to better remind the user of navigation. The audio acquisition module 107 is used to collect the user's voice information, which can be the user's voice commands or the user's voice during a call.

[0102] Alternatively, in one implementation, the above operation instruction can be a call request, and correspondingly:

[0103] The wireless communication module 102 can also be used to receive call requests sent by the mobile terminal, the call requests carrying the caller's phone number and a reminder message corresponding to the caller.

[0104] The AR display component 101 can also be used to display the phone number and the reminder information, which indicates the order information corresponding to the phone number and / or the call type of the phone number.

[0105] For example, when a mobile terminal receives an incoming call from a caller, the head-worn device 100, which has established a communication connection with the mobile terminal, can receive the call request from the incoming call through the wireless communication module 102, and display the caller's phone number and the corresponding reminder information to the user through the AR display component 101.

[0106] For example, if the current user is a food delivery person, the notification message can be identified based on the caller's phone number. If the caller's phone number corresponds to order information, the caller is identified as the buyer of the order, and the corresponding order information can be displayed through the AR display component 101. If no order information exists, the caller's phone number can be traversed in a pre-set number database to determine the caller's call type. This call type can include: normal calls, nuisance calls, advertising calls, etc., and can also include the phone number's location.

[0107] In one implementation, for the aforementioned incoming call, the processing module 103 can perform the following operations:

[0108] When the reminder message indicates the order information, after receiving the call request for a preset duration, the system responds to the call request to answer the corresponding call through the head-worn device 100.

[0109] If the call type indicated by the notification message is the specified type, the call request will be rejected.

[0110] The specified call type can include nuisance calls, telemarketing, etc., or it can be set by the user, such as including unknown numbers, blacklisted numbers, etc. The preset duration can be 5-10 seconds. This means that if the incoming call rings for the preset duration and the user does not actively answer, the call will be automatically answered if the notification message indicates an order; otherwise, it will be automatically rejected if the notification message indicates a nuisance call, telemarketing, or other specified type. Therefore, this method allows users to not miss important calls while cycling and to automatically hang up unnecessary calls, freeing their hands and improving cycling safety.

[0111] Optionally, the head-wearing device 100 may further include at least one button 108 connected to the processing module 103, the button including a touch button or a physical button. The at least one button is used for the user of the head-wearing device 100 to interact with the head-wearing device.

[0112] Based on the buttons on the head-worn device 100, when the above-mentioned call request is received, the call can be answered or hung up using the buttons on the head-worn device 100.

[0113] In one implementation, the aforementioned button can be used to receive or reject newly assigned orders via the head-worn device 100, including:

[0114] The wireless communication module receives order requests sent by the mobile terminal, and the order requests carry order information.

[0115] The AR display component 101 displays the order information and a prompt indicating whether the order request should be accepted.

[0116] When a first operation triggered by a button on the head-worn device 100 is received, or a first voice command is received through the audio acquisition module 107 of the head-worn device, an instruction to accept the order request is sent to the mobile terminal.

[0117] When a second operation is received triggered by a button on the head-worn device 100, or a second voice command is received through the audio acquisition module 107, a command to reject the order request is sent to the mobile terminal.

[0118] Understandably, when an application running on a mobile terminal, such as the application of a food delivery platform, receives a new order, the mobile terminal can send the order request to the head-worn device 100. The head-worn device 100 displays the order information and a prompt indicating whether to accept the order request through the AR display component 101. After seeing the order information displayed through the AR display component 101, the user can decide whether to accept the order. For example, the order information may include seller information (e.g., seller name, location, phone number), buyer information (buyer name, location, phone number), price information, shipping information, distance information, etc. Optionally, to simplify the information displayed to delivery personnel and avoid distracting them while riding, only information more relevant to the delivery personnel can be displayed on the AR display component 101, such as the location and shipping information of the seller and buyer for the order, so that the delivery personnel can determine whether to accept the order based on the distance and shipping cost.

[0119] The first and second operations triggered by the buttons on the head-wearing device 100 can be implemented using the same button or different buttons on the head-wearing device 100. For example, the head-wearing device 100 can have a first button and a second button respectively, used to accept or reject the order request. Alternatively, while displaying the order information through the AR display component 101, the head-wearing device 100 can listen for voice commands through the audio acquisition module 107. Upon hearing voice information indicating acceptance or rejection of the order, it can execute the operation of accepting or rejecting the order request. After receiving the user's operation of accepting or rejecting the order request, the head-wearing device 100 sends a corresponding instruction to the mobile terminal, which then accepts or rejects the order request.

[0120] Optionally, the head-mounted device 100 can also display traffic instructions corresponding to traffic lights and / or traffic signs. In one implementation:

[0121] The image acquisition device 105 is used to acquire road images.

[0122] The processing module 103 is used to identify the road image to determine the traffic instructions corresponding to the traffic lights and / or traffic signs in the road image, and to generate traffic icon information corresponding to the traffic instructions.

[0123] The AR display component 101 is also used to display the traffic icon information.

[0124] The aforementioned head-mounted device 100 can acquire road images through the image acquisition device 105 and send them to the processing module 103. The processing module 103 performs image recognition on the road images, identifies traffic lights or traffic signs in the road images, and obtains the traffic information indicated by the identified traffic lights or traffic signs, thereby generating corresponding traffic instructions.

[0125] For example, a traffic light can be a traffic signal light. Image recognition determines whether the current traffic signal light is red or green. If the current traffic signal light is red, a traffic instruction to prohibit passage is generated. If the current traffic signal light is green, a traffic instruction to allow passage is generated.

[0126] Traffic signs can include, for example, signs prohibiting left turns, speed limits, and prohibitions on non-motorized vehicles. If the current traffic sign indicates a speed limit of 30 km / h, a speed limit instruction of 30 km / h is generated. Upon receiving the traffic instruction, the processing module 103 generates corresponding traffic icon information. For example, when the traffic instruction is a prohibition instruction, the traffic icon information can be a red light-style icon, and optionally, the words "prohibited" can also be displayed simultaneously. Simultaneously, while displaying the red light-style icon, the audio output module 106 can output the voice message "prohibited."

[0127] Optionally, the head-mounted device 100 can further monitor whether the user complies with traffic regulations based on the aforementioned road images, its own driving trajectory, driving speed, and other information, for example:

[0128] The processing module 103 is used to determine the location information of the head-worn device in the road based on the road image, and to determine whether the traffic order is violated based on the location information;

[0129] The processing module 103 is also used to send a violation warning message to the AR display component 101 when it is determined that the traffic order has been violated;

[0130] The AR display component 101 is also used to display the violation warning information.

[0131] Alternatively, the head-mounted device 100 may also include a positioning module (not shown in the figure), which may be a GPS module or a BeiDou satellite navigation system module, then:

[0132] The positioning module is used to acquire the driving trajectory of the head-mounted device and send the driving trajectory to the processing module;

[0133] The processing module 103 is used to determine whether the traffic order has been violated based on the driving trajectory.

[0134] The processing module 103 is also used to send a violation warning message to the AR display component 101 when it is determined that the traffic order has been violated;

[0135] The AR display component 101 is also used to display the violation warning information.

[0136] In addition to displaying the violation warning information through the AR display component 101, the violation warning information can also be output through the audio output module 106 of the head-worn device.

[0137] For example, when the traffic instruction is a no-passing traffic instruction, the traffic icon information is displayed as a red light icon. At this time, if the processing module 103 of the head-wearing device 100 determines, based on the image analysis results of the road image, that the current position information of the head-wearing device 100 is in the middle of the intersection, or if the position information determined based on the continuously collected road images can indicate that the head-wearing device 100 is continuing to move forward, then it can be determined that the current user has not stopped driving; or if the driving trajectory determined by the positioning module indicates that the head-wearing device 100 is continuing to move forward, then it can be determined that the current user has not stopped driving, and thus it can be determined that the current user has run a red light. The AR display component 101 can display a warning message about running a red light, and the audio output module 106 can output a corresponding prompt voice.

[0138] Optionally, the wireless communication module 102 is further configured to send violation information to the mobile terminal when a violation of the traffic order is determined. This violation information instructs the mobile terminal to report the violation to a backend server. For example, the mobile terminal's application receives the violation information and reports the user's violation to the backend server.

[0139] Alternatively, the head-mounted device 100 can determine the driving speed based on the positioning module, and when the driving speed exceeds the preset speed, it can send an overspeed warning message to the AR display component 101, which displays the overspeed warning message, and / or output the overspeed warning message through the audio output module 106.

[0140] For example, when the traffic order is a speed limit of 30 km / h, if the current driving speed is greater than 30 km / h, the AR display component 101 will display a speeding warning, and the corresponding prompt voice can be output through the audio output module 106.

[0141] Optionally, when the head-worn device 100 determines that the driving speed exceeds a preset speed, it can generate the current user's violation driving information, which includes the speeding record, and send the violation driving information to the mobile terminal so that the violation driving information can be uploaded to the backend server.

[0142] Alternatively, in another implementation, the recognition of the aforementioned road images can be performed by a mobile terminal:

[0143] The image acquisition device 105 is used to acquire road images.

[0144] The wireless communication module 102 is used to send the road image to the mobile terminal and receive traffic instructions corresponding to the road image sent by the mobile terminal. The traffic instructions are obtained by the mobile terminal after recognizing the traffic lights or traffic signs in the road image.

[0145] The processing module 103 is also used to generate traffic icon information corresponding to the traffic instruction.

[0146] The AR display component 101 is also used to display the traffic icon information.

[0147] Optionally, while displaying the traffic icon information through the AR display component 101, the audio output module 106 can output voice information corresponding to the traffic instruction.

[0148] The aforementioned head-mounted device 100 can capture road images via the image acquisition device 105 and send them to a mobile terminal. The mobile terminal performs image recognition on the road images to identify traffic lights or traffic signs in the images and obtains the traffic information indicated by the identified traffic lights or traffic signs, thereby generating corresponding traffic instructions. Examples of traffic signs, traffic icon information, and traffic instructions can be found in the preceding text and will not be repeated here.

[0149] Optionally, the mobile terminal can further monitor whether the user complies with traffic regulations based on information such as driving trajectory and driving speed.

[0150] For example, mobile terminals typically have a positioning module that can detect driving trajectory and speed. After the mobile terminal determines that there is a violation of traffic rules based on the traffic instruction and the driving trajectory detected by the mobile terminal, the mobile terminal sends a violation warning message to the head-wearing device 100. The head-wearing device 100 receives the violation warning message sent by the mobile terminal through the wireless communication module 1102 and sends it to the AR display component 101.

[0151] AR display component 101 displays the violation warning information, and / or audio output module 106 outputs the corresponding voice information for the violation warning information.

[0152] For example, when the traffic instruction is a no-passing traffic instruction, the traffic icon information is displayed as a red light icon. If the mobile terminal detects that the current user has not stopped driving, it determines that the current user has run a red light. The AR display component 101 can display a warning message about running a red light, and the corresponding prompt voice can be output through the audio output module 106.

[0153] Optionally, when the mobile terminal determines that the current user has violated traffic regulations, it can generate information on the current user's violation and report the violation information to the backend server.

[0154] Optionally, when the mobile terminal detects that the driving speed exceeds a preset speed, the head-worn device can receive the speeding warning information sent by the mobile terminal through the wireless communication module 102.

[0155] The speeding warning information is displayed through the AR display component 101 and / or output through the audio output module 106 of the head-worn device.

[0156] For example, when the traffic instruction is a speed limit of 30 km / h, if the mobile terminal detects that the current driving speed is greater than 30 km / h, it sends a speeding warning message to the head-worn device 100, causing the head-worn device 100 to display the speeding warning, and can also output the corresponding prompt voice through the audio output module 106.

[0157] Optionally, when the mobile terminal determines that the driving speed exceeds the preset speed, it can generate the current user's violation information, which includes the speeding record, and upload the violation information to the backend server.

[0158] The above technical solution allows for the display of road-corresponding navigation icons to users via a head-worn device. This enables users to see both the navigation icons displayed by the AR display component and the real-world route seen through that component while cycling, creating a navigation map based on the actual route. This allows delivery personnel to obtain road-corresponding navigation information directly from the head-worn device without needing to consult other devices, thus improving cycling safety. Furthermore, the navigation function can be implemented on a mobile terminal, receiving processed navigation instructions from that terminal. This reduces the hardware processing requirements of the head-worn device, lowering hardware costs and improving battery life.

[0159] Figure 2 This is a flowchart illustrating a communication method for a head-wearing device according to an exemplary embodiment. The method is applied to the head-wearing device 100 described above and may include the following steps:

[0160] Step S11: Receive operation commands sent by the mobile terminal through the wireless communication module of the head-worn device.

[0161] Step S12: The processing module of the head-worn device generates corresponding prompt icon information according to the operation instruction.

[0162] Step S13: Display the prompt icon information through the AR display component of the head-worn device.

[0163] The structure of the head-mounted wearable device 100 can be seen in the following figure. Figure 1 After entering AR navigation mode, steps S11 to S13 are executed. The method of steps S11 to S13 is the same as described above. Figure 1 The methods described in the illustrated embodiments are the same and will not be repeated here.

[0164] Optionally, the method may further include:

[0165] Generate the voice information corresponding to the operation command.

[0166] When the prompt icon is displayed, the voice information is output through the audio output module of the head-worn device.

[0167] Taking navigation commands as an example, after receiving navigation commands sent while in motion, the head-mounted wearable device 100 can also generate corresponding voice information. Thus, when the AR display component 101 displays navigation icon information generated based on the navigation commands, it outputs voice information corresponding to the navigation icon information to better remind the user of navigation.

[0168] Figure 3 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment. The operation instruction may be a call request, such as... Figure 3 As shown, the method may further include:

[0169] Step S14: The wireless communication module of the head-worn device receives a call request sent by the mobile terminal. The call request carries the caller's phone number and a reminder message corresponding to the caller. The reminder message is used to indicate the order information corresponding to the phone number and / or the call type of the phone number.

[0170] Step S15: The processing module generates call notification icon information corresponding to the phone number and the reminder information.

[0171] Step S16: Display the call notification icon information through the AR display component.

[0172] Optionally, the method may further include:

[0173] Step S17: When the reminder information indicates the order information, after receiving the call request for a preset duration, respond to the call request to answer the corresponding call through the head-worn device.

[0174] Step S18: When the incoming call type indicated by the reminder message is a specified type, the call request is rejected.

[0175] The methods of steps S14 to S18 are the same as those described above. Figure 1 The methods described in the illustrated embodiments are the same and will not be repeated here.

[0176] Optionally, Figure 4 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment, such as... Figure 4 As shown, the method may further include:

[0177] Step S19: Receive an order request sent by the mobile terminal through the wireless communication module. The order request carries order information.

[0178] Step S20: Display the order information and a prompt message indicating whether to accept the order request through the AR display component.

[0179] Step S21: When a first operation triggered by a button on the head-worn device is received, or a first voice command is received through the audio acquisition module of the head-worn device, an instruction to accept the order request is sent to the mobile terminal.

[0180] Step S22: When a second operation triggered by a button on the head-worn device is received, or a second voice command is received through the audio acquisition module, a command to reject the order request is sent to the mobile terminal.

[0181] The methods of steps S19 to S22 are the same as those described above. Figure 1 The methods described in the illustrated embodiments are the same and will not be repeated here.

[0182] Figure 5 This is a flowchart illustrating a communication method for a head-worn device according to an exemplary embodiment, such as... Figure 5 As shown, the method may further include:

[0183] Step S23: Acquire road images using the image acquisition device of the head-mounted device.

[0184] Step S24: Identify the road image to determine the traffic instructions corresponding to the traffic lights and / or traffic signs in the road image.

[0185] Alternatively, in another implementation, the road image can be sent to a mobile terminal via the wireless communication module, and traffic instructions corresponding to the road image can be received from the mobile terminal. The traffic instructions are obtained by the mobile terminal after recognizing the traffic lights or traffic signs in the road image.

[0186] Step S25: The processing module generates traffic icon information corresponding to the traffic instruction.

[0187] Step S26: Display the traffic icon information through the AR display component.

[0188] The methods for steps S23 to S26 are the same as those described above. Figure 1 The methods described in the illustrated embodiments are the same and will not be repeated here.

[0189] Optionally, in one implementation, the method further includes:

[0190] Determine the location information of the head-worn device in the road based on road images;

[0191] Determine whether the traffic order has been violated based on location information;

[0192] If a traffic violation is confirmed, the system displays a violation warning message via an AR display component and / or outputs corresponding voice information.

[0193] or,

[0194] Acquire the driving trajectory of the head-worn device;

[0195] Determine whether traffic orders were violated based on the driving trajectory;

[0196] If a traffic violation is confirmed, the system displays a violation warning message via an AR display component and / or outputs corresponding voice information.

[0197] Furthermore, the method may also include:

[0198] If a traffic violation is confirmed, a violation information is sent to the mobile terminal, which instructs the mobile terminal to report the violation to the backend server.

[0199] Or, in another implementation,

[0200] After the mobile terminal determines that there is a violation of traffic rules based on the traffic instruction and the driving trajectory recorded by the mobile terminal, it receives the violation warning information sent by the mobile terminal through the wireless communication module.

[0201] The violation warning information is displayed via an AR display component, and / or the violation warning information is output via the audio output module of the head-worn device.

[0202] Optionally, the method may further include:

[0203] When the mobile terminal detects that the driving speed exceeds the preset speed, the wireless communication module receives the speeding warning information sent by the mobile terminal.

[0204] The speeding warning information is displayed via the AR display component and / or output via the audio output module of the head-worn device.

[0205] For example, when the traffic instruction is a no-passing traffic instruction, the traffic icon information is displayed as a red light icon. If the mobile terminal detects that the current user has not stopped driving, it determines that the current user has run a red light. The AR display component can be used to display a warning message about running a red light, and the corresponding prompt voice can be output through the audio output module.

[0206] For example, when the traffic order is a speed limit of 30 km / h, if the mobile terminal detects that the current driving speed is greater than 30 km / h, it sends a speeding warning message to the head-worn device, causing the head-worn device to display the speeding warning, and can also output the corresponding warning voice through the audio output module.

[0207] Optionally, when the mobile terminal determines that the driving speed exceeds the preset speed, it can generate the current user's violation information, which includes the speeding record, and upload the violation information to the backend server.

[0208] It should be noted that all actions involving the acquisition of signals, information, or data in this application are carried out in compliance with the relevant data protection laws and policies of the country where the application is located, and with the authorization granted by the owner of the relevant device.

[0209] The above technical solution generates relevant prompt icon information based on the operation instructions sent by the mobile terminal, and displays the prompt icon information through the AR display component of the head-worn device. This allows users to see the prompt icon information corresponding to the instructions sent by the mobile terminal through the AR display component while cycling, without having to look at other devices, thus improving cycling safety. Furthermore, displaying the information in the form of icons simplifies the information presented to the user, allowing them to focus on cycling. In addition, displaying information in the form of icons through the AR display component reduces the hardware processing power requirements of the head-worn device, thereby reducing hardware costs and improving the battery life of the head-worn device.

[0210] When the operation command is a navigation command, the head-worn device can display navigation icon information corresponding to the road to the user. This allows the user to see the navigation icon information displayed by the AR display component and the real-world route seen through the AR display component while riding, thus forming a navigation map information based on the real route. This allows delivery personnel to obtain navigation information corresponding to the road while riding through the head-worn device without having to look at other devices, improving riding safety. Furthermore, since the navigation function can be implemented on a mobile terminal and the processed navigation command can be obtained from the mobile terminal, the hardware processing power requirements of the head-worn device can be reduced, which can reduce hardware costs and improve the battery life of the head-worn device.

[0211] Figure 6 This is a block diagram illustrating a communication device 600 for a head-wearing device according to an exemplary embodiment, which can be applied to the head-wearing device 100 described above, such as... Figure 6 As shown, the communication device 600 may include:

[0212] The receiving module 601 is used to receive operation instructions sent by the mobile terminal;

[0213] The generation module 602 is used to generate corresponding prompt icon information according to the prompt instruction;

[0214] Display module 603 is used to display the prompt icon information through the AR display component of the head-worn device.

[0215] Optionally, the generation module 602 is further configured to generate voice information corresponding to the operation command;

[0216] The display module 603 is also used to output the voice information when displaying the prompt icon information.

[0217] Optionally, the operation instruction is a call request. The receiving module 601 is also used to receive the call request sent by the mobile terminal. The call request carries the caller's phone number and the reminder information corresponding to the caller. The reminder information is used to indicate the order information corresponding to the phone number and / or the call type of the phone number.

[0218] The generation module 602 is also used to generate call prompt icon information corresponding to the phone number and reminder information;

[0219] The display module 603 is also used to display call notification icon information through the AR display component.

[0220] Optionally, the communication device 600 may further include: a processing module, for:

[0221] When the reminder information indicates the order information, after a preset duration of receiving the call request, respond to the call request to answer the corresponding call through the head-worn device;

[0222] When the incoming call type indicated by the reminder message is a specified type, the call request is rejected.

[0223] Optionally, the communication device 600 may further include: a transmitting module;

[0224] The receiving module 601 is also configured to receive an order request sent by the mobile terminal, the order request carrying order information;

[0225] The display module 603 is also used to display the order information and a prompt message indicating whether the order request is accepted through the AR display component;

[0226] The sending module is configured to send an instruction to the mobile terminal to accept the order request when it receives a first operation triggered by a button on the head-wearing device or a first voice instruction; and to send an instruction to the mobile terminal to reject the order request when it receives a second operation triggered by a button on the head-wearing device or a second voice instruction.

[0227] Optionally, the communication device 600 may further include: a data acquisition module and an identification module;

[0228] This acquisition module is used to acquire road images;

[0229] The recognition module is used to recognize the road image to determine the traffic instructions corresponding to traffic lights and / or traffic signs in the road image;

[0230] The generation module 602 is used to generate traffic icon information corresponding to the traffic instruction;

[0231] The display module 603 is also used to display the traffic icon information through the AR display component.

[0232] Optionally, the communication device 600 may further include: a behavior determination module;

[0233] The recognition module is used to determine the location information of the head-mounted device in the road based on the road image;

[0234] The behavior determination module is used to determine whether the traffic instruction has been violated based on the location information;

[0235] The display module 603 is also used to display the violation warning information through the AR display component when it is determined that the traffic order has been violated, and / or output the corresponding voice information of the violation warning information.

[0236] Optionally, the communication device 600 may further include: a positioning module;

[0237] The positioning module is used to obtain the driving trajectory of the head-mounted device;

[0238] This behavior determination module is used to determine whether the traffic order has been violated based on the driving trajectory;

[0239] The display module 603 is also used to display the violation warning information through the AR display component and / or output the voice information corresponding to the violation warning information when it is determined that the traffic order has been violated.

[0240] Optionally, the sending module is further configured to send violation information to the mobile terminal when it is determined that the traffic order has been violated, the violation information being used to instruct the mobile terminal to report the violation information to the backend server.

[0241] Optionally, the receiving module 601 is further configured to receive an overspeed warning message sent by the mobile terminal when the mobile terminal detects that the driving speed exceeds a preset speed;

[0242] The display module 603 is also used to display the speeding warning information through the AR display component, and / or output the voice information corresponding to the speeding warning information.

[0243] The above technical solution generates relevant prompt icon information based on the operation instructions sent by the mobile terminal, and displays the prompt icon information through the AR display component of the head-worn device. This allows users to see the prompt icon information corresponding to the instructions sent by the mobile terminal through the AR display component while cycling, without having to look at other devices, thus improving cycling safety. Furthermore, displaying the information in the form of icons simplifies the information presented to the user, allowing them to focus on cycling. In addition, displaying information in the form of icons through the AR display component reduces the hardware processing power requirements of the head-worn device, thereby reducing hardware costs and improving the battery life of the head-worn device.

[0244] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0245] Figure 7 This is a block diagram illustrating an electronic device 700 according to an exemplary embodiment. Figure 7 As shown, the electronic device 700 may include a processor 701 and a memory 702. The electronic device 700 may also include one or more of a multimedia component 703, an input / output (I / O) interface 704, and a communication component 705.

[0246] The processor 701 controls the overall operation of the electronic device 700 to complete all or part of the steps in the communication method of the head-worn device described above. The memory 702 stores various types of data to support the operation of the electronic device 700. This data may include, for example, instructions for any application or method operating on the electronic device 700, and application-related data such as contact data, sent and received messages, pictures, audio, video, etc. The memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. Multimedia component 703 may include a screen and an audio component. The screen may be, for example, a touchscreen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in memory 702 or transmitted via communication component 705. The audio component also includes at least one speaker for outputting audio signals. I / O interface 704 provides an interface between processor 701 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual or physical buttons. Communication component 705 is used for wired or wireless communication between the electronic device 700 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IoT, eMTC, or other 5G technologies, or combinations thereof, is not limited here. Therefore, the corresponding communication component 705 may include: a Wi-Fi module, a Bluetooth module, an NFC module, etc.

[0247] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the communication method of the head-wearing device described above.

[0248] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, which, when executed by a processor, implement the steps of the communication method of the head-wearing device described above. For example, the computer-readable storage medium may be the memory 702 including the program instructions described above, which may be executed by the processor 701 of the electronic device 700 to complete the communication method of the head-wearing device described above.

[0249] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the communication method of the head-wearing device described above when executed by the programmable device.

[0250] The preferred embodiments of this disclosure have been described in detail above with reference to the accompanying drawings. However, this disclosure is not limited to the specific details of the above embodiments. Within the scope of the technical concept of this disclosure, various simple modifications can be made to the technical solutions of this disclosure, and these simple modifications all fall within the protection scope of this disclosure.

[0251] It should also be noted that the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, this disclosure will not describe the various possible combinations separately.

[0252] Furthermore, various different embodiments of this disclosure can be combined in any way, as long as they do not violate the spirit of this disclosure, they should also be regarded as the content disclosed in this disclosure.

Claims

1. A head-worn device, characterized in that, include: An AR display component, a wireless communication module, a processing module, and a power supply module are provided. The AR display component, the wireless communication module, and the processing module are connected to the power supply module. The AR display component, the wireless communication module, and the processing module are also connected to the processing module. The wireless communication module is used to receive operation instructions for a call request sent by a mobile terminal. The call request carries the caller's phone number and a reminder message corresponding to the caller. The reminder message is used to indicate the order information corresponding to the phone number and / or the call type of the phone number. The processing module is configured to generate call prompt icon information corresponding to the phone number or the reminder information according to the operation instruction, and send the prompt icon information to the AR display component; The AR display component is used to display the call notification icon information; The power module is used to supply power to the AR display component, the wireless communication module, and the processing module.

2. The head-wearing device according to claim 1, characterized in that, Also includes: An image acquisition device, wherein the image acquisition device is connected to the power module and the processing module; The image acquisition device is used to acquire road images; The processing module is used to identify the road image to determine the traffic instructions corresponding to traffic lights and / or traffic signs in the road image, and generate traffic icon information corresponding to the traffic instructions; The AR display component is also used to display the traffic icon information.

3. The head-wearing device according to claim 2, characterized in that, The processing module is used to determine the location information of the head-mounted device in the road based on the road image, and to determine whether the traffic order is violated based on the location information; The processing module is also used to send a violation warning message to the AR display component when it is determined that the traffic order has been violated; The AR display component is also used to display the violation driving warning information.

4. The head-wearing device according to claim 2, characterized in that, Also includes: Positioning module; The positioning module is used to acquire the driving trajectory of the head-mounted device and send the driving trajectory to the processing module; The processing module is used to determine whether the traffic order has been violated based on the driving trajectory; The processing module is also used to send a violation warning message to the AR display component when it is determined that the traffic order has been violated; The AR display component is also used to display the violation driving warning information.

5. The head-wearing device according to claim 3 or 4, characterized in that, The wireless communication module is further configured to send violation information to the mobile terminal when it is determined that the traffic order has been violated. The violation information is used to instruct the mobile terminal to report the violation information to the background server.

6. The head-wearing device according to claim 1, characterized in that, The AR display component includes a microdisplay and waveguide optical elements.

7. The head-wearable device according to claim 1, characterized in that, Also includes: An audio output module and an audio acquisition module are provided, wherein the audio output module and the audio acquisition module are connected to the power supply module and the processing module; The audio output module is used to output voice information corresponding to the prompt icon information when the AR display component displays the prompt icon information; The audio acquisition module is used to collect the user's voice information.

8. The head-wearing device according to claim 1, characterized in that, Also includes: At least one button, the at least one button being connected to the processing module, the button including: a touch button or a physical button; The at least one button is used for the user of the head-wearing device to interact with the head-wearing device.

9. The head-wearing device according to claim 1, characterized in that, The wireless communication module is a Bluetooth Low Energy module.

10. A communication method for a head-worn device, characterized in that, Applied to a head-worn device, the method includes: An operation instruction to receive a call request sent by a mobile terminal, wherein the call request carries the caller's phone number and a reminder message corresponding to the caller, wherein the reminder message is used to indicate the order information corresponding to the phone number and / or the call type of the phone number; Generate call notification icon information corresponding to the phone number and the reminder information according to the operation instructions; The call notification icon information is displayed via the AR display component of the head-worn device.

11. The method according to claim 10, characterized in that, The method further includes: Generate the voice information corresponding to the operation command; Display the call notification icon and output the voice information.

12. The method according to claim 10, characterized in that, The method further includes: When the reminder information indicates the order information, after a preset duration of receiving the call request, respond to the call request to answer the corresponding call through the head-worn device; When the incoming call type indicated by the reminder message is a specified type, the call request is rejected.

13. The method according to claim 10, characterized in that, The method further includes: Receive an order request sent by the mobile terminal, the order request carrying order information; The AR display component displays the order information, as well as a prompt indicating whether the order request is accepted. When a first operation triggered by a button on the head-worn device is received, or a first voice command is received, an instruction to accept the order request is sent to the mobile terminal. When a second operation triggered by a button on the head-worn device is received, or a second voice command is received, an instruction to reject the order request is sent to the mobile terminal.

14. The method according to claim 10, characterized in that, The method further includes: Acquire road images; The road image is identified to determine the traffic instructions corresponding to traffic lights and / or traffic signs in the road image; Generate traffic icon information corresponding to the traffic instruction; The traffic icon information is displayed through the AR display component.

15. The method according to claim 14, characterized in that, The method further includes: The location information of the head-mounted device in the road is determined based on the road image; Determine whether the traffic order has been violated based on the location information; If a violation of the traffic order is determined, the AR display component will display a violation warning message and / or output the corresponding voice message.

16. The method according to claim 14, characterized in that, The method further includes: Obtain the driving trajectory of the head-wearing device; Determine whether the traffic order has been violated based on the driving trajectory; If a violation of the traffic order is determined, a violation warning message is displayed via an AR display component, and / or a corresponding voice message is output.

17. The method according to claim 15 or 16, characterized in that, The method further includes: If a violation of the traffic order is determined, violation information is sent to the mobile terminal, which instructs the mobile terminal to report the violation to the backend server.

18. The method according to claim 10, characterized in that, The method further includes: When the mobile terminal detects that the driving speed exceeds the preset speed, it receives an overspeed warning message sent by the mobile terminal; The speeding warning information is displayed through the AR display component, and / or the corresponding voice information is output.

19. The method according to claim 10, characterized in that, The operation instructions include navigation instructions, and the step of generating corresponding prompt icon information based on the operation instructions includes: The corresponding navigation icon information is generated based on the navigation instructions.

20. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the steps of the method according to any one of claims 10-19.

21. An electronic device, characterized in that, include: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the steps of the method according to any one of claims 10-19.

Images