AR device, smart watch, control method thereof, and smart wearable device system

Abstract

The present invention discloses an AR device, a smartwatch, a control method thereof, and a smart wearable device system. The AR device control method includes the following steps: the AR device first obtains relative position parameters between itself and the smartwatch; then, based on the relative position parameters, determines the user's driving status, notifies the user if the user is driving fatigued, and controls the smartwatch to execute a reminder program. This invention aims to improve driving safety by providing reminders to drivers experiencing driving fatigue through the cooperation of smart wearable devices.

Description

Technical Field

[0001] The present invention relates to the technical field of smart wearable devices, and in particular to an AR device, a smart watch and a control method thereof, and a smart wearable device system. Background Art

[0002] When driving a car, especially during long-distance driving, the driver is prone to fatigue due to long-term driving. At this time, he will not be able to concentrate on operating the vehicle, which can easily lead to traffic accidents. Summary of the Invention

[0003] The main purpose of this invention is to provide a control method for an AR device, which aims to remind drivers who are in a fatigue driving state through the cooperation of smart wearable devices, thereby improving the user's driving safety.

[0004] To achieve the above object, the present invention proposes a control method for an AR device, comprising the following steps:

[0005] S100, the AR device obtains relative position parameters between itself and the smart watch;

[0006] S200, determining the user's driving state based on the relative position parameter, and reminding the user when it is determined that the user is in a fatigue driving state, and controlling the smart watch to execute a reminder program;

[0007] The AR device includes a first communication module, the relative position parameters include a relative distance and a relative angle, and step S100 is specifically as follows:

[0008] S110: The AR device controls itself to establish a communication connection with the smart watch via the first communication module;

[0009] S120: Control the smart watch to broadcast a first communication signal, and determine a relative distance and a relative angle between the smart watch and the smart watch according to signal parameters of the received first communication signal.

[0010] Optionally, the first communication module is a UWB module, and step S120 is specifically as follows:

[0011] The UWB module controls the smart watch to broadcast the first communication signal externally, and controls the UWB module to calculate the relative distance and the relative angle between itself and the smart watch according to the phase difference of the received first communication signal.

[0012] Optionally, the relative position parameters include the relative distance and the relative angle, and step S200 is specifically as follows:

[0013] S210: When the relative distance is within a preset distance interval and / or the relative angle is within a preset angle interval, determining that the user is awake;

[0014] S220: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle-distance interval, determining that the user is in a fatigue driving state, prompting the user, and controlling the smartwatch to execute a reminder program;

[0015] The step S220 is specifically as follows:

[0016] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

[0017] Optionally, step S200 further includes:

[0018] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

[0019] The present invention also provides an AR device, comprising:

[0020] Memory;

[0021] A processor, and a control program for an AR device stored in the memory and executed by the processor, wherein the control program for the AR device, when executed by the processor, implements any of the above-described methods for controlling the AR device.

[0022] The present invention also proposes a control method for a smart watch, comprising the following steps:

[0023] S1000, the smartwatch obtains the relative position parameters between itself and the AR device;

[0024] S2000, determining the driving state of the user based on the relative position parameter, and reminding the user when it is determined that the user is in a fatigue driving state, and controlling the AR device to execute a reminder program;

[0025] The smartwatch includes a second communication module, the relative position parameters include the relative distance and the relative angle, and step S1000 is specifically as follows:

[0026] S1100: The smartwatch controls itself to establish a communication connection with the AR device via the second communication module;

[0027] S1200: Control the AR device to broadcast a first communication signal, and determine the relative distance and the relative angle between the AR device and the AR device based on signal parameters of the received first communication signal.

[0028] Optionally, the second communication module is a UWB module, and step S1200 is specifically:

[0029] The UWB module controls the AR device to broadcast the first communication signal externally, and controls the UWB module to calculate the relative distance and the relative angle between itself and the AR device according to the phase difference of the received first communication signal.

[0030] Optionally, the relative position parameters include the relative distance and the relative angle, and step S2000 is specifically as follows:

[0031] S2100: When the relative distance is within a preset distance interval and / or the relative angle is within a preset angle interval, determining that the user is awake;

[0032] S2200: When the relative distance is less than a minimum value of a preset distance interval / greater than a maximum value of a preset distance interval, and the relative angle is less than a minimum value of a preset angle interval / greater than a maximum value of an angle-distance interval, determining that the user is in a fatigue driving state, prompting the user, and controlling the AR device to execute a reminder program;

[0033] The step S2200 is specifically as follows:

[0034] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute a reminder program.

[0035] Optionally, step S2000 further includes:

[0036] When the relative distance is not within the preset distance interval and the relative angle is not within the preset angle interval for a preset number of times within a second preset time period, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute a reminder program.

[0037] The present invention also proposes a smart watch, comprising:

[0038] Memory;

[0039] A processor, a control program for a smart watch stored in the memory and executed by the processor, wherein the control program for the smart watch implements any of the above-mentioned control methods for the smart watch when executed by the processor.

[0040] The present invention also proposes a smart wearable device system, including a smart watch and the AR device as described above; or,

[0041] AR device and smart watch as described above.

[0042] In the solution of the present invention, the AR device first obtains the relative position parameters between itself and the smartwatch. Based on these relative position parameters, it then determines the user's driving status, notifies the user when it determines that the user is driving fatigued, and controls the smartwatch to execute a reminder program. Thus, in practical applications, the cooperation of the two smart wearable devices can detect the user's driving status and, when it determines that the user is driving fatigued, promptly initiate a reminder action to wake the user, thereby improving driving safety. Furthermore, compared to existing technologies that implement fatigue driving monitoring and reminder functions using a single smart wearable device, the technology of the present invention that determines the user's driving status based on the relative position information between the AR device and the smartwatch is not only simpler in terms of algorithmic complexity and easier to implement. Furthermore, because the AR device is located on the user's head and the user's smartwatch is generally in close contact with the steering wheel during driving, the relative position information between the AR device and the smartwatch is equivalent to the relative position information between the user's head and the steering wheel during actual driving. Therefore, the technology of the present invention is more consistent with the user's actual driving situation and can more accurately determine the user's current driving status. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0044] Figure 1 A schematic diagram of a method flow of an embodiment of a method for controlling an AR device according to the present invention;

[0045] Figure 2 A schematic diagram of a method flow chart of another embodiment of a method for controlling an AR device according to the present invention;

[0046] Figure 3 This is a flowchart of another embodiment of a method for controlling an AR device according to the present invention;

[0047] Figure 4 This is a schematic diagram of a circuit module of an embodiment of an AR device of the present invention;

[0048] Figure 5 A schematic diagram of a method flow chart of an embodiment of a method for controlling a smartwatch according to the present invention;

[0049] Figure 6 A schematic diagram of a method flow chart of another embodiment of a method for controlling a smart watch according to the present invention;

[0050] Figure 7 A method flow chart of another embodiment of a method for controlling a smart watch according to the present invention;

[0051] Figure 8 This is a schematic diagram of a circuit module of an embodiment of a smart watch of the present invention;

[0052] Figure 9 This is a schematic diagram of the cooperation between a smart watch and an AR device in one embodiment of the smart wearable device system of the present invention.

[0053] Description of Figure Numbers:

[0054] Label name Label name 10 Memory 20 processor 30 First communication module 40 Second communication module

[0055] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0056] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0057] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0058] When driving a car, especially during long-distance driving, the driver is prone to fatigue due to long-term driving. At this time, he will not be able to concentrate on operating the vehicle, which can easily lead to traffic accidents.

[0059] To this end, the present invention proposes a control method for an AR device.

[0060] It is understandable that the AR device is provided with a main control module, a communication module and a prompt module. Among them, the main control module is integrated with a memory for storing the following method and a processor for executing the following method. Among them, the main control module can be implemented by a main controller, such as MCU, DSP (Digital Signal Process, digital signal processing chip), FPGA (Field Programmable Gate Array, programmable logic gate array chip), etc.; the prompt module can be a voice reminder module, a display reminder module, etc. The communication module can be implemented by a wireless communication module, such as a Bluetooth module, a 4G / 5G module, a WIFI module, a local area network module, a UWB communication module, etc., and the communication module is used to establish a communication connection with a smart watch.

[0061] refer to Figure 1 In one embodiment of the present invention, a method for controlling an AR device includes the following steps:

[0062] S100, the AR device obtains relative position parameters between itself and the smart watch;

[0063] Optionally, in one embodiment, the AR device may be provided with a positioning module and a communication module electrically connected to the main control module. At the same time, the smartwatch module may be provided with a corresponding communication module and positioning module. The main control module in the AR device may establish a wireless communication connection with the smartwatch via the communication module, and obtain the smartwatch location information generated by the positioning module in the smartwatch. Then, based on the AR device location information generated by its own positioning module, the relative position information between the AR device and the smartwatch may be determined.

[0064] Optionally, in another embodiment, the AR device may not be provided with a positioning module, but only with a communication module. The main control module can determine the phase position information between the AR device itself and the smart watch based on the signal parameters of the communication signal transmitted by the communication module and the smart watch in the current wireless communication network.

[0065] Optionally, in this embodiment, the relative position parameter includes at least one of a relative distance and a phase angle.

[0066] S200: Determine the user's driving status based on the relative position parameters, and remind the user when it is determined that the user is in a fatigue driving state, and control the smart watch to execute a reminder program.

[0067] Optionally, in this embodiment, the relative position parameter includes the relative distance and the relative angle, wherein the relative distance is the straight-line distance between the AR device and the smartwatch, and the relative angle can be the angle of the line between the AR device and the smartwatch relative to the horizontal plane or the vertical plane.

[0068] Specifically, refer to Figure 9 ,by Figure 9 Take this as an example to illustrate: Figure 9 The distance D is the straight-line distance between the AR device and the smartwatch, and the angle α is the angle between the line connecting the AR device and the smartwatch relative to the vertical plane. It's important to note that since AR devices are typically head-mounted devices, and the user's hands are normally on the steering wheel when driving, the current distance D and angle α are actually the relative distance and angle between the user's head and the steering wheel.

[0069] It should be understood that in actual applications, if the user is in a fatigue driving state, he or she will generally lower his or her head and lean forward, or lean left or right, or lean back and fall asleep. Figure 3 , step S200 is specifically as follows:

[0070] S210: When the relative distance is within a preset distance range and / or the relative angle is within a preset angle range, determining that the user is awake;

[0071] S220. When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval, it is determined that the user is in a fatigue driving state and a prompt is given to the user, and the smart watch is controlled to execute a reminder program.

[0072] It should be understood that the preset distance interval and the preset angle interval can be generated by combining the range parameters set by the R&D personnel during the R&D period and the actual user's measurement values. For example, the range parameters currently set by the R&D personnel are plus or minus 10cm and plus or minus 20°. When the user first turns on the driving anti-fatigue function of the AR device, the measured values are 20cm and 45°. Then the preset distance interval is 10cm to 30cm, and the preset angle interval is 25° to 65°. Alternatively, when the user first uses the driving anti-fatigue function of the AR device, he or she can calibrate the position where he or she is in a sleeping state, so that the main control module can generate the above-mentioned preset distance interval and preset angle interval.

[0073] In this embodiment, after the main control module in the AR device obtains the relative distance and relative angle between the AR device itself and the smartwatch according to the content of the above embodiment, if the current relative distance is within the preset distance range and the relative angle is within the preset angle range, it is determined that the user is in a normal awake and active state;

[0074] If the current relative distance is within the preset distance range or the relative angle is within the preset angle range, the main control module will assume that the user is currently performing normal driving actions, such as moving the head to observe the conditions of the left and right rearview mirrors, or observing the external vehicle conditions.

[0075] If the current relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval, the main control module will determine that the current user is in a fatigue driving state, and will control the prompt module in the AR device to start working, such as controlling the audio module in the AR device to emit a prompt sound. At the same time, the main control module will also control the smart watch to perform a prompt action through the communication module, such as controlling the smart watch to start vibrating to wake up the user and restore the user to normal state. In this way, in actual application, through the cooperation of the two smart wearable devices, it is possible to detect the user's driving status and, when it is determined that the user is in a fatigue driving state, promptly perform a reminder action to wake the user, thereby improving the user's driving safety.

[0076] It is understandable that when the user wakes up or regains consciousness and returns to a normal driving state, that is, when the current relative distance is within the preset distance range and / or the relative angle is within the preset angle range, the main control module of the AR device will stop the prompt component from working and stop the reminder action of the smart watch.

[0077] In addition, it is understandable that the AR device may also be provided with a trigger module. When the user needs to activate the above-mentioned anti-fatigue driving function, the trigger module may be triggered to cause the AR device to execute the above-mentioned control method of the AR device. For example, if the current trigger module is a voice command control module, then when the user needs to activate the anti-fatigue driving function of the AR device, the user may speak a corresponding voice command, such as "activate the anti-fatigue driving function" to cause the AR device to start executing the above-mentioned control method. When the above-mentioned function is not needed, the user may speak "deactivate the anti-fatigue driving function" to cause the AR device to stop executing the above-mentioned method, so as not to affect the normal use of the user in other states, thereby improving the convenience of the user in using the smart wearable device.

[0078] In the solution of the present invention, the AR device first obtains the relative position parameters between itself and the smartwatch. Based on these relative position parameters, it then determines the user's driving status, notifies the user when it determines that the user is driving fatigued, and controls the smartwatch to execute a reminder program. Thus, in practical applications, the cooperation of the two smart wearable devices can detect the user's driving status and, when it determines that the user is driving fatigued, promptly initiate a reminder action to wake the user, thereby improving driving safety. Furthermore, compared to existing technologies that implement fatigue driving monitoring and reminder functions using a single smart wearable device, the technology of the present invention that determines the user's driving status based on the relative position information between the AR device and the smartwatch is not only simpler in terms of algorithmic complexity and easier to implement. Furthermore, because the AR device is located on the user's head and the user's smartwatch is generally in close contact with the steering wheel during driving, the relative position information between the AR device and the smartwatch is equivalent to the relative position information between the user's head and the steering wheel during actual driving. Therefore, the technology of the present invention is more consistent with the user's actual driving situation and can more accurately determine the user's current driving status.

[0079] It should be understood that sometimes users may make some of the above-mentioned actions while driving that may be judged as fatigue driving, such as leaning back to relax the neck muscles, or temporarily getting close to the dashboard to observe the data on the dashboard, which may cause the AR device to misjudge.

[0080] To this end, in one embodiment of the present invention, step S220 is specifically as follows:

[0081] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

[0082] In this embodiment, the first preset duration can be preset in advance by R&D personnel during the actual R&D process and stored in the main control module of the AR device. Specifically, when the main control module just confirms that the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval, the subsequent reminder action will not be executed immediately. Instead, when the relative distance and relative angle maintain this state for a duration reaching the first preset duration, for example, 5 seconds, it is determined that the user is indeed in a fatigue driving state, and the above-mentioned reminder action will be executed again. If the above-mentioned duration is very short, and the user is determined to be awake based on the relative distance and relative angle, the reminder action will not be executed. In this way, in actual application, the above-mentioned setting improves the accuracy of the AR device in judging whether the user is in a fatigue driving state, thereby further improving the convenience and experience of the user in using the smart wearable device.

[0083] It should be understood that during actual vehicle maneuvers, the user (the driver) may experience periods of frequent dozing before falling completely asleep. For example, the user may suddenly close their eyes and fall asleep for a short time before waking up suddenly, and this may happen repeatedly. In this case, since the duration of the user's dozing is very short, as can be seen from the above content, the main control module may mistakenly judge the user's current state as being awake.

[0084] To this end, in one embodiment of the present invention, step S200 further includes:

[0085] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time period, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

[0086] In this embodiment, as can be seen from the above content, the user will doze off continuously before being completely in a fatigued driving state. Therefore, if the main control module confirms that the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time period, it can be confirmed that the current user is in a continuous dozing state, and then it will be directly determined that the user is in a fatigued driving state, and the subsequent reminder action will be directly executed. In this way, in actual application, it is not only to prevent the occurrence of the above-mentioned misjudgment situation, but also to judge in advance that the user may fall asleep before the user completely falls asleep, and to remind the user in time, thereby further improving the user's driving safety.

[0087] refer to Figure 2 In one embodiment of the present invention, the AR device includes a first communication module, and the relative position parameters include a relative distance and a relative angle. Step S100 is specifically as follows:

[0088] S110: The AR device controls itself to establish a communication connection with the smart watch via the first communication module;

[0089] S120: Control the smart watch to broadcast a first communication signal externally, and determine a relative distance and a relative angle between the smart watch and the smart watch according to signal parameters of the received first communication signal.

[0090] Optionally, the first communication module is a UWB module, and step S120 is specifically as follows:

[0091] The UWB module controls the smart watch to broadcast the first communication signal externally, and controls the UWB module to calculate the relative distance and relative angle between itself and the smart watch according to the phase difference of the received first communication signal.

[0092] It is understandable that the UWB module has strong anti-interference capabilities and has high-precision distance and angle positioning capabilities. Specifically, the UWB module in the smart watch can be defined as a UWB tag, and the UWB module in the AR device can be defined as a UWB base station. The UWB module in the AR device includes a UWB communication chip and two antennas. The distance between the two antennas is a known value d, where the distance between the two antennas is less than half the wavelength of the first communication signal. After the UWB base station (UWB module in the AR device) establishes a communication connection with the UWB tag (UWB module in the smart watch), the UWB tag will broadcast the first communication signal to the outside. Since there are two antennas in the UWB base station, each antenna will receive the first communication signal sent by the external terminal once. The UWB base station (UWB module in the AR device) can then calculate the relative distance and relative direction between the above-mentioned UWB base station and the UWB tag based on the phase difference of the first communication signals received by the two antennas, that is, the phase difference of the first communication signal output by the UWB tag reaching the two antennas of the two UWB base stations, and then combine it with the PDOA positioning algorithm using the phase difference. Optionally, the UWB module in the smart wearable device can also directly provide the distance between the above-mentioned antennas and the phase difference data of the first communication signal reaching the two antennas to the main control terminal, and the main control terminal calculates the relative distance and relative direction between the above-mentioned AR device and the smart watch according to the above-mentioned PDOA positioning algorithm. In this way, the relative position parameters between the AR device and the smart watch can be determined through UWB module communication, which can ensure the accuracy of the relative position parameters and thereby improve the accuracy of the AR device in judging whether the current user is in a fatigue state.

[0093] refer to Figure 4The present invention further proposes an AR device, comprising:

[0094] Memory 10;

[0095] The processor 20 stores a control program for the AR device on the memory 10 and executes the control program for the AR device. When the control program for the AR device is executed by the processor 20 , the control program for the AR device implements the aforementioned control method for the AR device.

[0096] In this embodiment, the AR device further includes a first communication module 30 , which is a UWB module.

[0097] It is worth noting that, because the AR device of the present invention includes all embodiments of the control method of the above-mentioned AR device, the AR device of the present invention has all the beneficial effects of the control method of the above-mentioned AR device, which will not be repeated here.

[0098] The present invention also proposes a smart wearable device system, including a smart watch and the above Figure 4 The AR device shown.

[0099] It is worth noting that, because the smart wearable device system of the present invention includes all embodiments of the above-mentioned AR device, the smart wearable device system of the present invention has all the beneficial effects of the above-mentioned AR device, which will not be repeated here.

[0100] The present invention also proposes a control method for a smart watch. It is understandable that a main control module, a communication module and a prompt module are provided in the smart watch. Among them, the main control module is integrated with a memory for storing the following method and a processor for executing the following method. Among them, the main control module can be implemented by a main controller, such as MCU, DSP (Digital Signal Process, digital signal processing chip), FPGA (Field Programmable Gate Array, programmable logic gate array chip), etc.; the prompt module can be a voice reminder module, a display reminder module, a vibration module, etc. The communication module can be implemented by a wireless communication module, such as a Bluetooth module, a 4G / 5G module, a WIFI module, a local area network module, a UWB communication module, etc., and the communication module is used to establish a communication connection with the AR device.

[0101] refer to Figure 5 In one embodiment of the present invention, a method for controlling a smart watch includes the following steps:

[0102] S1000, the smartwatch obtains the relative position parameters between itself and the AR device;

[0103] Optionally, in one embodiment, the smartwatch may be provided with a positioning module and a communication module electrically connected to the main control module. At the same time, the AR device module may be provided with a corresponding communication module and positioning module. The main control module in the smartwatch may establish a wireless communication connection with the AR device via the communication module, and obtain the AR device location information generated by the positioning module in the AR device. Then, based on the smartwatch location information generated by its own positioning module, the main control module in the smartwatch may determine the relative location information between the smartwatch and the AR device.

[0104] Optionally, in another embodiment, the smart watch may not be provided with a positioning module, but only with a communication module. The main control module can determine the phase position information between the smart watch itself and the AR device based on the signal parameters of the communication signal transmitted by the communication module and the AR device in the current wireless communication network.

[0105] Optionally, in this embodiment, the relative position parameter includes at least one of a relative distance and a phase angle.

[0106] S2000: Determine the user's driving status based on the relative position parameters, and remind the user when it is determined that the user is in a fatigue driving state, and control the AR device to execute a reminder program.

[0107] Optionally, in this embodiment, the relative position parameter includes a relative distance and a relative angle, wherein the relative distance is the straight-line distance between the smartwatch and the AR device, and the relative angle can be the angle of the line between the smartwatch and the AR device relative to the horizontal plane or the vertical plane.

[0108] Specifically, refer to Figure 9 ,by Figure 9 Take this as an example to illustrate: Figure 9 The distance D is the straight-line distance between the smartwatch and the AR device, and the angle α is the angle between the line connecting the smartwatch and the AR device relative to the vertical plane. It's important to note that since smartwatches are essentially head-mounted devices, and the user's hands are normally on the steering wheel when driving, the current distance D and angle α are actually the relative distance and angle between the user's head and the steering wheel.

[0109] It should be understood that in actual applications, if the user is in a fatigue driving state, he or she will generally lower his or her head and lean forward, or sway left and right, or lean back. Figure 7 , step 2000 is specifically as follows:

[0110] S2100: When the relative distance is within a preset distance range and / or the relative angle is within a preset angle range, determining that the user is awake;

[0111] S2200: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute the reminder program.

[0112] It should be understood that the preset distance interval and the preset angle interval can be generated by combining the range parameters set by the R&D personnel during the R&D period and the actual user's measurement values. For example, if the range parameters currently set by the R&D personnel are plus or minus 10 cm and plus or minus 20 degrees, and the user first turns on the anti-fatigue driving function of the smartwatch and the measured values are 20 cm and 45 degrees, then the preset distance interval is 10 cm to 30 cm, and the preset angle interval is 25 degrees to 65 degrees. Alternatively, the user can completely calibrate the position where they are sleeping when using the anti-fatigue driving function of the smartwatch for the first time, so that the main control module can generate the above-mentioned preset distance interval and preset angle interval.

[0113] In this embodiment, after the main control module in the smartwatch obtains the relative distance and relative angle between the smartwatch itself and the AR device according to the content of the above embodiment, if the current relative distance is within the preset distance range and the relative angle is within the preset angle range, it is determined that the user is in a normal awake and active state;

[0114] If the current relative distance is within the preset distance range or the relative angle is within the preset angle range, the main control module will assume that the user is currently performing normal driving actions, such as moving the head to observe the conditions of the left and right rearview mirrors, or observing the external vehicle conditions.

[0115] If the current relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval, the main control module will determine that the current user is in a fatigue driving state, and will control the reminder module in the smart watch to start working, such as controlling the vibration module in the smart watch to start vibrating. At the same time, the main control module will also control the AR device through the communication module to perform a reminder action, such as controlling the AR device to start emitting a reminder sound to wake the user and restore the user to normal state. In this way, in actual application, through the cooperation of the two smart wearable devices, it is possible to detect the user's driving status and, when it is determined that the user is in a fatigue driving state, promptly perform a reminder action to wake the user, thereby improving the user's driving safety.

[0116] It is understandable that when the user wakes up or regains consciousness and returns to normal driving state, that is, when the current relative distance is within the preset distance range and / or the relative angle is within the preset angle range, the main control module of the smart watch will stop the prompt component from working and stop the reminder action of the AR device.

[0117] Furthermore, it is understood that the smartwatch may also be provided with a trigger module. When the user needs to activate the aforementioned anti-fatigue driving function, the trigger module can be triggered to cause the smartwatch to execute the aforementioned control method. For example, if the current trigger module is a voice command control module, then when the user needs to activate the anti-fatigue driving function of the smartwatch, the user can speak a corresponding voice command, such as "activate anti-fatigue driving function," to cause the smartwatch to begin executing the aforementioned control method. When the aforementioned function is no longer required, the user can speak "deactivate anti-fatigue driving function," to cause the smartwatch to cease executing the aforementioned control method. This does not affect the user's normal use in other states, thereby improving the user's convenience in using the smart wearable device.

[0118] In the solution of the present invention, the smartwatch first obtains the relative position parameters between itself and the AR device; then, based on the relative position parameters, it determines the user's driving status, notifies the user when it determines that the user is driving fatigued, and controls the AR device to execute a reminder program. Thus, in practical applications, the cooperation of the two smart wearable devices can detect the user's driving status and, when it determines that the user is driving fatigued, promptly issue a reminder to wake the user, thereby improving driving safety. Furthermore, compared to existing technologies that implement fatigue driving monitoring and reminder functions using a single smart wearable device, the technology of the present invention that determines the user's driving status based on the relative position information between the smartwatch and the AR device is not only simple in terms of program algorithm but also easy to implement. Furthermore, because the smartwatch is located on the user's head and the user's AR device is generally in close contact with the steering wheel during driving, the relative position information between the smartwatch and the AR device is equivalent to the relative position information between the user's head and the steering wheel during actual driving. Therefore, the technology of the present invention is more consistent with the user's actual driving situation and can more accurately determine the user's current driving status.

[0119] It should be understood that sometimes users may make some of the above-mentioned actions while driving that may be judged as fatigue driving, such as leaning back to relax the neck muscles, or temporarily getting close to the dashboard to observe the data on the dashboard, which may cause the smart watch to misjudge.

[0120] To this end, in one embodiment of the present invention, step S2200 is specifically as follows:

[0121] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute the reminder program.

[0122] In this embodiment, the first preset duration can be preset by developers during the actual development process and stored in the smartwatch's main control module. Specifically, when the smartwatch's main control module confirms that the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle-distance interval, the subsequent reminder action is not immediately executed. Instead, when the relative distance and relative angle remain in this state for a duration exceeding the first preset duration (e.g., 5 seconds), it is determined that the user is indeed in a fatigued driving state, and the aforementioned reminder action is executed. If this duration is very short, and the user is determined to be awake based on the relative distance and relative angle, the reminder action is not executed. Thus, in actual application, this setting improves the accuracy of the smartwatch's judgment of whether the user is in a fatigued driving state, thereby further enhancing the user's convenience and experience in using the smart wearable device.

[0123] It should be understood that during actual vehicle maneuvers, the user (the driver) may experience periods of frequent dozing before falling completely asleep. For example, the user may suddenly close their eyes and fall asleep for a short time before waking up suddenly, and this may happen repeatedly. In this case, since the duration of the user's dozing is very short, as can be seen from the above content, the main control module may mistakenly judge the user's current state as being awake.

[0124] To this end, in one embodiment of the present invention, step S2000 further includes:

[0125] When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time period, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute the reminder program.

[0126] In this embodiment, as can be seen from the above content, the user will doze off continuously before being completely in a fatigued driving state. Therefore, if the main control module confirms that the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time period, it can be confirmed that the current user is in a continuous dozing state, and then it will be directly determined that the user is in a fatigued driving state, and the subsequent reminder action will be directly executed. In this way, in actual application, it is not only to prevent the occurrence of the above-mentioned misjudgment situation, but also to judge in advance that the user may fall asleep before the user completely falls asleep, and to remind the user in time, thereby further improving the user's driving safety.

[0127] refer to Figure 6 In one embodiment of the present invention, the smartwatch includes a second communication module, and the relative position parameters include a relative distance and a relative angle. Step S1000 is specifically as follows:

[0128] S1100: The smartwatch controls itself to establish a communication connection with the AR device via the second communication module;

[0129] S1200: Control the AR device to broadcast a first communication signal externally, and determine a relative distance and relative angle between the AR device and the AR device based on signal parameters of the received first communication signal.

[0130] Optionally, the second communication module is a UWB module, and step S1200 is specifically as follows:

[0131] The UWB module controls the AR device to broadcast the first communication signal externally, and controls the UWB module to calculate the relative distance and relative angle between itself and the AR device according to the phase difference of the received first communication signal.

[0132] It is understandable that the UWB module has a strong anti-interference ability and has a high-precision distance and angle positioning capability. Specifically, the UWB module in the AR device can be defined as a UWB tag, and the UWB module in the smart watch can be defined as a UWB base station. The UWB module in the smart watch includes a UWB communication chip and two antennas. The distance between the two antennas is a known value d, wherein the distance between the two antennas is less than half the wavelength of the first communication signal. After the UWB base station (UWB module in the smart watch) establishes a communication connection with the UWB tag (UWB module of the AR device), the UWB tag will broadcast the first communication signal to the outside. Since there are two antennas in the UWB base station, each antenna will receive the first communication signal sent by the external terminal once. The UWB base station (UWB module in the smart watch) can calculate the relative distance and relative direction between the above-mentioned UWB base station and the UWB tag based on the phase difference of the first communication signal received by the two antennas, that is, the phase difference of the first communication signal output by the UWB tag reaching the two antennas of the two UWB base stations, and then combine it with the PDOA positioning algorithm to use the phase difference to calculate the relative distance and relative direction between the above-mentioned UWB base station and the UWB tag. Optionally, the UWB module in the smart wearable device can also directly provide the distance between the above antennas and the phase difference data of the first communication signal reaching the two antennas to the main control terminal, and the main control terminal calculates the relative distance and relative direction between the above smart watch and AR device based on the above PDOA positioning algorithm. In this way, the relative position parameters between the smart watch and the AR device are determined through UWB module communication, which can ensure the accuracy of the relative position parameters and thus improve the accuracy of the smart watch in determining whether the current user is in a state of fatigue.

[0133] refer to Figure 8 The present invention also proposes a smart watch, comprising:

[0134] Memory 10;

[0135] The processor 20 stores a control program of the smart watch on the memory 10 and is executed by the processor 20. When the control program of the smart watch is executed by the processor, the control program of the smart watch implements the above-mentioned control method of the smart watch.

[0136] In this embodiment, the smart watch further includes a second communication module 40 , which is a UWB module.

[0137] It is worth noting that, because the smart watch of the present invention includes all embodiments of the control method of the smart watch described above, the smart watch of the present invention has all the beneficial effects of the control method of the smart watch described above, which will not be repeated here.

[0138] The present invention also proposes a smart wearable device system, including an AR device and the above Figure 8 Smartwatch shown.

[0139] It is worth noting that, because the smart wearable device system of the present invention includes all embodiments of the above-mentioned smart watch, the smart wearable device system of the present invention has all the beneficial effects of the above-mentioned smart watch, which will not be repeated here.

[0140] The present invention also proposes a smart wearable device assembly, including the AR device described above and the smart watch described above.

[0141] It is worth noting that, because the smart wearable device assembly of the present invention includes all embodiments of the above-mentioned smart watch and AR device, the smart wearable device assembly of the present invention has all the beneficial effects of the above-mentioned smart watch and AR device, which will not be repeated here.

[0142] The above descriptions are merely optional embodiments of the present invention and do not limit the patent scope of the present invention. All equivalent structural transformations made using the contents of the present description and drawings under the inventive concept of the present invention, or direct / indirect applications in other related technical fields, are included in the patent protection scope of the present invention.

Claims

1. A control method for an AR device, characterized in that: The following steps are involved: S100, the AR device obtains relative position parameters between itself and the smart watch; S200, determining the user's driving state based on the relative position parameter, and reminding the user when it is determined that the user is in a fatigue driving state, and controlling the smart watch to execute a reminder program; The AR device includes a first communication module, the relative position parameters include a relative distance and a relative angle, and step S100 is specifically as follows: S110: The AR device controls itself to establish a communication connection with the smart watch via the first communication module; S120: Control the smartwatch to broadcast a first communication signal, and determine the relative distance and angle between the smartwatch and the smartwatch based on signal parameters of the received first communication signal; if the first communication module is a UWB module, step S120 is specifically as follows: controlling the smartwatch to broadcast the first communication signal externally via the UWB module, and controlling the UWB module to calculate the relative distance and the relative angle between the smartwatch and the UWB module based on the phase difference of the received first communication signal, and using the relative distance and the relative angle as the relative angle and the relative distance between the user's head and the steering wheel; Among them, the UWB module includes a UWB communication chip and two antennas, and controlling the UWB module to calculate the relative distance and the relative angle between itself and the smart watch based on the phase difference of the first communication signal received includes: calculating the relative distance and the relative angle between itself and the smart watch based on the phase difference of the first communication signal received by the UWB communication chip via the two antennas, the preset antenna spacing and the PDOA positioning algorithm.

2. The control method of the AR device according to claim 1, wherein: The relative position parameters include the relative distance and the relative angle. Step S200 is specifically as follows: S210: When the relative distance is within a preset distance interval and / or the relative angle is within a preset angle interval, determining that the user is awake; S220: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle-distance interval, determining that the user is in a fatigue driving state, prompting the user, and controlling the smartwatch to execute a reminder program; The step S220 is specifically as follows: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

3. The control method of the AR device according to claim 2, wherein: The step S200 further includes: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the number of times the relative angle is less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a preset number within a second preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the smart watch is controlled to execute the reminder program.

4. An AR device, characterized in that: include: Memory; A processor, and a control program for an AR device stored in the memory and executed by the processor, wherein the control program for the AR device, when executed by the processor, implements the control method for the AR device according to any one of claims 1 to 3.

5. A method for controlling a smart watch, characterized in that: The following steps are involved: S1000, the smartwatch obtains the relative position parameters between itself and the AR device; S2000, determining the driving state of the user based on the relative position parameter, and reminding the user when it is determined that the user is in a fatigue driving state, and controlling the AR device to execute a reminder program; The smartwatch includes a second communication module, the relative position parameters include a relative distance and a relative angle, and step S1000 is specifically as follows: S1100: The smartwatch controls itself to establish a communication connection with the AR device via the second communication module; S1200: Control the AR device to broadcast a first communication signal, and determine the relative distance and relative angle between the AR device and the AR device based on signal parameters of the received first communication signal. The second communication module is a UWB module, and the step S1200 is specifically as follows: controlling the AR device to broadcast the first communication signal externally via the UWB module, and controlling the UWB module to calculate the relative distance and the relative angle between the UWB module and the AR device based on the phase difference of the received first communication signal, and using the relative distance and the relative angle as the relative angle and relative distance between the user's head and the steering wheel; Among them, the UWB module includes a UWB communication chip and two antennas, and controlling the UWB module to calculate the relative distance and the relative angle between itself and the smart watch based on the phase difference of the first communication signal received includes: calculating the relative distance and the relative angle between itself and the smart watch based on the phase difference of the first communication signal received by the UWB communication chip via the two antennas, the preset antenna spacing and the PDOA positioning algorithm.

6. The control method of the smart watch according to claim 5, characterized in that: The relative position parameters include the relative distance and the relative angle. Step S2000 is specifically as follows: S2100: When the relative distance is within a preset distance interval and / or the relative angle is within a preset angle interval, determining that the user is awake; S2200: When the relative distance is less than a minimum value of a preset distance interval / greater than a maximum value of a preset distance interval, and the relative angle is less than a minimum value of a preset angle interval / greater than a maximum value of an angle-distance interval, determining that the user is in a fatigue driving state, prompting the user, and controlling the AR device to execute a reminder program; The step S2200 is specifically as follows: When the relative distance is less than the minimum value of the preset distance interval / greater than the maximum value of the preset distance interval, and the duration of the relative angle being less than the minimum value of the preset angle interval / greater than the maximum value of the angle distance interval reaches a first preset time length, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute a reminder program.

7. The control method of the smart watch according to claim 6, characterized in that: The step S2000 further includes: When the relative distance is not within the preset distance interval and the relative angle is not within the preset angle interval for a preset number of times within a second preset time period, it is determined that the user is in a fatigue driving state and the user is prompted, and the AR device is controlled to execute a reminder program.

8. A smart watch, characterized in that: include: Memory; A processor, a control program for a smart watch stored in the memory and executed by the processor, wherein the control program for the smart watch, when executed by the processor, implements the control method for the smart watch according to any one of claims 5 to 7.

9. A smart wearable device system comprising a smart watch and the AR device according to claim 4; or An AR device and a smart watch as claimed in claim 8.

Images