Remote controller and control method for remote controller

Abstract

The present invention relates to a remote controller and a control method for the remote controller. The remote controller is communicatively connected to a water sports device. The remote controller comprises: a waterproof housing; an audio interaction assembly comprising a microphone and a loudspeaker; an intercom communication module configured to communicate with a device having an intercom function; a control assembly configured to generate control instruction data; a first communication module configured to communicate with the water sports device; and a processor configured to acquire the control instruction data and send the control instruction data to the water sports device by means of the first communication module so as to adjust a power parameter of the water sports device, and further configured to collect a first audio signal by means of the microphone and send the first audio signal to the device having the intercom function by means of the intercom communication module, to receive, by means of the intercom communication module, a second audio signal sent by the device having the intercom function and to play the second audio signal by means of the loudspeaker. According to the present invention, the functionality of the remote controller can be enriched, thereby improving user experience.

Description

Remote control and its control methods

[0001] This application claims priority to Chinese Patent Application No. 202510144288.8, filed on February 10, 2025, entitled "A Communication Method and Communication System for Waterborne Equipment", the entire contents of which are incorporated herein by reference.

[0002] Technical Field

[0003] This invention relates to the field of water sports equipment, and more specifically to a remote control and a method for controlling the remote control.

[0004] Background Technology

[0005] In recent years, personal water sports equipment has become increasingly popular, such as electric surfboards, electric hydrofoils, and electric jet skis. These water sports devices are usually equipped with handheld remote controls. The remote controls have built-in user command acquisition modules (such as throttle triggers) that collect user control commands to control the power parameters of the water sports equipment.

[0006] However, the remote control only has human-computer interaction capabilities but lacks interpersonal communication capabilities, which has obvious limitations, resulting in limited functionality and a poor user experience.

[0007] Summary of the Invention

[0008] To overcome the problems existing in related technologies, the present invention provides a remote controller and a method for controlling the remote controller.

[0009] According to a first aspect of the present invention, a remote controller is provided, the remote controller being communicatively connected to water sports equipment, the remote controller comprising:

[0010] Waterproof casing;

[0011] Audio interaction components, including microphones and speakers;

[0012] The intercom communication module is configured to communicate with devices that have intercom functionality;

[0013] The control component is configured to generate control command data;

[0014] The first communication module is configured to communicate with the water sports equipment;

[0015] The processor is configured to acquire the control command data and send the control command data to the water sports equipment via the first communication module to adjust the power parameters of the water sports equipment. It is also configured to acquire a first audio signal via the microphone and send it to a device with intercom functionality via the intercom communication module, and to receive a second audio signal sent by the device with intercom functionality via the intercom communication module and play it through the speaker.

[0016] In some exemplary embodiments of this disclosure, the processor is further configured to acquire motion posture data of the remote controller and operation telemetry data of the water sports equipment, and generate corresponding voice assistance information based on the motion posture data, the operation data, and the control command data; wherein the types of the voice assistance information include motion adjustment prompt voice information, stimulus feedback voice information, or diagnostic result voice information;

[0017] The speaker is also configured to broadcast the corresponding voice assistance information.

[0018] In some exemplary embodiments of this disclosure, the remote controller further includes:

[0019] The sensor module is configured to collect the motion posture data of the remote controller, and / or collect environmental image data and send the environmental image data to the processor, so that the processor generates obstacle avoidance prompt voice information based on the environmental image data;

[0020] In some exemplary embodiments of this disclosure, the remote controller further includes:

[0021] The second communication module is configured to access a wide area network to enable communication with the server, thereby enabling communication between the remote controller and electronic devices, the remote controller and wearable devices, and multiple remote controllers.

[0022] In some exemplary embodiments of this disclosure, the control component includes a cellular data communication module and / or a satellite communication module.

[0023] In some exemplary embodiments of this disclosure, the loudspeaker includes:

[0024] Air conduction loudspeakers, and / or bone conduction loudspeakers.

[0025] The remote control provided in the embodiments of the present invention may have the following beneficial effects:

[0026] By incorporating a waterproof casing, water interference with the remote control's functionality can be prevented, improving its stability and preventing audio quality degradation of the audio interaction components. The first communication module transmits control command data, enabling the remote control's processor to adjust the power parameters of the water sports equipment. Furthermore, the inclusion of an intercom communication module and audio interaction components allows the remote control to communicate with other devices possessing intercom capabilities (such as other remote controls), enhancing interpersonal communication. These features enrich the remote control's functionality, increase its intelligence, and improve the user experience.

[0027] According to a second aspect of the present invention, a control method for a remote controller is provided, employing the remote controller as described in the first aspect, wherein the remote controller is communicatively connected to a water sports device, and the control method includes:

[0028] Acquire motion posture data of the remote controller, operating data of the water sports equipment, and control command data input by the user;

[0029] Based on the motion posture data, the operation data, and the control command data, generate and broadcast corresponding voice assistance information;

[0030] The types of voice-assisted information include motion adjustment prompts, stimulus feedback, or diagnostic results.

[0031] In some exemplary embodiments of this disclosure, when the type of the voice assistance information is the motion adjustment prompt voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes:

[0032] Based on the motion posture data, the operation data, and the control command data, the user's control actions on the water sports equipment are determined;

[0033] When the control action is abnormal, generate and broadcast the action adjustment prompt voice information.

[0034] In some exemplary embodiments of this disclosure, the remote control used by the first user serves as the first remote control, and the remote control used by the second user serves as the second remote control; the first remote control and the second remote control are communicatively connected; the type of voice assistance information further includes motion adjustment supplementary prompt voice information; after generating and broadcasting the motion adjustment prompt voice information, the method further includes:

[0035] The motion adjustment prompt voice information broadcast to the first user is simultaneously sent to the second remote control, so that the second remote control broadcasts the motion adjustment prompt voice information.

[0036] Receive and broadcast the supplementary prompt voice information for action adjustment sent by the second remote control.

[0037] In some exemplary embodiments of this disclosure, when the type of the voice assistance information is stimulus feedback voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes:

[0038] Based on the motion posture data, the operation data, and the control command data, the user's control actions on the water sports equipment are determined;

[0039] When the control action is normal and the running data meets the preset conditions, the stimulus feedback voice information is generated and broadcast.

[0040] In some exemplary embodiments of this disclosure, the remote controller is communicatively connected to a server; when the type of the voice assistance information is diagnostic result voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes:

[0041] The motion posture data, the running data, and the control command data are sent to the server so that the server generates the diagnostic results.

[0042] When the diagnostic result is received from the server, the corresponding voice information of the diagnostic result is broadcast.

[0043] In some exemplary embodiments of this disclosure, generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes:

[0044] The motion posture data, the running data, and the control command data are input into the artificial intelligence model to generate and broadcast the corresponding voice assistance information.

[0045] In some exemplary embodiments of this disclosure, the remote controller is communicatively connected to a server; after acquiring the motion posture data of the remote controller, the operating data of the water sports equipment, and the control command data input by the user, the control method further includes:

[0046] Based on the motion posture data, the user's state of falling into the water is determined;

[0047] If a user is in the water, an emergency help alarm message is sent to the server.

[0048] The control method provided by embodiments of the present invention can include the following beneficial effects: Since the remote control is typically held in the user's hand, its movement is highly synchronized with the user's body movement. The remote control's motion posture data can reflect the user's body posture (e.g., when the body sways, the remote control also sways). The operating data of the water sports equipment can reflect the operating status of the equipment, and the control commands input by the user can reflect the user's control over the remote control. Based on these three types of data, the user's control over the remote control and the actual control over the water sports equipment can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used for real-time coaching to correct user movements, incentive feedback voice information can be used for interactive companionship to assist training, and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. Thus, the functions of the remote control are enriched, the intelligence level of the remote control is improved, and the user experience is enhanced.

[0049] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit the invention.

[0050] Attached Figure Description

[0051] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0052] Figure 1 is a schematic diagram of an electric surfboard communication system shown in a first exemplary embodiment.

[0053] Figure 2 is a schematic diagram of a communication system connection method for an electric surfboard, as shown in the first exemplary embodiment.

[0054] Figure 3 is a schematic diagram of the composition of a remote control shown in the first exemplary embodiment.

[0055] Figure 4 is a schematic diagram of the structure of a remote control shown in the first exemplary embodiment.

[0056] Figure 5 is a schematic diagram of a communication process for an electric surfboard, as shown in the first exemplary embodiment.

[0057] Figure 6 is a schematic block diagram of a remote controller according to a second exemplary embodiment.

[0058] Figure 7 is a schematic block diagram of a remote controller according to a third exemplary embodiment.

[0059] Figure 8 is a schematic diagram of the overall structure of a remote controller according to a fourth exemplary embodiment.

[0060] Figure 9 is a flowchart illustrating a control method for a remote controller according to a fifth exemplary embodiment.

[0061] Figure 10 is a flowchart illustrating a control method for a remote controller according to a sixth exemplary embodiment.

[0062] Figure 11 is a flowchart illustrating a control method for a remote controller according to a seventh exemplary embodiment.

[0063] In the picture:

[0064] 100 - Remote control; 101 - Short-range wireless communication module; 102 - Long-range wireless communication module; 103 - Voice component; 104 - Positioning component; 105 - Processor; 106 - Button; 107 - Battery; 108 - Screen; 109 - Circuit board; 110 - Housing; 200 - Controller; 201 - Surfboard body controller short-range communication module; 300 - Surfboard body; 400 - Remote device; 411 - Sensor module; 412 - First communication module; 413 - Second communication module; 414 - Control component; 415 - Microphone; 430 - Audio interaction component; 431 - Air conduction speaker; 432 - Bone conduction speaker; 440 - Waterproof housing; 450 - Display screen; 500 - Water sports equipment; 600 - Electronic device; 700 - Wearable device; 800 - Server; 900 - Intercom communication module.

[0065] Detailed Implementation

[0066] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of methods consistent with some aspects of the invention as detailed in the appended claims. It should also be understood that the term "and / or" as used in this invention refers to any or all possible combinations comprising one or more of the associated listed items.

[0067] In recent years, personal water sports equipment has become increasingly popular, such as electric surfboards, electric hydrofoils, and electric jet skis. These water sports devices are usually equipped with handheld remote controls. The remote controls have built-in user command acquisition modules (such as throttle triggers) that collect user control commands to control the power parameters of the water sports equipment.

[0068] However, the remote control only has human-computer interaction capabilities but lacks interpersonal communication capabilities, which has obvious limitations, resulting in limited functionality and a poor user experience.

[0069] As shown in Figure 1, an electric surfboard communication system includes a surfboard body 300, a controller 200, a remote controller 100, and a remote device 400. The controller 200 is a water sports equipment body controller, and in this embodiment, it is a surfboard body controller.

[0070] The surfboard body 300 includes an outer shell, a foam plastic cavity, a gyroscope, a Hall sensor, a speed sensor, a surfboard battery, and a power assembly. The controller 200, gyroscope, Hall sensor, speed sensor, and surfboard battery are housed within the foam plastic cavity to prevent water ingress. The power assembly is located at the bottom of the outer shell. The controller 200 is the electronic control system of the electric surfboard. It receives operating data from the gyroscope and Hall sensor, analyzes this data to obtain the surfboard's status data, generates control commands for power adjustment and mode switching, and receives corresponding control commands from the remote controller 100. The power assembly includes electric propellers and water jet propulsion systems. The power assembly receives commands from the controller 200 to adjust its output power.

[0071] The remote control 100 includes a processor 105, buttons 106, a battery 107, a screen 108, a circuit board 109, and a housing 110, as shown in Figures 3 and 4. Specifically, the processor 105 is a micro CPU; the buttons 106 include a trigger button for adjusting the output power of the power unit, and three menu and selection buttons for function and mode selection; the battery 107 is a lithium-ion battery that provides suitable battery life and stable voltage output; the circuit board 109 is a PCB circuit board that houses the various components of the remote control; the housing 110 is waterproof and lightweight; the seam between the screen 108 and the housing 110 is sealed with sealant to achieve a waterproof effect, and the surface of the screen 108 is coated with a hydrophobic coating to make water droplets slide off more easily, thereby keeping the screen 108 clearly visible.

[0072] As shown in Figure 2, the remote device 400 can be one or a combination of a remote management terminal and a mobile terminal. When the remote device 400 is a mobile terminal, the remote controller 100 establishes a connection with the mobile terminal through a cloud server; when the remote device 400 is a remote management terminal, the remote controller 100 establishes a connection with the remote management terminal through a cloud server and a device management server. Users can conveniently perform remote monitoring, operation data collection, training, safety management, authorization management, and revenue management through the mobile terminal or the remote management terminal of the electric surfboard rental company.

[0073] Remote controller 100 communicates wirelessly with controller 200 in the short range, and remote controller 100 communicates wirelessly with remote device 400. The communication process of the electric surfboard is shown in Figure 5, including the following steps:

[0074] Step S1: Remote controller 100 establishes short-range wireless communication with controller 200, and remote controller 100 establishes long-range wireless communication with remote device 400;

[0075] Step S2: The controller 200 generates status data and operation data of the electric surfboard, and the remote controller 100 generates the first voice data;

[0076] Step S3: Remote controller 100 receives status data and operation data using short-range wireless communication, and sends status data, operation data and first voice data to remote device 400 using long-range wireless communication;

[0077] Step S4: The remote device 400 generates remote control data and second voice data;

[0078] Step S5: Remote controller 100 receives remote control data and second voice data using remote wireless communication, and sends remote control data to controller 200 using short-range wireless communication.

[0079] Compared to "setting the remote wireless communication module 102 on the surfboard body 300, or obtaining remote wireless communication function through a mobile phone", remote wireless communication with the remote device 400 via the remote controller 100 can effectively avoid the impact of water and waves on the quality of remote wireless communication, as well as the inability to conduct remote wireless communication when the surfboard body 300 is turned off or the user does not have a mobile phone. This improves the reliability of remote data transmission and two-way voice communication between the electric surfboard and the remote device 400.

[0080] Specifically, the remote controller 100 includes a short-range wireless communication module 101, a long-range wireless communication module 102, and a voice component 103. The short-range wireless communication module 101 is communicatively connected to the controller 200, and the long-range wireless communication module 102 is communicatively connected to the remote device 400. The short-range wireless communication module 101 can be a Bluetooth or Zigbee communication module, the long-range wireless communication module 102 can be a 4G, 5G, 6G, or satellite communication module, and the voice component 103 includes a microphone and a speaker.

[0081] In this specific embodiment, the short-range wireless communication module 101 is a Bluetooth communication module. Bluetooth communication modules are characterized by low power consumption, which can increase the battery life of the remote control 100. The long-range wireless communication module 102 is a 4G / 5G communication module with the chip directly soldered onto the circuit board 109. By adding a single chip, the remote control 100 can have complete cellular network connectivity, effectively reducing space requirements. It also does not require changing the arrangement of existing components within the remote control 100, thus not affecting the reliability of basic functions such as power adjustment and mode switching. Therefore, without increasing the size of the remote control 100 or affecting the reliability of basic functions, long-range wireless communication between the remote control 100 and the remote device 400 is achieved.

[0082] In some other embodiments, the remote controller 100 also includes a WiFi communication module. The Bluetooth communication module, 4G / 5G communication module and WiFi communication module are integrated into a single communication component. This not only reduces the area occupied on the circuit board 109 and simplifies the design process, but also enables the remote controller 100 to select a more suitable short-range wireless communication method from the Bluetooth communication module and the WiFi communication module, or a more suitable long-range wireless communication method from the 4G / 5G communication module and the WiFi communication module, depending on the application scenario and signal coverage. This further improves the reliability of remote data transmission and two-way voice communication between the electric surfboard and the remote device 400.

[0083] When the controller 200 collects the status data and operation data of the electric surfboard, and the voice component 103 collects the first voice data, the remote controller 100 receives the status data and operation data through the short-range wireless communication module 101, and sends the status data, operation data, and the first voice data to the remote device 400 through the long-range wireless communication module 102. When the remote device 400 generates remote control data and the second voice data, the voice component 103 receives and plays the second voice data through the long-range wireless communication module 102, and the remote controller 100 receives the remote control data through the long-range wireless communication module 102, and sends the remote control data to the controller 200 through the short-range wireless communication module 101.

[0084] In a further embodiment, the controller 200 also includes a surfboard body controller short-range communication module 201, used to establish a communication connection with the short-range wireless communication module 101 of the remote controller 100. The surfboard body controller short-range communication module 201 receives data and information sent by the short-range wireless communication module 101 of the remote controller 100 and sends it to the controller 200, and also sends data and information generated by the controller 200 to the short-range wireless communication module 101 of the remote controller 100. After receiving the status data and operation data of the electric surfboard, the remote device 400 can diagnose whether the electric surfboard has malfunctioned based on the status data and operation data, and promptly detect emergencies. The remote device 400 can also generate remote control data when an emergency is detected, thereby remotely controlling the electric surfboard and improving the safety of using the electric surfboard.

[0085] When the first voice data includes a distress signal, the remote device 400 can identify the distress signal in the first voice data to determine whether an emergency has occurred. For example, when a user encounters an emergency and needs to call for help, they can loudly and repeatedly shout "Help!" or the internationally recognized distress signal of "three short, three long, three short sounds" into the remote control 100. The remote control 100 will then transmit the first voice data containing the distress signal to the remote device 400 via remote wireless communication. The remote device 400 can listen to and identify distress signals such as "Help!" and "three short, three long, three short sounds" in the first voice data to determine whether an emergency has occurred even when no one is listening, thereby increasing the chances of receiving rescue in an emergency and further improving the safety of using the electric surfboard.

[0086] The remote controller 100 can also generate location data, which is then transmitted to the remote device 400 via long-range wireless communication. For example, the remote controller 100 includes a positioning component 104 as shown in Figure 3. The positioning component 104 can be a GPS or BDS locator. The positioning component 104 can provide accurate location information of the electric surfboard, thereby increasing the chances of obtaining rescue in an emergency and further improving the safety of using the electric surfboard.

[0087] The remote device 400 can generate safe use area data, and the remote controller 100 receives the safe use area data via remote wireless communication. When the location data does not match the safe use area data, the remote controller 100 generates a power limit command and sends the power limit command to the controller 200 via short-range wireless communication. The controller 200 sends the power limit command to the power component, thereby limiting the output power of the electric surfboard. This allows parents or electric surfboard rental companies to set the safe use area of ​​the electric surfboard through the terminal device, improving the safety and ease of management of the electric surfboard.

[0088] The remote device 400 can also generate firmware upgrade data. The remote controller 100 receives the firmware upgrade data via remote wireless communication to enable remote firmware upgrades. The remote controller 100 also sends firmware upgrade data to the controller 200 via short-range wireless communication to enable remote firmware upgrades for the controller 200, power assembly, surfboard battery, and power assembly. Receiving firmware upgrade data generated by the remote device 400 via remote wireless communication allows for remote software updates, ensuring users always have access to the latest security patches, performance optimizations, and new features, further improving the safety and ease of management of the electric surfboard.

[0089] To enable users to easily manage and use electric surfboards, the remote device 400 can also store user data and manage permissions. After users log in and authenticate via the remote control 100, they can use functions such as cloud synchronization of device parameters, real-time and global synchronization of sports data, and uploading of operating status and log information. This ensures the security of remote wireless communication, effectively prevents user data leakage, and can also accurately record data such as breaking historical records, bringing a better user experience.

[0090] It should be noted that, referring to Figures 1 to 8, the structural correspondence between the above embodiments and the following embodiments is as follows: the surfboard body 300 and controller 200 in the above embodiments are equivalent to the electric surfboard of the water sports equipment 500 in the following embodiments; the remote controller 100 in the above embodiments is equivalent to the remote controller 100 in the following embodiments; the processor 105 in the above embodiments is equivalent to the processor 105 in the following embodiments; the short-range wireless communication module 101 in the above embodiments... The Bluetooth communication module and the above two are equivalent to the first communication module 412 in the following embodiments; the remote wireless communication module 102, WiFi communication module, 4G / 5G communication module and WiFi communication module integrated into a single communication component in the above embodiments are equivalent to the second communication module 413 in the following embodiments; the voice component 103 in the above embodiments is equivalent to the audio interaction component 430 in the following embodiments; the positioning component 104 in the above embodiments is equivalent to the global positioning system module in the sensor module 411 in the following embodiments; the button 106 in the above embodiments is a type of control component 414 in the following embodiments; the remote control 100 in the following embodiments also includes the battery 107 in the above embodiments; the screen 108 in the above embodiments is equivalent to the display screen 450 in the following embodiments; the following embodiments include the circuit board 109 in the above embodiments; the housing 110 in the above embodiments is equivalent to the waterproof housing 440 in the following embodiments; the remote device 400 in the above embodiments is equivalent to the electronic device 600, wearable device 700 and server 800 in the following embodiments.

[0091] As shown in Figures 6 to 8, in one exemplary embodiment, a remote controller 100 is provided. The remote controller 100 is communicatively connected to a water sports device 500. The remote controller 100 includes a waterproof housing 440, an audio interaction component 430, an intercom communication module 900, a control component 414, a first communication module 412, and a processor 105.

[0092] Audio interaction component 430 includes microphone 415 and speaker;

[0093] The intercom communication module 900 is configured to communicate with devices that have intercom functionality;

[0094] Control component 414 is configured to generate control command data;

[0095] The first communication module 412 is configured to communicate with the water sports equipment 500;

[0096] The processor 105 is configured to acquire control command data and send control command data to the water sports equipment 500 through the first communication module 412 to adjust the power parameters of the water sports equipment 500. It is also configured to acquire a first audio signal through the microphone 415 and send it to a device with intercom functionality through the intercom communication module 900, and receive a second audio signal sent by the device with intercom functionality through the intercom communication module 900 and play it through the speaker.

[0097] The remote control provided in the embodiments of the present invention may have the following beneficial effects:

[0098] By incorporating a waterproof casing, water interference with the remote control's functionality can be prevented, improving its stability and preventing audio quality degradation of the audio interaction components. The first communication module transmits control command data, enabling the remote control's processor to adjust the power parameters of the water sports equipment. Furthermore, the inclusion of an intercom communication module and audio interaction components allows the remote control to communicate with other devices possessing intercom capabilities (such as other remote controls), enhancing interpersonal communication. These features enrich the remote control's functionality, increase its intelligence, and improve the user experience.

[0099] In one embodiment, the processor 105 is further configured to acquire motion posture data of the remote controller 100 and operation telemetry data of the water sports equipment 500, and generate corresponding voice assistance information based on the motion posture data, operation data and control command data; wherein the types of voice assistance information include motion adjustment prompt voice information, stimulus feedback voice information or diagnostic result voice information.

[0100] The speaker is also configured to broadcast corresponding voice assistance information.

[0101] In the remote control provided in this embodiment, the remote control is typically held in the user's hand, so its movement is highly synchronized with the user's body movement. The remote control's motion posture data can reflect the user's body posture (e.g., when the body sways, the remote control also sways). The operational data of the water sports equipment can reflect the equipment's operating status, and the user's input control commands can reflect the user's actual control intention. Based on these three types of data, the user's actual control intention and the actual control status of the water sports equipment can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used for real-time coaching to correct the user's movements; incentive feedback voice information can be used for interactive companionship to assist training; and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. In this way, the remote control's functions are enriched, its intelligence level is improved, and the user experience is enhanced.

[0102] In one embodiment, the remote controller 100 further includes a sensor module 411.

[0103] Sensor module 411 is configured to acquire motion posture data of remote controller 100, and / or acquire environmental image data and send the environmental image data to processor 105 so that processor 105 generates obstacle avoidance prompt voice information based on the environmental image data.

[0104] In this embodiment, environmental image data is used to determine whether the user needs obstacle avoidance, and an obstacle avoidance prompt voice message is issued accordingly. This enriches the remote control's functionality, increases its intelligence, and enhances the user experience.

[0105] Exemplarily, sensor module 411 includes at least one of a vision sensor, an accelerometer, a gyroscope, a barometer, and a global positioning system (GPS) module. The vision sensor is used to acquire environmental image data and includes a camera for acquiring environmental image data. Motion attitude data includes rotational angular velocity and attitude angle. The accelerometer is used to detect the rotational angular velocity of the remote controller 100. The gyroscope is used to detect the attitude angle of the remote controller 100. The GPS module is used to acquire the geographical location of the remote controller 100.

[0106] In this embodiment, by setting up various types of sensors, data can be collected from multiple dimensions. For example, the motion posture data of the remote control can be used to generate voice assistance information to achieve intelligent coaching, interactive play, and fault diagnosis; environmental image data can be used to generate voice assistance information, especially obstacle avoidance prompts, to achieve intelligent obstacle avoidance; and the geographical location of the remote control can be used to generate emergency help alarm information to achieve intelligent rescue. This provides a data foundation for the functions of the remote control and helps to improve the user experience.

[0107] Exemplarily, the first communication module 412 includes at least one of a Bluetooth module, a Starlight module, a Zigbee module, a Mesh module, a Wi-Fi module, or a proprietary radio frequency protocol module. The communication connection between the first communication module 412 and the water sports equipment 500 includes short-range wireless communication or wired communication. Short-range wireless communication includes at least one of Bluetooth, Starlight, Zigbee, Wi-Fi, Mesh, or a proprietary radio frequency protocol. Wired communication includes at least one of CAN and RS-485.

[0108] In this embodiment, the first communication module includes various types, and its communication methods with the water sports equipment also include various types, which helps to reduce the difficulty of data acquisition and improve the richness of data acquisition. It can adapt to a variety of communication scenarios, making the remote control design more flexible.

[0109] For example, when the communication connection between the first communication module 412 and the water sports equipment 500 is short-range wireless communication, the operating frequency band of the first communication module 412 is set to a first preset frequency band. The first preset frequency band includes: 433MHz, 868MHz or 915MHz.

[0110] In traditional communication methods, water severely attenuates 2.4GHz electromagnetic waves. However, in this embodiment, the short-range wireless communication and its corresponding operating frequency band have strong anti-attenuation capabilities, which can significantly reduce the attenuation of communication signals by water and ensure communication reliability.

[0111] For example, the gain of the antenna of the first communication module 412 is greater than or equal to a first preset gain threshold, and the value of the first preset gain threshold can be 3 dB isotropic; the antenna structure is a PIFA structure or an IFA structure.

[0112] In this embodiment, by adjusting the antenna gain and structure, the attenuation of communication signals by water can be significantly reduced, ensuring communication reliability.

[0113] In one embodiment, the remote controller 100 further includes a second communication module 413.

[0114] The second communication module 413 is configured to access a wide area network to achieve communication connection with the server 800, thereby realizing communication connection between the remote controller 100 and the electronic device 600, the remote controller 100 and the wearable device 700, and multiple remote controllers 100.

[0115] In this embodiment, by setting a second communication module, the remote controller can communicate with multiple devices simultaneously, thereby improving the richness and real-time performance of the communication scenarios.

[0116] In one embodiment, the second communication module 413 includes a cellular data communication module and / or a satellite communication module.

[0117] For example, the second communication module 413 accesses the wide area network in at least one of the following methods: 4G cellular network, 5G cellular network, Wi-Fi, Mesh, and satellite network communication.

[0118] In this embodiment, the second communication module includes various types, including those between the remote control and electronic devices, between the remote control and wearable devices, and between multiple remote controls. This helps reduce the difficulty of data acquisition and improve the richness of data acquisition. It can adapt to various communication scenarios, making the remote control design more flexible. By setting the first and second communication modules independently, it is beneficial to achieve communication with multiple devices simultaneously, improving the richness and real-time performance of communication scenarios. At the same time, all communication data transmission is relayed through an aerial base station, completely avoiding the direct path of water, which can significantly reduce the attenuation of communication signals by water and ensure communication reliability. Especially when issuing emergency distress alarm information, satellite communication module is used first to communicate with satellites, ensuring that in areas without 4G or 5G cellular network coverage, emergency distress alarm information can be successfully sent, further ensuring communication reliability.

[0119] For example, when the second communication module 413 fails to access a 4G cellular network or a 5G cellular network, the first communication module 412 is also configured to establish a communication connection with the electronic device 600, the wearable device 700, and the second remote control. The communication method includes at least one of short-range wireless communication or wired communication.

[0120] In this embodiment, when the second communication module fails to access the 4G or 5G cellular network, it often means that the cellular network at the user's location is not covered or the signal is weak. At this time, the first communication module is used to realize communication between the remote control and electronic devices, the remote control and wearable devices, and multiple remote controls. This can achieve short-range communication and still ensure data collection at close range, thereby avoiding the situation where data cannot be collected and improving the stability of the remote control's multi-functionality.

[0121] For example, the first communication module 412 and / or the second communication module 413 are also configured to acquire biometric data of the user sent by the wearable device 700.

[0122] In this embodiment, the user's physiological fatigue level can be determined by acquiring the user's biometric data sent by the wearable device, thereby broadcasting corresponding action adjustment prompts to the user and improving the user's health.

[0123] Through actual testing, in typical freshwater or nearshore seawater environments, when the distance between the remote control and the water sports equipment is less than or equal to 10m, the transmission success rate of the communication signal between the first communication module and the water sports equipment is greater than or equal to 99.9%, and the latency is less than 30ms. In coastal cellular coverage areas, the interruption rate of the second communication module's communication connection with the wide area network is less than 0.1%.

[0124] In one embodiment, the loudspeaker includes an air conduction loudspeaker 431 and / or a bone conduction loudspeaker 432.

[0125] In this embodiment, by setting up multiple types of speakers, voice broadcasting can be achieved in different environments. For example, when the wind and waves are small and the noise is low, and the user can clearly hear the sound from the air conduction speaker, the air conduction speaker is used for broadcasting. When the wind and waves are large and the noise is high, and the user cannot clearly hear the sound from the air conduction speaker, the bone conduction speaker is used for broadcasting. Air conduction speakers and bone conduction speakers can also broadcast simultaneously to enhance the clarity of the broadcasting sound and improve the user experience.

[0126] For example, the microphone 415 is configured to acquire the user's voice data and send the voice data to the electronic device 600, the wearable device 700, and the second remote control via the first communication module 412 and / or the second communication module 413.

[0127] In this embodiment, a microphone is set up to enable intercom functionality with other devices, thereby improving the functionality of the remote control and the user experience.

[0128] For example, the audio interaction component 430 and the remote control 100 are packaged in a waterproof manner. Specifically, the air conduction speaker 431, the bone conduction speaker 432, and the microphone 415 are all packaged in a waterproof manner.

[0129] In this embodiment, both the audio interaction component and the processor are packaged in a waterproof manner, which helps to improve the reliability of data acquisition and voice broadcasting functions, thereby further improving the stability of the remote control.

[0130] For example, the control component 414 includes at least one of a throttle trigger, a shifter, and a button.

[0131] In this embodiment, user control command data can be collected from multiple dimensions, and the diversification of control component types improves the flexibility of remote control design.

[0132] As shown in Figure 8, the remote control 100 also includes a waterproof housing 440, which is exemplary. The processor 105 and the audio interaction component 430 are disposed inside the waterproof housing 440.

[0133] In this embodiment, the processor and audio interaction components are encapsulated inside the remote control through a waterproof shell, which helps to avoid water interference with the remote control's functions and improves the stability of the remote control.

[0134] For example, the waterproof housing 440 has a waterproof rating of IP67 / IP68, a high level of waterproofing.

[0135] In this embodiment, the waterproofness of the remote control is further improved, thereby further enhancing the stability of the remote control.

[0136] For example, the acoustic pathway consisting of the air-conduction speaker 431, the bone-conduction speaker 432, and the microphone 415 uses an ePTFE pore membrane, the pore size of which is less than or equal to a preset pore size threshold. The preset pore size threshold can be 1 μm.

[0137] In this embodiment, with the air conduction speaker, bone conduction speaker, and microphone using waterproof encapsulation and the waterproof housing meeting the IP67 / IP68 high-level waterproof standard, the acoustic path uses a small-pore ePTFE membrane, which can control the sound pressure attenuation in the 1kHz to 4kHz frequency band to within 3dB, thereby avoiding sound quality attenuation.

[0138] For example, the remote control 100 also includes a digital equalizer. The digital equalizer is electrically connected to the air-conducting speaker and is used to perform gain compensation on a second preset frequency band of the air-conducting speaker. The second preset frequency band includes [2kHz, 4kHz].

[0139] In this embodiment, in scenarios with relatively small waves and low noise, the gain compensation of the digital equalizer can enhance the clarity of the sound broadcast by the air-conducting loudspeaker and improve the user experience.

[0140] In this embodiment, the microphone 415 includes: a beamforming hardware circuit consisting of at least two digital microelectromechanical system microphones, and a front-end signal conditioning circuit electrically connected to the beamforming hardware circuit and the processor 105.

[0141] A beamforming hardware circuit is configured to form a pickup beam to enhance target speech and suppress environmental noise, generating a first audio signal. A front-end signal conditioning circuit includes a high-pass filter configured to filter out low-frequency wind-induced noise generated by the direct impact of high-speed airflow in the first audio signal, outputting a second audio signal. The processor 105 is further configured to: filter out non-stationary wind noise components in the second audio signal using an adaptive wind noise suppression algorithm to obtain a third audio signal; enhance the third audio signal based on a speech enhancement model to obtain a fourth audio signal; perform endpoint detection on the fourth audio signal to obtain a detection result; and when the detection result is a valid speech segment, send the fourth audio signal to the communication module or perform speech recognition on the fourth audio signal.

[0142] The cutoff frequency of the high-pass filter is greater than or equal to a first frequency threshold, which can be up to 100Hz. The adaptive wind noise suppression algorithm includes non-stationary noise modeling based on a long short-term memory network model and spectral subtraction fusion processing.

[0143] In this embodiment, actual measurements verified that under conditions of level 5 wind (wind speed of 9 m / s) and wave height of 0.5 m, the fourth audio signal collected by the microphone in this embodiment, after being sent to the communication module, achieved an average opinion score of greater than or equal to 3.5 points for broadcast clarity, and the accuracy of speech recognition of the fourth audio signal was greater than or equal to 90%. This significantly improves the signal-to-noise ratio of the speech signal and the reliability of command recognition.

[0144] For example, the waterproof housing 440 is sealed by a seamless seal, and the seamless seal is achieved by processes including ultrasonic welding or two-color injection molding.

[0145] In this embodiment, the seamless seal eliminates the need for traditional screws and multiple sealing rings, improving protection reliability and reducing the overall weight of the remote control to achieve lightweighting.

[0146] For example, the antenna of the first communication module 412 is disposed outside the waterproof housing 440.

[0147] In this embodiment, placing the antenna outside the waterproof casing can significantly reduce the attenuation of communication signals by the waterproof casing, thereby reducing the attenuation of communication signals by water and ensuring communication reliability.

[0148] For example, the waterproof housing 440 is shaped like a handheld device.

[0149] In this embodiment, the handheld waterproof shell is ergonomic, which helps to improve the user experience from a structural perspective.

[0150] For example, the waterproof housing 440 is provided with a first opening, and the control component 414 is provided in a position corresponding to the first opening for collecting user control command data through the first opening.

[0151] For example, processor 105 includes one or more processor implementations.

[0152] For example, the remote controller 100 also includes a display screen 450. The waterproof housing 400 is provided with a second opening, and the display screen 450 is disposed inside the waterproof housing 440, with its display surface corresponding to the position of the second opening, for displaying the operating data of the water sports equipment through the second opening.

[0153] In this embodiment, the operating data of the water sports equipment is displayed on a screen, which can visualize the operation of the water sports equipment and improve the user experience.

[0154] Using the aforementioned remote control, this invention provides a remote control method. The remote control is communicatively connected to a water sports device. The control method includes: acquiring motion posture data of the remote control, operating data of the water sports device, and control command data input by the user; generating and broadcasting corresponding voice assistance information based on the motion posture data, operating data, and control command data; wherein the types of voice assistance information include motion adjustment prompt voice information, stimulus feedback voice information, or diagnostic result voice information. The remote control is typically held in the user's hand, therefore its movement is highly synchronized with the user's body movement. The motion posture data of the remote control can reflect the user's body posture (e.g., when the body sways, the remote control also sways), while the operating data of the water sports device can reflect the operating status of the water sports device, and the control commands input by the user can reflect the user's control over the remote control. Based on these three types of data, the user's control over the remote control and the actual control over the water sports device can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used for real-time coaching to correct user movements, stimulus feedback voice information can be used for interactive companionship to assist training, and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. This enriches the functions of the remote control, improves its intelligence, and enhances the user experience.

[0155] For example, the remote controller can communicate with water sports equipment, servers, electronic devices, wearable devices, and multiple remote controllers. This enables information exchange between the remote controller and various devices, as well as between multiple remote controllers, providing a rich data source for the remote controller and enhancing its functionality.

[0156] As shown in Figure 9, in one exemplary embodiment, a control method for a remote controller is provided. The remote controller is communicatively connected to a water sports device. The control method includes:

[0157] S910: Acquires motion attitude data of the remote controller, operation data of the water sports equipment, and control command data input by the user.

[0158] Exemplarily, the remote controller includes a sensor module and a control command input module. The sensor module includes a gyroscope for measuring rotational angular velocity and / or an accelerometer for measuring attitude angles. The control command input module includes a throttle trigger for measuring the user's control force. The motion attitude data in step S110 includes rotational angular velocity and / or attitude angles. The operating data includes motor speed data and glide length of the water sports equipment, such as the acceleration of the motor speed. The control command data includes the user's control thrust on the throttle trigger.

[0159] In this embodiment, the rotational angular velocity and / or attitude angle of the remote control can represent the rotational angular velocity and / or attitude angle of the user's body, thereby determining whether the user's motion posture is stable or unstable. Motor speed data can represent the operating status of the water sports equipment, thereby determining whether the operating status of the water sports equipment is stable or unstable. Glide length can represent the user's actual glide length, thereby determining whether the operating data of the water sports equipment meets preset conditions (e.g., whether it meets 500 meters). The user's control thrust on the throttle trigger represents the user's control of the remote control, thereby determining whether the user's control of the remote control is stable or unstable. Thus, it can be determined whether the user's control actions on the water sports equipment are normal, providing a judgment benchmark for triggering subsequent intelligent coaching, interactive companionship, and intelligent diagnostic functions.

[0160] For example, the method for obtaining the operational data of the water sports equipment in step S910 includes:

[0161] Send a data acquisition request to the water sports equipment.

[0162] Receive operational data sent by water sports equipment.

[0163] In this embodiment, the operation data of the water sports equipment can be obtained in real time based on communication with the water sports equipment, thereby generating and broadcasting corresponding voice assistance information in real time. This enables the remote control to obtain real-time coaching, real-time interactive companionship, and real-time fault detection functions, thereby further improving the user experience.

[0164] S920 generates and broadcasts corresponding voice assistance information based on motion posture data, operation data, and control command data.

[0165] The types of voice-assisted information include motion adjustment prompts, stimulus feedback, or diagnostic results.

[0166] In one embodiment, when the type of voice assistance information in step S920 is motion adjustment prompt voice information, the step S920 of generating and broadcasting the corresponding voice assistance information based on motion posture data, running data, and control command data includes:

[0167] Based on motion posture data, operation data, and control command data, the user's control actions on the water sports equipment are determined.

[0168] When abnormal operation occurs, generate and broadcast voice prompts for action adjustment.

[0169] In this embodiment, the remote control is typically held in the user's hand, so its movement is highly synchronized with the user's body movement. The remote control's motion posture data reflects the user's body posture (e.g., when the body sways, the remote control also sways). The water sports equipment's operational data reflects the equipment's operational status, and the user's input control commands reflect the user's control over the remote control. Based on these three types of data, the user's control over the remote control and the actual control over the water sports equipment can be determined, thus determining whether the user's control actions on the water sports equipment are normal. For example, if during initial training, due to nervousness, the user's input commands to the remote control's user command input module (e.g., the throttle trigger) are inconsistent in speed, and the body also sways violently, the acquired remote control motion posture data reflects the user's swaying body posture, the water sports equipment's operational data reflects unstable operation, and the user's input control commands reflect inaccurate control over the remote control, then the control action is determined to be abnormal. If the control action is abnormal, a voice prompt message for action adjustment will be generated and broadcast to remind the user to correct their body posture and control of the remote control. For example, the voice prompt message for action adjustment may be "Keep the throttle of the remote control increasing smoothly and shift your body center of gravity forward". This provides real-time voice control guidance, realizes the intelligent coach function to assist training, improves the versatility and intelligence of the remote control function, and enhances the user experience.

[0170] For example, based on motion posture data, operational data, and control command data, the user's control actions on the water sports equipment are determined, including:

[0171] The user's motion posture is determined based on motion posture data, the operation status of the water sports equipment is determined based on operation data, and the user's control status of the remote control is determined based on the user's control actions on the water sports equipment.

[0172] When the user's movement posture is unstable, and / or the operation of the water sports equipment is unstable, and / or the user's control of the remote control is unstable, it is determined that the user's control actions on the water sports equipment are abnormal.

[0173] When the user's movement posture is unstable, the operation of the water sports equipment is unstable, and the user's control of the remote control is stable, it is determined that the user's control of the water sports equipment is normal.

[0174] Determining the user's motion posture based on motion posture data includes:

[0175] When the rotational angular velocity is greater than or equal to a preset angular velocity threshold, and the attitude angle is greater than or equal to a first preset attitude angle threshold, the user's motion attitude is unstable.

[0176] When the rotational angular velocity is less than the first preset angular velocity threshold, or the attitude angle is less than the first preset attitude angle threshold, the user's motion attitude is stable.

[0177] The first preset angular velocity threshold ranges from [20° / s, 60° / s] and can be adjusted according to actual engineering conditions. For example, the first preset angular velocity threshold can be 20° / s, 30° / s, or 60° / s. When the user is gliding normally, the rotational angular velocity ranges from [10° / s, 15° / s]. When the rotational angular velocity is greater than or equal to the first preset angular velocity threshold, it indicates that the user is making a violent correction of their center of gravity or their body is swaying unbalanced, but they have not yet fallen into the water, and a motion adjustment prompt is needed. The first preset attitude angle threshold ranges from [15°, 35°] and can be adjusted according to actual engineering conditions. For example, the first preset attitude angle threshold can be 15°, 25°, or 35°. When the user is gliding normally, the attitude angle range is usually less than [15°, 35°]. When the attitude angle is greater than or equal to the first preset attitude angle threshold, it indicates that the user is tilting too much and is prone to losing control, and a motion adjustment prompt is needed.

[0178] Determine the operational status of water sports equipment based on operational data, including:

[0179] When the acceleration of the motor speed is greater than or equal to the preset acceleration threshold, the operation of the water sports equipment is unstable.

[0180] When the acceleration of the motor speed is less than the preset acceleration threshold, the operation of the water sports equipment is stable.

[0181] The preset acceleration threshold range is [8000rpm / s, 30000rpm / s], which can be adjusted according to the actual project. For example, the preset acceleration threshold can be 8000rpm / s, 15000rpm / s, or 30000rpm / s. When the water sports equipment accelerates normally, due to the influence of underwater resistance, the acceleration of the motor speed is usually less than [8000rpm / s, 30000rpm / s]. When the acceleration of the motor speed is greater than or equal to the preset acceleration threshold, it indicates that the water sports equipment is slipping and the operation is unstable, requiring an action adjustment prompt.

[0182] The user's control over the remote control is determined based on their actions in operating the water sports equipment, including:

[0183] When the change in the user's control force on the throttle trigger is greater than or equal to a preset threshold, the user's control of the remote control becomes unstable.

[0184] When the change in the user's control force on the throttle trigger is less than a preset threshold, the user's control of the remote control is stable.

[0185] The preset change threshold is greater than or equal to 15% / s of the total travel mapped to the throttle trigger's control force, and less than or equal to 40% / s of the total travel mapped to the throttle trigger's control force. This can be adjusted according to actual engineering conditions; for example, the preset change threshold can be 15%, 25%, or 40% / s of the total travel mapped to the throttle trigger's control force. It should be noted that the total travel is the maximum displacement or angle experienced by the throttle trigger from its initial position to its fully depressed position. 25% / s of the total travel means that the displacement or angle change of the throttle trigger within 1 second is 25% of the total travel. When the user's control of the throttle trigger is stable, the change in the user's control force is usually less than the aforementioned preset change threshold. When the change in the user's control force is greater than or equal to the aforementioned preset change threshold, it indicates that the user's control force on the throttle trigger is fluctuating, and the user's finger is stiff or twitching due to tension. In this case, an action adjustment prompt is needed.

[0186] In this embodiment, the user's motion posture is first determined based on motion posture data, the operation status of the water sports equipment is determined based on operation data, and the user's control of the remote control is determined based on the user's control actions on the water sports equipment. Then, based on the first three factors, it is determined whether the user's control actions on the water sports equipment are normal. This allows for an accurate determination of whether the user's body posture is normal and whether the control of the remote control is normal, thereby deciding whether to broadcast motion adjustment prompt voice information to the user.

[0187] In one embodiment, the remote control used by the first user is designated as the first remote control, and the remote control used by the second user is designated as the second remote control; the first remote control and the second remote control are communicatively connected; the type of voice assistance information in step S120 further includes motion adjustment supplementary prompt voice information; after generating and broadcasting the motion adjustment prompt voice information in step S120, the method further includes:

[0188] The motion adjustment prompt voice information broadcast to the first user is simultaneously sent to the second remote control, so that the second remote control broadcasts the motion adjustment prompt voice information.

[0189] Receive and broadcast supplementary voice prompts for action adjustment sent by the second remote control.

[0190] In this embodiment, when the first user uses the smart coach function of the remote control, the second user can simultaneously hear the first user's motion adjustment prompts via voice, and the second user can send supplementary motion adjustment prompts via voice to the first user. For example, if the first user is the student and the second user is the coach, when the student uses the smart coach function of the remote control, for instance, if the student's remote control emits a motion adjustment prompt voice message such as "Keep the throttle of the remote control increasing smoothly and shift your body's center of gravity forward," the coach, upon hearing this simultaneously, can provide supplementary guidance to the student by issuing a supplementary motion adjustment prompt voice message such as "Yes, just like the remote control says, lean your body forward a little more." Through supplementary prompts between the smart coach and multiple remote control users, remote control users can obtain more accurate training guidance, enriching the remote control's functionality while improving the user experience.

[0191] In one embodiment, when the type of voice assistance information in step S920 is excitation feedback voice information, the step S920 of generating and broadcasting the corresponding voice assistance information based on motion posture data, running data, and control command data includes:

[0192] Based on motion posture data, operation data, and control command data, the user's control actions on the water sports equipment are determined.

[0193] When the operation is normal and the running data meets the preset conditions, the stimulus feedback voice information is generated and broadcast.

[0194] In this embodiment, if the user's operation of the water sports equipment is normal and the operating data meets the preset conditions, incentive feedback voice information can be generated and broadcast to encourage the user to realize the interactive playmate function, thereby improving the functionality of the remote control and the user experience.

[0195] For example, based on motion posture data, operational data, and control command data, the user's control actions on the water sports equipment are determined as described above. The operational data meets preset conditions, including:

[0196] The gliding length of the water sports equipment is greater than or equal to a preset length threshold.

[0197] The preset length threshold range is [300m, 1000m]. The preset length threshold can be 300m, 500m, 800m or 1000m, and can be adjusted according to the actual project.

[0198] In this embodiment, when the user's gliding distance exceeds a preset length threshold, a motivational feedback voice message "Great! First successful gliding distance of over 500 meters" is generated and broadcast, which can provide positive feedback for user training and thus improve the user experience.

[0199] In one embodiment, the remote controller is communicatively connected to the server; when the type of voice assistance information in step S920 is diagnostic result voice information, the step S920 of generating and broadcasting the corresponding voice assistance information based on motion posture data, running data, and control command data includes:

[0200] The motion posture data, operation data, and control command data are sent to the server so that the server can generate diagnostic results.

[0201] When a diagnostic result is received from the server, the corresponding diagnostic result voice information is broadcast.

[0202] In this embodiment, motion attitude data, operational data, and control command data are sent to a server for remote diagnostics. For example, if the hydrofoil of a water sports device suddenly loses some power, the user sends a command to the remote controller to check the device. The remote controller then sends the motion attitude data, operational data, and control command data to the server's remote device management platform. The server generates a diagnostic result indicating that the propeller is entangled in a foreign object, and sends a voice message to the remote controller stating, "A foreign object has been detected entangled in the propeller. Please stop in a safe area and check." This allows fault diagnosis and cause analysis, which the remote controller cannot perform, to be achieved through a powerful server, enabling efficient and professional remote device maintenance and support. It also realizes fault detection functionality and further enhances the user experience.

[0203] In one embodiment, step S920, which involves generating and broadcasting corresponding voice assistance information based on motion posture data, running data, and control command data, includes:

[0204] The motion posture data, operation data, and control command data are input into the artificial intelligence model to generate and broadcast the corresponding voice assistance information.

[0205] In this embodiment, by using an artificial intelligence model to process multiple data, more accurate voice assistance information that is more in line with the current state of the user and the current state of the water sports equipment can be generated, thereby enabling the intelligent coach, interactive playmate, and fault detection functions to be more accurately matched to the user.

[0206] For example, the artificial intelligence model includes a first artificial intelligence model, a second artificial intelligence model, and a third artificial intelligence model. The first artificial intelligence model is used to generate action adjustment prompt voice information, the second artificial intelligence model is used to generate stimulus feedback voice information, and the third artificial intelligence model is used to generate diagnostic result voice information.

[0207] In this embodiment, multiple artificial intelligence models with different functions are used to adapt to various application scenarios. These models can generate various corresponding voice assistance information for different application scenarios, which enriches the functions of the remote control, improves the intelligence level of the remote control, and enhances the user experience.

[0208] For example, the first artificial intelligence model is constructed as follows:

[0209] The first artificial intelligence model is constructed by using time-series data of motion posture data, running data, and control command data as input vectors and voice information of motion adjustment prompts as output vectors.

[0210] Supervised learning is performed on the first artificial intelligence model using correct action data with correct labels and incorrect action data with incorrect labels to train the first artificial intelligence model;

[0211] The probability of a user making an incorrect control action on water sports equipment, based on time-series data of motion posture data, operation data, and control command data, is determined using an artificial intelligence model as the first probability.

[0212] When the first probability is greater than or equal to the first preset probability threshold, output action adjustment prompt voice information.

[0213] Correct motion data includes motion posture data, operational data, and control command data collected when the user performs standard actions. Incorrect motion data includes motion posture data, operational data, and control command data collected when the user leans back or experiences severe shaking while operating the throttle trigger.

[0214] The first type of artificial intelligence model includes one or more of the following: long short-term memory network or Transformer encoder architecture.

[0215] In this embodiment, the first artificial intelligence model can be applied to the application scenario of real-time coaching, thereby realizing real-time coaching to correct user actions.

[0216] For example, the second artificial intelligence model is constructed as follows:

[0217] Using current operating data and historical benchmark operating data as input vectors, and the rating of the current operating data as the output vector, a second artificial intelligence model is constructed.

[0218] The second artificial intelligence model is used to compare the current running data with the historical benchmark running data to obtain the score of the current running data, and the probability that the score of the current running data is greater than the score corresponding to the historical benchmark running data is calculated to obtain the second probability;

[0219] If the first probability is greater than or equal to the second preset probability threshold, then incentive feedback voice information with praise properties is generated.

[0220] If the second probability is less than the second preset probability threshold, then a soothing stimulus feedback voice message is generated.

[0221] The second type of artificial intelligence model includes one or more of the following: multilayer perceptron model, random forest algorithm model.

[0222] In this embodiment, the second artificial intelligence model can be applied to interactive companionship application scenarios, thereby achieving interactive companionship to assist training.

[0223] For example, the third artificial intelligence model is constructed as follows:

[0224] Using current operating data as the input vector and fault category and diagnostic result voice information as the output vector, a third artificial intelligence model is constructed.

[0225] The third artificial intelligence model is trained by using operational data with labeled fault categories and corresponding diagnostic result voice information to conduct supervised learning; or, the third artificial intelligence model is trained by using operational data with unlabeled fault categories and corresponding fault categories and diagnostic result voice information to conduct unsupervised learning.

[0226] Using a third artificial intelligence model, diagnostic result voice information corresponding to the current running data is generated.

[0227] The third type of artificial intelligence model includes one or more of the following: one-dimensional convolutional neural network, autoencoder.

[0228] In this embodiment, a third artificial intelligence model can be applied to fault detection scenarios to provide intelligent diagnosis and assist in fault detection.

[0229] In one embodiment, the remote controller is communicatively connected to the server; after acquiring the motion attitude data of the remote controller, the operating data of the water sports equipment, and the control command data input by the user in step S910, the control method further includes:

[0230] Based on motion posture data, determine the user's state upon falling into the water.

[0231] If a user is in the water, an emergency help alarm message is sent to the server.

[0232] In this embodiment, the judgment of the user's falling into the water and the emergency help alarm function have been added, which can trigger rescue at the first time when the user is in danger, and improve the user's safety in operating water sports equipment.

[0233] For example, emergency help alarm information includes the geographical location of the remote control, the user's submersion status, and the user's identity information.

[0234] In this embodiment, search and rescue organizations can more accurately locate users, thereby improving search and rescue efficiency.

[0235] For example, determining a user's fall-in-water state based on motion posture data includes:

[0236] When the rotational angular velocity is less than the second preset angular velocity threshold, or the attitude angle is less than the second preset attitude angle threshold, the user's water-falling state is determined to be "not in water".

[0237] When the rotational angular velocity is greater than or equal to the second preset angular velocity threshold, or the attitude angle is greater than or equal to the second preset attitude angle threshold, the user's state of falling into the water is determined to be that they have fallen into the water.

[0238] Among them, the second preset angular velocity threshold is greater than the first preset angular velocity threshold, and the second preset attitude angle threshold is greater than the first preset attitude angle threshold.

[0239] The second preset angular velocity threshold ranges from [100° / s, 300° / s] and can be adjusted according to actual engineering conditions. For example, the second preset angular velocity threshold can be 100° / s, 150° / s, or 300° / s. When the user is not in the water, their arm will not make violent waving or rolling movements, and the rotational angular velocity of the remote control will be less than [100° / s, 300° / s]. When the rotational angular velocity is greater than or equal to the second preset angular velocity threshold, it indicates that the user's arm has made violent waving or rolling movements, causing the rotational angular velocity of the remote control to increase, which indicates that the user has fallen into the water. The second preset attitude angle threshold ranges from [60°, 180°] and can be adjusted according to actual engineering conditions. For example, the second preset attitude angle threshold can be 60°, 75°, or 180°. When a user has not yet fallen into the water, their attitude angle is typically less than [60°, 180°]. When the attitude angle is greater than or equal to a second preset attitude angle threshold, it is determined that the user has fallen into the water or is struggling in the water. The range of the second preset angular velocity threshold is greater than the range of the first preset angular velocity threshold, and the range of the second preset attitude angle is greater than the range of the first preset attitude angle, which can better distinguish whether the user's motion posture is stable and whether the user has fallen into the water.

[0240] In this embodiment, the range of motion of the user's body posture when falling into the water is much greater than the range of motion of the body posture when the control of the water sports equipment is unstable. Therefore, the user's falling into the water state can be determined based on the motion posture data of the remote control, thereby improving the accuracy of the falling into the water state judgment.

[0241] In the remote control method provided in this embodiment, the remote control is typically held in the user's hand, so its movement is highly synchronized with the user's body movement. The remote control's motion posture data can reflect the user's body posture (e.g., when the body sways, the remote control also sways), while the water sports equipment's operating data can reflect the equipment's operating status, and the user's input control commands can reflect the user's actual control intention. Based on these three types of data, the user's actual control intention and the actual control status of the water sports equipment can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used to achieve real-time coaching to correct the user's movements, incentive feedback voice information can be used to achieve interactive companionship to assist training, and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. In this way, the remote control's functions are enriched, its intelligence level is improved, and the user experience is enhanced.

[0242] As shown in Figure 10, in one exemplary embodiment, a control method for a remote controller is provided. The remote controller is communicatively connected to a water sports device. The control method includes:

[0243] S1010: Acquire motion attitude data of the remote controller, operation data of the water sports equipment, control command data input by the user, and environmental image data.

[0244] S1020: Generate and broadcast corresponding voice assistance information based on motion posture data, operation data, and control command data.

[0245] S1030. When the environmental image data includes obstacles, generate and broadcast obstacle avoidance prompt voice information.

[0246] The types of voice-assisted information include motion adjustment prompts, incentive feedback, diagnostic results, and obstacle avoidance prompts.

[0247] In the remote control method provided in this embodiment, the remote control is typically held in the user's hand, so its movement is highly synchronized with the user's body movement. The remote control's motion posture data can reflect the user's body posture (e.g., when the body sways, the remote control also sways), while the water sports equipment's operational data can reflect the equipment's operating status, and the user's input control commands can reflect the user's actual control intention. Based on these three types of data, the user's actual control intention and the actual control status of the water sports equipment can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used to achieve real-time coaching to correct the user's movements, incentive feedback voice information can be used to achieve interactive companionship to assist training, and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. Environmental image data is used to determine whether the user needs obstacle avoidance and to issue obstacle avoidance prompt voice information. In this way, the remote control's functions are enriched, its intelligence level is improved, and the user experience is enhanced.

[0248] As shown in Figure 11, in one exemplary embodiment, a control method for a remote controller is provided. The remote controller is communicatively connected to a water sports device. The control method includes:

[0249] S1110: Acquire motion posture data of the remote controller, operation data of the water sports equipment, control command data input by the user, and biometric data of the user.

[0250] S1120. Based on motion posture data, operation data, and control command data, generate and broadcast corresponding voice assistance information. The types of voice assistance information include motion adjustment prompts, stimulus feedback, and diagnostic results.

[0251] S1130. Generate and broadcast voice prompts for action adjustment based on biometric data.

[0252] In the remote control method provided in this embodiment, the remote control is typically held in the user's hand, so its movement is highly synchronized with the user's body movement. The remote control's motion posture data can reflect the user's body posture (e.g., when the body sways, the remote control also sways). The operating data of the water sports equipment can reflect the operating status of the water sports equipment, and the control commands input by the user can reflect the user's actual control intention. Based on these three types of data, the user's actual control intention and the actual control status of the water sports equipment can be determined, thereby generating and broadcasting corresponding voice assistance information to achieve real-time coaching, interactive companionship, and fault detection functions. For example, motion adjustment prompt voice information can be used to achieve real-time coaching to correct the user's movements, incentive feedback voice information can be used to achieve interactive companionship to assist training, and diagnostic result voice information can be used for intelligent diagnosis to assist fault detection. At the same time, the user's biometric data can reflect the user's physiological fatigue level. Based on the user's physiological fatigue level, motion adjustment prompt voice information can be generated and broadcast to adjust the training intensity, which is beneficial to maintaining the user's physical health.

[0253] For example, obtaining the user's biometric data in step S1110 includes:

[0254] Send a data retrieval request to the wearable device.

[0255] Receive user biometric data sent by wearable devices.

[0256] The biometric data includes at least one of heart rate and blood oxygen concentration.

[0257] In this embodiment, it is beneficial to obtain the user's biometric data in real time, thereby obtaining the user's physiological fatigue level in real time, so as to generate more accurate motion adjustment prompt voice information to adjust the training intensity.

[0258] For example, step S1130, generating and broadcasting motion adjustment prompt voice information based on biometric data, includes:

[0259] When the biometric data is within the fatigue threshold range, a prompt voice message for motion adjustment is generated and broadcast.

[0260] Among them, the biometric data being within the fatigue threshold range includes at least one of the following: heart rate being within the heart rate fatigue threshold range and blood oxygen concentration being within the blood oxygen concentration fatigue range.

[0261] The heart rate fatigue threshold range is [150 bpm, 190 bpm], which can be adjusted according to the physiological differences of users in actual engineering. The heart rate fatigue threshold range can be [150 bpm, 170 bpm] or [170 bpm, 190 bpm]. The blood oxygen concentration fatigue threshold range is [90%, 95%], which can be adjusted according to the physiological differences of users in actual engineering. The blood oxygen concentration fatigue threshold range can be [90%, 93%] or [93%, 95%]. During strenuous exercise, if the user's heart rate is within the aforementioned heart rate fatigue range or the user's blood oxygen concentration is within the blood oxygen concentration fatigue threshold range, it usually indicates that the user has entered an anaerobic limit state or a state of excessive tension due to high-intensity training or training at high altitudes. In this case, it is necessary to remind the user to reduce the intensity of exercise.

[0262] In this embodiment, the criterion for determining the user's level of physiological fatigue is based on whether the biometric data is within the fatigue threshold range, which is beneficial for determining more accurate motion adjustment prompt voice information based on the user's level of physiological fatigue.

[0263] In one exemplary embodiment, a remote control is provided, including a processor and a memory, the memory storing a computer program, and the processor executing the computer program to implement the steps of any of the above-described remote control control methods.

[0264] In one exemplary embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of any of the remote control control methods described above. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, magnetic tape, a floppy disk, or an optical data storage device, etc.

[0265] In one exemplary embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps of any of the above-described remote control control methods.

[0266] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered illustrative only, and the true scope and spirit of the invention are indicated by the claims.

[0267] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A remote control, characterized in that, The remote controller is communicatively connected to the water sports equipment, and the remote controller includes: Waterproof casing; Audio interaction components, including microphones and speakers; The intercom communication module is configured to communicate with devices that have intercom functionality; The control component is configured to generate control command data; The first communication module is configured to communicate with the water sports equipment; The processor is configured to acquire the control command data and send the control command data to the water sports equipment via the first communication module to adjust the power parameters of the water sports equipment. It is also configured to acquire a first audio signal via the microphone and send it to a device with intercom functionality via the intercom communication module, and to receive a second audio signal sent by the device with intercom functionality via the intercom communication module and play it through the speaker.

2. The remote control according to claim 1, characterized in that, The processor is further configured to acquire motion posture data of the remote controller and operation telemetry data of the water sports equipment, and generate corresponding voice assistance information based on the motion posture data, the operation data and the control command data; wherein the types of voice assistance information include motion adjustment prompt voice information, stimulus feedback voice information or diagnostic result voice information; The speaker is also configured to broadcast the corresponding voice assistance information.

3. The remote control according to claim 2, characterized in that, The remote control also includes: The sensor module is configured to acquire the motion posture data of the remote controller, and / or acquire environmental image data and send the environmental image data to the processor so that the processor generates obstacle avoidance prompt voice information based on the environmental image data.

4. The remote control according to claim 1, characterized in that, The remote control also includes: The second communication module is configured to access a wide area network to enable communication with a server, thereby enabling communication between the remote controller and electronic devices, the remote controller and wearable devices, and multiple remote controllers.

5. The remote control according to claim 4, characterized in that, The second communication module includes a cellular data communication module and / or a satellite communication module.

6. The remote control according to claim 1, characterized in that, The loudspeaker includes: Air conduction loudspeakers, and / or bone conduction loudspeakers.

7. A method for controlling a remote control, characterized in that, The remote controller as described in any one of claims 1 to 6 is communicatively connected to the water sports equipment, and the control method includes: Acquire motion posture data of the remote controller, operating data of the water sports equipment, and control command data input by the user; Based on the motion posture data, the operation data, and the control command data, generate and broadcast corresponding voice assistance information; The types of voice-assisted information include motion adjustment prompts, stimulus feedback, or diagnostic results.

8. The control method according to claim 7, characterized in that, When the type of the voice assistance information is the action adjustment prompt voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes: Based on the motion posture data, the operation data, and the control command data, the user's control actions on the water sports equipment are determined; When the control action is abnormal, generate and broadcast the action adjustment prompt voice information.

9. The control method according to claim 8, characterized in that, The remote control used by the first user is the first remote control, and the remote control used by the second user is the second remote control. The first remote control and the second remote control are communicatively connected. The types of voice-assisted information also include action adjustment supplementary prompt voice information; After generating and broadcasting the motion adjustment prompt voice information, the method further includes: The motion adjustment prompt voice information broadcast to the first user is simultaneously sent to the second remote control, so that the second remote control broadcasts the motion adjustment prompt voice information. Receive and broadcast the supplementary prompt voice information for action adjustment sent by the second remote control.

10. The control method according to claim 7, characterized in that, When the type of the voice assistance information is stimulus feedback voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes: Based on the motion posture data, the operation data, and the control command data, the user's control actions on the water sports equipment are determined; When the control action is normal and the running data meets the preset conditions, the stimulus feedback voice information is generated and broadcast.

11. The control method according to claim 7, characterized in that, The remote controller is communicatively connected to the server; when the type of the voice assistance information is diagnostic result voice information, the step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes: The motion posture data, the running data, and the control command data are sent to the server so that the server generates the diagnostic results. When the diagnostic result is received from the server, the corresponding voice information of the diagnostic result is broadcast.

12. The control method according to claim 7, characterized in that, The step of generating and broadcasting the corresponding voice assistance information based on the motion posture data, the running data, and the control command data includes: The motion posture data, the running data, and the control command data are input into the artificial intelligence model to generate and broadcast the corresponding voice assistance information.

13. The control method according to claim 7, characterized in that, The remote controller is communicatively connected to the server; after acquiring the motion posture data of the remote controller, the operating data of the water sports equipment, and the control command data input by the user, the control method further includes: Based on the motion posture data, the user's state of falling into the water is determined; If a user is in the water, an emergency help alarm message is sent to the server.

Images