Remote control loading system
By using head-mounted devices and arm-worn components to wirelessly communicate with the loader, the operation process is simplified, the complexity and communication problems of remote-controlled loaders are solved, the operation efficiency and communication quality are improved, and a better operating experience is provided.
Patent Information
- Application Number
- CN202410612094.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-16
- Publication Date
- 2025-11-18
AI Technical Summary
Existing remote-controlled loaders are complex and labor-intensive to operate, and 5G network communication is costly and unstable, making them difficult to deploy, especially in indoor or short-distance scenarios.
The device uses a head-mounted device and arm-worn components to communicate wirelessly with the loader. It generates control signals by acquiring images, parameters, and arm and head movement information of the operator to control the operation of the loader. It uses short-range wireless communication such as WIFI or Bluetooth to reduce operational complexity and improve communication quality.
Simplify operation procedures, improve operational efficiency, reduce costs, enhance communication quality, provide an immersive operating experience, avoid misoperation, and enable multi-dimensional observation and control.
Smart Images
Figure CN120977099A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the fields of engineering machinery and remote control technology, and more specifically, to a remote-controlled loading system. Background Technology
[0002] As construction machinery continues to evolve towards intelligence, automation, and unmanned operation, remote-controlled loaders have become standard equipment for many manufacturers. However, existing remote-controlled loaders require operators to perform complex operations on a handle-type control panel, which is labor-intensive and time-consuming. Furthermore, existing remote-controlled loaders are based on 5G (5th-Generation Mobile Communication Technology) networks, which are costly, have unstable communication quality, and are difficult to deploy. This is especially true for short-range scenarios where operators only need to be indoors or a short distance away from hazardous environments; in these cases, communication based on 5G networks does more harm than good. Summary of the Invention
[0003] The purpose of this disclosure is to provide a remote-controlled loading system to solve the aforementioned problems existing in the prior art.
[0004] Embodiments of this disclosure provide a remote-controlled loading system, comprising a head-mounted device, an arm-worn assembly, and a loader. The head-mounted device and the arm-worn assembly are capable of wireless communication with the loader, which is equipped with at least one camera.
[0005] The head-mounted device is used to: acquire image and parameter information from the loader, and display the image and parameter information;
[0006] The arm-wearing component is used to: acquire the operator's arm movement information, generate a work control signal based on the acquired arm movement information, and send the work control signal to the loader;
[0007] The loader is used to: operate according to the work control signal, and send the images captured by the camera and the parameter information of the loader to the head-mounted device.
[0008] Optionally, the head-mounted device is further configured to: acquire head movement information of the operator, generate a camera control signal based on the acquired head movement information, and send the camera control signal to the loader; the loader is further configured to: adjust the shooting angle of the at least one camera according to the camera control signal.
[0009] Optionally, the head-mounted device is a VR (Virtual Reality) display helmet.
[0010] Optionally, the arm-wearing assembly includes a right arm-wearing device, wherein the yaw angle of the built-in IMU (Inertial Measurement Unit) module of the right arm-wearing device corresponds to the boom of the loader and the roll angle corresponds to the bucket of the loader.
[0011] Optionally, when the up-and-down swing speed and / or swing amplitude of the right arm of the operator wearing the right arm wearable device is within a set threshold range, the boom of the loader performs corresponding work; when the left-and-right swing speed and / or swing amplitude of the right arm of the operator wearing the right arm wearable device is within a set threshold range, the bucket of the loader performs corresponding work; and when the right arm of the operator wearing the right arm wearable device swings simultaneously in multiple directions, the boom and bucket of the loader perform work according to a preset priority.
[0012] Optionally, the arm-wearing assembly includes a right-hand one-button device, wherein the right-hand one-button device includes four buttons, the four buttons respectively corresponding to the loader's leveling, digging and lifting, unloading and moving center positions.
[0013] Optionally, the arm-wearing assembly includes a left-arm wearable device, wherein the yaw angle of the built-in IMU module of the left-arm wearable device corresponds to the travel speed of the loader and the roll angle corresponds to the travel direction of the loader.
[0014] Optionally, when the up-and-down swing speed and / or swing amplitude of the left arm of the operator wearing the left arm wearable device is within a set threshold range, the loader travels at a corresponding speed; when the left-and-right swing speed and / or swing amplitude of the left arm of the operator wearing the left arm wearable device is within a set threshold range, the loader turns at a corresponding angle; and when the left arm of the operator wearing the left arm wearable device swings simultaneously in multiple directions, the loader's travel speed and travel direction are adjusted according to a preset priority.
[0015] Optionally, the arm-worn device includes a left-hand one-button device, wherein the left-hand one-button device includes three buttons, the three buttons corresponding to the loader's emergency braking, forward movement, and reverse movement, respectively.
[0016] Optionally, if the distance between the head-mounted device and the arm-wearing assembly and the loader is less than a set distance threshold, the head-mounted device and the arm-wearing assembly communicate with the loader via short-range wireless communication, wherein the short-range wireless communication includes at least one of the following: WIFI and Bluetooth.
[0017] The remote-controlled loading system disclosed herein has at least the following advantages:
[0018] In this disclosure, images and parameter information from the loader are displayed through a head-mounted device, and the operator's arm movement information is acquired through an arm-wearing component, thereby generating work control signals to control the operation of the loader. This eliminates the need for complex operations by the operator, reduces the difficulty of operation for the operator, and improves operational efficiency.
[0019] In this disclosure, the operator's head movement information is acquired through a head-mounted device, and a working camera control signal is generated therefrom to control the camera's shooting angle. This allows the operator to easily adjust the camera's shooting angle as needed, achieving multi-directional, blind-spot-free observation, so that the operator can control the loader.
[0020] In this disclosure, the head-mounted device may be a VR display helmet to enable the operator to have an immersive operating experience.
[0021] In this disclosure, the operator's right and left arm movements are acquired through right and left arm wearable devices, thereby enabling control of the loader's boom, bucket, travel speed, and travel direction. Furthermore, the loader can only be operated when the swing speed and / or swing amplitude of the operator's right and left arms are within a set threshold range, thus avoiding misoperation caused by unreasonable arm movements of the operator.
[0022] In this disclosure, the operator can easily control the loader's working actions and driving status through a one-button device on the right hand and a one-button device on the left hand.
[0023] In this disclosure, when the distance between the operator wearing a head-mounted device and an arm-worn component and the loader is less than a set distance threshold, the head-mounted device and the arm-worn component can communicate wirelessly with the loader via short-range wireless communication such as WIFI or Bluetooth, thereby enhancing communication quality and reducing costs in short-range scenarios. Attached Figure Description
[0024] Other details and advantages of this disclosure will become apparent from the detailed description provided below. It should be understood that the following figures are merely schematic and not drawn to scale, and therefore should not be considered as a limitation of this disclosure. A detailed description will follow with reference to the figures, in which:
[0025] Figure 1 A remote-controlled loading system according to a first embodiment of the present disclosure is schematically shown.
[0026] Figure 2 The display interface of a head-mounted device for a remote-controlled loading system according to a first embodiment of the present disclosure is shown. Detailed Implementation
[0027] Embodiments of this disclosure are described below with reference to the accompanying drawings. In the following description, numerous specific details are set forth to enable those skilled in the art to more fully understand and implement this disclosure. However, it will be apparent to those skilled in the art that implementations of this disclosure may not include some of these specific details. Furthermore, it should be understood that this disclosure is not limited to the specific embodiments described. Rather, this disclosure may be practiced with any combination of the features and elements described below, regardless of whether they relate to different embodiments. Therefore, the following aspects, features, embodiments, and advantages are for illustrative purposes only and should not be construed as elements or limitations of the claims unless expressly set forth in the claims.
[0028] Now refer to Figure 1 The diagram schematically illustrates a remote-controlled loading system according to a first embodiment of the present disclosure. For example... Figure 1 As shown, the remote-controlled loading system includes a head-mounted device, an arm-wearing assembly, and a loader. The head-mounted device and the arm-wearing assembly are capable of wireless communication with the loader. At least one camera is mounted on the loader. This at least one camera includes a front-facing camera capable of capturing images of the front of the loader, and several cameras that can optionally capture images of other directions around the loader.
[0029] Specifically, the head-mounted device is used to: acquire image and parameter information from the loader, and display the image and parameter information. The arm-wearing component is used to: acquire the operator's arm movement information, generate work control signals based on the acquired arm movement information, and send the work control signals to the loader. The loader is used to: perform work according to the work control signals, and send images captured by the camera and the loader's parameter information to the head-mounted device.
[0030] Figure 2 The display interface of a head-mounted device for a remote-controlled loading system according to a first embodiment of the present disclosure is shown. For example... Figure 2As shown, the display interface of the head-mounted device is divided into six display areas: a front-view display area, a left-view display area, a right-view display area, a rear-view display area, and two parameter display areas. Those skilled in the art will understand that the specific form and content of the display areas of the head-mounted device's display interface can be adjusted according to actual needs, and these modifications do not exceed the scope of protection of this disclosure.
[0031] In addition, the head-mounted device can also be used to: acquire the operator's head movement information, generate camera control signals based on the acquired head movement information, and send the camera control signals to the loader. Correspondingly, the loader is also used to: adjust the shooting angle of at least one camera according to the camera control signals. Preferably, the head-mounted device can be a VR display helmet.
[0032] Arm-worn components may include a right-arm wearable device, a right-hand one-button device, a left-arm wearable device, and a left-hand one-button device.
[0033] Specifically, the yaw angle of the built-in IMU module of the right arm wearable device can correspond to the boom of the loader, and the roll angle can correspond to the bucket of the loader. Preferably, when the up-and-down swing speed and / or swing amplitude of the right arm of the operator wearing the right arm wearable device is within a set threshold range, the boom of the loader performs corresponding work. When the left-and-right swing speed and / or swing amplitude of the right arm of the operator wearing the right arm wearable device is within a set threshold range, the bucket of the loader performs corresponding work. When the right arm of the operator wearing the right arm wearable device swings simultaneously in multiple directions, the boom and bucket of the loader work according to a preset priority.
[0034] Specifically, the right-hand one-button device may include four buttons, which correspond to the loader's leveling, digging and lifting, unloading and movement center position (the position of the bucket and boom when the loader is moving quickly without load).
[0035] Specifically, the yaw angle of the built-in IMU module of the left arm wearable device can correspond to the loader's travel speed, and the roll angle can correspond to the loader's travel direction. Preferably, when the up-and-down swing speed and / or swing amplitude of the operator's left arm wearing the left arm wearable device is within a set threshold range, the loader travels at the corresponding speed. When the left-and-right swing speed and / or swing amplitude of the operator's left arm wearing the left arm wearable device is within a set threshold range, the loader turns at the corresponding angle. When the operator's left arm wearing the left arm wearable device swings simultaneously in multiple directions, the loader's travel speed and travel direction are adjusted according to a preset priority.
[0036] Specifically, the left-hand one-button device includes three buttons, which correspond to the loader's emergency brake, forward, and reverse functions, respectively.
[0037] Those skilled in the art will understand that the functions implemented by the right arm wearable device, the right hand one-button button device, the left arm wearable device, and the left hand one-button button device can be adjusted according to actual needs. For example, the yaw angle of the built-in IMU module of the right arm wearable device can correspond to the bucket of the loader and the roll angle can correspond to the boom of the loader. The functions implemented by the right arm wearable device and the left arm wearable device can be interchanged, etc. These modifications do not exceed the protection scope of this disclosure.
[0038] Preferably, when the distance between the head-mounted device and the arm-wearing assembly and the loader is less than a set distance threshold, the head-mounted device and the arm-wearing assembly can communicate with the loader via short-range wireless communication. Those skilled in the art will understand that any suitable short-range wireless communication method (e.g., Wi-Fi, Bluetooth) can be used, and these variations do not exceed the scope of this disclosure.
[0039] Industrial applicability
[0040] In this disclosure, images and parameter information from the loader are displayed through a head-mounted device, and the operator's arm movement information is acquired through an arm-wearing component, thereby generating work control signals to control the operation of the loader. This eliminates the need for complex operations by the operator, reduces the difficulty of operation for the operator, and improves operational efficiency.
[0041] In this disclosure, the operator's head movement information is acquired through a head-mounted device, and a working camera control signal is generated therefrom to control the camera's shooting angle. This allows the operator to easily adjust the camera's shooting angle as needed, achieving multi-directional, blind-spot-free observation, so that the operator can control the loader.
[0042] In this disclosure, the head-mounted device may be a VR display helmet to enable the operator to have an immersive operating experience.
[0043] In this disclosure, the operator's right and left arm movements are acquired through right and left arm wearable devices, thereby enabling control of the loader's boom, bucket, travel speed, and travel direction. Furthermore, the loader can only be operated when the swing speed and / or swing amplitude of the operator's right and left arms are within a set threshold range, thus avoiding misoperation caused by unreasonable arm movements of the operator.
[0044] In this disclosure, the operator can easily control the loader's working actions and driving status through a one-button device on the right hand and a one-button device on the left hand.
[0045] In this disclosure, when the distance between the operator wearing a head-mounted device and an arm-worn component and the loader is less than a set distance threshold, the head-mounted device and the arm-worn component can communicate wirelessly with the loader via short-range wireless communication such as WIFI or Bluetooth, thereby enhancing communication quality and reducing costs in short-range scenarios.
[0046] While this disclosure has been described above with reference to preferred embodiments, it is not limited thereto. Any modifications and alterations made by those skilled in the art without departing from the spirit and scope of this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope defined in the claims.
Claims
1. A remote controlled loading system, characterized in that, The remote control loading system comprises a head-mounted device, an arm-mounted component and a loader, the head-mounted device and the arm-mounted component are capable of wireless communication with the loader, the loader is provided with at least one camera, wherein, the head-mounted device is configured to acquire image and parameter information from the loader and display the image and parameter information; the arm-mounted component is configured to acquire hand-arm action information of an operator, generate a work control signal based on the acquired hand-arm action information and send the work control signal to the loader; the loader is configured to work according to the work control signal and send image captured by the camera and parameter information of the loader to the head-mounted device.
2. The remote control loading system according to claim 1, wherein the head-mounted device is further configured to acquire head action information of an operator, generate a camera control signal based on the acquired head action information and send the camera control signal to the loader; the loader is further configured to adjust the shooting angle of the at least one camera according to the camera control signal.
3. The remote controlled loading system according to claim 2, wherein, The head-mounted device is a VR display helmet.
4. The remote controlled loading system of claim 1, wherein, The arm-mounted component comprises a right arm-mounted device, wherein the yaw angle of the built-in IMU module of the right arm-mounted device corresponds to the swing arm of the loader and the roll angle corresponds to the bucket of the loader.
5. The remote control loading system according to claim 4, wherein in the case that the up-and-down swinging speed and / or swinging amplitude of the right arm of the operator wearing the right arm-mounted device is within a set threshold range, the swing arm of the loader works accordingly; in the case that the left-and-right swinging speed and / or swinging amplitude of the right arm of the operator wearing the right arm-mounted device is within a set threshold range, the bucket of the loader works accordingly; and in the case that the right arm of the operator wearing the right arm-mounted device swings in multiple directions at the same time, the swing arm and the bucket of the loader work according to a preset priority.
6. The remote controlled loading system of claim 4, wherein, The arm-mounted component comprises a right-hand one-key button device, wherein the right-hand one-key button device comprises four buttons, which correspond to the flat, digging and lifting, unloading and moving mid-position of the loader respectively.
7. The remote controlled loading system of claim 4, wherein, The arm-mounted component comprises a left arm-mounted device, wherein the yaw angle of the built-in IMU module of the left arm-mounted device corresponds to the running speed of the loader and the roll angle corresponds to the running direction of the loader.
8. The remote control loading system according to claim 7, wherein in the case that the up-and-down swinging speed and / or swinging amplitude of the left arm of the operator wearing the left arm-mounted device is within a set threshold range, the loader runs at a corresponding speed; in the case that the left-and-right swinging speed and / or swinging amplitude of the left arm of the operator wearing the left arm-mounted device is within a set threshold range, the loader turns at a corresponding angle; and In the case that the left arm of the operator wearing the left arm wearing device swings in multiple directions at the same time, the travel speed and travel direction of the loader are adjusted according to a preset priority.
9. The remote controlled loading system of claim 4, wherein, The arm wearing device comprises a left-hand one-key button device, wherein the left-hand one-key button device comprises three buttons corresponding to emergency braking, forward movement and backward movement of the loader respectively.
10. The remote controlled loading system of claim 1, wherein, In the case that the distance between the head-mounted device and the arm wearing assembly and the loader is less than a set distance threshold, the head-mounted device and the arm wearing assembly communicate with the loader through a short-range wireless communication mode, wherein the short-range wireless communication mode comprises at least one of WIFI and Bluetooth.