Remote cockpit of engineering machinery

Abstract

The invention relates to an engineering machinery remote cockpit in the technical field of engineering machinery. The engineering machinery remote cockpit comprises a control area, a visual feedback system, a sound feedback system and a supporting system. The control area is provided with a seat and a control handle; the visual feedback system comprises a display main screen arranged on one side of the control area and a touchable display auxiliary screen arranged in the control area, and the display main screen is formed by splicing a plurality of main screens and auxiliary screens in a surrounding manner; the sound feedback system is arranged around the control area and is used for feeding back the equipment running state and the working site environment information; the seat is provided with an adjusting device used for adjusting the height, and an elbow support flush with the height of the handle is arranged at the position of the control handle. According to the remote cockpit, wide-view and multi-dimensional operation picture feedback and real sound restoration can be achieved, operation comfort and data transmission stability are both considered, and therefore the safety, real-time performance and man-machine interaction experience of remote control are improved.

Description

Technical Field

[0001] This invention relates to a remote control cockpit for engineering machinery, belonging to the field of engineering machinery technology. Background Technology

[0002] With the development of intelligent and remote technologies in construction machinery, traditional driving operation modes are gradually failing to meet the safety and efficiency requirements of high-risk and high-intensity construction environments. Most existing construction machinery adopts vehicle-mounted control, requiring operators to work in environments with high noise, high vibration, and severe dust for extended periods. This not only results in poor working comfort but also poses certain safety hazards. Furthermore, due to the limited space and complex terrain of construction sites, operators have limited visibility and cannot fully monitor the work area, which can easily lead to operational errors and equipment collisions.

[0003] To address these issues, some construction machinery manufacturers have attempted to introduce remote control technology. This involves using cameras to capture on-site footage and transmit it to a remote control terminal, allowing operators to control the equipment remotely. However, existing remote control systems still have several shortcomings: First, the visual feedback interface of the existing system is mostly a single-screen display with a limited field of view, making it difficult to form an immersive panoramic working view. Operators need to frequently switch perspectives, which affects the operation efficiency. Secondly, the sound feedback is singular and cannot accurately reproduce the operating status of the equipment and the sound of the surrounding environment, making it impossible for operators to judge the equipment load and malfunctions by hearing. Furthermore, some remote control cabins lack ergonomic structural design, with fixed positions for the seats and control handles, which can easily cause fatigue during prolonged operation. In addition, there are delays in signal transmission between devices and insufficient data processing capabilities, making it impossible to achieve real-time and stable remote control. Summary of the Invention

[0004] The purpose of this invention is to overcome the problems of limited visual feedback range, imperfect sound feedback, and insufficient operating comfort in existing remote control systems for engineering machinery.

[0005] To solve the above-mentioned technical problems, the present invention is implemented using the following technical solution: This invention provides a remote control cockpit for engineering machinery, comprising: a control area, equipped with a seat and control handles; A visual feedback system includes a main display screen and a secondary display screen. The main display screen is located on one side of the control area. The secondary display screen is touch-sensitive and is located within the control area. The main display screen comprises five main screens and one secondary screen. The main screen and the secondary screen are arranged in a surround pattern. A sound feedback system is installed around the control area to provide feedback on the equipment's operating status and the work site environment. The support system includes an electrical box, which contains a power distribution box, a server, and a switch for connecting the visual feedback system and the audio feedback system. The seat is equipped with an adjustment device for adjusting the height of the seat; An elbow rest is provided at the control handle, and the elbow rest is located adjacent to the handle, with the height of the elbow rest being the same as the height of the control handle.

[0006] Furthermore, the main screen of the display is set to a surround splicing angle of 160°, and the vertical surround angle is 70°.

[0007] Furthermore, the adjustment range of the device is 10-15cm; the elbow rest is 15-20cm from the center of the handle.

[0008] Furthermore, the visual feedback system also includes: AR depth-of-field labeling function; Driving assistance functions including steering guide lines and distance warning; 360° panoramic imaging system; Obstacle recognition module.

[0009] Furthermore, the operating condition data displayed on the main screen of the monitor is overlaid with the work screen; wherein the transparency of the operating condition data is 30% to 50%. The working condition data includes: working surface slope value, obstacle location, and working boundary marking.

[0010] Furthermore, the sound feedback system emits different types of prompts based on the device status, including: A high-frequency alert tone is used to indicate that the current device load is too high; A low-frequency warning sound is used to indicate any abnormal engine noise.

[0011] Furthermore, the power distribution box provides a stable power supply with voltage fluctuations ≤ ±5%, the server's data processing latency is ≤ 100ms, and the switch's transmission rate is ≥ 100Mbps.

[0012] Furthermore, it also includes a monitor stand, a base, and casters; the monitor stand is used to support the main screen and the secondary screen of the monitor; the base is used to support the control cabin, and the bottom surface of the base is provided with casters for moving the control cabin.

[0013] Compared with related technologies, the beneficial effects achieved by this invention are as follows: This invention enables operators to precisely control remote construction machinery within a fixed space by incorporating a seat and control handles in the control area. A visual feedback system, consisting of a main display screen and a touch-sensitive secondary screen within the control area, significantly expands the operator's field of vision, simultaneously displaying operational images and status information for an intuitive and immersive experience. An audio feedback system, located around the control area, provides real-time feedback on equipment operating status and the working environment, allowing operators to perceive changes visually and audibly, enhancing the realism and safety of remote control. The height-adjustable seat adapts to different operator sizes, improving comfort during extended operation. An elbow rest at the control handle, flush with the handle's height, provides arm support and reduces operator fatigue. This invention's remote control cockpit for construction machinery significantly improves visual immersion, operational comfort, information interaction efficiency, and system stability, resulting in a safe, efficient, and comfortable remote control experience. Attached Figure Description

[0014] Figure 1 The diagram shown is a schematic of the remote control cockpit for engineering machinery provided by the present invention.

[0015] In the picture: 1. Monitor stand; 2. Stand decorative panel; 3. Steering column; 4. Steering wheel; 5. Speakers; 6. Base; 7. Steering wheel; 8. Main monitor screen; 9. Secondary monitor screen; 10. Elbow rest; 12. Electrical box; 13. Armrest box. Detailed Implementation

[0016] The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the embodiments and specific features in the embodiments are detailed descriptions of the technical solution of the present application, rather than limitations thereof. In the absence of conflict, the embodiments and technical features in the embodiments can be combined with each other.

[0017] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0018] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0019] like Figure 1As shown, this embodiment provides a remote cockpit for engineering machinery, including a control area, a visual feedback system, an audio feedback system, and a support system.

[0020] Specifically, the remote control cockpit adopts an integrated cabin design, the base 6 is the main load-bearing structure, and the bottom surface of the base 6 is equipped with steering wheels 7, which facilitates the flexible movement and positioning of the control cabin indoors or at the work site; the control area is located above the base 6, thereby providing control space for the operator.

[0021] The control area is the core area for remote operation, including: The system employs an ergonomically designed adjustable seat with an adjustment device at the bottom. This device allows for height adjustment, with a range of 10-15cm in this embodiment. Based on actual usage tests, it is suitable for operators of different heights, ranging from 150cm to 190cm. The distance between the seat and the control pedals can be adjusted synchronously with the seat height adjustment, ensuring that the operator's legs remain naturally extended when operating the brake and accelerator pedals, effectively reducing leg fatigue caused by prolonged work.

[0022] The control area is equipped with a control handle for controlling the operation of remote construction machinery, specifically including the raising, lowering, and rotating of the excavator bucket; the control handle adopts a shape design that conforms to human grip habits and the surface is made of non-slip material to ensure operation accuracy.

[0023] An elbow rest 10 is provided at the control handle, and the elbow rest 10 is 15-20cm away from the center of the handle, so as to provide elbow support for the operator and avoid shoulder, neck and arm muscle fatigue caused by long-term suspension of the elbow; the height of the elbow rest 10 is flush with the height of the control handle, and in this embodiment, the error is controlled within ≤2cm to ensure that the operator's arm is in a natural and comfortable posture when operating; the surface of the elbow rest 10 is covered with a soft and breathable material, specifically including memory foam or breathable mesh fabric.

[0024] A steering column 3 is located in front of the control area, and a steering wheel 4 is mounted on the steering column 3. The steering column 3 supports angle and height adjustment, and can also be customized according to the operator's sitting posture. Specifically, the steering wheel 4 adopts a multi-functional design and integrates commonly used control buttons, such as horn and light control, to facilitate quick operation by the operator.

[0025] The control area is also equipped with armrest boxes 13, which can be located on both sides of the seat or near the control handle, for placing the operator's personal items, operation manuals or communication equipment, etc.

[0026] In this embodiment, the system also includes a main display screen 8, a secondary display screen 9, and a display stand 1.

[0027] The main display screen 8 is located in front of the control area and adopts a multi-screen splicing layout, specifically including 5 horizontally arranged main screens and 1 secondary screen; the 6 screens are spliced ​​through a combination of hardware and software to achieve a 160° panoramic and 70° vertical field of view coverage; the main display screen 8 is used to display real-time operation images, including video of the working face of the construction machinery and monitoring images of the surrounding environment; at the same time, key operating parameters are superimposed on the main screen, specifically including hydraulic system oil pressure, engine speed, and equipment load data.

[0028] Specifically, the operating data is displayed in a semi-transparent manner, with a transparency setting of 30% to 50%. This ensures clear presentation of data information without obscuring key areas of the screen, allowing operators to intuitively grasp the overall operating status. The operating data includes: slope values ​​of the working surface (such as the slope angle during foundation pit excavation), obstacle locations (such as the relative distance and orientation of pipelines and rocks), and work boundary markings (such as boundary line indicators for the excavation area). When the equipment experiences an abnormal alarm (such as overload or abnormal hydraulic system pressure), the main screen will flash and a red alert box will pop up, prominently reminding the operator to take timely action.

[0029] The secondary display screen 9 is a touch-sensitive display screen, located in the control area, on the right side of the operator or at the center console, so that the operator can perform touch operations without affecting the main control actions.

[0030] The secondary monitor 9 is used to display detailed equipment status information, including equipment operation history, fault diagnosis logs, maintenance reminders, work plans, etc. Operators can use touch operation to view detailed equipment parameters, switch different monitoring views, adjust display settings, etc. The main monitor 8 and the secondary monitor 9 are linked through software to achieve synchronized information updates. For example, when the main monitor 8 displays an alarm for a certain device, the secondary monitor 9 will automatically jump to the detailed fault information page of that device.

[0031] The monitor stand 1 is used to support the main monitor screen 8 and the secondary monitor screen 9, ensuring that the screen is installed stably and at a suitable angle. The monitor stand 1 adopts an adjustable design, which supports fine adjustment of the screen tilt angle and left and right angle to adapt to the viewing habits of different operators. The surface of the stand is provided with a stand decorative plate 2, which serves to beautify the appearance and protect the internal cables of the stand.

[0032] In this embodiment, the visual feedback system also integrates multiple intelligent auxiliary functions to enhance the intuitiveness and safety of operation. On the real-time operation screen 8, AR technology is used to mark the distance between the bucket, grab bucket, and other operating components and the target in real time, avoiding inaccurate loading or collisions caused by visual deviations. For example, when the excavator is operating, the main screen 8 will display a real-time mark stating "bucket is 1.2 meters from the ground".

[0033] When the construction machinery is in motion, the main display screen 8 will show steering guide lines to indicate the best driving trajectory, which is especially suitable for rough roads or narrow spaces. At the same time, the system will warn of possible collision risks based on vehicle speed and steering angle, and display distance warning information on the main display screen 8, such as "obstacle ahead 3 meters".

[0034] In addition, by installing multiple cameras around the construction machinery, the system can synthesize a 360° panoramic image, eliminating blind spots within 1.5 meters around the vehicle. Operators do not need to frequently turn their heads to grasp the distribution of obstacles in front, behind, left, and right through the main display screen 8 or the secondary display screen 9, which greatly reduces the difficulty of operation and safety risks.

[0035] Specifically, the system also integrates obstacle recognition algorithms based on image recognition and deep learning, which can accurately capture dangerous targets such as pedestrians, protruding rocks, underground pipelines, and trees. Once a dangerous obstacle is detected, the system will pop up an alarm window within milliseconds and mark the location of the obstacle with a red box on the screen to remind operators to avoid it.

[0036] In this embodiment, since the sound feedback system is set around the control area, it can fully restore the work site environment and equipment operation from an auditory perspective. The sound feedback system can be selected as: speaker 5, power amplifier and headphones.

[0037] In this embodiment, a speaker 5 is selected as the main sound sensing source. Specifically, the speaker 5 is set on the left and right sides of the control area and adopts a stereo layout, which can realistically reproduce the spatial sound field of the work site. The sound content played by the speaker 5 includes: the running sound of the construction machinery engine, the working sound of the hydraulic system, the sound of the bucket contacting the ground, and the ambient sound of the surrounding environment. Through sound feedback, the operator can judge the operating status of the equipment based on auditory experience. For example, abnormal engine sound may indicate a potential fault.

[0038] This embodiment also provides different types of prompting sounds emitted by the device in different states, thereby helping operators to quickly identify abnormal situations. The prompting sounds include: high-frequency prompting sounds and low-frequency prompting sounds. When the equipment load exceeds the limit, such as excessive digging resistance or excessive hydraulic system pressure, the system will emit a high-frequency "beep beep beep" warning sound with a frequency of about 2000 to 3000 Hz. This sound has strong penetrating power and can quickly attract the attention of the operator.

[0039] When the engine makes abnormal noises or other signs of mechanical failure, the system emits a low-frequency "buzzing" warning sound, with a frequency of approximately 200 to 500 Hz, to remind the operator that there may be a mechanical problem with the equipment and that it needs to be checked in time.

[0040] The sound feedback system also includes an amplifier and headphones: the amplifier is used to amplify and optimize the audio signal to ensure clear and distinct sound. At the same time, the system supports wired or wireless headphone access, and operators can choose to use speakers or headphones depending on the working environment. In situations where quiet operation is required, operators can wear headphones to obtain complete sound feedback without causing noise interference to the surrounding environment.

[0041] The support system includes an electrical box 12, which contains a power distribution box, a server, and a switch.

[0042] The power distribution box provides a stable power supply for the visual feedback system, sound feedback system, control system, and other components. Utilizing high-precision voltage regulation technology, the box controls voltage fluctuations within ≤±5%, ensuring that electronic equipment is unaffected by voltage fluctuations during long-term operation, thus guaranteeing system stability and equipment lifespan. The distribution box also integrates overload protection and short-circuit protection functions to effectively prevent electrical faults. The server receives real-time data from remote engineering machinery, processes, analyzes, and distributes it in real time. Employing a high-performance processor and large-capacity memory, the server controls data processing latency to ≤100ms, ensuring that the operator's visuals and audio are almost synchronized with the on-site operation, meeting the needs of precise remote control.

[0043] The server also supports multiple industrial communication protocols, such as CAN bus protocol, Modbus protocol, OPC-UA protocol, etc., and can be connected with remote control modules of different brands and models of construction machinery to achieve universal control of "one place to control multiple machines".

[0044] In this embodiment, a scene switching function is also provided, allowing operators to select a work scene mode on the secondary display screen 9, including: Mine tunneling mode: The visual feedback system highlights information such as tunnel width, support status, and gas concentration; the sound feedback system improves the sensitivity to identify abnormal vibrations and falling object sounds.

[0045] Road paving mode: The visual feedback system highlights information such as paving thickness, smoothness, and edge alignment lines; the sound feedback system monitors the screed temperature and vibration frequency of the paver.

[0046] Excavation mode of foundation pit: The visual feedback system highlights information such as slope gradient, excavation depth, and location of support structure; the sound feedback system monitors the sound of earth unloading and bucket collision.

[0047] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A remote control cockpit for engineering machinery, characterized in that, include: The control area includes a seat and control handles; The visual feedback system includes a main display screen (8) and a secondary display screen (9). The main display screen (8) is located on one side of the control area. The secondary display screen (9) is touch-sensitive and is located within the control area. The main display screen (8) includes 5 main screens and 1 secondary screen. The main screen and the secondary screen are arranged in a surround pattern. A sound feedback system is installed around the control area to provide feedback on the equipment's operating status and the work site environment. The support system includes an electrical box (12), which contains a power distribution box, a server and a switch for connecting the visual feedback system and the sound feedback system. The seat is equipped with an adjustment device for adjusting the height of the seat; An elbow rest (10) is provided at the control handle. The elbow rest (10) is located adjacent to the handle, and the height of the elbow rest (10) is the same as the height of the control handle.

2. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The main screen (8) of the display is set to a surround splicing angle of 160° and a top and bottom surround angle of 70°.

3. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The adjustment device has a range of 10-15cm; the elbow support (10) is 15-20cm away from the center of the handle.

4. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The visual feedback system also includes: AR depth-of-field labeling function; Driving assistance functions including steering guide lines and distance warning; 360° panoramic imaging system; Obstacle recognition module.

5. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The main screen (8) of the display shows the working condition data and the work screen superimposed; wherein the transparency of the working condition data is 30% to 50%; The working condition data includes: working surface slope value, obstacle location, and working boundary marking.

6. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The sound feedback system emits different types of prompts based on the device status, including: A high-frequency alert tone is used to indicate that the current device load is too high; A low-frequency warning sound is used to indicate any abnormal engine noise.

7. The remote control cockpit for engineering machinery according to claim 1, characterized in that, The power distribution box provides a stable power supply with voltage fluctuations ≤ ±5%, the server's data processing latency is ≤ 100ms, and the switch's transmission rate is ≥ 100Mbps.

8. The remote control cockpit for engineering machinery according to claim 1, characterized in that, It also includes a monitor bracket (1), a base (6) and a steering wheel (7); the monitor bracket (1) is used to support the main screen (8) and the secondary screen (9) of the monitor; the base (6) is used to support the control cabin, and the bottom surface of the base (6) is provided with a steering wheel (7) for moving the control cabin.

Images