Control system for construction machinery and control method thereof

Abstract

The present invention relates to a construction machine, a control system thereof, and a control method thereof. A construction machine according to an embodiment of the present invention comprises a machine body on which a selected attachment among a plurality of attachments is replaceably mounted, and a driver's seat equipped with a control panel for controlling the machine body. The control panel is connected via wireless communication to a wireless terminal equipped with an augmented reality camera. Furthermore, when the selected attachment is mounted on the machine body and an attachment dimension input mode is activated on the control panel, the wireless terminal is configured to input dimension information acquired by photographing the attachment with the augmented reality camera from outside the driver's seat to the control panel via wireless communication.

Description

Technology Field

[0001] The present invention relates to a construction machine, a control system thereof, and a control method thereof, and more specifically, to a construction machine that uses interchangeable attachments, a control system thereof, and a control method thereof. Background Technology

[0002] Construction machinery broadly refers to all machinery used in civil engineering or construction work. Generally, construction machinery is equipped with an engine and a hydraulic pump that operates using the engine's power, and it runs or drives various work devices using the hydraulic fluid discharged by the hydraulic pump. In addition, construction machinery is equipped with various attachments depending on the type of work to be performed. For example, an excavator, a type of construction machinery, is used by selectively mounting various attachments, such as excavation buckets, breakers, vibrators, and hammers, on one end of its arm.

[0003] Recently, as construction machinery becomes increasingly electronic, technology is being developed to control the operation of equipment or determine the position and attitude of equipment by combining the actual dimensions of various equipment with the values ​​of sensors mounted on the equipment.

[0004] However, since the various dimensions of the attachments that can be replaced on construction machinery differ depending on the type, in order to precisely control the operation of the equipment with the attachments, the various dimensions of the attached attachments must be entered, and the various dimension information must be changed whenever the type of attached attachment is changed.

[0005] However, conventionally, whenever an attached attachment is replaced, there is the inconvenience of having to manually measure various dimensions on-site using a ruler and input the information. In addition, if the user inputs the dimensions incorrectly, errors may occur, which can lead to problems where the equipment does not operate accurately. The problem to be solved

[0006] Embodiments of the present invention provide a construction machine capable of easily inputting various dimensional information of a changed attachment when replacing an attachment, a control system thereof, and a control method thereof. means of solving the problem

[0007] According to an embodiment of the present invention, a construction machine comprises a machine body on which a selected attachment among a plurality of attachments is interchangeably mounted, and a driver's seat equipped with a control panel for controlling the machine body. The control panel is connected via wireless communication to a wireless terminal equipped with an Augmented Reality (AR) camera. Furthermore, when the selected attachment is mounted on the machine body and an attachment dimension input mode is activated on the control panel, the wireless terminal is configured to input dimension information acquired by photographing the attachment with the Augmented Reality camera from outside the driver's seat to the control panel via wireless communication.

[0008] In addition, according to an embodiment of the present invention, a construction machine control system comprises a machine body on which a selected attachment among a plurality of attachments is replaceably mounted, a driver's seat equipped with a control panel for controlling the machine body, and a wireless terminal connected to the control panel via wireless communication and equipped with an Augmented Reality (AR) camera. Furthermore, when the selected attachment is mounted on the machine body and an attachment dimension input mode is activated on the control panel, the wireless terminal is configured to input dimension information acquired by photographing the attachment with the Augmented Reality camera from outside the driver's seat to the control panel via wireless communication.

[0009] The wireless terminal may further include a display device for displaying information and an input device for inputting information. The wireless terminal may display the plurality of attachments through the display device and receive a selection of the attachment mounted on the machine body through the input device.

[0010] The above wireless terminal can guide the shooting direction on the display device according to the type of attachment selected through the input device.

[0011] The above augmented reality camera may be a marker-based augmented reality (AR) camera. And the wireless terminal may guide the attachment position of the marker on the display device according to the type of attachment selected through the input device.

[0012] In addition, a control method for a construction machine according to an embodiment of the present invention is for controlling a construction machine comprising a control panel for inputting the dimensions of a mounted attachment, wherein a selected attachment among a plurality of attachments is replaceably mounted thereon, and the method comprises the steps of: mounting the attachment to the construction machine; activating an attachment dimension input mode in the control panel; photographing the attachment with a wireless terminal connected to the control panel via wireless communication and equipped with an Augmented Reality (AR) camera; inputting the dimension information of the attachment acquired by the wireless terminal to the control panel via wireless communication; and reflecting the dimension information of the attachment input to the control panel into a control logic.

[0013] The control method of the above-described construction machine may further include the step of selecting the type of attachment to be photographed from the wireless terminal before photographing the attachment with the augmented reality camera.

[0014] When the type of attachment is selected, the above wireless terminal can guide the shooting direction according to the selected type of attachment.

[0015] The augmented reality camera of the above-mentioned wireless terminal may be a marker-based augmented reality (Marker-based AR) camera.

[0016] When the type of attachment is selected, the wireless terminal can guide the attachment position of a marker according to the selected type of attachment. Additionally, the control method of the construction machine may further include the step of attaching a marker to the attachment according to the guidance of the wireless terminal. Effects of the invention

[0017] According to an embodiment of the present invention, a construction machine, a control system thereof, and a control method thereof can easily input various dimensional information of a changed attachment when replacing an attachment. Brief explanation of the drawing

[0018] FIG. 1 is a drawing showing a construction machine and a control system thereof according to one embodiment of the present invention. Figure 2 is a drawing showing the screen of a control panel installed in the driver's seat of the construction machine of Figure 1. FIGS. 3 to 6 are drawings showing screens displayed on the wireless terminal of the construction machine of FIG. 1. Figure 7 is a flowchart showing the control method of the construction machine of Figure 1. Specific details for implementing the invention

[0019] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present invention. The present invention may be embodied in various different forms and is not limited to the embodiments described herein.

[0020] It should be noted that the drawings are schematic and not drawn to scale. The relative dimensions and proportions of parts in the drawings are exaggerated or reduced in size for clarity and convenience in the drawings, and any dimensions are merely illustrative and not limiting. Additionally, the same reference numerals are used to denote similar features for the same structure, element, or part appearing in two or more drawings.

[0021] The embodiments of the present invention specifically illustrate ideal embodiments of the present invention. As a result, various variations of the illustration are expected. Accordingly, the embodiments are not limited to the specific form of the illustrated area and include, for example, variations in form resulting from manufacturing.

[0022] Hereinafter, a construction machine (101) and a construction machine control system (10) according to an embodiment of the present invention will be described with reference to FIGS. 1 to 6.

[0023] For example, the construction machine (101) may be an excavator. And the construction machine (101) may be interchangeably equipped with a selected attachment (115) among a plurality of attachments (115). At this time, the plurality of attachments (115) may include buckets of various sizes, tilt rotators, shovels, breakers, vibrators, and hammers, etc.

[0024] The construction machine control system (10) may include a construction machine (101) and a wireless terminal (500).

[0025] Additionally, the construction machine (101) may include a machine body (110) and a driver's seat (150). A control panel (200) (shown in FIG. 2) may be installed in the driver's seat (150).

[0026] The machine body (110) may include a hydraulic pump (not shown) that generates a flow rate, an arm (112) that operates by the flow rate supplied by the hydraulic pump, and an attachment (115) that is coupled to the arm (112) and performs various operations.

[0027] The driver's seat (150) is provided to control the machine body (110). A user sits in the driver's seat (150) and controls the operation of the machine body (110) through various operating devices and a control panel (200). The control panel (200) can display various information to the user or receive various information from the user. For example, the control panel (200) can be formed as a touch panel capable of performing both display and input functions.

[0028] The wireless terminal (500) can be connected to the control panel (200) of the driver's seat (150) via wireless communication. That is, even if the user moves out of the driver's seat (150) while carrying the wireless terminal (500), the wireless terminal (500) and the control panel (200) can exchange information.

[0029] Additionally, the wireless terminal (500) may include an Augmented Reality (AR) camera, a display device, and an input device.

[0030] When the attachment (115) that has been replaced and mounted on the machine body (110) is photographed by the augmented reality camera of the wireless terminal (500), the wireless terminal (500) is able to acquire various dimensional information of the attachment (115). The wireless terminal (500) transmits the various dimensional information of the attachment acquired by the augmented reality camera to the control panel (200) of the driver's seat (150), and the control panel (200) reflects the various dimensional information of the attachment (115) input from the wireless terminal (500) into the control logic of the machine body (110).

[0031] A markerless augmented reality camera can be used as the augmented reality camera mounted on the wireless terminal (500), but a marker-based augmented reality camera can also be used to improve the accuracy of the dimension measurement.

[0032] The display device of the wireless terminal (500) displays various information to the user, and the input device allows the user to input or select information. For example, a touch panel with integrated display and input functions may be used as the display device and input device.

[0033] Additionally, the wireless terminal (500) can display a plurality of attachments (115) through a display device before photographing the attachment (115) with an augmented reality camera, and can select the attachment (115) currently mounted on the machine body (110) through an input device.

[0034] Additionally, the wireless terminal (500) can guide the attachment position of the marker (700) (shown in FIG. 4) on the display device according to the type of attachment (115) selected through the input device.

[0035] Additionally, the wireless terminal (500) can guide the shooting direction on the display device according to the type of attachment (115) selected through the input device.

[0036] Additionally, the wireless terminal (500) can display a plurality of attachments (115) through a display device and receive a selection of an attachment (115) mounted on the machine body (110) through an input device.

[0037] With such a configuration, the construction machine (101) and the construction machine control system (10) according to one embodiment of the present invention can easily input various dimensional information of the changed attachment (115) when the attachment (115) is replaced.

[0038] Specifically, since the attachment (115) that is replaceably mounted on the construction machine (101) has different dimensions depending on the type, in order to precisely control the operation of the equipment to which the attachment (115) is mounted, the various dimensions of the currently mounted attachment (115) must be accurately entered. In one embodiment of the present invention, whenever the attachment (115) is replaced, the various dimensions of the attachment (115) can be easily measured and reflected in the control logic.

[0039] In other words, not only can the user reduce the inconvenience of having to manually input the information into the control panel (200) after measuring the various dimensions of the attachment (115) one by one using a ruler, but also prevent errors from occurring during the process of the user manually inputting the dimensions into the control panel (200).

[0040] Hereinafter, with reference to FIGS. 2 to 7, a control method for a construction machine (101) according to an embodiment of the present invention will be described in detail.

[0041] First, when an attachment (115) mounted on a construction machine (101) is replaced, as illustrated in FIGS. 2 and FIGS. 7, the user can activate the attachment dimension input mode on the control panel (200). Various dimension information for the replaced attachment (115) must be accurately entered into the control panel (200) so that the operation of the machine body (110) can be controlled by combining values ​​measured by various sensors mounted on the machine body (110), or the position or orientation of the machine body (110) can be accurately determined. In this way, when the attachment dimension input mode of the control panel (200) is activated, the control panel (200) is connected to the wireless terminal (500) via wireless communication. For example, when the attachment dimension input is activated on the control panel (200) and the wireless terminal (500) runs an application, the wireless terminal (500) recognizes the network of the control panel (200) and attempts to establish a wireless connection. That is, before running an application on the wireless terminal (500), the attachment dimension input mode must be activated on the control panel (200) to enter a wireless communication connection waiting state. Here, the wireless communication may be, for example, Wi-Fi or Bluetooth.

[0042] Next, as illustrated in FIGS. 3 and 7, a type of attachment (115) is selected from the wireless terminal (500). Since the dimensions to be measured may differ depending on the type of attachment (115), in order to measure the dimensions accurately, the wireless terminal (500) displays a plurality of attachments (115) to the user through a display device and receives a selection of the type of attachment (115) mounted on the machine body (110) from the user through an input device.

[0043] Next, as illustrated in FIGS. 4 and 7, the wireless terminal (500) guides the attachment location of the marker (700) according to the type of selected attachment (115). Then, the user attaches the marker (700) to the corresponding location according to the guidance of the wireless terminal (500). In FIG. 4, D, G, Q, and N are symbols that guide the attachment location of the marker (700).

[0044] As described above, the process of guiding the attachment position of the marker (700) and attaching the marker (700) accordingly is applied only when the augmented reality camera of the wireless terminal (500) is a marker-based augmented reality (Marker-based AR) camera, and can be omitted when it is a markerless augmented reality (Markerless AR) camera.

[0045] Next, as illustrated in FIGS. 5 and 7, the wireless terminal (500) guides the shooting direction according to the type of selected attachment (115). Then, following the guidance of the wireless terminal (500), the user captures the shape so that all the markers (700) attached to the attachment (115) are captured within the screen.

[0046] Next, as illustrated in FIGS. 6 and 7, when the augmented reality camera of the wireless terminal (500) normally captures the attachment (115) and the wireless terminal (500) obtains the required dimensional information of the attachment (115), the attachment dimensional information is transmitted to the control panel (200) of the driver's seat (150). That is, when the acquisition of various dimensions of the attachment (115) is confirmed, the user presses the completion button on the wireless terminal (500) to transmit the attachment dimensional information to the control panel (200).

[0047] Next, as illustrated in FIG. 7, when the dimension information of the attachment (115) acquired by the wireless terminal (500) is input to the control panel (200) via wireless communication, the control panel (200) reflects the input dimension information of the attachment (115) in the control logic.

[0048] As such, according to the control method of a construction machine (101) according to one embodiment of the present invention, various dimensional information of the changed attachment (115) can be easily entered when the attachment (115) is replaced.

[0049] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art to which the present invention pertains will understand that the present invention may be implemented in other specific forms without changing its technical concept or essential features.

[0050] Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting, and the scope of the invention is defined by the claims set forth below, and all modifications or variations derived from the meaning and scope of the claims and equivalents thereof should be interpreted as being included within the scope of the invention. Explanation of the symbols

[0051] 10: Construction Machinery Control System 101: Construction Machinery 110: Machine body 112: Cancer 115: Attachment 150: Driver's seat 200: Control panel 500: Wireless terminal

Claims

Claim 1 delete Claim 2 A construction machine comprising a machine body on which a selected attachment among a plurality of attachments is replaceably mounted, and a driver's seat equipped with a control panel for controlling the machine body; and a wireless terminal connected to the control panel via wireless communication and equipped with an Augmented Reality (AR) camera, wherein when the selected attachment is mounted on the machine body and an attachment dimension input mode is activated on the control panel, the wireless terminal captures the attachment with the augmented reality camera from outside the driver's seat and acquires dimension information, which is then input to the control panel via wireless communication, and the wireless terminal further comprises a display device for displaying information and an input device for inputting information, wherein the wireless terminal displays the plurality of attachments through the display device, and when a user carries the wireless terminal and moves outside the driver's seat to select the attachment mounted on the machine body through the input device, the wireless terminal guides the shooting direction on the display device according to the type of attachment selected through the input device. Claim 3 delete Claim 4 delete Claim 5 A construction machine control system according to paragraph 2, wherein the augmented reality camera is a marker-based augmented reality (Mark-based AR) camera, and the wireless terminal guides the attachment position of the marker on the display device according to the type of attachment selected through the input device. Claim 6 A method for controlling a construction machine comprising a driver's seat in which a selected attachment among a plurality of attachments is replaceably mounted and a control panel for inputting the dimensions of the mounted attachment is installed, the method comprising: mounting the attachment to the construction machine; activating an attachment dimension input mode in the control panel; photographing the attachment with a wireless terminal connected to the control panel via wireless communication and equipped with an Augmented Reality (AR) camera; and inputting the dimension information of the attachment acquired by the wireless terminal to the control panel via wireless communication. A method for controlling a construction machine, comprising the step of reflecting the dimensional information of the attachment input to the control panel into the control logic, and further comprising the step of selecting the type of attachment to be photographed from the wireless terminal before photographing the attachment with the augmented reality camera, wherein when a user carries the wireless terminal and moves out of the driver's seat and selects the attachment mounted on the machine body through an input device, the wireless terminal guides the shooting direction according to the selected type of attachment. Claim 7 delete Claim 8 delete Claim 9 A method for controlling a construction machine according to claim 6, characterized in that the augmented reality camera of the wireless terminal is a marker-based augmented reality (Mark-based AR) camera. Claim 10 A method for controlling a construction machine according to claim 9, wherein the wireless terminal guides the attachment position of a marker according to the selected attachment type when the type of attachment is selected, and further includes the step of attaching a marker to the attachment according to the guide of the wireless terminal.

Images