Crane device

Abstract

To provide a crane device capable of eliminating a blind spot regardless of the type and the specification of a device or capable of eliminating a blind spot according to the request of an operator.SOLUTION: A crane device 12 comprises a safety device 17. The safety device 17 comprises a wide angle camera 18, a display 84 installed in a cabin, and a controller 70. The wide angle camera 18 is installed on the upper surface of a boom, and sets the surrounding area of a boom tip, the area facing the upper surface of the boom, the side area of the boom, and the rear area of the cabin as a shooting range. The controller 70 determines the types of monitoring images to be displayed on a display 84 based on first specification information stored in a memory 72 according to the specification and on second specification information indicating screen specification by the operator, and generates the monitoring image data indicating the monitoring image of the determined type based on the captured image data output by the wide angle camera 18.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a crane apparatus having a boom that can be swiveled, raised, and extended. [Background technology]

[0002] Patent Document 1 discloses a crane apparatus including a rotating base and a boom mounted on the rotating base. The boom is capable of raising and lowering and extending. A sensor is provided at the tip of the boom as a safety device. The sensor detects an obstacle approaching the tip of the boom. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] WO2022-092093 publication Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, there are various types of crane equipment, including mobile types such as rough terrain cranes and all-terrain cranes, as well as fixed types such as tower cranes. Even for the same type of crane equipment, the size and working radius vary depending on the specifications (model), and the blind spot of the operator during operation changes. For example, with one model, the blind spot is the area on the top side of the boom, while with another model, the blind spot is the area around the tip of the boom, and in some cases, both of these areas are blind spots. In this way, the blind spot of the boom that needs to be monitored varies depending on the model of the crane equipment.

[0005] To ensure the safety of work, measures are required that enable the operator to monitor the above-mentioned areas and eliminate blind spots. However, it is difficult to monitor blind spots that change depending on the specifications of the crane device using the above-mentioned sensors. Moreover, the above-mentioned areas (blind spots that need to be eliminated) also differ depending on the needs of the operator who actually operates the boom.

[0006] The present invention has been made against this background, and an object of the present invention is to provide a crane apparatus that can eliminate blind spots regardless of the type or specifications of the apparatus, or that can eliminate blind spots according to the operator's request. [Means for solving the problem]

[0007] (1) A crane apparatus according to the present invention includes a rotating base, a cabin mounted on the rotating base and having a control device installed therein, a boom rotatably provided on the rotating base and capable of extending and retracting, and a safety device having a wide-angle camera attached to an upper surface of the boom in a lowered position, a controller, and a display. The controller executes a generation process for generating surveillance image data based on captured image data generated by the wide-angle camera, and a display process for displaying a surveillance image indicated by the surveillance image data on the display.

[0008] Since the wide-angle camera is attached to the top surface of the boom, it can capture images of the area around the tip of the boom, the side area of ​​the boom, the area facing the top surface of the boom, and the rear area around the base end of the boom all at once. The controller generates monitoring image data from the captured image data for an area indicated by a setting previously stored in the memory or an area specified by the operator (generation process), inputs the monitoring image data to a display, and displays the monitoring image on the display (display process). Therefore, the safety device can display a monitoring image of a blind spot on the display, even if the blind spot is an area determined by the type or specifications or an area desired by the operator, such as an area around the tip of the boom, a side area of ​​the boom, an area facing the top surface of the boom, or a rear area around the base end of the boom. Therefore, the crane apparatus according to the present invention can eliminate blind spots regardless of the type or specifications, or can eliminate blind spots according to the operator's request.

[0009] (2) The controller may further execute a designation information acquisition process for acquiring designation information. The generation process is one or more processes indicated by the designation information among a first process of generating boom-tip monitoring image data by correcting the captured image data based on a first correction standard corresponding to the tip of the boom shown in the captured image indicated by the captured image data, a second process of generating boom side monitoring image data by correcting the captured image data based on a predetermined second correction standard in an area shown in the captured image indicated by the captured image data that is on the side of the boom, a third process of generating boom top side monitoring image data by correcting the captured image data based on a predetermined third correction standard in an area shown in the captured image indicated by the captured image data that faces the top surface of the boom, and a fourth process of generating rear monitoring image data by correcting the captured image data based on a fourth correction standard corresponding to the base end of the boom shown in the captured image indicated by the captured image data.

[0010] The designation information is, for example, stored in advance in a memory included in the controller, or input by the operator to the controller. The controller reads out the designation information from the memory, or receives and acquires the designation information input by the operator. The controller executes one of the first to fourth processes, which is designated by the designation information, as a generation process to generate monitoring image data. Therefore, an appropriate monitoring image according to the type and specifications of the crane apparatus is displayed on the display, or an appropriate monitoring image designated by the operator is displayed on the display.

[0011] (3) The crane apparatus according to the present invention may further include a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle. The fourth process includes a process of correcting the captured image data based on the fourth correction standard, and a conversion process of converting a viewpoint based on the boom hoisting angle indicated by the first detection value. The rear monitoring image indicated by the rear monitoring image data is an overhead image showing a rear of the cabin.

[0012] The position and height of the wide-angle camera relative to the swivel base change as the boom is hoisted. A conversion process is performed to create an overhead image based on the boom hoist angle, which is a parameter that determines the position and height of the wide-angle camera. Therefore, regardless of the boom hoist angle, a rear monitoring image that overlooks the rear of the cabin from a fixed position is always displayed on the display.

[0013] (4) The crane apparatus according to the present invention may further include a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle. The second process further includes a process of correcting the captured image data based on the second correction standard, and a rotation process of rotating a boom side monitoring image, which is a monitoring image indicated by the boom side monitoring image data, by a rotation angle corresponding to the boom hoisting angle indicated by the first detection value.

[0014] The boom side monitoring image tilts in response to the boom hoisting angle. The controller rotates the boom side monitoring image in response to the boom hoisting angle to correct the tilt of the boom side monitoring image. Therefore, the crane apparatus according to the present invention can make it easier for the operator to recognize obstacles compared to a case in which the tilt of the boom side monitoring image is not corrected.

[0015] (5) The crane apparatus according to the present invention may further include a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle. The controller executes the third process based on the designation information indicating execution of the third process, and executes a first enlargement process to enlarge a boom top side monitoring image indicated by the boom top side monitoring image data generated in the third process before executing the display process based on a determination that the boom is being raised based on a change over time in the hoisting angle indicated by the first detection value.

[0016] When the boom is being raised, there is a risk of the top surface of the boom coming into contact with an obstacle. When the boom is being raised, the controller enlarges and displays the boom top side monitoring image. Therefore, the crane apparatus according to the present invention makes it easier for the operator to recognize obstacles compared to when the boom top side monitoring image is always displayed at a constant size on the display.

[0017] (6) The crane apparatus according to the present invention may further include a rotation angle sensor that outputs a second detection value indicating a rotation angle of the rotation base. The boom side monitoring image data includes boom left side monitoring image data indicating the left side of the boom and boom right side monitoring image data indicating the right side of the boom. The controller executes the second process based on the designation information indicating execution of the second process, executes a second enlargement process of enlarging a boom left side monitoring image indicated by the boom left side monitoring image data generated in the second process before executing the display process based on the determination of left rotation based on the second detection value, and executes a third enlargement process of enlarging a boom right side monitoring image indicated by the boom right side monitoring image data generated in the second process before executing the display process based on the determination of right rotation based on the second detection value.

[0018] When the boom is being rotated, there is a risk of contact between the side of the boom and an obstacle. The controller enlarges and displays the boom left side monitoring image when the boom is being rotated left, and enlarges and displays the boom right side monitoring image when the boom is being rotated right. Therefore, the crane apparatus according to the present invention makes it easier for the operator to recognize obstacles compared to a case in which the boom side monitoring image is always displayed on the display at a constant size.

[0019] (7) The boom may have a plurality of cylinders including a base boom. The wide-angle camera is provided on the base boom.

[0020] Since the wide-angle camera is mounted on the base boom, whose position does not change with the extension and contraction of the boom, a wired connection between the wide-angle camera and the controller is easier than when the wide-angle camera is mounted on another cylindrical body, whose position changes with the extension and contraction of the boom.

[0021] (8) The crane apparatus according to the present invention may further include a boom length sensor that outputs a third detection value indicating an extended length of the boom. The boom has a plurality of cylindrical bodies including a base boom. The wide-angle camera is provided on the base boom. The first process includes a process of correcting the captured image data based on the first correction standard, and a fourth enlargement process of enlarging the captured image data by a magnification factor corresponding to the third detection value.

[0022] If a wide-angle camera is provided on the base boom, the tip of the boom moves away from the wide-angle camera as the boom extends. The boom-tip monitoring image, which is the monitoring image shown by the boom-tip monitoring image data, is enlarged at a magnification rate according to the extended length of the boom, making it easier for the operator to recognize obstacles approaching the tip of the boom.

[0023] (9) The angle of view of the wide-angle camera may be 180 degrees or more.

[0024] A wide-angle camera with a field of view of 180 degrees or more is used. Effect of the Invention

[0025] The crane apparatus according to the present invention can eliminate blind spots regardless of the type or specifications of the apparatus, or can eliminate blind spots according to the operator's request. [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 is a functional block diagram of a crane apparatus 12. [Diagram 2] FIG. 2 is a schematic side view of the crane vehicle 10 with the boom 22 raised. [Diagram 3]FIG. 3 is a schematic side view of the mobile crane 10 in a lowered position with the boom 22 lowered. [Figure 4] FIG. 4 is a diagram showing the control device 29 inside the cabin 13. [Diagram 5] FIG. 5 is a flowchart of the monitoring image display process. [Figure 6] Figure 6(A) is a schematic diagram of an image captured by wide-angle camera 18, Figure 6(B) is a diagram showing a rear monitoring image, Figure 6(C) is a diagram showing a monitoring image of the left side of the boom, Figure 6(D) is a diagram showing a monitoring image of the right side of the boom, Figure 6(E) is a diagram showing a monitoring image of the boom tip, and Figure 6(F) is a diagram showing a monitoring image of the top side of the boom. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] An embodiment of the present invention will be described below. Note that the embodiment described below is merely one example of the present invention, and it goes without saying that the embodiment can be appropriately modified without changing the gist of the present invention. For example, the execution order of each process described below can be appropriately modified without changing the gist of the present invention. Alternatively, a part of the process described below can be appropriately omitted without changing the gist of the present invention.

[0028] Fig. 1 is a functional block diagram of the crane apparatus 12. Fig. 2 is a side view of the mobile crane 10 with the boom 22 in an upright position. Fig. 3 is a schematic side view of the mobile crane 10 with the boom 22 in a lowered position.

[0029] 2 and 3, the mobile crane 10 is a rough terrain crane. However, the mobile crane 10 may also be an all-terrain crane.

[0030] The crane vehicle 10 includes a running body 11, an outrigger device 14 attached to the running body 11, and a crane device 12 and a cabin 13 mounted on the running body 11. Note that the outrigger device 14 is not shown in FIG. 3.

[0031] The outrigger unit 14 has a plurality of jacks 24 that contact the ground to stabilize the attitude of the crane vehicle 10. The crane unit 12 is used in a state in which the jacks 24 are extended and the attitude of the crane vehicle 10 is stable.

[0032] The crane equipment 12 has a swivel base 21, a boom 22, a winch 23, a group of sensors 26 (see Figure 1), a group of hydraulic actuators 27 (see Figure 1), a hydraulic supply unit 28 (see Figure 1), a steering device 29 (see Figure 1), a hook block 32, and a safety device 17 (see Figure 1).

[0033] The swivel base 21 is rotatably held by the running body 11. The rotation axis of the swivel base 21 is aligned in the vertical direction (up-down direction) and is located approximately in the center of the running body 11.

[0034] The boom 22 is supported by the swivel base 21 so as to be able to rise and fall. That is, the boom 22 is able to rise and fall and is able to rotate.

[0035] The boom 22 includes a base boom 42, an intermediate boom 43, and a top boom 44. The base boom 42, the intermediate boom 43, and the top boom 44 are each a rectangular tube. The intermediate boom 43 is located inside the base boom 42, and the top boom 44 is located inside the intermediate boom 43. That is, the base boom 42, the intermediate boom 43, and the top boom 44 are arranged in a nested manner, forming a so-called telescopic structure. The boom 22 expands and contracts as the intermediate boom 43 slides relative to the base boom 42 and the top boom 44 slides relative to the intermediate boom 43. The base boom 42, the intermediate boom 43, and the top boom 44 correspond to the "cylinder" described in the claims. The boom 22 may be composed of two cylinders, or may be composed of four or more cylinders.

[0036] The base boom 42 is located on the outermost side. Therefore, the outer surface of the base boom 42 is always exposed to the outside. The square cylindrical base boom 42 has an upper surface 45 which becomes the upper surface when the boom 22 is in the horizontally laid down position (see FIG. 3). A wide-angle camera 18, which will be described later, is provided on the upper surface 45.

[0037] The boom 22 is supported by the swivel base 21 at the base boom 42 so that it can be raised and lowered. In other words, the base boom 42 does not move (slide) when the boom 22 is extended or retracted. In other words, the position of the wide-angle camera 18 attached to the base boom 42 does not change when the boom 22 is extended or retracted.

[0038] The winch 23 is attached to the base end of the boom 22 or to the swivel base 21. The winch 23 has a drum 56 around which the wire rope 41 (hereinafter referred to as "wire 41") is wound, and a sheave 57 around which the wire 41 is wound. When the winch 23 is driven, the wire 41 is wound onto the drum 56 or is unwound from the drum 56. Note that the winch 23, wire 41, sheave 57, drum 56, etc. are not shown in FIG. 3.

[0039] The wire 41 is looped around a sheave 57 provided at the base end of the boom 22, a sheave 58 provided at the tip of the boom 22, and a pulley device (not shown). The pulley device has a plurality of first sheaves (not shown) provided at the tip of the boom 22, and a plurality of second sheaves (not shown) provided on the hook block 32. Note that the hook block 32 is not shown in FIG. 3.

[0040] The hook block 32 comprises a hook body 33, a plurality of the second sheaves rotatably held within the hook body 33, and a hook 34 provided on the underside of the hook body 33.

[0041] Two winches 23 may be provided on the crane apparatus 12. A hook block 32, which is a so-called main hook, is connected to a wire 41 of one winch 23, and a sub-hook (not shown) is connected to the wire 41 of the other winch 23.

[0042] As shown in FIG. 1, the hydraulic actuator group 27 includes a swing motor 51, a hoisting cylinder 52, a telescopic cylinder 53, a hydraulic motor 54, and the jack 24.

[0043] The swing motor 51 is a hydraulic motor that rotates via hydraulic oil supplied from the hydraulic supply unit 28, and rotates the swing base 21. The hoisting cylinder 52 is a hydraulic cylinder that expands and contracts via hydraulic oil supplied from the hydraulic supply unit 28, and raises and lowers the boom 22. The telescopic cylinder 53 is a hydraulic cylinder that expands and contracts via hydraulic oil supplied from the hydraulic supply unit 28, and extends and lowers the boom 22. The hydraulic motor 54 rotates via hydraulic oil supplied from the hydraulic supply unit 28, and rotates the drum 56 of the winch 23.

[0044] The hydraulic supply device 28 includes a hydraulic pump driven by the engine 15 mounted on the traveling body 11, piping connecting the hydraulic pump to the swing motor 51 and the like of the hydraulic actuator group 27, and a hydraulic switching valve and the like provided on the piping and the like. The hydraulic switching valve may be a so-called electromagnetic valve, and is driven by a drive signal input from the controller 70. The swing motor 51, the hoisting cylinder 52, the telescopic cylinder 53, the hydraulic motor 54, and the jack 24 are driven by the electromagnetic valve being driven. In other words, the controller 70 can swing, hoist, and extend the boom 22, reel in or pay out the wire 41, and extend or contract the jack 24 by outputting a drive signal.

[0045] The sensor group 26 includes a swing angle sensor 61 , a boom length sensor 62 , and a hoisting angle sensor 63 .

[0046] The swivel angle sensor 61 outputs a detection value corresponding to the swivel angle from the swivel reference position of the swivel base 21. The swivel reference position is a position in the state shown in FIG. 3 where the boom 22 protrudes forward. The swivel angle sensor 61 is, for example, a rotary encoder provided on the swivel shaft of the swivel base 21. The swivel angle sensor 61 outputs a number of pulse signals corresponding to the swivel angle of the swivel base 21 as a detection value. In the following, the swivel angle is described as an angle in a counterclockwise direction from the swivel reference position. That is, the swivel angle increases when the boom 22 swivels left and decreases when the boom 22 swivels right. The detection value output by the swivel angle sensor 61 corresponds to the "second detection value" described in the claims.

[0047] The boom length sensor 62 outputs a detection value corresponding to the length of the boom 22. The detection value output by the boom length sensor 62 may indicate the length from the base end to the tip end of the boom 22, or may indicate the extended length of the boom 22. The boom length sensor 62 may be a sensor that outputs a detection value that directly indicates the boom length, a sensor that outputs a detection value that indicates the extended length of the telescopic cylinder 53, or a sensor that outputs a detection value that indicates the drive time of the telescopic cylinder 53. The detection value output by the boom length sensor 62 corresponds to the "third detection value" recited in the claims.

[0048] The hoisting angle sensor 63 outputs a detection value corresponding to the hoisting angle of the boom 22. The hoisting angle sensor 63 is, for example, an inclination sensor or a horizontal sensor that outputs the angle with respect to the horizontal plane. Alternatively, the hoisting angle sensor 63 may be a sensor that outputs a detection value indicating the extension length or drive time of the hoisting cylinder 52. The detection value output by the hoisting angle sensor 63 corresponds to the "first detection value" recited in the claims.

[0049] In the following description, the detection values ​​output by the swing angle sensor 61, the boom length sensor 62, and the hoisting angle sensor 63 are also referred to as "sensor detection values."

[0050] The swing angle sensor 61, the boom length sensor 62, and the hoisting angle sensor 63 are connected to the controller 70 by cables. That is, the sensor detection values ​​output by the swing angle sensor 61, etc. are input to the controller 70. The sensor detection values ​​output by each sensor may be input to the controller 70 by wireless communication.

[0051] Each sensor such as the turning angle sensor 61 performs detection continuously at a predetermined time interval (so-called sampling period / sampling cycle) and outputs a sensor detection value at the predetermined time interval.

[0052] FIG. 4 is a diagram showing the control device 29 inside the cabin 13.

[0053] 4, the control device 29 is disposed in the cabin 13. The control device 29 includes an operation lever, a foot pedal, an operation button, and the like that are operated by the operator.

[0054] The control device 29 is connected to a controller 70 (see FIG. 1) by a signal line (not shown). An operator operates the control device 29 to input instructions to the controller 70, and controls the crane apparatus 12.

[0055] As shown in Fig. 4, the control monitor device 80 is installed in the cabin 13. As shown in Fig. 1, the control monitor device 80 includes a display 81, a transparent sheet-like touch sensor 82 overlaid on the display 81, and a speaker 83. In other words, the control monitor device 80 is a so-called AML.

[0056] The operator inputs (selects) image designation using the touch sensor 82. The image designation is information showing one or more images among the rear monitoring image shown in Fig. 6(B), the boom left side monitoring image shown in Fig. 6(C), the boom right side monitoring image shown in Fig. 6(D), the boom tip monitoring image shown in Fig. 6(E), and the boom top side monitoring image shown in Fig. 6(F). The operator inputs designation of one or more images to be displayed on the display 84 out of the above five images through the touch sensor 82. The input image designation is stored in the memory 72 (see Fig. 1) as second designation information.

[0057] As shown in FIG. 1, the safety device 17 includes a wide-angle camera 18, a display 84, and a controller 70.

[0058] The wide-angle camera 18 includes a condenser lens, an optical system, a plurality of image sensors, a control circuit, and a communication interface. The condenser lens is a so-called wide-angle lens or a fisheye lens, and the wide-angle camera 18 is a so-called wide-angle camera or a fisheye camera.

[0059] The optical system has, for example, multiple lenses, and guides light focused by a focusing lens to an imaging element. The multiple imaging elements are image sensors such as CCD or CMOS. The multiple imaging elements are arranged in a matrix (grid). The multiple imaging elements output image data according to the incident light. The image data consists of multiple pixel data and pixel position data. When the captured image is a color image, one pixel data consists of, for example, three color pixel data. The control circuit captures images using the wide-angle camera 18 and generates image data. The communication interface converts the image data into transmission data and outputs it. The control circuit is, for example, a driver IC, and the communication interface is, for example, a communication IC.

[0060] 2 and 3, wide-angle camera 18 is attached to upper surface 45 of base boom 42. Wide-angle camera 18 is disposed away from the base end of base boom 42. In other words, wide-angle camera 18 is located at a position higher than swivel base 21 when boom 22 is raised (crane operation state). Therefore, the rear monitoring image (see FIG. 6(B)) generated from the image captured by wide-angle camera 18 shows a wide range behind cabin 13. In other words, by attaching wide-angle camera 18 to upper surface 45 of boom 22, a wider range behind cabin 13 can be displayed as an overhead image than when wide-angle camera 18 is attached to swivel base 21.

[0061] 2 and 3, the wide-angle camera 18 is disposed closer to the tip side than the center of the base boom 42 so as to be able to generate a rear monitoring image (see FIG. 6(B)) that captures a wider range. However, the wide-angle camera 18 may be disposed at the center of the base boom 42, or may be disposed closer to the base end side than the center.

[0062] Wide-angle camera 18 may be a monochrome camera that outputs image data representing a monochrome image, or a color camera that outputs image data representing a color image. Moreover, the image data output by wide-angle camera 18 may be data representing a still image, or may be video data consisting of multiple frames.

[0063] 2 and 3 indicate the imaging range (angle of view) of wide-angle camera 18. As shown in Fig. 2 and 3, the mounting position of wide-angle camera 18 and the angle of view of wide-angle camera 18 are determined so that the imaging range of wide-angle camera 18 includes the tip of boom 22, the left and right sides of boom 22, the area facing top surface 45 of boom 22, and the rear of cabin 13. In other words, the imaging range of wide-angle camera 18 includes all of the areas around the tip of boom 22, the area on the left side of boom 22, the area on the right side of boom 22, the area facing top surface 45 of boom 22, and the rear area of ​​cabin 13.

[0064] The angle of view of wide-angle camera 18 is set to 180 degrees or more. In the example shown in Figures 2 and 3, the angle of view of wide-angle camera 18 is 220 degrees. The angle of view of a wide-angle camera is generally up to 220 degrees. In other words, the angle of view of wide-angle camera 18 is set in the range of 180 degrees or more and less than 220 degrees.

[0065] 1, the wide-angle camera 18 and the controller 70 are connected by a cable 19. Captured image data output by the wide-angle camera 18 is input to the controller 70 through the cable 19. However, the captured image data may also be input to the controller 70 by wireless communication. In this case, a battery and a transmitting antenna are attached to the boom 22, and a receiving antenna connected to the controller 70 by a communication line is installed in the cabin 13. The wide-angle camera 18 captures images using power supplied from the battery and transmits the captured image data from the transmitting antenna. The transmitted captured image data is received by the receiving antenna and input to the controller 70.

[0066] The wide-angle camera 18 captures images continuously at a predetermined time interval and outputs captured image data at the predetermined time interval, or alternatively, the wide-angle camera 18 continuously outputs video data made up of a plurality of frames.

[0067] As shown in FIG. 4, the display 84 is installed in the cabin 13. As shown in FIG. 1, the display 84 is connected to the controller 70 by a signal line. The display 84 displays an image indicated by image data input from the controller 70. Specifically, the display 84 displays a rear monitoring image shown in FIG. 6(B), a boom left side monitoring image shown in FIG. 6(C), a boom right side monitoring image shown in FIG. 6(D), a boom tip monitoring image shown in FIG. 6(E), and a boom top side monitoring image shown in FIG. 6(F). The display 84 corresponds to the "display" described in the claims. The above five images may be displayed on the display 81 of the control monitor device 80. In that case, the display 81 corresponds to the "display" described in the claims.

[0068] 1, the controller 70 includes a CPU 71 which is a central processing unit, a memory 72, a power supply circuit 74, and a communication bus (not shown). The controller 70 is realized by, for example, an IC mounted on a control board, a computer, resistors, diodes, coils, capacitors, etc. The control board is disposed, for example, in a control box disposed in the cabin 13.

[0069] The CPU 71, memory 72, hydraulic supply device 28, rotation angle sensor 61 of sensor group 26, wide-angle camera 18, and control device 29 are connected to a communication bus (not shown). A control program 75 executed by CPU 71, which will be described later, reads data and information from memory 72, stores the data and information in memory 72, and controls the driving of hydraulic actuator group 27. In addition, control program 75 acquires sensor detection values ​​output by sensor group 26, captured image data output by wide-angle camera 18, and inputs made by the operator to control monitor device 80 and control device 29.

[0070] The memory 72 stores in advance an OS 77, which is an operating system, and a control program 75 executed by the CPU 71. The memory 72 also stores in advance first designation information, and stores the above-mentioned second designation information indicating an image designation input by the operator through the control monitor device 80. The first designation information corresponds to the "designation information" described in the claims. The second designation information corresponds to the "designation information" described in the claims. The first designation information and the second designation information correspond to the "designation information" described in the claims.

[0071] The first designation information, like the second designation information, is information indicating one or more of the five images. The developer of the crane apparatus 12 stores in the memory 72 the first designation information corresponding to the specifications determined by the model, type, destination, etc. of the crane apparatus 12.

[0072] Moreover, the memory 72 stores in advance a first correction function, a second correction function, a third correction function, a fourth correction function, a fifth correction function, a first conversion function, a second conversion function, and a third conversion function.

[0073] Fig. 6(A) is a schematic diagram of an image captured by the wide-angle camera 18. Fig. 6(B) is a schematic diagram showing a rear monitoring image which is an image showing the rear of the cabin 13. Fig. 6(C) is a schematic diagram of a boom left side monitoring image showing the left side of the boom 22. Fig. 6(D) is a schematic diagram of a boom right side monitoring image showing the right side of the boom 22. Fig. 6(E) is a schematic diagram of a boom tip monitoring image showing the periphery of the tip of the boom 22. Fig. 6(F) is a schematic diagram of a boom top side monitoring image showing the area facing the top surface 45 of the boom 22.

[0074] With reference to FIG. 6, the first correction function, the second correction function, the third correction function, the fourth correction function, the fifth correction function, the first conversion function, the second conversion function, and the third conversion function will be described.

[0075] The first correction function is a function for correcting the captured image data output by the wide-angle camera 18 to generate corrected image data showing the rear of the cabin 13. Specifically, the first correction function is a function that discards data of an area other than the area behind the cabin 13, which is a part of the captured image shown by the captured image data, and corrects distortion. The first correction function discards data showing an area other than the area surrounded by the two-dot chain line in FIG. 6A, which is an area other than the periphery of the fourth correction reference (see FIG. 6A), and corrects distortion.

[0076] The first correction function receives the captured image data and the hoisting angle detected by the hoisting angle sensor 63 as arguments, and outputs corrected image data as a return value. To explain in more detail, the height of the wide-angle camera 18 changes according to the hoisting angle of the boom 22. When the height of the wide-angle camera 18 changes, the range shown in the captured image represented by the captured image data changes. The first correction function determines the pixels in the area to be discarded based on the hoisting angle passed to it. In other words, the range shown in the image represented by the generated corrected image data is a fixed range regardless of the hoisting angle of the boom 22.

[0077] The first conversion function is a function that changes the viewpoint in the image represented by the corrected image data. The first conversion function is, for example, a function that performs a projective transformation. The corrected image data and the hoisting angle detected by the hoisting angle sensor 63 are passed to the first conversion function as arguments, and the first conversion function outputs rear monitoring image data. The rear monitoring image data is an image showing the rear of the cabin 13, and is also a bird's-eye image. To explain in detail, the position (viewpoint) of the wide-angle camera 18 changes depending on the hoisting angle of the boom 22. The first conversion function changes the position of the viewpoint based on the passed hoisting angle. In other words, the rear monitoring image represented by the generated rear monitoring image data becomes a bird's-eye image from the same viewpoint regardless of the hoisting angle of the boom 22.

[0078] The second correction function is a function for correcting the captured image data output by the wide-angle camera 18 to generate boom-tip monitoring image data showing the periphery of the tip of the boom 22. Specifically, the second correction function is a function that discards data of an area other than the periphery of the tip of the boom 22 shown by the first correction reference (see FIG. 6(A)), which is a part of the captured image shown by the captured image data, and corrects distortion. The second correction function corrects distortion by discarding data showing an area other than the periphery of the first correction reference (see FIG. 6(A)), which is an area other than the area surrounded by the dotted line in FIG. 6(A). The second correction function receives the captured image data as an argument, and outputs the boom-tip monitoring image data as a return value.

[0079] The second transformation function is a function that enlarges an image. The second transformation function receives image data and an enlargement ratio as arguments, and outputs image data that indicates the enlarged image. The second transformation function is, for example, an affine transformation (affine matrix) that performs the enlargement.

[0080] The third correction function is a function for generating boom top side monitoring image data by correcting the captured image data output by the wide-angle camera 18. The boom top side monitoring image data is data representing a boom top side monitoring image that shows an area facing the top surface 45 of the boom 22.

[0081] The third correction function is a function that discards data of a region other than the region facing the upper surface 45 of the boom 22, which is a part of the captured image represented by the captured image data, and corrects distortion. Specifically, the third correction function discards data indicating a region other than the region determined by the third correction standard (see FIG. 6(A)), which is other than the region surrounded by the dashed line in FIG. 6(A), and corrects distortion. The third correction function receives the captured image data as an argument and outputs the boom top side monitoring image data as a return value. Note that the boom top side monitoring image (see FIG. 6(F)) represented by the boom top side monitoring image data is composed of an image from a viewpoint from the wide-angle camera 18 toward the base end of the boom 22 and an image from a viewpoint from the wide-angle camera 18 toward the tip of the boom 22. Note that the boom top side monitoring image may be a single image that combines an image from a viewpoint from the wide-angle camera 18 toward the base end of the boom 22 and an image from a viewpoint from the wide-angle camera 18 toward the tip of the boom 22.

[0082] The fourth correction function is a function for correcting the captured image data output by the wide-angle camera 18 to generate boom left side monitoring image data that shows the left side of the boom 22. Specifically, the fourth correction function is a function that discards data of a part of the captured image indicated by the captured image data, which is an area other than the area on the left side of the boom 22 indicated by the left second correction reference (see FIG. 6(A)), i.e., an area other than the area to the left of the dotted line in FIG. 6(A), and corrects distortion. The fourth correction function receives the captured image data as an argument and outputs the boom left side monitoring image data as a return value. The left second correction reference corresponds to the "second correction reference" recited in the claims.

[0083] The fifth correction function is a function for correcting the captured image data output by the wide-angle camera 18 to generate boom right side monitoring image data showing the right side of the boom 22. Specifically, the fifth correction function is a function that discards data of a part of the captured image indicated by the captured image data, which is an area other than the area on the right side of the boom 22 indicated by the right second correction standard (see FIG. 6(A)), that is, an area other than the area to the right of the dotted line in FIG. 6(A), and corrects distortion. The fifth correction function receives the captured image data as an argument and outputs boom right side monitoring image data as a return value. The right second correction standard corresponds to the "second correction standard" described in the claims. The left second correction standard and the right second correction standard correspond to the "second correction standard" described in the claims.

[0084] The third transformation function is a function that rotates an image represented by the image data. The third transformation function receives image data and a rotation angle as arguments, and outputs image data representing the rotated image as a return value. The third transformation function is, for example, an affine transformation (affine matrix) that performs rotation.

[0085] In FIG. 6(A), the area used to generate the surveillance image is shown in a rectangular shape or the like by a dotted line, a double-dotted line, a dotted line, and a dashed line, but the area used to generate the surveillance image may be a shape other than a rectangle.

[0086] The control program 75 shown in FIG. 1 is a program that controls the operation of the hydraulic actuator group 27 etc. based on operation signals input from the control device 29, controls the display on the display 81 of the control monitor device 80, accepts input from the operator through the control monitor device 80, and executes the monitoring image display process described below (see FIG. 5).

[0087] The power supply circuit 74 converts the DC voltage supplied from the battery 16 mounted on the running object 11 into a DC voltage of a predetermined voltage value such as 3.3 V or 5 V, and outputs the converted voltage. The power supply circuit 74 is, for example, a DC / DC converter (power supply IC) such as a switching regulator. The battery 16 is charged by the engine 15 of the running object 11. The DC voltage output by the power supply circuit 74 is supplied to the CPU 71, the control device 29, the sensor group 26, the wide-angle camera 18, and the like. In FIG. 1, the power supply lines from the power supply circuit 74 to the sensor group 26 and the like are omitted.

[0088] The following describes the processing executed by the controller 70 of the crane vehicle 10. The processing executed by the controller 70 is processing that the control program 75 causes the CPU 71 to execute.

[0089] First, a process in which the controller 70 acquires the second designation information, which is the image designation of the operator, through the control monitor device 80 and stores it in the memory 72 will be described. The controller 70 acquires the first designation information previously stored in the memory 72. The controller 70 displays the type of image indicated by the first designation information on the display 81. The operator inputs the type of image that he / she desires to display on the display 84 among the displayed types of images through the touch sensor 82. For example, when the first designation information is the above-mentioned five types of images, the operator's options are all of the above-mentioned five types of images. However, among the above-mentioned five types of images, an image that is always displayed on the display 84 without any choice by the operator may be predetermined. In that case, the information indicating the type of image that is always displayed on the display 84 is included in the first designation information. Moreover, the image is excluded from the operator's options.

[0090] The controller 70 stores in the memory 72 second designation information indicating the type of image designated by the operator using the control monitor device 80 .

[0091] FIG. 5 is a flowchart of the monitoring image display process executed by the controller 70.

[0092] The monitoring image display process will be described with reference to Fig. 5. The controller 70 starts the monitoring image display process, for example, based on the operation device 29 being powered on, or based on the operator making a predetermined input to the operation device 29 or the control monitor device 80.

[0093] The controller 70 acquires the first designation information and the second designation information stored in the memory 72 (S11). If the operator can select all of the types of images indicated by the first designation information, the controller 70 may acquire only the second designation information indicating the type of image designated (selected) by the operator. If the first designation information includes information indicating the type of image that is always displayed on the display 84, the controller 70 acquires both the first designation information and the second designation information. If the operator cannot designate (select) an image, the controller 70 acquires only the first designation information. In the following description, the first designation information and the second designation information are collectively referred to as "designation information". The process of step S11 corresponds to the "designation information acquisition process" described in the claims.

[0094] The controller 70 acquires sensor detection values ​​output by each sensor of the sensor group 26 and stores them in the memory 72 (S12). The controller 70 repeatedly acquires the sensor detection values ​​at a predetermined sampling period and stores them in the memory 72. The controller 70 also acquires captured image data output by the wide-angle camera 18 (S13).

[0095] The controller 70 judges whether or not the designation information acquired in step S11 indicates the display of a "rear monitoring image" (S14). That is, in step S14, it is judged whether or not the pilot has designated (selected) the display of the "rear monitoring image", or whether or not the "rear monitoring image" is an image that is always displayed.

[0096] When the controller 70 determines that the designation information indicates the display of a "rear monitoring image" (S14: Yes), it generates rear monitoring image data based on the sensor detection value acquired in step S12, the captured image data acquired in step S13, and the first correction function and the first conversion function stored in the memory 72 (S15). In more detail, the controller 70 calls the first correction function, passes the captured image data and the hoisting angle θ detected by the hoisting angle sensor 63 as arguments to the first correction function, and receives the corrected image data as a return value. The controller 70 passes the received corrected image data and the hoisting angle θ as arguments to the first conversion function, and receives the rear monitoring image data as a return value. The image represented by the rear monitoring image data is an image that shows a predetermined range around the rear of the cabin 13, and is an overhead image. The process of step S15 corresponds to the "generation process" and the "fourth process" described in the claims. The process of acquiring the corrected image data based on the first correction function, the captured image data, and the hoisting angle θ corresponds to the "process of correcting the captured image data based on the fourth correction standard" described in the claims. The process of acquiring the rear monitoring image data based on the corrected image data, the hoisting angle θ, and the first conversion function corresponds to the "conversion process" described in the claims.

[0097] When the controller 70 determines that the designation information does not indicate the display of the "rear monitoring image" (S14: No), the controller 70 skips the process of step S15.

[0098] After executing the process of step S15, or when it is determined that the designation information does not indicate the display of a "rear monitoring image" (S14: No), the controller 70 determines whether or not the designation information acquired in step S11 indicates the display of a "boom tip monitoring image" (S16). That is, in step S16, it is determined whether or not the operator has designated (selected) the display of the "boom tip monitoring image", or whether or not the "boom tip monitoring image" is an image that is always displayed.

[0099] When the controller 70 determines that the designation information acquired in step S11 indicates display of a "boom tip monitoring image" (S16: Yes), it acquires a magnification ratio based on the boom length indicated by the sensor detection value acquired in step S12 (S17). Specifically, the memory 72 stores in advance a table associating the boom length with the magnification ratio. The controller 70 reads out the magnification ratio associated with the boom length indicated by the sensor detection value from the table.

[0100] The controller 70 generates boom tip monitoring image data based on the captured image data acquired in step S13, the magnification factor acquired in step S17, and the second correction function and second conversion function stored in the memory 72 (S18). In more detail, the controller 70 calls the second correction function, passes the captured image data as an argument to the second correction function, and acquires pre-magnification boom tip monitoring image data as a return value. Next, the controller 70 calls the second conversion function for magnification, passes the pre-magnification boom tip monitoring image data and the magnification factor to the second conversion function as arguments, and acquires boom tip monitoring image data showing the magnified boom tip monitoring image as a return value. In other words, the boom tip monitoring image showing the periphery of the tip of the boom 22 is magnified by a magnification factor according to the distance from the wide-angle camera 18 to the tip of the boom 22 and displayed on the display 84. The process of step S18 corresponds to the "generation process" and "first process" described in the claims. In step S18, the process of acquiring pre-magnification boom tip monitoring image data based on the second correction function and the captured image data corresponds to "the process of correcting the captured image data based on the first correction standard" in the claims. In step S18, the process of acquiring boom tip monitoring image data based on the second conversion function, pre-magnification boom tip monitoring image data, and the magnification ratio corresponds to "fourth enlargement process" in the claims.

[0101] When the controller 70 determines that the designation information acquired in step S11 does not indicate the display of the "boom tip monitoring image" (S16: No), it skips the processes of steps S17 and S18.

[0102] After determining in step S16 that the designation information does not indicate the display of a "boom tip monitoring image", or after executing the process of step S18, the controller 70 determines whether or not the designation information acquired in step S11 indicates the display of a "boom upper side monitoring image" (S19). That is, in step S19, it is determined whether or not the operator has designated (selected) the display of a "boom upper side monitoring image", or whether or not the "boom upper side monitoring image" is an image that is always displayed.

[0103] When the controller 70 determines that the designation information acquired in step S11 indicates display of a "boom top side monitoring image" (S19: Yes), it generates boom top side monitoring image data based on the captured image data acquired in step S13 and the third correction function stored in the memory 72 (S20). To explain in detail, the controller 70 calls the third correction function, passes the captured image data to the third correction function as an argument, and acquires the boom top side monitoring image data as a return value. The process of step S20 corresponds to the "generation process" and "third process" described in the claims.

[0104] Next, the controller 70 determines whether or not the boom 22 is being raised based on the sensor detection value acquired in step S12 (S21). To explain in more detail, the controller 70 determines whether or not the hoisting angle θ is increasing over time based on multiple hoisting angles θ detected by the hoisting angle sensor 63 at a predetermined sampling period.

[0105] When the controller 70 determines that the boom 22 is being raised (S21: Yes), it executes a first enlargement process to enlarge the boom top side monitoring image represented by the boom top side monitoring image data generated in step S20 (S22). To explain in detail, the controller 70 calls a second conversion function for enlargement and reads out a predetermined enlargement magnification stored in advance from the memory 72. The controller 70 passes the boom top side monitoring image data generated in step S20 and the predetermined enlargement magnification as arguments to the second conversion function, and obtains boom top side monitoring image data representing the enlarged boom top side monitoring image as a return value. The process of step S22 corresponds to the "first enlargement process" described in the claims.

[0106] When the controller 70 determines that the boom 22 is not being raised (S21: No), it skips the process of step S22. That is, when the boom 22 is not being raised, a boom upper surface monitoring image of the specified size is displayed on the display 84, and when the boom 22 is being raised, a boom upper surface monitoring image of a size larger than the specified size is displayed on the display 84. It is while the boom 22 is being raised that there is a possibility that the upper surface 45 of the boom 22 may come into contact with an obstacle. That is, the controller 70 enlarges and displays the boom upper surface monitoring image while the boom 22 is being raised, when there is a possibility that the upper surface 45 of the boom 22 may come into contact with an obstacle.

[0107] When the controller 70 determines that the designation information acquired in step S11 does not indicate display of the "boom upper surface side monitoring image" (S19: No), it skips the processes of steps S20, S21, and S22.

[0108] After determining in step S19 that the designation information does not indicate the display of a "boom upper surface monitoring image", or after determining in step S21 that the boom 22 is not being raised, or after executing the process of step S22, the controller 70 determines whether or not the designation information acquired in step S11 indicates the display of a "boom left side monitoring image" and a "boom right side monitoring image" (S23). That is, in step S23, it is determined whether or not the operator has designated (selected) the display of the "boom left side monitoring image" and the "boom right side monitoring image", or whether the "boom left side monitoring image" and the "boom right side monitoring image" are images that are always displayed.

[0109] When the controller 70 determines that the designation information acquired in step S11 indicates display of a "boom left side monitoring image" and a "boom right side monitoring image" (S23: Yes), it determines a first rotation angle and a second rotation angle based on the boom hoisting angle θ of the boom 22 indicated by the sensor detection value acquired in step S12 (S24). For example, the hoisting angle θ is determined as the first rotation angle, and -θ is determined as the second rotation angle. The first rotation angle is the angle by which the boom left side monitoring image is rotated, and the second rotation angle is the angle by which the boom right side monitoring image is rotated.

[0110] The controller 70 generates boom left side monitoring image data based on the captured image data acquired in step S13, the fourth correction function and the third conversion function stored in the memory 72, and the first rotation angle determined in step S24 (S25). The controller 70 also generates boom right side monitoring image data based on the captured image data acquired in step S13, the fifth correction function and the third conversion function stored in the memory 72, and the second rotation angle determined in step S24 (S25). Note that in the following description, the boom left side monitoring image data and the boom right side monitoring image data may be collectively referred to as boom side monitoring image data, and the boom left side monitoring image and the boom right side monitoring image may be collectively referred to as boom side monitoring images.

[0111] The boom left side monitoring image data corresponds to the "boom side monitoring image data" described in the claims. The boom right side monitoring image data corresponds to the "boom side monitoring image data" described in the claims. The boom left side monitoring image data and the boom right side monitoring image data correspond to the "boom side monitoring image data" described in the claims. The boom left side monitoring image corresponds to the "boom side monitoring image" described in the claims. The boom right side monitoring image corresponds to the "boom side monitoring image" described in the claims. The boom left side monitoring image and the boom right side monitoring image correspond to the "boom side monitoring image" described in the claims.

[0112] The process of step S25 will be described in detail. The controller 70 calls the fourth correction function, passes the captured image data to the fourth correction function as an argument, and acquires the pre-rotation boom left side monitoring image data as a return value. Next, the controller 70 calls the third conversion function for rotating the image, passes the pre-rotation boom left side monitoring image data and the first rotation angle to the third conversion function as arguments, and acquires the boom left side monitoring image data showing the rotated boom left side monitoring image as a return value. The ground shown in the rotated boom left side monitoring image becomes approximately horizontal on the display 84. That is, the rotation of the image by the third conversion function is performed to make the ground shown in the boom left side monitoring image horizontal on the display 84 to eliminate the discomfort of the operator. Similarly, the controller 70 calls the fifth correction function, passes the captured image data to the fifth correction function as an argument, and acquires the pre-rotation boom right side monitoring image data as a return value. Next, the controller 70 calls a third conversion function that rotates the image, passes the pre-rotation boom right side monitoring image data and the second rotation angle as arguments to the third conversion function, and obtains boom right side monitoring image data showing the rotated boom right side monitoring image as a return value. The ground shown in the rotated boom right side monitoring image becomes approximately horizontal on the display 84.

[0113] The process of step S25 corresponds to the "generation process" and the "second process" described in the claims. In step S25, the process of acquiring the pre-rotation boom left side monitoring image data based on the captured image data and the fourth correction function corresponds to the "process of correcting the captured image data based on the second correction standard" described in the claims. In step S25, the process of acquiring the pre-rotation boom right side monitoring image data based on the captured image data and the fifth correction function corresponds to the "process of correcting the captured image data based on the second correction standard" described in the claims. In step S25, the process of acquiring the pre-rotation boom left side monitoring image data and the pre-rotation boom right side monitoring image data based on the captured image data, the fourth correction function, and the fifth correction function corresponds to the "process of correcting the captured image data based on the second correction standard" described in the claims. In step S25, the process of acquiring the boom left side monitoring image data based on the pre-rotation boom left side monitoring image data, the first rotation angle, and the third conversion function corresponds to the "rotation process" described in the claims. In step S25, the process of acquiring boom right side monitoring image data based on the pre-rotation boom right side monitoring image data, the second rotation angle, and the third conversion function corresponds to the "rotation process" recited in the claims. In step S25, the process of acquiring boom left side monitoring image data and boom right side monitoring image data based on the pre-rotation boom left side monitoring image data, the pre-rotation boom right side monitoring image data, the first rotation angle, the second rotation angle, and the third conversion function corresponds to the "rotation process" recited in the claims.

[0114] Next, the controller 70 determines whether the boom 22 is rotating left based on the sensor detection value acquired in step S12 (S26). More specifically, the controller 70 determines whether the rotation angle α detected by the rotation angle sensor 61 at a predetermined sampling period is increasing over time. If the rotation angle α is increasing, the controller 70 determines that the boom 22 is rotating left.

[0115] When the controller 70 determines that the boom 22 is rotating to the left (S26: Yes), it executes a second enlargement process to enlarge the boom left side monitoring image represented by the boom left side monitoring image data generated in step S25 (S27). To explain in detail, the controller 70 calls a second conversion function for enlargement and reads out a predetermined enlargement magnification stored in advance from the memory 72. The controller 70 passes the boom left side monitoring image data generated in step S25 and the predetermined enlargement magnification as arguments to the second conversion function, and obtains boom left side monitoring image data representing the enlarged boom left side monitoring image as a return value. The process of step S27 corresponds to the "second enlargement process" described in the claims.

[0116] When the controller 70 determines that the boom 22 is not rotating left (S26: No), it skips the process of step S27. That is, when the boom 22 is not rotating left, a boom left side monitoring image of the specified size is displayed on the display 84, and when the boom 22 is rotating left, a boom left side monitoring image of a size larger than the specified size is displayed on the display 84. It is during the left rotation of the boom 22 that the left side of the boom 22 may come into contact with an obstacle. That is, the controller 70 enlarges and displays the boom left side monitoring image during the left rotation of the boom 22 when there is a possibility that the left side of the boom 22 may come into contact with an obstacle.

[0117] When the controller 70 determines that the boom 22 is not rotating to the left (S26: No), or after executing the process of step S27, the controller 70 determines whether or not the boom 22 is rotating to the right based on the sensor detection value acquired in step S12 (S28). More specifically, the controller 70 determines whether or not the rotation angle α detected by the rotation angle sensor 61 at a predetermined sampling period is decreasing over time. If the rotation angle α is decreasing, the controller 70 determines that the boom 22 is rotating to the right.

[0118] When the controller 70 determines that the boom 22 is rotating to the right (S28: Yes), it executes a third enlargement process to enlarge the boom right side monitoring image indicated by the boom right side monitoring image data generated in step S25 (S29). To explain in detail, the controller 70 calls a second conversion function for enlargement and reads out a predetermined enlargement magnification stored in advance from the memory 72. The controller 70 passes the boom right side monitoring image data generated in step S25 and the predetermined enlargement magnification as arguments to the second conversion function, and obtains boom right side monitoring image data indicating the enlarged boom right side monitoring image as a return value. The process of step S29 corresponds to the "third enlargement process" described in the claims.

[0119] When the controller 70 determines that the boom 22 is not rotating to the right (S28: No), it skips the process of step S29. That is, when the boom 22 is not rotating to the right, a boom right side monitoring image of the specified size is displayed on the display 84, and when the boom 22 is rotating to the right, a boom right side monitoring image of a size larger than the specified size is displayed on the display 84. It is during the right rotation of the boom 22 that the right side of the boom 22 may come into contact with an obstacle. That is, the controller 70 enlarges and displays the boom right side monitoring image during the right rotation of the boom 22 when there is a possibility that the right side of the boom 22 may come into contact with an obstacle.

[0120] When the controller 70 determines that the designation information acquired in step S11 does not indicate display of the "boom side monitoring image" (S23: No), it skips the processes from step S24 to S29.

[0121] After determining that the designation information does not indicate the display of a "boom side monitoring image" (S23: No), or after determining that the right turn is not being performed (S28: No), or after executing the process of step S29, the controller 70 inputs the generated image data to the display 84 and causes the monitor image to be displayed on the display 84 (S30). Specifically, the controller 70 inputs the generated monitor image data to the display 84. The monitor image displayed on the display 84 is an image determined to be displayed according to the specifications (first designation information) and an image designated (selected) by the operator. In addition, the monitor image displayed on the display 84 is an image appropriately enlarged in accordance with the extension, contraction, elevation, and rotation of the boom 22. The process of step S30 corresponds to the "display process" described in the claims.

[0122] Each monitoring image will be described in detail. The wide-angle camera 18 is attached to the boom 22 and rotates integrally with the boom 22. Therefore, the rear monitoring image shown in Fig. 6(B) always shows the rear of the cabin 13 (see Fig. 2), not the rear of the crane truck 10. In other words, the rear monitoring image always shows the rear of the cabin 13, which is a blind spot for the operator. Moreover, the rear monitoring image is an overhead image looking down on the rear of the cabin 13 from the same viewpoint regardless of whether the boom 22 is rising or falling. Moreover, the rear monitoring image is an image that always shows a fixed range regardless of whether the boom 22 is rising or falling.

[0123] The boom left side monitoring image shown in Fig. 6(C) is an image looking left from the boom 22, and the boom right side monitoring image shown in Fig. 6(D) is an image looking right from the boom 22. The ground shown in the boom left side monitoring image and the ground shown in the boom right side monitoring image are approximately horizontal on the display 84, and obstacles standing vertically from the ground in the boom left side monitoring image and the boom right side monitoring image are approximately aligned in the up-down direction on the display 84.

[0124] 6(E) shows the periphery of the tip of the boom 22. The range shown in the boom-tip monitoring image is, for example, a range in which an operator who notices an obstacle in the boom-tip monitoring image can stop the crane apparatus 12 before the tip of the boom 22 comes into contact with the obstacle. This range becomes constant regardless of the extended length of the boom 22 by enlarging the boom-tip monitoring image (S17, S18).

[0125] 6(F) is made up of an image of the tip and upward of the boom 22 seen from the wide-angle camera 18, and an image of the base and upward of the boom 22 seen from the wide-angle camera 18. In other words, the boom top-side monitoring image is an image that shows the area facing the top surface 45 of the boom 22. The two images may be displayed side-by-side on the display 84, or side-by-side on the display 84. Alternatively, the two images may be composited and displayed as a single image on the display 84.

[0126] The five monitoring images shown in FIGS. 6(B) through 6(F) may be displayed in any arrangement on the display 84.

[0127] Furthermore, the enlarged boom side monitoring image and boom top side monitoring image may be displayed on the display 84 separately from the unmagnified boom side monitoring image and boom top side monitoring image. For example, when the boom 22 is not rotated, the unmagnified boom side monitoring image is displayed on the display 84, and when the boom 22 is rotated, the enlarged boom side monitoring image is displayed on the display 84 together with the unmagnified boom side monitoring image.

[0128] 5, after executing the process of step S30, the controller 70 judges whether or not to end the monitoring image display process (S31). The controller 70 judges to end the monitoring image display process based on, for example, the power supply of the control device 29 being turned off or based on the input of an end instruction through the control monitor device 80 (S31: Yes, end). If the controller 70 judges not to end the monitoring image display process (S31: No), it executes the processes from step S11 onwards again. That is, the controller 70 repeatedly executes the monitoring image display process. The cycle (sampling cycle) at which the controller 70 repeats the monitoring image display process is set to, for example, between several hundred milliseconds and several minutes.

[0129] [Effects of the embodiment]

[0130] Since the wide-angle camera 18 is attached to the top surface 45 of the boom 22, it can simultaneously capture images of the area around the tip of the boom 22, the left and right side areas of the boom 22, the area facing the top surface 45 of the boom 22, and the rear area around the base end of the boom 22. The controller 70 generates monitoring image data from the captured image data for the area indicated by the first designation information prestored in the memory 72 or the area designated (selected) by the operator, and displays the monitoring image indicated by the generated monitoring image data on the display 84. Therefore, the safety device 17 can display a monitoring image of a blind spot area or a monitoring area desired by the operator of the crane vehicle 10 on the display 84, even if the area is an area around the tip of the boom 22, a side area of ​​the boom 22, an area facing the top surface 45 of the boom 22, or a rear area around the base end of the boom 22 (rear area of ​​the cabin 13). Therefore, the crane apparatus 12 can eliminate blind spots regardless of the type or specifications, or can eliminate blind spots according to the operator's request.

[0131] The safety device 17, which is made up of the wide-angle camera 18, the display 84, and the controller 70, can change the type of image to be displayed on the display 84 by the first designation information stored in the memory 72. Therefore, the safety device 17 can be commonly used for various crane apparatuses 12. As a result, it is possible to standardize the parts.

[0132] The controller 70 reads out second designation information indicating the image designation of the operator from the memory 72, and causes the type of surveillance image designated by the second designation information to be displayed on the display 84. Thus, the surveillance image desired by the operator can be displayed on the display 84.

[0133] The position and height of the wide-angle camera 18 relative to the swivel base 21 change as the boom 22 is hoisted. A viewpoint conversion process is performed to obtain an overhead image based on the hoisting angle of the boom 22, which is a parameter that determines the position and height of the wide-angle camera 18. Therefore, the crane apparatus 12 can always display on the display 84 a rear monitoring image that overlooks the rear of the cabin 13 from a fixed position, regardless of the hoisting angle of the boom 22.

[0134] The boom side monitoring image tilts in response to the hoisting of the boom 22. The controller 70 corrects the tilt of the boom side monitoring image by rotating the boom side monitoring image in response to the hoisting angle of the boom 22. Therefore, the crane apparatus 12 allows the operator to easily recognize obstacles compared to a case in which the tilt of the boom side monitoring image is not corrected.

[0135] When the boom 22 is being raised, there is a risk of contact between the upper surface 45 of the boom 22 and an obstacle. When the boom 22 is being raised, the controller 70 enlarges and displays the boom upper surface side monitoring image. Therefore, the crane apparatus 12 makes it easier for the operator to recognize an obstacle compared to a case in which the boom upper surface side monitoring image is always displayed at a constant size on the display 84.

[0136] When the boom 22 is being rotated, there is a risk of contact between the side of the boom 22 and an obstacle. The controller 70 enlarges and displays the boom left side monitoring image when the boom 22 is being rotated left, and enlarges and displays the boom right side monitoring image when the boom 22 is being rotated right. Therefore, the crane apparatus 12 makes it easier for the operator to recognize an obstacle compared to a case in which the boom side monitoring image is always displayed on the display 84 at a constant size.

[0137] Since the wide-angle camera 18 is mounted on the base boom 42, whose position does not change due to the extension and contraction of the boom 22, a wired connection between the wide-angle camera 18 and the controller 70 is easier than when the wide-angle camera 18 is mounted on the intermediate boom 43 or top boom 44, whose position changes due to the extension and contraction of the boom 22.

[0138] When the wide-angle camera 18 is provided on the base boom 42, the tip of the boom 22 moves away from the wide-angle camera 18 as the boom 22 extends. Since the boom tip monitoring image is enlarged at a magnification rate according to the extended length of the boom 22, the crane apparatus 12 can make it easier for the operator to recognize obstacles approaching the tip of the boom 22.

[0139] [Variations]

[0140] In the above embodiment, an example has been described in which the angle of view of the wide-angle camera 18 is 220 degrees. However, the angle of view of the wide-angle camera 18 may be other angles between 180 degrees and 220 degrees, such as 180 degrees or 200 degrees.

[0141] In the above embodiment, an example has been described in which the crane apparatus 12 is mobile (the crane vehicle 10). However, the crane apparatus 12 may be a fixed type such as a tower crane.

[0142] In the above embodiment, an example has been described in which the first designation information is stored in advance in the memory 72, and the second designation value input by the operator is stored in the memory 72. That is, an example has been described in which the monitoring image to be displayed is determined in advance according to the format and specifications, and the operator can select the monitoring image to be displayed. However, the first designation information does not have to be stored in advance in the memory 72, or the function for the operator to input the second designation value does not have to be provided. That is, the operator may only be able to select the monitoring image to be displayed, or the monitoring image to be displayed may be determined in advance according to the format and specifications, and the operator may not be able to select the monitoring image.

[0143] In the above embodiment, an example has been described in which the boom left side monitoring image is enlarged when the boom 22 is rotated left, and the boom right side monitoring image is enlarged when the boom 22 is rotated right. However, it is also possible that the boom left side monitoring image and the boom right side monitoring image are not displayed on the display 84 when the boom 22 is not rotated, and the boom left side monitoring image is displayed normally or enlarged when the boom 22 is rotated left, and the boom right side monitoring image is displayed normally or enlarged when the boom 22 is rotated right.

[0144] In the above embodiment, an example has been described in which the boom top side monitoring image is enlarged when the boom 22 is raised. However, when the boom 22 is not raised, the boom top side monitoring image may not be displayed on the display 84, and when the boom 22 is raised, the boom top side monitoring image may be displayed normally or enlarged.

[0145] In the above embodiment, an example has been described in which the first correction function for correcting the captured image and the first conversion function for changing the viewpoint are different functions. However, the first correction function and the first conversion function may be one function. Similarly, the second correction function and the second conversion function may be one function, the fourth correction function and the third conversion function may be one function, and the fifth correction function and the third conversion function may be one function.

[0146] In the above embodiment, an example of correcting and converting image data using a function has been described. However, as long as image data can be corrected and converted, a class that generates monitoring image data as an instance (object), an arithmetic expression, or the like may be used. [Explanation of symbols]

[0147] 10. Crane truck 11...Running body 12. Crane equipment 13. Cabin 17...Safety device 18. Wide-angle camera 19. Cable 21... Swivel table 22. Boom 23. Winch 26 Sensor group 29. Controls 41...Wire rope 42 Base boom (cylinder body) 43... Intermediate boom (cylinder body) 44···Top boom (cylinder) 45...Top surface 51... Swing motor 52. Raising and lowering cylinder 53 Telescopic cylinder 54 Hydraulic motor 61....Rotation angle sensor 62 Boom length sensor 63. Elevation angle sensor 70...Controller 71 CPU 72. Memory 75 Control program 80 Control monitor device 81. Display 82 Touch sensor 84...Display

Claims

1. A swivel base, A cabin mounted on the rotating base and having a control device installed therein; A boom that is provided on the swivel base and is extendable and retractable; a safety device having a wide-angle camera, a controller, and a display attached to an upper surface of the boom in the lowered position; The above controller is A generation process of generating monitoring image data based on the captured image data generated by the wide-angle camera; A display process of displaying a monitoring image represented by the monitoring image data on the display.

2. The above controller is A specific information acquisition process is further performed to acquire specific information; The above generation process is a first process for generating boom-tip monitoring image data by correcting the captured image data based on a first correction standard corresponding to the tip of the boom shown in a captured image represented by the captured image data; a second process of correcting the captured image data based on a predetermined second correction standard in an area shown in an image represented by the captured image data and located to the side of the boom, to generate boom side monitoring image data; a third process for generating boom top side monitoring image data by correcting the captured image data based on a third predetermined correction standard in an area shown in the captured image represented by the captured image data and facing the top surface of the boom; a fourth process of correcting the captured image data based on a fourth correction standard corresponding to the base end of the boom shown in the captured image represented by the captured image data to generate rear monitoring image data, the fourth process being one or more processes indicated by the specified information.

3. a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle, The fourth process is as follows: a process of correcting the captured image data based on the fourth correction standard; A conversion process of converting a viewpoint based on the elevation angle indicated by the first detection value, The crane apparatus according to claim 2 , wherein the rear monitoring image represented by the rear monitoring image data is an overhead image showing a rear side of the cabin.

4. a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle, The second process is a process of correcting the captured image data based on the second correction standard; 3. The crane apparatus according to claim 2, further comprising a rotation process of rotating a boom side monitoring image, which is a monitoring image represented by the boom side monitoring image data, at a rotation angle corresponding to the hoisting angle indicated by the first detection value.

5. a boom hoisting angle sensor that outputs a first detection value indicating a boom hoisting angle, The controller executes the third process based on the designation information indicating execution of the third process; 3. The crane apparatus according to claim 2, further comprising: a first enlargement process for enlarging a boom top side monitoring image indicated by the boom top side monitoring image data generated in the third process, before executing the display process, based on a determination that the boom is being raised based on a change over time in the hoisting angle indicated by the first detection value.

6. a rotation angle sensor that outputs a second detection value indicating a rotation angle of the rotation table; The boom side monitoring image data includes boom left side monitoring image data showing the left side of the boom and boom right side monitoring image data showing the right side of the boom, The above controller is executing the second process based on the designation information indicating execution of the second process; a second enlargement process is executed to enlarge a boom left side monitoring image indicated by the boom left side monitoring image data generated in the second process before the execution of the display process, based on the determination that a left turn is being made based on the second detection value; 3. The crane apparatus according to claim 2, further comprising: a third enlargement process for enlarging the boom right side monitoring image indicated by the boom right side monitoring image data generated in the second process, before executing the display process, based on a determination that a right turn is being made based on the second detection value.

7. The boom has a plurality of cylinders including a base boom, The crane apparatus according to claim 1 , wherein the wide-angle camera is provided on the base boom.

8. a boom length sensor that outputs a third detection value indicating an extended length of the boom; The boom has a plurality of cylinders including a base boom, The wide-angle camera is provided on the base boom, The first process is a process of correcting the captured image data based on the first correction standard; The crane apparatus according to claim 2 , further comprising a fourth enlargement process for enlarging the image by an enlargement factor corresponding to the third detection value.

9. 2. The crane apparatus according to claim 1, wherein the wide-angle camera has an angle of view of 180 degrees or more.

Images