Display devices for construction machinery and construction machinery

Abstract

To provide a display device for construction machinery that can simultaneously display images captured by two or more cameras, and that allows for easy configuration of two or more cameras to simultaneously display captured images. [Solution] In a display device for construction machinery equipped with multiple cameras, the display unit can simultaneously display images captured by two or more cameras that are different from each other within the image display area. The display control unit allows both the operation of selecting a division pattern in the image display area and the operation of associating a camera to display an image for each of the multiple division areas of the selected division pattern to be input on the display unit without switching screens from a predetermined settings screen.

Description

Technical Field

[0004] , , , ,

[0005] , , ,

[0003] , ,

[0001] The present invention relates to a display device for construction machinery and construction machinery.

Background Art

[0002] In Patent Document 1, as a construction machine, a crane equipped with a plurality of cameras is disclosed. In this crane, a display unit is arranged in the cab of the slewing body. And, it is possible to display a captured image by one selected from among the plurality of cameras on the display unit. In the crane of Patent Document 1, the screen of the display unit can be switched to each of a captured image screen for displaying a captured image and a setting screen for setting a camera for displaying the captured image. On the setting screen, an operation of selecting two cameras capable of displaying a captured image on the display unit from among the plurality of cameras can be input. Also, on the captured image screen, an operation of switching the captured image to be displayed between the two cameras selected on the setting screen can be input. And, on the captured image screen, in correspondence with the switching operation, a captured image by one of the two selected cameras is displayed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] <{ In a construction machine equipped with a plurality of cameras, it is required to enable an operator or the like to simultaneously check captured images by two or more cameras by simultaneously displaying the captured images by two or more cameras on the display unit. And, in a configuration capable of simultaneously displaying captured images by two or more cameras, it is required that the setting of two or more cameras for simultaneously displaying the captured images can be easily performed.

[0005] The present invention has been made to solve the aforementioned problems, and its objective is to provide a display device for construction machinery that can simultaneously display images captured by two or more cameras, and that allows for easy configuration of two or more cameras to simultaneously display images, and a construction machinery equipped with the display device. [Means for solving the problem]

[0006] To achieve the above objective, one aspect of the present invention is a display device for a construction machine equipped with multiple cameras, comprising: a display unit capable of simultaneously displaying images captured by two or more cameras that are different from each other among the multiple cameras in an image display area; and a display control unit that, in setting up the two or more cameras that simultaneously display captured images in the image display area, enables both the operation of selecting a division pattern in the image display area and the operation of associating a camera to display a captured image for each of the multiple division areas of the selected division pattern, to be input on the display unit without switching screens from a predetermined setting screen. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a display device for construction machinery that can simultaneously display images captured by two or more cameras, and that allows for easy configuration of two or more cameras to simultaneously display captured images, as well as a construction machinery equipped with the display device. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of a crane according to the first embodiment. [Figure 2] Figure 2 is a schematic block diagram showing an example of a crane control system according to the first embodiment. [Figure 3] Figure 3 is a schematic diagram showing, in the first embodiment, the captured image screen (first captured image screen) displayed on the display unit when the PTO device is turned off, and an example of an operation to switch from the captured image screen to a predetermined settings screen. [Figure 4]Figure 4 is a schematic diagram showing, in the first embodiment, the captured image screen (second captured image screen) displayed on the display unit when the PTO device is ON, and an example of the operation to switch from the captured image screen to a predetermined settings screen. [Figure 5] Figure 5 is a schematic diagram showing an example of an operation to be entered on a predetermined setting screen for settings related to image data that can be displayed on the captured image screen (first captured image screen) when the PTO device is turned off, in the first embodiment. [Figure 6] Figure 6 is a schematic diagram showing an example of an operation to be entered on a predetermined settings screen for settings related to image data that can be displayed on the captured image screen (second captured image screen) when the PTO device is turned on, in the first embodiment. [Figure 7] Figure 7 is a flowchart illustrating a portion of the processing performed by the display control unit in the display control of the display unit when a predetermined settings screen is displayed, in one example of the first embodiment. [Figure 8] Figure 8 is a flowchart illustrating some of the processes performed by the display control unit during display control of the display unit when a predetermined settings screen is displayed, as shown in an example in Figure 7, and which are not shown in Figure 7. [Modes for carrying out the invention]

[0009] The embodiments will be described below with reference to the drawings.

[0010] First, as an example of an embodiment, the first embodiment will be described. In the first embodiment, a crane will be used as an example of construction machinery. Figure 1 is a schematic diagram showing an example of the configuration of the crane 1 according to the first embodiment. As shown in Figure 1, the crane 1 comprises a traveling body 2 and a slewing body 3. The slewing body 3 is connected to the traveling body 2 from the vertically upper side (arrow Z1 side). The slewing body 3 is also capable of rotating around the traveling body 2 about a slewing axis P that is in the vertical direction (direction shown by arrows Z1 and Z2).

[0011] In the traveling vehicle body 2, the longitudinal direction (indicated by arrows X1 and X2) intersects (orthogonal or nearly orthogonal to) the vertical direction, and the width direction (indicated as orthogonal or nearly orthogonal to the plane of the paper in Figure 1) intersects (orthogonal or nearly orthogonal to) both the vertical and longitudinal directions. Similarly, in the slewing body 3, the longitudinal direction (orthogonal or nearly orthogonal to) intersects (orthogonal or nearly orthogonal to) the vertical direction, and the width direction (orthogonal or nearly orthogonal to) both the vertical and longitudinal directions are defined. Figure 1 shows a state where the longitudinal direction of the traveling vehicle body 2 coincides with or nearly coincides with the longitudinal direction of the slewing body 3, and the width direction of the traveling vehicle body 2 coincides with or nearly coincides with the width direction of the slewing body 3. Also in Figure 1, the crane 1 is shown with the front side of the traveling vehicle body 2 (arrow X1 side) coincides with or nearly coincides with the front side of the slewing body 3. Furthermore, Figure 1 shows a side view of the traveling vehicle body 2 as seen from one side in the width direction.

[0012] The vehicle body 2 is equipped with two pairs of outriggers 5A and 5B. On the vehicle body 2, a pair of outriggers 5A is provided on the front part, and a pair of outriggers 5B is provided on the rear part. When operating the crane 1, the outriggers 5A and 5B are each in contact with the ground. The rear end of the boom 6 is attached to the slewing body 3. The boom 6 extends along its longitudinal direction from the rear end to the front end. The boom 6 can be raised and lowered relative to the slewing body 3. The boom 6 can also slewing together with the slewing body 3 relative to the vehicle body 2. The slewing body 3 is also equipped with a cab 7. The cab 7 is positioned alongside the boom 6 on one side in the width direction of the slewing body 3. When operating the crane 1, with the boom 6 raised, a hook is suspended from the front end of the boom 6 via a rope. Then, the load is lifted by the hook suspended from the front end of the boom 6. The rope connected to the hook is fed out from the winch 8 installed on the slewing body 3.

[0013] Figure 2 is a schematic block diagram showing an example of the control system of the crane 1 according to the first embodiment. As shown in Figure 2, the crane 1 includes a display device 10. The display device 10 includes a touch panel 11 and a display control unit 12, and the touch panel 11 includes a display unit 13 and an operation detection unit 15. The crane 1 also includes an operation control unit 16, a PTO (power take-off) device 17 and a plurality of cameras 18.

[0014] The touch panel 11 is a device in which a display unit 13 and an operation detection unit 15 are integrally formed, and is located inside the operator's cab 7 of the slewing body 3 (see Figure 1). The display unit 13 can display information related to the crane 1, and operators can check the information displayed on the display unit 13 from inside the operator's cab 7. Operators can also input operations on the display unit 13. The operation detection unit 15 is composed of, for example, a touch sensor. In the touch panel 11, the operation detection unit 15 detects operations input on the display unit 13. When the operation detection unit 15 detects an operation input on the display unit 13, it inputs an operation signal corresponding to the input operation to the display control unit 12.

[0015] Each of the display control unit 12 and the operation control unit 16 consists of a processing unit such as a computer mounted on the crane 1, and includes a processor and a storage medium. The processors of each of the display control unit 12 and the operation control unit 16 are integrated circuits or circuit configurations such as a CPU (central processing unit), ASIC (application specific integrated circuit), ECU (electronic control unit), or FPGA (Field Programmable Gate Array). Each of the display control unit 12 and the operation control unit 16 may have only one processor or may have multiple processors. In each of the display control unit 12 and the operation control unit 16, processing by the processor is performed according to a program stored in the processor or the storage medium. In addition, in each of the display control unit 12 and the operation control unit 16, the processing program used by the processor, and parameters, functions, tables, etc. used in calculations by the processor are stored in the storage medium.

[0016] The PTO device 17 can be switched between an ON state, where it draws power from the engine, and an OFF state, where it does not draw power from the engine. The motion control unit 16 controls the operation of the PTO device 17 to switch its operation between the ON and OFF states. When the crane 1 is traveling, the PTO device 17 is in the OFF state, and engine power is not drawn by the PTO device 17. The engine power is then used for the travel operation of the crane 1. On the other hand, when the crane 1 is working, the PTO device 17 is in the ON state, and engine power is drawn by the PTO device 17. The power drawn by the PTO device 17 is then used for the slewing operation of the slewing body 3, the luffing operation of the boom 6, and the rotation operation of the winch 8, etc.

[0017] The display control unit 12 of the display device 10 can communicate with the operation control unit 16 by wire or wirelessly. The display control unit 12 acquires information regarding the operation state of the PTO device 17, that is, information on whether the PTO device 17 is in an on state or an off state, from the operation control unit 16.

[0018] The plurality of cameras 18 are installed on the crane 1 at different positions with respect to each other, and capture captured images with different ranges as the capture ranges with respect to each other. In one example, the plurality of cameras 18 include a camera that captures the front side of the slewing body 3 from the boom 6, a camera that captures one side in the width direction of the slewing body 3 from the boom 6, a camera that captures one side in the width direction of the traveling vehicle body 2 from the traveling vehicle body 2, a camera that captures the front side of the traveling vehicle body 2 from the traveling vehicle body 2, a camera that captures the winch 8, and the like. The display control unit 12 acquires the captured images by each of the plurality of cameras 18.

[0019] The display control unit 12 controls the display on the display unit 13 of the touch panel 11. At this time, the display control unit 12 controls the display on the display unit 13 based at least on the operation signal from the operation detection unit 15, that is, based at least on the operation input on the display unit 13. The display control unit 12, for example, switches the screen displayed on the display unit 13 based on the operation input on the display unit 13. Further, the display control unit 12 controls the display on the display unit 13 based on whether the PTO device 17 is in an on state or an off state.

[0020] The display control unit 12 can switch the display on the display unit 13 to display captured image screens that show images captured by one or more of the multiple cameras 18. When the PTO device 17 is off, the display control unit 12 can display the captured image screen (first captured image screen) I1 as the captured image screen on the display unit 13. When the PTO device 17 is on, the display control unit 12 can display the captured image screen (second captured image screen) I2 as the captured image screen on the display unit 13. The display control unit 12 can display only images captured by one camera 18 on each of the captured image screens I1 and I2, and can also display images captured by two or more cameras 18 simultaneously on a single screen.

[0021] Furthermore, the display unit 13 allows input for setting two or more cameras 18 to simultaneously display captured images on the captured image screen I1, and also allows input for setting two or more cameras 18 to simultaneously display captured images on the captured image screen I2. The setting of two or more cameras 18 to simultaneously display captured images on the captured image screen I1, and the setting of two or more cameras 18 to simultaneously display captured images on the captured image screen I2, is performed while a predetermined setting screen I3 is displayed on the display unit 13. The display control unit 12 can switch the display on the display unit 13 to the predetermined setting screen I3 as a setting screen for setting two or more cameras 18 to simultaneously display captured images. In one example, when displaying only an image captured by one camera 18 on the captured image screen I1, it is also possible to set the camera 18 to display the image alone on the predetermined setting screen I3.

[0022] Figure 3 is a schematic diagram showing, in the first embodiment, a captured image screen (first captured image screen) I1 displayed on the display unit 13 when the PTO device 17 is off, and an example of an operation to switch from the captured image screen I1 to a predetermined setting screen I3. As shown in Figure 3, the captured image screen I1 has a captured image display area 21. In the captured image screen I1, captured images from one or more cameras 18 are displayed in the captured image display area 21.

[0023] Furthermore, if images captured by two or more cameras 18 are displayed simultaneously in the image display area 21, the image display area 21 is divided into multiple sub-areas 22. Then, in each of the sub-areas 22, an image captured by one of the linked cameras 18 is displayed. In the example shown in Figure 3, the image display area 21 is divided into three sub-areas 22. If images captured by two or more cameras 18 are displayed simultaneously in the image display area 21, the image display area 21 is divided into multiple sub-areas 22 according to a division pattern corresponding to the settings in the predetermined setting screen I3 described later. Then, an image captured by the camera 18 corresponding to the settings in the predetermined setting screen I3 described later is displayed in each of the sub-areas 22.

[0024] Furthermore, the captured image screen I1 has a setting item display area 23, which is adjacent to the captured image display area 21 from the bottom of the screen. Multiple setting item tabs 25 are displayed in the setting item display area 23. Among the multiple setting item tabs 25 in the setting item display area 23, a setting item tab 25A related to the camera 18 is displayed. The display control unit 12 displays a group of operation buttons 26 related to the camera 18 on the captured image screen I1 in response to an input of pressing the setting item tab 25A on the captured image screen I1. On the captured image screen I1, the group of operation buttons 26 is displayed adjacent to the setting item tab 25 from the bottom of the screen.

[0025] In the operation button group 26, multiple operation buttons 27, including operation buttons 27A to 27D, are displayed as operation buttons related to the camera 18. In the captured image screen I1, when images captured by two or more cameras 18 are displayed simultaneously in the captured image display area 21, it is possible to select one of the multiple image data to be displayed in the captured image display area 21. In the example in Figure 3, when the PTO device 17 is off, multiple image data, including three image data A1 to A3, can be displayed in the captured image display area 21. For example, one of the multiple image data, including three image data A1 to A3, that is selected as the display target is displayed in the captured image display area 21.

[0026] On the captured image screen I1, in response to the input of pressing operation buttons 27A, 27B, and 27C, image data A1, A2, and A3 are selected as display targets to be shown in the captured image display area 21, respectively. Therefore, on the captured image screen I1, it is possible to switch the display targets to be shown in the captured image display area 21 among multiple image data, including image data A1 to A3. The settings for the division pattern of the captured image display area 21 for each of the image data A1 to A3, and the settings for the camera 18 to display the captured image in each of the multiple division areas 22 for each of the image data A1 to A3, are performed on a predetermined setting screen I3 as described later.

[0027] When the operation button group 26 is displayed, if one of the image data A1 to A3 is selected as the display target, the operation button (one of the corresponding A1 to A3) corresponding to the selected image data (one of the corresponding A1 to A3) is highlighted in real time. In the example in Figure 3, image data A1 is selected as the display target, and image data A1 is displayed in real time in the captured image display area 21. Then, the operation button 27A corresponding to image data A1 is highlighted. In Figure 3, the highlighted operation button 27A is indicated by diagonal hatching. In addition, in response to the input of pressing operation button 27D on the captured image screen I1, the display control unit 12 switches the screen displayed on the display unit 13 from the captured image screen I1 to a predetermined setting screen I3.

[0028] Figure 4 is a schematic diagram showing, in the first embodiment, an example of an operation to switch from the captured image screen I2 to a predetermined setting screen I3, which is displayed on the display unit 13 when the PTO device 17 is ON, and the captured image screen I2. As shown in Figure 4, the captured image screen I2 has a captured image display area 31. In the captured image screen I2, captured images from one or more cameras 18 are displayed in the captured image display area 31.

[0029] Furthermore, if images captured by two or more cameras 18 are displayed simultaneously in the image display area 31, the image display area 31 is divided into multiple sub-areas 32. Then, in each of the sub-areas 32, an image captured by one of the linked cameras 18 is displayed. In the example shown in Figure 4, the image display area 31 is divided into two sub-areas 32. If images captured by two or more cameras 18 are displayed simultaneously in the image display area 31, the image display area 31 is divided into multiple sub-areas 32 according to a division pattern corresponding to the settings in the predetermined setting screen I3 described later. Then, an image captured by the camera 18 corresponding to the settings in the predetermined setting screen I3 described later is displayed in each of the sub-areas 32.

[0030] Furthermore, the captured image screen I2 has a setting item display area 33, which is adjacent to the captured image display area 31 from the right side of the screen. Multiple setting item buttons 35 are displayed in the setting item display area 33. Among the multiple setting item buttons 35, a setting item button 35A related to the camera 18 is displayed in the setting item display area 33. In response to the input of pressing the setting item button 35A on the captured image screen I2, the display control unit 12 displays the camera drawer 36 related to the camera 18 on the captured image screen I2. On the captured image screen I2, the camera drawer 36 is displayed superimposed on a part of the captured image display area 31, and the camera drawer 36 is superimposed on the lower part of the screen within the captured image display area 31.

[0031] In the camera drawer 36, multiple operation buttons 37, including operation buttons 37A to 37D, are displayed as operation buttons for the camera 18. In the captured image screen I2, when images captured by two or more cameras 18 are displayed simultaneously in the captured image display area 31, it is possible to select one of the multiple image data to be displayed in the captured image display area 31. In the example in Figure 4, when the PTO device 17 is ON, multiple image data, including three image data B1 to B3, can be displayed in the captured image display area 31. For example, one of the multiple image data, including the three image data B1 to B3, that is selected as the display target is displayed in the captured image display area 31.

[0032] On the captured image screen I2, in response to the input of pressing operation buttons 37A, 37B, and 37C, image data B1, B2, and B3 are selected as display targets to be shown in the captured image display area 31, respectively. Therefore, on the captured image screen I2, it is possible to switch the display targets to be shown in the captured image display area 31 among multiple image data, including image data B1 to B3. The settings for the division pattern of the captured image display area 31 for each of the image data B1 to B3, and the settings for the camera 18 to display the captured image in each of the multiple division areas 32 for each of the image data B1 to B3, are performed on a predetermined setting screen I3 as described later.

[0033] When the camera drawer 36 is displayed, if one of the image data B1 to B3 is selected as the display target, the corresponding operation button (one of the corresponding B1 to B3) is highlighted in real time. In the example in Figure 4, image data B1 is selected as the display target, and image data B1 is displayed in real time in the captured image display area 31. Then, the operation button 37A corresponding to image data B1 is highlighted. In Figure 4, the highlighted operation button 37A is indicated by diagonal hatching. Also, in response to the input of pressing the operation button 37D on the captured image screen I2, the display control unit 12 switches the screen displayed on the display unit 13 from the captured image screen I2 to a predetermined setting screen I3.

[0034] Figure 5 is a schematic diagram showing an example of an operation input on a predetermined setting screen I3 for settings related to image data that can be displayed on the captured image screen (first captured image screen) I1 when the PTO device 17 is off, in the first embodiment. Figure 6 is a schematic diagram showing an example of an operation input on a predetermined setting screen I3 for settings related to image data that can be displayed on the captured image screen (second captured image screen) I2 when the PTO device 17 is on, in the first embodiment. As shown in Figures 5 and 6, the predetermined setting screen I3 has selection display areas 41 to 43 and a preview image display area 45.

[0035] In the selection display area 41, an operation to select one of multiple image data to be set is input. Multiple selection buttons 46 that are the selection options to be set are displayed in the selection display area 41. In the example in Figures 5 and 6, six selection buttons 46A to 46F are displayed in the selection display area 41. Selection buttons 46A, 46B, and 46C correspond to image data A1, A2, and A3 that can be displayed when the PTO device 17 is off, respectively, and selection buttons 46D, 46E, and 46F correspond to image data B1, B2, and B3 that can be displayed when the PTO device 17 is on, respectively. When an operation to press one of the multiple selection buttons 46 is input in the selection display area 41, the image data (one of A1 to A3, one of B1 to B3) corresponding to the pressed selection button (one of the corresponding 46) is selected as the setting target.

[0036] Furthermore, in the selection display area 41 of the predetermined setting screen I3, the corresponding selection button (one of 46) for the image data (one of A1-A3, one of B1-3) that is selected as the setting target in real time is highlighted. In the example in Figure 5, image data A1 is selected as the setting target in real time, and the selection button 46A corresponding to image data A1 is highlighted. In the example in Figure 6, image data B1 is selected as the setting target in real time, and the selection button 46D corresponding to image data B1 is highlighted. In Figures 5 and 6, the highlighted selection buttons (46A; 46D) are indicated by diagonal hatching.

[0037] In the specified setting screen I3, the selection display area 42 is located below the selection display area 41. In the selection display area 42, an operation is input to select a division pattern in the captured image display area (one of the corresponding 21 or 31) for the image data selected as the setting target (one of the corresponding A1-A3, B1-3). One or more selection buttons 48, which are the division pattern options, are displayed in the selection display area 42. In the example shown in Figures 5 and 6, when one of the image data A1-A3 is selected as the setting target, six selection buttons 48 are displayed in the selection display area 42 (see Figure 5). Therefore, for the image data A1-A3 that can be displayed when the PTO device 17 is off, a division pattern for the captured image display area 21 is selected from the six division patterns. In the six division patterns, at least one of the number of divisions in the captured image display area 21 and the position of the boundary lines differs from one another. Then, when an operation is input by pressing one of the six selection buttons 48, the division pattern corresponding to the pressed selection button 48 is selected as the division pattern for the captured image display area 21.

[0038] Furthermore, in the examples shown in Figures 5 and 6, when one of the image data B1 to B3 is selected as the setting target, only one selection button 48B is displayed in the selection display area 42 as the selection button 48 (see Figure 6). Therefore, for the image data B1 to B3 that can be displayed when the PTO device 17 is ON, the captured image display area 31 can be divided by only one division pattern. When an operation to press the displayed selection button 48B is input, the division pattern corresponding to the pressed selection button 48B is selected as the division pattern for the captured image display area 31. In one example, when one of the image data B1 to B3 is selected as the setting target, multiple selection buttons 48B are displayed in the selection display area 42 as the selection button 48. In this case, for the image data B1 to B3 that can be displayed when the PTO device 17 is ON, the division pattern for the captured image display area 31 is selected from among the multiple division patterns. Then, when an operation is input to press one of the multiple selection buttons 48, the division pattern corresponding to the pressed selection button 48 is selected as the division pattern for the captured image display area 31.

[0039] Furthermore, on the designated settings screen I3, the selection button (one of the 48 corresponding buttons) that corresponds to the currently selected division pattern is highlighted. In the example in Figure 5, one of the six selection buttons 48, selection button 48A, is highlighted, and the division pattern corresponding to selection button 48A is selected as the division pattern for the captured image display area 21. In the example in Figure 6, selection button 48B is highlighted, and the division pattern corresponding to selection button 48B is selected as the division pattern for the captured image display area 31. In Figures 5 and 6, the highlighted selection buttons (48A; 48B) are indicated by hatched diagonal lines.

[0040] In the settings on the predetermined settings screen I3, when the division pattern in the captured image display area (21;31) is selected as described above, the display control unit 12 sets an identifier for each of the multiple division areas (22;32) of the selected division pattern. In the examples of Figures 5 and 6, when the number of divisions N (where N is a natural number greater than or equal to 2) in the selected division pattern is specified, α1 to αN are set as identifiers for the multiple division areas (22;32). In one example, identifiers are set for the multiple division areas (22;32) in the order of α1, α2, ... along a Z shape.

[0041] In the specified setting screen I3, the selection display area 43 is located below the selection display area 42. In the selection display area 43, an operation is input to associate a camera 18 that will display the captured image with each of the multiple division areas (22;32) of the selected division pattern for the image data selected as the setting target (one of the corresponding A1-A3, B1-3). Multiple selection buttons 51, which are the options for the camera 18 to be associated, are displayed in the selection display area 43. In the example shown in Figures 5 and 6, the camera 18 options for setting image data A1-A3, which can be displayed when the PTO device 17 is off, are different from the camera 18 options for setting image data B1-B3, which can be displayed when the PTO device 17 is on. Therefore, when any of the image data A1-A3 is selected as the setting target, the types of selection buttons 51 displayed in the selection display area 43 are different from when any of the image data B1-B3 is selected as the setting target. In another example, the camera selection options for image data A1-A3, which can be displayed when the PTO device 17 is off, are the same as the camera selection options for image data B1-B3, which can be displayed when the PTO device 17 is on. In this case, if any of image data A1-A3 is selected as the setting target, the type of selection button 51 displayed in the selection display area 43 will be the same as if any of image data B1-B3 were selected as the setting target.

[0042] The association of cameras 18 to each of the multiple divided regions (22;32) is performed, for example, in the order of identifiers α1, α2, ..., αN. In this case, after selecting a division pattern, pressing one of the multiple selection buttons 51 is input, and the camera 18 corresponding to the pressed selection button 51 is associated with the divided region (22;32) of identifier α1. Then, after one of the multiple cameras 18 is associated with identifier α1, pressing one of the selection buttons 51 that are other than the camera 18 associated with identifier α1 is input, and the camera 18 corresponding to the pressed selection button 51 is associated with the divided region (22;32) of identifier α2. If there are divided regions (22;23) with identifiers α3 to αN, each of the divided regions (22;23) with identifiers α3 to αN is associated with a camera 18 in the same manner.

[0043] In the predetermined settings screen I3, the preview image display area 45 is adjacent to the selection display areas 42 and 43 from the right side of the screen. In the preview image display area 45, the selected division pattern and the multiple division areas (22;32) of that division pattern are displayed for the image data to be set (one corresponding image from A1 to A3, B1 to B3). For each division area (22;32) associated with one of the multiple cameras 18, the image captured by the associated camera 18 is displayed in the preview image display area 45. Therefore, in the setting of two or more cameras 18 to simultaneously display captured images in the captured image display areas (21;31), the display control unit 12 displays the selected division pattern and the images captured by the cameras 18 associated with each of the multiple division areas (22;32) in the preview image display area 45 of the predetermined settings screen I3.

[0044] In the specified settings screen I3, the preview image display area 45 shows identifiers α1 to αN for each of the multiple division regions (22;32) of the selected division pattern. Then, in the selection display area 43, for each camera 18 associated with one of the multiple division regions (22;32), the identifier of the associated division region (22;32) (one of the corresponding identifiers from α1 to αN) is displayed on the selection button 51 corresponding to that camera 18.

[0045] In the example shown in Figure 5, identifiers α1 to α3 are set for the three division regions 22 of the selected division pattern. Then, the camera 18 corresponding to selection button 51A, one of the multiple selection buttons 51, is linked to the division region 22 with identifier α1, and the camera 18 corresponding to selection button 51B, another of the multiple selection buttons 51 different from selection button 51A, is linked to the division region 22 with identifier α2. In the example shown in Figure 6, identifiers α1 and α2 are set for the two division regions 32 of the selected division pattern. Then, the camera 18 corresponding to selection button 51C, one of the multiple selection buttons 51, is linked to the division region 32 with identifier α1.

[0046] Furthermore, in the preview image display area 45 of the predetermined settings screen I3, the segmented area (22;32) that is selected in real time as the linking target for camera 18 is highlighted. In the example in Figure 5, segmented area 22 of identifier α3 is highlighted in the preview image display area 45. Segmented area 22 of identifier α3 is selected in real time as the linking target for camera 18. In the example in Figure 6, segmented area 32 of identifier α2 is highlighted in the preview image display area 45. Segmented area 32 of identifier α2 is selected in real time as the linking target for camera 18. Note that in the preview image display area 45, if none of the segmented areas (22;32) are selected as the linking target, none of the segmented areas (22;32) are highlighted.

[0047] Furthermore, in the preview image display area 45, it is possible to input an operation to select the divided area (22;32) to which the camera 18 will be linked. In the preview image display area 45, when an operation is input to press one of the multiple divided areas (22;32) that is not highlighted, the pressed divided area (22;32) is selected as the linking target for the camera 18. In this case, if an operation is input to press one of the unhighlighted divided areas (22;32) while one divided area (22;32) is selected as the linking target, the divided area (22;32) to be linked will switch.

[0048] In the preview image display area 45 of the predetermined settings screen I3, if one of the multiple divided areas (22;32) is selected as the target for association, pressing one of the multiple selection buttons 51 will link the camera 18 corresponding to the pressed selection button 51 to the selected divided area (22;32). On the other hand, if none of the multiple divided areas (22;32) are selected as the target for association in the preview image display area 45, even if pressing one of the multiple selection buttons 51 is input, the display control unit 12 will determine that the operation to select a camera to associate is invalid. In this case, the camera 18 corresponding to the pressed selection button 51 will not be linked to any of the multiple divided areas (22;32).

[0049] On the predetermined settings screen I3, a save button 52 and a back button 53 are displayed. On the predetermined settings screen I3, the save button 52 and the back button 53 are adjacent to the selection display area 43 from the bottom of the screen. By pressing the save button 52 on the predetermined settings screen I3, an operation to save the setting information in real time regarding the settings of image data A1~A3 and B1~B3 is input. Then, in response to the input of the operation to save the setting information, the display control unit 12 saves the setting information in real time regarding the settings of image data A1~A3 and B1~B3, that is, the settings of two or more cameras 18 that simultaneously display captured images, to a storage medium or the like.

[0050] Furthermore, pressing the back button 53 on the predetermined settings screen I3 inputs an operation to switch the display unit 13's screen back to the screen immediately preceding the switch to the predetermined settings screen I3. In other words, pressing the back button 53 inputs an operation to switch the display unit 13's screen from the predetermined settings screen I3. In response to the input of the screen switching operation, the display control unit 12 switches the display unit 13's screen to a screen different from the predetermined settings screen I3. Note that when switching screens from the predetermined settings screen I3, the setting information at the time of the most recent save process is saved to the storage medium, etc., and the setting information set by operations on the predetermined settings screen I3 after the time of the most recent save process is not saved.

[0051] Figure 5 shows the situation after switching from the captured image screen I1 to the predetermined settings screen I3. Therefore, in the situation shown in Figure 5, pressing the back button 53 switches the screen of the display unit 13 from the predetermined settings screen I3 to the captured image screen I1. Then, in the situation shown in Figure 5, on the predetermined settings screen I3, the same group of operation buttons 26 as on the captured image screen I1 is displayed at the bottom of the screen relative to the save button 52 and the back button 53. Figure 6 shows the situation after switching from the captured image screen I2 to the predetermined settings screen I3. Therefore, in the situation shown in Figure 6, pressing the back button 53 switches the screen of the display unit 13 from the predetermined settings screen I3 to the captured image screen I2. Then, in the situation shown in Figure 6, on the predetermined settings screen I3, the same camera drawer 36 as on the captured image screen I2 is displayed at the bottom of the screen relative to the save button 52 and the back button 53.

[0052] Figure 7 is a flowchart schematically showing a part of the processing performed by the display control unit 12 in the display control of the display unit 13 when a predetermined setting screen I3 is displayed, in one example of the first embodiment. Figure 8 is a flowchart schematically showing a part of the processing performed by the display control unit 12 in the display control of the display unit 13 when a predetermined setting screen I3 is displayed, in an example of Figure 7, that is not shown in Figure 7. The display control in the example of Figures 7 and 8 is performed repeatedly over time when the predetermined setting screen I3 is displayed on the display unit 13. When the display control in the example of Figures 7 and 8 is started, the display control unit 12 determines whether or not an operation to select image data to be set has been entered in the selection display area 41 (S101).

[0053] If an operation to select image data is input (S101-Yes), the display control unit 12 highlights the corresponding selection button (one of the corresponding A1-A3, B1-B3) in the selection display area 41 (S102). Then, the display control unit 12 displays the selection button 48, which is the selection for the division pattern of the captured image display area (21;31) for the selected image data (one of the corresponding A1-A3, B1-B3), in the selection display area 42 (S103). Then, the display control unit 12 displays the selection button 51, which is the selection for the camera 18 to be associated with each of the multiple division areas for the selected image data (one of the corresponding A1-A3, B1-B3), in the selection display area 43 (S104). On the other hand, if no operation to select image data is input (S101-No), the display control unit 12 proceeds to the next process without performing the processes in S102-S104.

[0054] After performing the aforementioned processing, the display control unit 12 determines whether or not an operation to select a division pattern for the captured image display area (21;31) has been entered in the selection display area 42 (S105). If an operation to select a division pattern has been entered (S105-Yes), the display control unit 12 highlights the selection button (one of the corresponding buttons 48) corresponding to the selected division pattern in the selection display area 42 (S106). At this time, the display control unit 12 displays the selected division pattern in the preview image display area 45. On the other hand, if an operation to select a division pattern has not been entered (S105-No), the display control unit 12 proceeds to the next process without performing the processing in S106.

[0055] After performing the processing described above, the display control unit 12 determines whether or not an operation to select the division area (22;32) to be linked has been entered in the preview image display area 45 (S107). If an operation to select the division area (22;32) to be linked has been entered (S107-Yes), the display control unit 12 highlights the selected division area (22;32) in the preview image display area 45 (S108). On the other hand, if an operation to select the division area (22;32) to be linked has not been entered (S107-No), the display control unit 12 proceeds to the next process without performing the processing in S108.

[0056] After performing the processing described above, the display control unit 12 determines whether an operation to select the camera 18 to be linked has been entered in the selection display area 43 (S109). If an operation to select the camera 18 to be linked has been entered (S109-Yes), the display control unit 12 determines whether the segmented area (22;32) to be linked has been selected in real time (S110). If the segmented area (22;32) to be linked has been selected (S110-Yes), the display control unit 12 links the selected camera 18 to the segmented area (22;32) to be linked (S111). In other words, the camera 18 that will display the captured image in the segmented area (22;32) to be linked is set. Then, the display control unit 12 displays the identifier of the associated segmented area (22;32) (one of α1 to αN) on the selection button (one of 51) corresponding to the selected camera 18 in the selection display area 43 (S112).

[0057] On the other hand, if no segmented region (22;32) to be linked is selected (S110-No), the display control unit 12 determines that the operation to select the camera 18 to be linked is invalid (S113). In this case, the camera 18 selected by the operation cannot be linked to any of the segmented regions (22;32). Also, if no operation to select the camera 18 to be linked is input (S109-No), the display control unit 12 proceeds to the next process without performing the processes in S110 to S113.

[0058] After performing the aforementioned processing, the display control unit 12 determines whether or not an operation to save real-time setting information has been input using the save button 52 (S114). If the operation to save has been input (S114-Yes), the display control unit 12 saves real-time setting information for the settings of two or more cameras 18 that simultaneously display captured images to a storage medium or the like (S115). On the other hand, if the operation to save has not been input (S114-No), the display control unit 12 proceeds to the next process without performing the processing in S115.

[0059] After performing the aforementioned processing, the display control unit 12 determines whether or not a screen switching operation has been input using the back button 53 or the like (S116). If a screen switching operation has been input (S116-Yes), the display control unit 12 switches the screen of the display unit 13 from the predetermined setting screen I3 (S117). At this time, the setting information at the time of the most recent save processing is saved to the storage medium or the like. On the other hand, if a screen switching operation has not been input (S116-No), the display control unit 12 proceeds to the next process without performing the S117 process.

[0060] In this embodiment, the display control unit 12 controls the display on the display unit 13 as described above. Therefore, when setting up two or more cameras 18 to simultaneously display captured images in the captured image display area (21;31), both the operation of selecting a division pattern in the captured image display area (21;31) and the operation of associating a camera 18 to display captured images for each of the multiple division areas (22;32) of the selected division pattern can be input on the display unit 13 without switching screens from the predetermined setting screen I3. Therefore, it is possible to set up two or more cameras 18 to simultaneously display captured images with only operations on one screen, that is, only operations on the predetermined setting screen I3. This makes it easy to set up two or more cameras 18 to simultaneously display captured images in a configuration where captured images from two or more cameras 18 can be displayed on the display unit 13 simultaneously. In other words, operability is improved when setting up two or more cameras 18 to simultaneously display captured images.

[0061] Furthermore, since the settings for two or more cameras 18 that simultaneously display captured images can be configured solely through operations on a predetermined settings screen I3, operators can check the configuration information for the two or more cameras 18 that simultaneously display captured images without switching from the predetermined settings screen I3. This improves the readability of the configuration information for the two or more cameras 18 that simultaneously display captured images.

[0062] Furthermore, in this embodiment, one image selected from multiple image data as the display target can be displayed on the display unit 13 as an image captured by two or more cameras 18. The operation of selecting one image data to be set from multiple image data (e.g., A1-A3, B1-B3), the operation of selecting a division pattern in the captured image display area (21;31) for the image data selected as the setting target, and the operation of associating a camera 18 with each of the multiple division areas (22;32) of the selected division pattern for the image data selected as the setting target can all be input on the display unit 13 without switching screens from the predetermined setting screen I3. Therefore, even when setting up two or more cameras 18 to display captured images simultaneously for each of multiple image data, all settings for multiple image data can be performed with operations on a single screen. Therefore, even when setting up two or more cameras 18 to display captured images simultaneously for each of multiple image data, the operability of the settings and the viewability of the setting information are improved.

[0063] Furthermore, in this embodiment, it is possible to select the image data to be set from one or more image data (e.g., A1 to A3) that can be displayed in the captured image display area 21 when the PTO device 17 is off, and one or more image data (e.g., B1 to B3) that can be displayed in the captured image display area 31 when the PTO device 17 is on, on a predetermined setting screen I3. Therefore, it is possible to set both the image data that will be displayed simultaneously by two or more cameras 18 when the PTO device 17 is off, and the image data that will be displayed simultaneously by two or more cameras 18 when the PTO device 17 is on, by operating on only one screen.

[0064] Furthermore, in this embodiment, in the settings for two or more cameras 18 that simultaneously display captured images in the captured image display area (21;31), the selected division pattern and the captured images of the cameras 18 associated with each of the multiple division areas (22;32) are displayed on a predetermined setting screen I3. As a result, operators can appropriately check (preview) real-time setting information on the predetermined setting screen I3 when setting up two or more cameras 18 that simultaneously display captured images. This further improves the operability of the settings and the accessibility of the setting information when setting up two or more cameras 18 that simultaneously display captured images.

[0065] Furthermore, although the above-described embodiments mainly described the crane 1 as a construction machine, the display control of the display unit 13 shown in the above-described embodiments may also be applied to construction machines other than the crane 1.

[0066] Furthermore, the present invention is not limited to the embodiments described above, and can be modified in various ways during implementation without departing from its essence. The embodiments may also be combined as appropriate as possible, and the combined effects can be obtained in such cases. Moreover, the embodiments described above include inventions at various stages, and various inventions can be extracted by appropriate combinations of the multiple disclosed constituent elements. [Explanation of Symbols]

[0067] 1...Crane, 2...Vehicle body, 3...Slewing body, 6...Boom, 10...Display device, 11...Touch panel, 12...Display control unit, 13...Display unit, 15...Operation detection unit, 17...PTO device, 18...Camera, 21,31...Captured image display area, 22,32...Divided area, 41~43...Selection display area, 46(46A~46F),48(48A,48B),51(51A~51C)...Selection button, I1...Captured image screen (first captured image screen), I2...Captured image screen (second captured image screen), I3...Determined setting screen.

Claims

1. A display device for construction machinery equipped with multiple cameras, A display unit capable of simultaneously displaying images captured by two or more cameras, which are different from each other, within the image display area of ​​the aforementioned plurality of cameras, In the setting of two or more cameras that simultaneously display captured images in the aforementioned captured image display area, a display control unit is provided that allows both the operation of selecting a division pattern in the captured image display area and the operation of associating a camera to display a captured image with each of the multiple division areas of the selected division pattern, to be input on the display unit without switching screens from a predetermined setting screen. A display device equipped with the following:

2. The display control unit causes one of the multiple image data to be selected as the image to be displayed from among the images captured by the two or more cameras to be displayed in the image display area of ​​the display unit. The display control unit enables the following operations to be input on the display unit without switching screens from the predetermined setting screen: selecting one of the multiple image data to be set, selecting the division pattern in the captured image display area for the image data selected as the setting target, and associating the camera with each of the multiple division areas of the selected division pattern for the image data selected as the setting target. The display device according to claim 1.

3. The display device according to claim 2, wherein the display control unit allows the user to select, on the predetermined setting screen of the display unit, one or more image data that can be displayed in the captured image display area when the PTO device is off, and one or more image data that can be displayed in the captured image display area when the PTO device is on, from among the image data to be set.

4. The display device according to claim 1, wherein the display control unit displays the selected division pattern and the images captured by the cameras associated with each of the plurality of division areas in the settings for the two or more cameras that simultaneously display captured images in the captured image display area, on the predetermined setting screen of the display unit.

5. A display device according to any one of claims 1 to 4, The aforementioned multiple cameras, The driver's cab where the display unit of the display device is located, A construction machine equipped with the following features.

Images