Operator confirmation of machine control schemes

Abstract

The customizable control scheme determines the operation of the machine or the attached implement generated by the operator using the machine control device. In response to machine startup, new implement attachment to the machine, or another trigger condition, a display of the machine presents a control scheme confirmation screen. The operator may understand the control scheme for which the machine is currently configured to be used via the control scheme confirmation screen and, prior to starting an active operation of the machine after the trigger condition, provide a user input that confirms that the operator is understood of the control scheme for which the machine is currently configured to be used.

Description

Technical Field

[0001] This disclosure relates to user-customizable control schemes for machines, and more specifically to user interface confirmation screens displayed to confirm that the machine operator is aware of the control scheme configured for use of the machine prior to operation of the machine. Background Technology

[0002] Machines (such as tracked loaders, excavators, or other commercial or operational machinery) can be used to perform work operations at a work site or other location. Human operators can control the operation of the machine using its machine controls (such as joysticks, levers, buttons, and other types of control devices).

[0003] Some machines allow human operators to change the control scheme, enabling the same physical machine controls to be adjusted or remapped to induce different machine operations. However, when an operator is about to begin operating the machine, they may not be aware of which control scheme the machine is currently configured to use.

[0004] For example, when a new operator begins operating a machine, they may initially be unaware that the previous operator has changed the control scheme associated with that machine. For instance, the new operator might expect to operate the machine based on the default control scheme and be surprised when using the machine controls does not produce the expected results. The new operator may have to learn the current control scheme through experimentation and trial and error, for example, by using the machine controls over a period of time to determine which machine actions using those controls will produce. Operators may need to spend time learning the current control scheme through trial and error, which can be dangerous and / or lead to decreased productivity on the job site.

[0005] Furthermore, it can be dangerous and / or inefficient for an operator to begin operating a machine without knowing that the control scheme being used differs from the operator's expectations. For example, if an operator expects a specific button to raise the bucket attached to the machine, but that button is actually set to dump the load inside the bucket, the operator may be surprised when pressing the button and the material in the bucket is dumped instead of moving upwards. Moreover, such accidental dumping of material can pose a danger to nearby personnel and property, and / or damage material that the operator intended to move to a different location.

[0006] Various systems have been developed to display information to operators of vehicles and other machines. For example, U.S. Patent No. 9,718,360 by Yang (hereinafter referred to as "Yang") describes a display device for a vehicle that can present information to vehicle occupants, such as drivers and / or passengers. The display device described by Yang can be divided into a main display area and a secondary display area, which can display information associated with different applications. The display device described by Yang can also be a touchscreen or have other input functions, allowing user commands to be received via the display device.

[0007] However, display systems (such as the display device described by Yang) typically focus on displaying information and receiving user input while the vehicle or other machine is in active use. Therefore, such display systems may have limited ability to display information before the operator begins operating the machine.

[0008] The examples disclosed herein are intended to overcome the defects mentioned above. Summary of the Invention

[0009] According to a first aspect, a computer-implemented method includes: a processor of an onboard computing system of a machine causing a display of the machine to display a control scheme confirmation screen. The control scheme confirmation screen visually depicts a control scheme based on control scheme data and currently configured to convert input data from a machine control device of the machine into a corresponding operation of the machine. The computer-implemented method further includes receiving user input by the processor and via the control scheme confirmation screen, the user input including confirmation of the control scheme. The computer-implemented method additionally includes enabling active machine operation of the machine by the processor and based on the user confirmation input, the active machine operation being controlled via the machine control device based on the control scheme data.

[0010] According to a second aspect, a machine includes: a transmission; a implement configured to perform at least one work task; a machine control unit; a display; and an onboard computing system. The one or more machine control units are configured to control the operation of at least one of the transmission or the implement based on a control scheme defined by control scheme data. The onboard computing system is configured to cause the display to present a control scheme confirmation screen visually depicting the control scheme. The onboard computing system is further configured to receive user input via the control scheme confirmation screen, the user input including confirmation of the control scheme. The onboard computing system is additionally configured to, based on the user input, enable active machine operation of the at least one of the transmission or the implement, the active machine operation being controlled via the machine control unit based on the control scheme data.

[0011] According to a third aspect, a machine-on-machine computing system includes a processor and a memory having computer-executable instructions stored thereon. When executed by the processor, the computer-executable instructions cause the processor to display a control scheme confirmation screen on the machine. The control scheme confirmation screen visually depicts a control scheme based on control scheme data and is currently configured to convert input data from a machine control device of the machine into a corresponding operation of the machine. When executed by the processor, the computer-executable instructions also cause the processor to receive user input via the control scheme confirmation screen, the user input including confirmation of the control scheme. Additionally, when executed by the processor, the computer-executable instructions cause the processor to enable active machine operation of the machine based on the user input, the active machine operation being controlled via the machine control device based on the control scheme data. Attached Figure Description

[0012] The detailed description is given with reference to the accompanying drawings. In the drawings, the leftmost numeral of the reference numeral first appears in the drawing for which that numeral appears. The same reference numerals in different drawings indicate similar or identical items.

[0013] Figure 1 This is an exemplary illustrative example of a machine with a customizable control scheme.

[0014] Figure 2 An example is shown where different control schemes can be used in conjunction with the machine's joystick.

[0015] Figure 3 An example is shown where the order of the screens can be confirmed via a control scheme presented on a display.

[0016] Figure 4 This is a flowchart illustrating an exemplary process for presenting and confirming the control scheme used by the machine before it is actively used by an operator.

[0017] Figure 5 This is a schematic example depicting an exemplary architecture of a computing system. Detailed Implementation

[0018] Figure 1This is an exemplary illustrative representation of a machine 100 with customizable control schemes. Machine 100 can be a vehicle, heavy machinery, industrial equipment, or any other type of machine. For example, machine 100 can be a commercial or operational machine, such as a mining vehicle, dump truck, backhoe excavator, excavator, scraper, bulldozer, crusher, loader (e.g., large wheel loader, track loader, etc.), single-bucket excavator, truck (e.g., mining truck, haulage truck, highway truck, off-highway truck, articulated truck, tanker truck, etc.), crane, pipelaying machine, paver, compactor, tractor, agricultural equipment, or any other type of mobile, stationary, or portable machine.

[0019] In some examples, machine 100 may operate at and / or travel around a work site, such as a mine, quarry, construction site, farm, or any other type of work site or work environment. Machine 100 may have one or more implements 102 (such as buckets, scrapers, rippers, blades, pushers, forks, grapples, plows, tractors), or other types of work tools or implements that machine 100 may use to perform work operations. For example, machine 100 may use one or more types of implements 102 to move rocks, gravel, soil, sand, timber, building materials, and / or any other type of materials at the work site, and / or otherwise interact with them.

[0020] As discussed further below, one or more types of implements 102 may be able to be removed from and / or inspected from machine 100. Therefore, different implements 102 may be attached to machine 100 at different times, allowing machine 100 to use different implements 102 to perform different types of work operations.

[0021] One or more engines, motors, transmissions, drive systems, hydraulic systems, and / or other components of machine 100 can provide power for the propulsion of machine 100 and / or the movement of implement 102. For example, the transmission 104 of machine 100 can move the wheels, tracks, and / or other components of machine 100, thereby enabling machine 100 to drive around the work site or other environment.

[0022] Machine 100 has one or more types of machine control devices 106 that can be used by a human operator of machine 100. In various examples, machine control devices 106 may include joysticks, control levers, pedals, steering wheels, buttons, keyboards, switches, dials, knobs, triggers, touch-sensitive displays, other touch-sensitive input elements and / or other types of input elements.

[0023] A human operator can use machine control device 106 to control the operation of machine 100, such as driving operation of machine 100, operation of one or more implements 102, operation of machine 100's lights and other auxiliary systems, and / or other operations associated with machine 100. As an example, machine 100 can be a manned machine operated by a human operator who interacts with one or more machine control devices 106 to control the driving speed and direction of machine 100, and / or control the movement of one or more implements 102 of machine 100 during operation. As another example, machine 100 can be a semi-autonomous machine, which may have some functions automatically controlled by an onboard computing system and / or a remote computing system, but has at least some functions that can be controlled by a human operator via one or more types of machine control devices 106. Machine control device 106 may be located in the cab of machine 100, or at another location above or within machine 100, such that a human operator can access and use machine control device 106 while machine 100 is in operation.

[0024] In some examples, multiple types of machine control devices 106 can be combined into a single input device. For example, machine 100 may have a joystick, which the operator can physically move to control the direction of movement of machine 100 or implement. However, the joystick may also have one or more integrated buttons, dials, triggers, or other input elements that the operator can use to control or adjust other types of operation of machine 100 or implement. For example, the joystick may have a button that makes the horn of machine 100 sound, and also other buttons or input elements that make the gearbox 104 of machine 100 upshift and downshift.

[0025] Machine 100 may also have multiple machine control devices 106, which together control the same operation, or individually control different operations or different components of machine 100. As a first example, machine control device 106 may include a joystick and a foot pedal, allowing the operator to control the direction of movement of machine 100 via the joystick and the speed of movement of machine 100 via the foot pedal. As a second example, machine control device 106 may include a joystick and a control lever, allowing the operator to control the driving movement of machine 100 via the joystick and to control the movement of implements attached to machine 100 individually and / or simultaneously via the control lever.

[0026] Different types and / or models of machines may have different machine control devices 106. As an example, one tracked loader model may have a joystick with three buttons, while another tracked loader model may have a joystick with two buttons, or a control lever instead of a joystick. As another example, the transmission 104 of one machine model may be controlled via a joystick and a brake pedal, while the transmission 104 of different machine models may be controlled via a shift lever, a left turn pedal, a right turn pedal, and a brake pedal.

[0027] Machine control device 106 can receive and / or capture input data based on the interaction between the operator of machine 100 and machine control device 106. Machine control device 106 can also provide input data to controller 108 of machine 100. Controller 108 can be an onboard computing system of machine 100, such as an electronic control module (ECM) or other computing system onboard to machine 100. Controller 108 can use control scheme data 110 to convert the input data received via machine control device 106 into commands and / or signals that cause corresponding operations of machine 100 and / or one or more implements 102 of machine 100. For example, controller 108 can convert input data received via one or more machine control devices 106 into data commands, electrical signals, hydraulic valve movements and / or other operations or instructions that cause corresponding movements or operations of machine 100 as a whole and / or one or more implements 102 of machine 100. Therefore, control scheme data 110 can define the current control scheme, which is currently configured to control the operation of machine 100 and / or one or more implements 102.

[0028] As described herein, control scheme data 110 can be user-configurable. Therefore, although the machine control unit 106 of machine 100 can remain physically identical, the operator can reconfigure control scheme data 110 so that the same input provided by the operator via machine control unit 106 is translated differently by controller 108, thereby causing different operations of machine 100 and / or implement 102. As a non-limiting example, the operator can configure control scheme data 110 such that forward movement of a joystick causes the implement attached to machine 100 to move upward. However, at different times, the same operator or different operators can reconfigure control scheme data 110 such that the same forward movement of the same joystick instead causes the implement attached to machine 100 to move downward. The following relates to... Figure 2 Further discussion is given of an example of reconfiguring control scheme data 110 to change the operation resulting from the same operator input provided via machine control unit 106.

[0029] Machine 100 may have a display 112 (such as a screen) configured to present information to an operator of machine 100. For example, display 112 may present information via a graphical user interface (GUI) or other user interface presented via display 112. In some examples, display 112 may be a screen integrated into a dashboard in the cab of machine 100. In other examples, the display may be a separate display device or screen that may be mounted to machine 100 or otherwise present on or within machine 100. In some examples, display 112 may be a touch-sensitive screen that can accept touch-based user input from the operator. In other examples, other buttons, keyboards, or user input devices associated with display 112 may be used to receive user input from the operator in association with information displayed via display 112. For example, the operator may use a separate button to select a user interface element or other data presented via display 112 and / or otherwise interact with that user interface element or other data.

[0030] The user interface manager 114 of machine 100 can be configured to determine which user interface elements and other information are presented via display 112. The user interface manager 114 can also be configured to receive and / or process user input provided via and / or associated with display 112, such as user commands provided by an operator in response to information presented on display 112. The user interface manager 114 can be executed by controller 108 or another onboard computing system of machine 100.

[0031] As described herein, the user interface manager 114 can cause at least one control scheme confirmation screen 116 to be presented via display 112. The control scheme confirmation screen 116 can present information associated with the current control scheme that the machine 100 is configured to use, based on control scheme data 110, which the controller 108 is currently configured to use to translate input received via machine control device 106 into corresponding operations of machine 100 and / or implement 102. For example, the control scheme confirmation screen 116 can display a visual representation of machine control device 106 and the corresponding operations that will currently be performed by the operator using machine control device 106, based on the current control scheme indicated by control scheme data 110. Figure 3 An example instance of the control scheme confirmation screen 116 is shown, and further discussed below.

[0032] Therefore, the operator can view the control scheme confirmation screen 116 to understand the current control scheme that the machine 100 is currently configured to use. For example, if the current control scheme is not the default control scheme or another control scheme that the operator might expect, the operator can understand the current control scheme via the control scheme confirmation screen 116. The operator can adjust accordingly how the operator uses the machine control devices 106 to control the operation of the machine 100 and / or the implement 102. For example, the operator can use the control scheme confirmation screen 116 to understand which specific machine control devices 106 are currently set to cause these operations, rather than assuming which machine control devices 106 will cause certain operations.

[0033] In some examples, the control scheme confirmation screen 116 may also provide the operator with options to adjust the control scheme (e.g., via menus, other screens, and / or user-selectable options), allowing the operator to provide user input to remap the machine control unit 106 to perform different operations. The control scheme data 110 stored and / or used by the controller 108 may be modified based on requested changes indicated by user input, such that the controller 108 can use the modified control scheme data 110 to translate input received via the machine control unit 106 into new or different operations for the machine 100 and / or tool 102.

[0034] The control scheme confirmation screen 116 can also be configured to accept user confirmation input from the operator, confirming that the operator is aware of the current control scheme. The current control scheme can be a control scheme previously configured for use by the machine 100 (if the operator has not made any changes to the control scheme via the control scheme confirmation screen 116), or it can be a new current control scheme selected or adjusted by the operator via the control scheme confirmation screen 116. Once the operator confirms their awareness of the current control scheme using the control scheme confirmation screen 116, the user interface manager 114, the controller 108, and / or other components of the machine 100 can allow the operator to begin controlling the machine 100 to drive the machine 100 and / or perform job operations based on the operator-confirmed control scheme.

[0035] For example, after the operator confirms the current control scheme of machine 100 via control scheme confirmation screen 116, user interface manager 114 can cause display 112 to display other screens, views, and / or other user interface elements associated with the active operation of machine 100. For example, user interface manager 114 can cause display 112 to switch from displaying control scheme confirmation screen 116 to displaying information such as machine speed values, hydraulic pressure values, battery charge level values, fuel tank level, temperature values, maps and / or other navigation information, machine control options, implement control options, images captured by the camera of machine 100, and / or any other information that may reflect the status of machine 100 and / or be available to the operator when machine 100 is in active operation.

[0036] User interface manager 114 can be configured to present control scheme confirmation screen 116 via display 112 upon the occurrence of one or more triggering events (such as machine power-on events, tool change events, operator change events, and / or other events or conditions). User interface manager 114, controller 108, and / or other components of machine 100 can be configured to prevent the operator from actively operating machine 100 after such triggering events until the operator provides user input via control scheme confirmation screen 116 to confirm that the operator is aware of the current control scheme. Thus, the operator can understand and / or adjust the current control scheme, and the operator's knowledge of the current control scheme is confirmed via control scheme confirmation screen 116 before starting to drive machine 100 or performing work operations using machine 100 and / or tool 102.

[0037] As a first example of the triggering status of the display control scheme confirmation screen 116, the user interface manager 114 can be configured to present the control scheme confirmation screen 116 via the display 112 in association with a machine power-on event when the machine 100 is initially powered on. When the machine 100 is powered on, the display 112 can be activated, and the user interface manager 114 can present user interface elements via the display 112. The user interface manager 114 can cause the display 112 to present one or more initial views or screens (such as an operator login screen), which allow the operator operating the machine 100 to enter an operator identification number or other login information identifying the operator. The user input of the operator's login information can allow the user interface manager 114 to identify corresponding operator profile information, which stores preferences or settings associated with the operator, such as language preferences or other settings. Therefore, the user interface manager 114 can cause the display 112 to present user interface elements in a language previously selected by the operator, and / or otherwise present user interface elements based on settings previously selected by the operator.

[0038] After the operator login screen and / or any other initial screens or views are displayed when machine 100 is initially powered on, user interface manager 114 can cause display 112 to show control scheme confirmation screen 116, as described herein. Thus, the operator who will operate machine 100 can use control scheme confirmation screen 116 to understand the current control scheme for which machine 100 is configured, optionally change the current control scheme, and confirm that the operator is aware of the current control scheme. Once the operator confirms via control scheme confirmation screen 116 that they are aware of the current control scheme, the operator can begin active operation of machine 100 based on the operator-confirmed control scheme, and user interface manager 114 can cause display 112 to switch to displaying other screens, views, and / or other user interface elements associated with the active operation of machine 100.

[0039] In some examples, one or more elements of the control scheme data 110 can be determined based on the operator profile, such as the operator's past preferences or settings for control scheme configurations. Therefore, based on the operator identifier entered after the machine 100 is powered on, the controller 108 and / or the user interface manager 114 can determine the control scheme data 110 at least in part based on the corresponding operator profile and display the current control scheme via the control scheme confirmation screen 116.

[0040] However, in other examples, some or all of the control scheme data 110 may not be linked to individual operator profiles. For example, the control scheme for machine 100 may be modified or determined, at least in part, based on the operating conditions and / or environment of machine 100, making it potentially unsuitable to store or use preset control scheme configurations associated with individual operator profiles. For instance, if machine 100 is operating in muddy conditions, a previous operator may have modified the control scheme for machine 100 to suit the muddy conditions. These changes may be stored in the control scheme data 110 so that they can be used the next time another operator uses machine 100 in muddy conditions. Therefore, when the next operator powers on machine 100, machine 100 may continue to be configured to use the control scheme set by the previous operator based on the muddy conditions, rather than reconfiguring the control scheme for machine 100 based on the next operator's preset preferences stored in the operator profile (which may not be suitable for muddy conditions). Additionally, when the next operator turns on machine 100, the current control scheme, previously modified to adapt to muddy conditions, can be displayed to the next operator via the control scheme confirmation screen 116. The next operator can view the control scheme confirmation screen 116 to understand the current control scheme (which may have been modified by the previous operator), such as which machine controls 106 may have been adjusted to adapt to muddy conditions. The next operator can optionally make any desired changes to the control scheme via the control scheme confirmation screen 116, and can confirm the control scheme via the control scheme confirmation screen 116 before the operator begins actively using machine 100.

[0041] As a second example of the triggering status of the display control scheme confirmation screen 116, the user interface manager 114 can be configured to present the control scheme confirmation screen 116 via the display 112 in association with a machine change event. As discussed above, machine 100 can be configured to change machine 102 (e.g., by disassembling one machine and attaching another). When machine 100 changes machine 102, the machine change can be detected automatically and / or based on user input.

[0042] As an example, machine 100 may have an equipment detector 118 configured to automatically detect when a new piece of equipment 102 is attached to machine 100 and / or determine the type or model of the new equipment 102. Equipment detector 118 may be executed by controller 108 or another onboard computing system of machine 100, or linked to such controller or the other onboard computing system. Equipment detector 118 may detect the new equipment attached to machine 100 based on a wired or wireless data connection between equipment 102 and controller 108 or other computing systems of machine 100, based on a radio frequency identification (RFID) tag on equipment 102, based on a barcode, QR code, or other code displayed on equipment 102 and identified by a camera or scanner of machine 100, based on the physical connector type or other physical attributes of equipment 102, and / or via other equipment monitoring systems of machine 100.

[0043] As another example, the operator may use the display 112 or other input device to manually indicate when a new tool is attached to machine 100 and to indicate the type or model of the new tool. For example, when the operator attaches a new tool to machine 100, the operator may provide user input using one or more options or menus presented via the display 112, which identifies that the tool has been changed and / or identifies the type or model of the newly attached tool.

[0044] When an equipment change event occurs, and a newly attached machine is automatically detected and / or detected based on user input, the controller 108 and / or the user interface manager 114 can use the stored control scheme data 110 to determine the default control scheme data 110 associated with the newly attached machine or the latest operator-set control scheme data 110. The user interface manager 114 can also, in response to the equipment change event, cause the display 112 to show a control scheme confirmation screen 116 as described herein. Thus, an operator who will be operating machine 100 in association with the newly attached machine can use the control scheme confirmation screen 116 to understand the current control scheme for which machine 100 is configured to be used in association with the newly attached machine. The operator can also use the control scheme confirmation screen 116 to optionally change the control scheme associated with the newly attached machine and confirm that the operator is aware of the current control scheme associated with the newly attached machine. Once the operator confirms via the control scheme confirmation screen 116 that the operator is aware of the current control scheme associated with the newly attached machine, the operator can actively operate the machine 100 and the newly attached machine based on the operator-confirmed control scheme, and the user interface manager 114 can convert the display 112 to present other screens, views and / or other user interface elements associated with the active operation of the machine 100.

[0045] In some examples, an equipment change event may occur when machine 100 is turned off. Therefore, the control scheme confirmation screen 116 can be displayed in response to both machine power-on events and equipment change events. For example, if a new piece of equipment is attached to machine 100 when machine 100 is turned off, the new equipment can be detected when machine 100 is turned on the next time it is turned on. When machine 100 is turned on, as part of the machine startup process, the current control scheme associated with both the new equipment and machine 100 can generally be presented to the operator via the control scheme confirmation screen 116, allowing the operator to understand, optionally change, and confirm the control schemes for machine 100 and the new equipment before initiating active operation of machine 100.

[0046] In other examples, a machine change event may occur when machine 100 is already in active use. When machine 100 is initially powered on and a first machine is attached to machine 100, the operator may have already confirmed the control scheme via control scheme confirmation screen 116. However, the operator may later choose to remove the first machine from machine 100 and attach a new second machine to the machine while machine 100 is still powered on. In this case, when the new machine is attached and detected automatically or via manual user input, user interface manager 114 may present control scheme confirmation screen 116, which displays the current control scheme associated with the new machine and allows the operator to optionally change the control scheme associated with the new machine. User interface manager 114 and / or controller 108 may be configured to disable active use of machine 100 and / or the new machine after the new machine is attached until the operator confirms the control scheme associated with the new machine via control scheme confirmation screen 116. For example, although machine 100 may remain powered on, it may idle and / or switch to a low-power state in which it cannot be driven or used to perform work operations until the operator confirms the control scheme associated with the new machine via the control scheme confirmation screen 116.

[0047] As a third example of the triggering status of the control scheme confirmation screen 116, the user interface manager 114 can be configured to present the control scheme confirmation screen 116 via the display 112 in association with an operator change event. In some cases, when machine 100 is off, a new operator can take over the operation of machine 100 from the previous operator. For example, the previous operator can complete their shift and shut down machine 100, and the next operator can subsequently start their shift and turn machine 100 back on, allowing the control scheme confirmation screen 116 to be presented in association with a machine power-on event. However, in other cases, the previous operator can park machine 100 but keep it idling when powered on, allowing another operator to begin operating machine 100 without restarting it. In this example, a new operator can use the login screen on display 112 to manually enter a new operator identifier or other login actions to identify the new operator, or machine 100 can automatically detect that the operator of machine 100 has changed based on an RFID tag carried by the new operator, a camera in the cab of machine 100, a planned shift change, or another operator detection system.

[0048] Therefore, when a new operator is detected on machine 100 before machine 100 has been stopped and restarted, the user interface manager 114 can present a control scheme confirmation screen 116, which displays the current control scheme of machine 100 to the new operator and allows the new operator to optionally change the control scheme of machine 100. The user interface manager 114 and / or the controller 108 can be configured to prevent the new operator from actively using machine 100 until the new operator confirms the control scheme associated with machine 100 via the control scheme confirmation screen 116. For example, although machine 100 may idle but remain powered on during an operator change, machine 100 may continue to idle and be in a state where machine 100 cannot be driven or used to perform work operations until the new operator confirms the control scheme associated with machine 100 via the control scheme confirmation screen 116.

[0049] In some examples, before machine 100 can be actively used, user interface manager 114 may cause multiple control scheme confirmation screens 116 to be displayed sequentially. Different control scheme confirmation screens 116 may be associated with different types of machine control devices 106 and / or different types of operation or function of machine 100 or machine tool 102.

[0050] As an example, in response to a machine power-on event, the user interface manager 114 can be configured to display a first control scheme confirmation screen 116, which presents the current control scheme associated with the transmission 104 of the machine 100, allowing the operator to understand the control scheme associated with the transmission 104, operatively change the control scheme associated with the transmission 104, and confirm that the operator is aware of the control scheme associated with the transmission 104. After the operator has confirmed using the first control scheme confirmation screen 116 that they are aware of the control scheme associated with the transmission 104, the user interface manager 114 can be configured to display a second control scheme confirmation screen 116, which presents the current control scheme associated with an implement attached to the machine 100. Therefore, the operator can use the second control scheme confirmation screen 116 to understand the control scheme associated with the implement, operatively change the control scheme associated with the implement, and confirm that the operator is aware of the control scheme associated with the implement.

[0051] Overall, because the control scheme associated with the machine control device 106 can be changed, the control scheme confirmation screen 116 can present information about the current control scheme to the operator in response to a triggering condition, so that the operator can confirm and be aware of the current control scheme before starting active operation of the machine 100 via the machine control device 106. Figure 2 (Further discussion below) Examples are shown in which different control schemes can be used with the same machine control unit 106.

[0052] Figure 2 Example 200 is shown, in which different control schemes can be used in association with the joystick 202 of machine 100. As discussed above, the machine may have one or more types of machine control devices 106. In some examples, the machine control device 106 may include... Figure 2 The joystick 202 is shown. The joystick 202 may also have one or more buttons 204, which can be used to induce operation of the machine 100 and / or one or more implements 102 attached to the machine 100.

[0053] As discussed above, the controller 108 of machine 100 can use control scheme data 110 to translate operator input provided via machine control device 106 (such as joystick 202 and joystick 202 button 204) to cause corresponding movements and operations of machine 100 or implement 102. While machine control device 106 may remain physically identical, control scheme data 110 can be modified to adjust which movements and operations of machine 100 or implement 102 are caused by operator input provided via machine control device 106. As described herein, control scheme confirmation screen 116 can display the current control scheme associated with machine control device 106 to the operator, allowing the operator to understand the current control scheme, optionally change the control scheme, and confirm the operator's awareness of the current control scheme before actively operating machine 100.

[0054] like Figure 2 As shown, control scheme data 110 can instruct the joystick 202 to be set to control the movement of machine 100 according to either a first control scheme 206 or a second control scheme 208. The first control scheme 206 can control the steering of machine 100 such that tilting the joystick 202 forward and to the right causes machine 100 to move forward while simultaneously turning to the right. The second control scheme 208 can control the steering of machine 100 via the joystick 202 in a manner different from the first control scheme 206, for example, causing tilting the joystick 202 forward and to the right to cause machine 100 to rotate around a fixed point without moving forward.

[0055] In response to a machine power-on event, an equipment change event, an operator change event, or another triggering condition, a control scheme confirmation screen 116 can be presented to the operator of machine 100. For example, in response to a machine power-on event, when machine 100 is powered on, the control scheme confirmation screen 116 can be presented to the operator via display 112. If control scheme data 110 indicates that machine 100 is currently configured according to the first control scheme 206 at the time the machine power-on event occurs, the control scheme confirmation screen 116 can display a visual representation of the first control scheme 206 to the operator. The visual representation shown when the first control scheme 206 is presented via the control scheme confirmation screen 116 can be compared with... Figure 2 The visual representation of the first control scheme 206 shown is similar. Therefore, the operator can view the control scheme confirmation screen 116 to understand how different movements of the joystick 202 will translate into movements of the machine 100, and to understand what action activating the button 204 on the joystick 202 will trigger. If the operator wants to use the first control scheme 206, the operator can confirm via the control scheme confirmation screen 116 that the operator is aware that the first control scheme 206 will be used.

[0056] However, if the operator prefers to use the second control scheme 208 to control the machine 100, the operator can use the control scheme confirmation screen 116 to change the settings and underlying control scheme data 110, thereby configuring the machine 100 to use the second control scheme 208. A visual representation of the newly selected second control scheme 208, such as similar to [other methods], can also be displayed via the control scheme confirmation screen 116. Figure 2 The visual representation of the second control scheme 208 is shown. The operator can use the control scheme confirmation screen 116 to confirm that the operator is aware that the second control scheme 208 will be used to control the machine 100. Figure 3 An example of a control scheme confirmation screen 116 is shown in the figure, and further discussion of the figure follows.

[0057] Figure 3 An example 300 of the sequence of control scheme confirmation screens 116 that can be presented via display 112 is shown. For example, in response to a machine power-on event, display 112 may present a first control scheme confirmation screen 302 associated with a first machine control unit 106 that operates the transmission 104, brakes, and / or other elements of the machine 100 associated with driving the machine 100. The first control scheme confirmation screen 302 may display a visual depiction of the first machine control unit 106, along with corresponding text, icons, and / or other elements, thereby indicating how the input types provided by the first machine control unit 106 are currently configured to translate into driving operations, transmission functions, braking functions, and / or other operations of the machine 100 based on the current control scheme data 110.

[0058] The first control scheme confirmation screen 302 can also display user-selectable customization options 304, such as buttons or other icons. If the operator selects customization option 304, the display 112 can display other options, menus, and / or views that allow the operator to change and customize which operations will be generated by operator input provided via the first machine control device 106. The customized changes can be stored as updated control scheme data 110, and the visual representation of the updated control scheme can be displayed via the first control scheme confirmation screen 302.

[0059] The first control scheme confirmation screen 302 may also display a user-selectable control scheme confirmation option 306. When the display 112 presents the first control scheme confirmation screen 302, the operator can view it to understand the current control scheme associated with the transmission 104 and / or other driving operations of the machine 100. In some examples, the operator may optionally modify the control scheme via the customization option 304. Once the operator has understood and / or customized the control scheme based on the first control scheme confirmation screen 302, the operator can select the control scheme confirmation option 306 to confirm that the operator is aware that the machine 100 is currently configured to control the transmission 104 and / or other operations associated with driving the machine 100 using the control scheme represented by the first control scheme confirmation screen 302.

[0060] In response to selecting the control scheme confirmation option 306 on the first control scheme confirmation screen 302, the display 112 can switch to presenting a second control scheme confirmation screen 308 associated with a second machine control device 106 that controls the movement and / or other operations of implements integrated into and / or attached to the machine 100. For example, the second control scheme confirmation screen 308 may display control scheme information associated with a bucket attached to the machine 100 and indicate that the movement of the bucket can be controlled by either or both of a switch and / or a joystick. The second control scheme confirmation screen 308 may display a visual depiction of the second machine control device 106, along with corresponding text, icons, and / or other elements, indicating how the input type provided by the second machine control device 106 is currently configured to translate into implement movement based on the current control scheme data 110.

[0061] The second control scheme confirmation screen 308 may also display instances of customization option 304 and control scheme confirmation option 306. Therefore, the operator may optionally select customization option 304 on the second control scheme confirmation screen 308 to customize how the second machine control device 106 is used to control the implement. Any changes to the control scheme made via customization option 304 can be visually indicated via the second control scheme confirmation screen 308. Once the operator has used the second control scheme confirmation screen 308 to understand and / or customize the control scheme associated with the implement, the operator may select control scheme confirmation option 306 on the second control scheme confirmation screen 308 to confirm that the operator is aware that machine 100 is currently configured to control the operation of the implement using the control scheme represented via the second control scheme confirmation screen 308.

[0062] In response to selecting the control scheme confirmation option 306 on the second control scheme confirmation screen 308, the display 112 can switch to displaying the operation screen 310. The operation screen 310 can display information associated with the active operation of the machine 100. For example, the operation screen 310 can display information such as machine speed values, hydraulic pressure values, battery charge level values, fuel tank level, temperature values, map and / or other navigation information, machine control options, implement control options, images captured by the machine 100's camera, and / or any other information that may reflect the status of the machine 100 and / or be available to the operator when the machine 100 is in active operation. Figure 3 As shown, the operator can first view the first control scheme confirmation screen 302 and the second control scheme confirmation screen 308 to understand and / or customize the control schemes associated with driving operations and machine operations, and confirm the operator's knowledge of these control schemes via instances of the control scheme confirmation option 306 before the operation screen 310 is displayed on the display 112.

[0063] although Figure 3 Example 300 shows two different control scheme confirmation screens 116, but other and / or different control scheme confirmation screens 116 can be displayed via display 112. As an example, if machine 100 has different types of machine controls 106, display 112 can present different control scheme confirmation screens 116 that display visual representations of the different types of machine controls 106, and the operations currently set to occur when using the different types of machine controls 106. As another example, if machine 100 has auxiliary systems (such as lighting, air conditioning, heating, and / or other types of systems), display 112 can also display one or more control scheme confirmation screens 116 in place of or supplement to the first control scheme confirmation screen 302 and the second control scheme confirmation screen 308, which allow the operator to understand and / or customize the control schemes used to control these auxiliary systems via one or more types of machine controls 106.

[0064] Despite Figure 3In Example 300, customization option 304 is shown presented via a first control scheme confirmation screen 302 and a second control scheme confirmation screen 308, but in some examples, customization option 304 may be omitted from instances of control scheme confirmation screen 116. In these examples, the operator can understand and confirm the current control scheme via control scheme confirmation screen 116. After the operator has understood and confirmed the current control scheme, and the display 112 switches to displaying operation screen 310, the operator can select an option via operation screen 310 that allows the operator to optionally reconfigure the control scheme.

[0065] on the whole, Figure 3 The control scheme shown on screen 116 can be presented in a sequence to inform the operator of the control scheme associated with machine control device 106, and to obtain confirmation from the operator that they are aware of the control scheme before they begin actively using machine control device 106. The following is about... Figure 4 Further discussion can be presented Figure 3 The control scheme shown is an example process for confirming the order of screen 116.

[0066] Figure 4 This is a flowchart 400 illustrating an exemplary process for presenting and confirming the control scheme used by machine 100 before it is actively used by an operator. Figure 4 The operations shown can be performed by one or more onboard computing systems of machine 100, such as controller 108 or other computing systems. Further discussion follows. Figure 5 An example system architecture for such an airborne computing system is described.

[0067] At box 402, the computing system can detect a machine power-on event. For example, a machine power-on event can occur and a startup procedure can be initiated when machine 100 is powered on after being in a shutdown state. For example, the computing system onboard machine 100 can be activated, the user interface manager 114 can begin displaying information via display 112, and / or other startup operations can begin preparing machine 100 for active use. In some examples, the user interface manager 114 can cause one or more initial screens to be presented via display 112, such as an operator login screen, which the operator can use to provide an operator identifier or other login credentials.

[0068] The computing system can be configured to prevent the operator from actively operating machine 100 until the operator provides user confirmation input that confirms the operator is aware of a control scheme that will control machine 100 via machine control device 106. Therefore, in response to a machine power-on event detected at box 402, user interface manager 114 can avoid displaying operation screen 310 and instead display information associated with the current scheme at box 404 via control scheme confirmation screen 116. For example, control scheme confirmation screen 116 displayed at box 404 can present a visual representation of machine control device 106 and the corresponding operation based on current control scheme data 110, which will be generated from using machine control device 106.

[0069] In some examples, the current control scheme data 110 may be determined at least in part based on which appliances 102 were attached to machine 100 at the time of the machine power-on event. For example, as part of the machine power-on event and / or subsequent startup sequence, appliance detector 118 may determine the identifiers of the appliances attached to machine 100. The computing system may determine the default or latest control scheme data 110 associated with the appliance based on the appliance identifier, such that the control scheme confirmation screen 116 displayed at box 404 reflects the current control scheme associated with that appliance.

[0070] At box 406, the computing system can determine whether the operator has selected customization option 304 via control scheme confirmation screen 116. Selecting customization option 304 indicates to the operator that they wish to change the control scheme displayed on control scheme confirmation screen 116 at box 404.

[0071] Therefore, if the operator selects customization option 304 (box 406 - Yes), the computing system can receive user input associated with the operator's requested change to the control scheme at box 408. For example, in response to selecting customization option 304, the user interface manager 114 can cause the display 112 to present menus, options, and / or other elements that allow the operator to select from other predetermined control schemes and / or customize the operation resulting from the use of the various machine control devices 106 or the functions or elements of machine control devices 106. At box 410, the computing system can use the user input received at box 408 to make corresponding changes to the control scheme data 110 to be used by the controller 108, thereby translating the input received via the machine control device 106 into corresponding movement and / or operation of the machine 100 and / or one or more implements 102.

[0072] After the control scheme data is changed at box 410, or if the operator does not select customization option 304 (box 406 – No), the computing system can receive user confirmation input at box 412, which confirms the control scheme initially presented at box 404 and / or changed at boxes 408 and 410. For example, the computing system can determine when the operator selects control scheme confirmation option 306 on control scheme confirmation screen 116 to confirm whether the operator is aware of the control scheme currently set for controlling machine 100. In some examples, boxes 404 through 412 can be repeated for different types of machine control devices 106, different operations and / or systems of machine 100, and / or different operations of one or more machines 102, so that the operator can understand, optionally adjust, and confirm awareness of the corresponding control scheme.

[0073] At box 412, in response to receiving user confirmation input that confirms the operator's awareness of the control scheme set up to control machine 100, the computing system can, at box 414, enable machine 100 to perform active machine operation based on the confirmed control scheme. For example, controller 108 can begin using the confirmed control scheme via control scheme data 110 to translate operator input provided by machine control device 106 into corresponding actions and other operations of machine 100 and / or one or more implements 102. User interface manager 114 can also convert display 112 into an operation screen 310, allowing the operator to view information displayed on operation screen 310 while driving machine 100 and / or using one or more implements 102 to perform work tasks.

[0074] At box 416, the computing system can determine whether an equipment change event has been detected. In some examples, machine 100 may have an equipment detector 118 configured to automatically detect when a new piece of equipment is attached to machine 100, and thus automatically detect equipment change events. In other examples, equipment change events may be detected based on user input provided by an operator indicating that a new piece of equipment has been attached to machine 100.

[0075] If no machine change event is detected (box 416 - No), the computing system may continue to allow machine 100 to perform active machine operation based on the control scheme confirmed at box 414. However, if a machine change event is detected (box 416 - Yes), the computing system may disable and / or deactivate active machine operation and return to box 404 to present a new instance of the control scheme confirmation screen 116 in response to the machine change event. For example, based on the identification of a newly attached machine, the computing system and / or user interface manager 114 may use stored control scheme data 110 to determine the default control scheme data 110 or the latest operator-set control scheme data 110 associated with the newly attached machine. The computing system and / or user interface manager 114 may use such control scheme data 110 to display a representation of the corresponding control scheme for the newly attached machine via a new instance of the control scheme confirmation screen 116 displayed at box 404. Therefore, the operator can understand the control scheme associated with the newly attached machine by checking the new instance of the control scheme confirmation screen 116, optionally modify the control scheme, and confirm that they are aware of the control scheme associated with the newly attached machine. When the operator confirms that they are aware of the control scheme associated with the newly attached machine by checking the new instance of the control scheme confirmation screen 116, the computing device can enable the machine 100 to perform active machine operations based on the confirmed control scheme, including operations associated with the newly attached machine.

[0076] Figure 5 This is a schematic illustration of an exemplary architecture of a computing system 500 that performs one or more elements described in this disclosure. The computing system 500 may include one or more processors 502, memory 504, and communication interface 506. The computing system 500 may be, or may include, one or more other onboard computing devices such as controller 108 and / or machine 100.

[0077] Processor 502 can operate to perform a variety of functions as set forth herein. Processor 502 may include one or more chips, microprocessors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) and / or other programmable circuits, central processing units (CPUs), graphics processing units (GPUs), digital signal processors (DSPs), and / or other processing units or components known in the art. In some examples, processor 502 may have one or more arithmetic logic units (ALUs) that perform arithmetic and logical operations and / or one or more control units (CUs) that fetch instructions and stored contents from processor cache and execute such instructions by invocation on the ALUs during program execution. Processor 502 may also access contents and computer-executable instructions stored in memory 504 and execute such computer-executable instructions.

[0078] Memory 504 may be a volatile and / or non-volatile computer-readable medium, including integrated or removable storage devices, including random access memory (RAM), read-only memory (ROM), flash memory, hard disk drive or other disk drive, memory card, optical storage device, magnetic storage device, and / or any other computer-readable medium. The computer-readable medium may be a non-transitory computer-readable medium. The computer-readable medium may be configured to store computer-executable instructions that can be executed by processor 502 to perform the operations described herein.

[0079] For example, memory 504 may include drive units and / or other elements including machine-readable media. The machine-readable media may store one or more sets of instructions, such as software or firmware, embodying any one or more of the methods or functions described herein. The instructions may also reside wholly or at least partially within processor 502 and / or communication interface 506 during execution by computing system 500. For example, processor 502 may have local memory that may also store program modules, program data, and / or one or more operating systems.

[0080] Memory 504 may store data and / or computer-executable instructions associated with control scheme data 110, user interface manager 114, and / or machine detector 118. For example, memory 504 may store data and / or computer-executable instructions that cause computing system 500 to convert input data received via machine control device 106 into commands or signals that cause corresponding operations to be determined based on control scheme data 110. Memory 504 may also store other modules and data 508 that can be used by computing system 500 to perform or enable the performance of any actions taken by computing system 500. For example, other modules and data 508 may include platforms, operating systems, and / or applications, as well as data used by platforms, operating systems, and / or applications.

[0081] Communication interface 506 may include interfaces through which computing system 500 receives input data from machine control unit 106, display 112, and / or other devices or systems. Communication interface 506 may also include interfaces through which computing system 500 outputs data, such as commands or signals converted from input data based on control scheme data 110, user interface elements, and other data to be presented via display 112, and / or other types of output data. In some examples, communication interface 506 may include transceivers, modems, interfaces, antennas, and / or other components that can transmit and / or receive data via networks, wireless connections, wired connections, or other data connections.

[0082] Industrial applicability

[0083] As described above, the control scheme confirmation screen 116 can be displayed via the display 112 of the machine 100, allowing the operator of the machine 100 to understand the current control scheme configured for use, optionally change the control scheme, and confirm that the operator is aware of the control scheme configured for use. The control scheme confirmation screen 116 can be displayed in response to a machine power-on event, a machine change event, an operator change event, or another triggering condition. Upon the occurrence of such a triggering condition, the machine 100 can disable active operation until the operator provides user input via the control scheme confirmation screen 116 to confirm that the operator is aware of the control scheme configured for use. The presentation of the control scheme confirmation screen 116 and the corresponding receipt of confirmation that the operator is aware of the control scheme to be used to control the machine 100 before active use can improve efficiency and enhance the security associated with the operation of the machine 100.

[0084] For example, by presenting the current control scheme to the operator via the control scheme confirmation screen 116 before the operator begins actively using machine 100 to perform a work task, the efficiency and safety associated with machine 100 and its surrounding environment can be improved. Therefore, the operator can be aware of any non-standard or undesirable aspects of the current control scheme and / or any changes to the control scheme before actively using machine 100. The operator can also confirm their awareness of the current control scheme via the control scheme confirmation screen 116, ensuring that the operator knows what actions will be produced by using machine control device 106. By ensuring that the operator knows what actions will be produced by using machine control device 106, the risk of the operator using machine 100 in an undesirable and / or unsafe manner due to an undesirable control scheme can be reduced.

[0085] The control scheme confirmation screen 116 can also improve efficiency when the operator uses machine types or machine control devices 106 that they have not used before. For example, by presenting a visual representation of the current control scheme to the operator via the control scheme confirmation screen 116, the operator can quickly understand which machine control devices 106 are present in the machine 100 and what actions will be performed by using these machine control devices 106. Therefore, the operator can understand the control scheme associated with the machine control devices 106 via the control scheme confirmation screen 116, which is more efficient and safer than the operator trying to understand the control scheme through trial and error over a period of time.

[0086] While various aspects of the invention have been specifically shown and described with reference to the above embodiments, those skilled in the art will understand that various additional embodiments can be conceived through modifications to the disclosed machines, systems, and methods without departing from the spirit and scope of the disclosure. These embodiments should be understood to fall within the scope of the invention as defined by the claims and any equivalents.

Claims

1. A computer-implemented method, the method comprising: The processor (502) of the onboard computing system (108) of the machine (100) causes the display (112) of the machine (100) (404) to display a control scheme confirmation screen (116), wherein: The control scheme confirmation screen (116) visually depicts the control scheme, which is based on control scheme data (110) and is currently configured to convert input data from the machine control device (106) of the machine (100) into corresponding operations of the machine (100); The processor (502) receives (412) user input via the control scheme confirmation screen (116), the user input including confirmation of the control scheme; and Active machine operation of the machine (100) is enabled (414) by the processor (502) and based on the user input, the active machine operation being controlled via the machine control device (106) based on the control scheme data (110).

2. The computer-implemented method according to claim 1, wherein the active machine operation of the machine (100) controlled via the machine control device (106) based on the control scheme data (110) includes at least one of the following: The driving operation of the machine (100), or Machine operation of the implement (102) attached to the machine (100).

3. The computer-implemented method according to claim 1, further comprising: The processor (502) detects a triggering condition associated with the control scheme confirmation screen (116); The processor (502) prevents the active machine from operating based on the occurrence of the triggering condition until it receives user input, which includes confirmation of the control scheme; as well as The processor causes the control scheme to confirm the presentation of the screen (116) based on the occurrence of the triggering condition.

4. The computer-implemented method according to claim 3, wherein the triggering condition includes at least one of the following: The machine power-on event (402) associated with the machine (100) being powered on, or An equipment change event (416) associated with the new equipment (102) being attached to the machine (100).

5. The computer-implemented method according to claim 4, further comprising: The processor (502) determines the identifier of the new machine (102); as well as The processor (502) determines the control scheme associated with the new machine (102) based on the identifier of the new machine (102). The control scheme confirmation screen (116) visually depicts the control scheme associated with the new machine (102).

6. The computer-implemented method according to claim 1, wherein: The user input includes the first user input. The method further includes: The processor (502) receives (408) a second user input via the control scheme confirmation screen (116), the second user input indicating a request to change the control scheme; and The processor (502) modifies (410) the control scheme data (110) based on the second user input, and The first user input confirms the control scheme at least in part based on the changes to the control scheme data (110), the changes being based on the second user input.

7. A machine (100), said machine comprising: Transmission (104); The machine (102) is configured to perform at least one work task; A machine control device (106) configured to control the operation of at least one of the transmission (104) or the implement (102) based on a control scheme defined by control scheme data (110); Display (112); and Airborne computing system (108), the airborne computing system being configured to: The display (112) of (404) is made to display a control scheme confirmation screen (116), which visually depicts the control scheme; The control scheme confirmation screen (116) receives (412) user input, the user input including confirmation of the control scheme; and Based on the user input, activate (414) active machine operation of at least one of the transmission (104) or the machine (102), the active machine operation being controlled via the machine control device (106) based on the control scheme data (106).

8. The machine (100) according to claim 7, wherein the onboard computing system (108) is further configured to: A trigger condition associated with the control scheme confirmation screen (116) has been detected; Based on the occurrence of the aforementioned trigger state, the active machine operation is prevented until user input is received, the user input including confirmation of the control scheme; and Based on the occurrence of the aforementioned triggering condition, the control scheme confirmation screen (116) is displayed.

9. The machine (100) according to claim 7, wherein the triggering condition includes at least one of the following: The machine power-on event (402) associated with the machine (100) being powered on, or An appliance change event (416) associated with the appliance (102) being attached to the machine (100).

10. The machine (100) according to claim 7, wherein: The user input includes the first user input. The airborne computing system (108) is also configured to: The control scheme confirmation screen (116) receives a second user input, which indicates a request to change the control scheme; and The control scheme data (110) is changed based on the second user input, and The first user input confirms the control scheme at least in part based on a change to the control scheme, the change being based on the second user input.

Images