Man-machine interaction system of display device and display

By integrating the human-machine interaction system of construction machinery products through a unified software framework, the problems of poor control system versatility and complex fault diagnosis have been solved. It has achieved centralized information management and rapid fault diagnosis, improved user experience and safety, and enabled rapid adaptation to different vehicle models.

CN121583016APending Publication Date: 2026-02-27江苏思创工业设计研究院有限公司 +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202511644878.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-11-11
Publication Date
2026-02-27

AI Technical Summary

Technical Problem

The existing human-machine interaction systems of construction machinery products have significant differences in control logic, functional modules and interaction methods, resulting in poor control system versatility, high development costs, complex fault diagnosis, incomplete information retrieval, and difficulty for drivers to obtain key information in a timely manner.

Method used

A unified software framework is adopted to integrate vehicle control and information functions. Through fault query module, information query module, function setting module, system setting module and administrator setting module, it realizes centralized information management, rapid fault diagnosis and handling, convenient user operation and secure control of system access.

Benefits of technology

It improves system development efficiency and maintainability, enhances the timeliness of fault detection and the ease of troubleshooting, shortens downtime, provides a comprehensive vehicle status view, ensures vehicle operation safety and data integrity, and allows for rapid adaptation to different vehicle models.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121583016A_ABST
    Figure CN121583016A_ABST
Patent Text Reader

Abstract

The invention discloses a man-machine interaction system of a display device and a displayer, and relates to the technical field of man-machine interaction systems. The system comprises a system bus, and a fault query module, an information query module, a function setting module, a system setting module, an administrator setting module and a vehicle type adaptation module which are connected with the system bus. According to the system, the functions of fault query, whole vehicle information visualization, underlying communication management, interaction parameter setting, key function access control, vehicle type adaptation and the like are integrated through modular design, the system complexity is reduced, and the development efficiency and maintainability are improved; a dual-path fault access mechanism improves the troubleshooting efficiency, and a closed loop from problem discovery to service response is realized in combination with a repair function; the information of the whole vehicle is displayed in a centralized and classified manner to provide a visual state view for a driver; and the administrator permission and vehicle type adaptation module ensures the system security and the wide application capability across vehicle types, and realizes multiple improvements in user experience, operation security and commercial benefits.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to a man-machine interaction system of a display device, and belongs to the technical field of man-machine interaction of engineering machinery.

[0002] The present application relates to a man-machine interaction system of a display device, and belongs to the technical field of man-machine interaction of engineering machinery. BACKGROUND

[0003] With the rapid development of electronic information technology, the man-machine interaction system configured for engineering machinery products is constantly updated. At present, the design of display interaction in the engineering machinery industry has the following problems: most of the existing vehicles are single vehicle type customized development, and the control logic, function modules and interaction modes of different vehicle types are significantly different, resulting in poor generality of the control system and high development cost. The traditional man-machine interaction control system has the problems of scattered functions, complex fault troubleshooting process, incomplete information query and lack of permission management. Many existing interfaces simply list various information and functions on the screen, and the core driving information and auxiliary information are not effectively distinguished, which causes the driver to be unable to obtain the key information of the vehicle in time. The above-mentioned problems exist significant bottlenecks in the improvement of user experience, operation efficiency and safety. SUMMARY

[0004] The purpose of the present application is to provide a man-machine interaction system of a display device and a display, which logically integrates the dispersed vehicle control and information functions through a unified software framework, realizes centralized management of information, rapid diagnosis and processing of faults, convenience of user operation and safety control of system access.

[0005] To achieve the above purpose, the present application adopts the following technical scheme.

[0006] On the one hand, the present application provides a man-machine interaction system of a display device, which comprises a system bus, and a fault query module, an information query module, a function setting module, a system setting module and an administrator setting module connected with the system bus.

[0007] The fault query module is used for providing a fault information access path;

[0008] The information query module is used for uniformly collecting, classifying and visually displaying the whole vehicle data;

[0009] The function setting module is used for providing the underlying communication interface management and diagnosis function;

[0010] The system setting module is used for managing the display and interaction parameters related to man-machine interaction;

[0011] The administrator setting module is used for access control of key functions;

[0012] A vehicle model adaptation module is configured to provide a vehicle model configuration file to the fault query module, the information query module, and the function setting module to achieve quick adaptation of different vehicle models.

[0013] Optionally, the fault information access path comprises:

[0014] An active query path is configured to control the display device to jump to a fault information main page in response to a fault query instruction triggered by a user on a system main page.

[0015] A passive guide path is configured to control the display device to generate an alarm prompt on the main page when the system detects a vehicle fault, and jump to a fault detail page corresponding to the vehicle fault in response to user operation on the alarm prompt.

[0016] Optionally, the fault detail main page provides a repair function configured to respond to a user repair instruction and automatically package and send fault information to a cloud server for pushing to a bound maintenance terminal.

[0017] The fault information main page displays fault information classified by subsystems, including vehicle faults, steering system faults, hydraulic system faults, walking system faults, and BMS faults. Each fault information entry includes a fault code, a fault description, a fault cause prompt, and a preliminary treatment suggestion.

[0018] Optionally, the information query module is configured to:

[0019] Collect operating data of vehicle subsystems, including the power system, the GPS system, the vehicle system, the walking system, the tire pressure monitoring system, the hydraulic system, the cooling system, and the steering system, and generate corresponding visual information views.

[0020] When the vehicle is a new energy vehicle model, the power system information is changed from engine-related parameters of a fuel vehicle to real-time parameters of an electric motor, battery pack information, and electric motor control information.

[0021] The visual information views are implemented through graphical user interface elements, including icons, instrument panels, and color coding.

[0022] Optionally, the administrator setting module is configured to access control key functions through permission isolation and password verification.

[0023] After verification, authorized personnel can perform the following operations, including clearing fault history records, calibrating and adjusting key system parameters, viewing and updating software versions, restoring factory settings, and viewing and managing repair sending records.

[0024] Optionally, the function setting module further includes a human-machine interface management unit, which includes:

[0025] The family-style unified interface settings function is used to apply a unified visual and interactive theme to different car models;

[0026] The standardized layout design function is used to define and manage the area division and layout templates of information on the screen.

[0027] Optionally, the family-oriented unified interface settings function is configured as follows:

[0028] The display status of interface elements is updated based on changes in vehicle data, including triggering color changes of interface elements based on preset parameter thresholds and updating the corresponding parameter values.

[0029] Optionally, the standardized layout function defines the interface as three areas: the status bar at the top, the core function area in the middle, and the menu bar at the bottom;

[0030] The positions of the elements in the status bar and menu bar are fixed, while the core function area allows users to customize, add, or configure function modules.

[0031] Optionally, when the vehicle model adaptation module imports a new vehicle model configuration file, it only needs to import the function list and parameter thresholds of the new vehicle model; the system synchronously calls the human-machine interface management unit to load the corresponding interface theme and layout template.

[0032] In a second aspect, the present invention provides a display that is configured with a human-computer interaction system of the display device described in any one of the first aspects.

[0033] Compared with the prior art, the beneficial effects achieved by the present invention are as follows:

[0034] This invention boasts advantages of high integration and modularity. By consolidating disparate functions into logically clear modules through a unified software framework, it reduces system complexity and improves development efficiency and maintainability. The dual-path access mechanism significantly enhances the timeliness of fault detection and the convenience of troubleshooting. The repair reporting function achieves seamless integration from fault discovery to service response, shortening downtime. Categorizing and displaying all vehicle information within a single module provides drivers with a comprehensive and intuitive view of vehicle status, assisting them in making accurate operational decisions, particularly optimizing the information display for the powertrain systems of new energy vehicles. The administrator settings module effectively prevents unauthorized personnel from misoperating critical functions, ensuring vehicle operational safety and data integrity. The vehicle model adaptation module is designed to be quickly applied to traditional fuel vehicles or new energy vehicles by adding, removing, or modifying specific sub-modules, demonstrating excellent market adaptability. Attached Figure Description

[0035] Figure 1 This is a schematic diagram of the human-computer interaction system of the display device provided in an embodiment of the present invention;

[0036] Figure 2 This is a schematic diagram of the system main page functional layout provided in an embodiment of the present invention;

[0037] Figure 3 This is a schematic diagram of a fault query page provided in an embodiment of the present invention;

[0038] Figure 4 This is a schematic diagram of an information query page provided in an embodiment of the present invention. Detailed Implementation

[0039] The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the embodiments of the present invention and the specific features in the embodiments are detailed descriptions of the technical solution of the present invention, rather than limitations thereof. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments can be combined with each other.

[0040] The term "and / or" simply describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Additionally, the character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0041] Example 1

[0042] This embodiment describes a human-computer interaction system for a display device, which is applied to a display, such as... Figure 1 As shown, the system includes a system bus, and components connected to the system bus:

[0043] The fault query module, which provides access paths for fault information, is the core diagnostic unit of the system and offers two intelligent fault information access paths.

[0044] The information query module is used to collect, classify, and visualize all vehicle data; this module is the information hub of the vehicle.

[0045] The function settings module provides low-level communication interface management and diagnostic functions, primarily serving technicians for in-depth troubleshooting. This includes communication query and port query. The communication query checks the status of the vehicle's current communication network (such as the CAN bus), including communication speed, error frame statistics, and network load rate, assisting in determining if the communication link is functioning correctly. The port query displays the definitions and status of each pin of the on-board diagnostic interface, facilitating wiring checks and connections when external diagnostic equipment is connected.

[0046] The system settings module is used to manage display and interaction parameters related to human-computer interaction, avoiding fragmented settings. Specifically, it allows you to set the system's time, language, unit of measurement, and display (screen brightness, contrast, backlight duration, etc.).

[0047] The administrator settings module is used for access control of critical functions and serves as the system's security portal.

[0048] The vehicle model adaptation module is used to provide vehicle model configuration files to the fault query module, information query module, and function setting module to achieve rapid adaptation to different vehicle models.

[0049] The two fault information access paths mentioned above include:

[0050] Active query path: In response to the user's touch operation of the "Fault Query" button in the home menu, directly enter the main page of fault query information.

[0051] Passive guidance path: The system monitors the vehicle status in real time. When a fault that reaches the alarm threshold is detected, a high-priority pop-up window will be displayed on the main page. When the user clicks on the pop-up window, they can directly jump to the secondary page for fault query information most relevant to the alarm.

[0052] The main page for fault details provides a repair request function, configured to respond to user repair requests and automatically package the fault information and send it to the cloud server. The cloud server then pushes the information to the bound repair terminal. Specifically:

[0053] When the hydraulic system ECU detects abnormal oil pressure, it sends a message containing a fault code via the CAN bus. The system's fault diagnosis module captures this message through bus monitoring and first parses and determines its severity in the background. If a serious fault is detected, a "passive guidance" path is immediately triggered, displaying a warning box on the homepage: "Hydraulic system pressure abnormal, please check immediately!" Clicking the warning box redirects the system to the "Hydraulic System Faults" subpage, highlighting the fault entry. A "Contact Repair" button is provided at the bottom of the page. Clicking this button automatically packages the fault information and sends it to the cloud server via the built-in mobile communication module. The server then pushes the information to the linked repair engineer's mobile app, where a repair plan is confirmed and repairs are performed.

[0054] The fault information main page displays fault information categorized by subsystem, such as... Figure 3 As shown, the fault information includes: vehicle faults, steering system faults, hydraulic system faults, running system faults, and BMS faults. Each fault information entry includes a fault code, fault description, fault cause indication, and preliminary handling suggestions.

[0055] The information query module collects operational data from the vehicle subsystems and generates corresponding visual information views. The specific interface for information querying is as follows: Figure 4 As shown, the vehicle subsystem includes:

[0056] Powertrain: For new energy vehicles, it deeply integrates real-time motor parameters (speed, torque, temperature), battery pack information (SOC, SOH, cell voltage, temperature), and motor controller information. For traditional vehicles, it displays engine-related parameters.

[0057] GPS system: Displays real-time vehicle location, speed, heading, historical trajectory, and other information.

[0058] Vehicle System: Displays the core status of the vehicle, such as key switch status, hourly meter, total mileage, etc.

[0059] Walking system: Displays vehicle speed, gear, braking status, etc.

[0060] Tire pressure monitoring system: Displays the real-time pressure and temperature of each tire in a visual manner.

[0061] Hydraulic system: Displays hydraulic oil temperature, oil pressure, working pump status, etc.

[0062] Cooling system: Displays coolant temperature, fan speed, etc.

[0063] Steering system: Displays steering angle, steering pump pressure, etc.

[0064] This module uses various UI elements such as charts, dashboards, and color coding to enable users to quickly and intuitively understand the vehicle's health status and operational status.

[0065] The administrator settings module is configured to control access to critical functions through permission isolation and password verification. This module is hidden or inoperable by default and can only be accessed through a specific operation (entering a password). The password is held by the relevant personnel in the maintenance service management department.

[0066] Once verified, authorized personnel can perform the following operations: clearing fault history records, calibrating and setting critical system parameters, viewing and updating software versions, restoring factory settings, and viewing and managing repair request records.

[0067] The function setting module also includes a human-machine interface management unit, which includes:

[0068] The family-oriented unified interface settings feature allows for the application of a consistent visual and interactive theme across different vehicle models. This theme includes different configurations for icon shapes and colors in the interface elements. This improves operator learning efficiency and reduces learning costs and the risk of misoperation.

[0069] The standardized layout design function is used to define and manage the area division and layout templates of information on the screen.

[0070] Among them, the family-oriented unified interface settings function can update the display status of interface elements according to changes in vehicle data, including triggering color changes of interface elements based on preset parameter thresholds and updating the corresponding parameter values. When the battery level is lower than a certain value, the fill color of the battery display box turns red to serve as a reminder.

[0071] The standardized layout feature defines the interface as three areas, such as Figure 2 The interface is as follows: a top status bar (displaying time, temperature, working hours, and mileage), a central core function area (displaying the most critical driving or operational information), and a bottom menu bar (for function navigation). The positions of elements in the status bar and menu bar are fixed. The primary menu items "Home" and "Mute" remain in fixed positions and are always visible. The core function area allows users to add or configure custom function modules, such as voltage, current, and motor modules. This ensures that any function module can be connected, and that different functions have reserved display positions, guaranteeing 100% interface reuse across the three vehicle types (mining machine, loader, and grader).

[0072] When the vehicle model adaptation module imports a new vehicle model configuration file, it only needs to import the new vehicle model's function list (e.g., new energy vehicles need to enable the BMS fault submodule, and fuel vehicles need to disable the module) and parameter thresholds (e.g., the normal range of hydraulic pressure for different vehicle models), without modifying the system's core framework; the system synchronously calls the human-machine interface management unit to load the corresponding interface theme and layout template.

[0073] Example 2

[0074] Based on the same inventive concept as Embodiment 1, this embodiment introduces a display that is equipped with the human-computer interaction system of the display device of Embodiment 1.

[0075] In summary, this invention boasts advantages of high integration and modularity. By consolidating disparate functions into logically clear modules through a unified software framework, it reduces system complexity and improves development efficiency and maintainability. The dual-path access mechanism significantly enhances the timeliness of fault detection and the convenience of troubleshooting. The repair reporting function achieves seamless integration from fault discovery to service response, shortening downtime. Categorizing and displaying all vehicle information within a single module provides drivers with a comprehensive and intuitive view of vehicle status, assisting them in making accurate operational decisions, particularly optimizing the information display for the powertrain systems of new energy vehicles. The administrator settings module effectively prevents unauthorized personnel from misoperating critical functions, ensuring vehicle operational safety and data integrity. The vehicle model adaptation module is designed to be quickly applied to traditional fuel vehicles or new energy vehicles by adding, removing, or modifying specific sub-modules, demonstrating excellent market adaptability.

[0076] The embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of the present invention without departing from the spirit and scope of the claims. All of these forms are within the protection scope of the present invention.

Claims

1. A human-machine interaction system of a display device, characterized by, The system bus and a display device connected with the system bus are provided, and the system bus comprises: a fault query module configured to provide a fault information access path; an information query module configured to collect, classify and visually display whole vehicle data; a function setting module configured to provide a bottom-layer communication interface management and diagnosis function; a system setting module configured to manage display and interaction parameters related to human-computer interaction; an administrator setting module configured to access control of key functions; a vehicle model adaptation module configured to provide a vehicle model configuration file to the fault query module, the information query module and the function setting module to realize quick adaptation of different vehicle models.

2. The human-machine interaction system of claim 1, wherein, The fault information access path comprises: an active query path configured to control the display device to jump to a fault information main page in response to a fault query instruction triggered by a user on a system main page; a passive guide path configured to control the display device to generate an alarm prompt on the main page when the system monitors a vehicle fault, and jump to a fault detail page corresponding to the vehicle fault in response to user operation on the alarm prompt.

3. The human-machine interaction system of claim 2, wherein, The fault detail main page provides a repair function configured to respond to a user repair instruction and automatically package and send fault information to a cloud server, which is pushed to a bound maintenance terminal. The fault information main page displays fault information classified by subsystems, including whole vehicle faults, steering system faults, hydraulic system faults, walking system faults and BMS faults, and each fault information entry includes a fault code, a fault description, a fault cause prompt and a preliminary treatment suggestion.

4. The human-machine interactive system of display device according to claim 1, wherein, The information query module is configured to: collect running data of vehicle subsystems, including power systems, GPS systems, whole vehicle systems, walking systems, tire pressure monitoring systems, hydraulic systems, heat dissipation systems and steering systems, and generate corresponding visual information views; when the vehicle is a new energy vehicle model, power system information is changed from engine related parameters of a fuel vehicle to real-time parameters of an electric motor, battery pack information and electric motor control information; the visual information views are realized through graphical user interface elements, including icons, instrument panels and color coding.

5. The human-machine interactive system of display device according to claim 1, wherein, The administrator setting module is configured to access control of key functions through permission isolation and password verification; after verification, authorized personnel can perform the following operations, including clearing fault history records, calibrating key system parameters, checking and updating software versions, restoring factory settings, checking and managing repair sending records.

6. The human-machine interactive system of display device according to claim 1, wherein, The function setting module further comprises a human-computer interface management unit, which comprises: a family unified interface setting function for applying a unified visual and interaction theme to different vehicle models; a standardized layout design function for defining and managing area division and layout templates of information on a screen.

7. The human-machine interaction system of claim 6, wherein, The family unified interface setting function is configured to: update the display state of interface elements according to changes in vehicle data, including triggering color changes of interface elements based on preset parameter thresholds, and updating corresponding parameter values.

8. The human-machine interactive system of display device according to claim 6, wherein, The standardized layout function defines the interface into three areas: a status bar at the top, a core function area in the middle, and a menu bar at the bottom; The element positions of the status bar and the menu bar are fixed, and the core function area allows the user to add or configure function modules.

9. The human-machine interactive system of display device according to claim 6, wherein, When the vehicle model adaptation module imports a new vehicle model configuration file, only the function list and parameter threshold of the new vehicle model need to be imported; the human-computer interface management unit is called synchronously to load the corresponding interface theme and layout template.

10. A display, characterized by The display is configured with the human-computer interaction system of the display device of any one of claims 1-9.