Modular display control device and method based on FMQL

Abstract

The invention provides a modular display control device and method based on FMQL. The display control device based on the FMQL comprises an FMQL series PSOC, a touch display screen, an NOR FLASH, an NAND FLASH, a DDR, a gigabit Ethernet, a serial port, a key and the like. The display and control method based on the FMQL comprises configuration of each interface controller of the system, transmission of data streams, analysis and storage of data, adaptation of an operating system, display and touch of an interface and the like. Based on the scheme, the modularized display control device and method based on the FMQL are realized, aiming at a scene with a display control requirement, resources required by display and partial control are allocated to the independent display control module, and the independent display control module can be used as an additional module to provide display and control services for any equipment with an RGMII protocol interface; due to the high-reliability design, the design can adapt to various complex and changeable scenes.

Description

Technical Field

[0001] This invention relates to the field of embedded computer display and control technology, specifically to a modular display and control device and method based on FMQL. Background Technology

[0002] Embedded systems are dedicated computing systems designed for specific functions. They typically use microcontrollers or microprocessors as their core, tightly integrating hardware and software and embedding them into larger devices or systems. These devices are generally characterized by low power consumption, high reliability, and strong real-time performance, and are widely used in everything from smart home appliances and wearable devices to critical fields such as industrial control, automotive electronics, medical instruments, communication networks, and aerospace, becoming indispensable invisible computers in modern intelligent products and infrastructure. Currently, various fields are rapidly iterating on embedded systems. Modern human-computer interaction often requires graphical and user-friendly interfaces to present product functions and operation methods to customers in the most straightforward and simple way, thus increasing the demand for display and control solutions in the embedded field.

[0003] In existing technologies, display and control solutions require rapid adaptation. Display functionality is resource-intensive in embedded systems, and integrating it into the main control chip would significantly deplete its resources. Conventional display and control solutions integrate the resources required for display and some control functions, thus placing high pressure on the main control CPU and reducing device reliability. Summary of the Invention

[0004] In view of the shortcomings of the existing technology, the purpose of this invention is to provide a modular display and control device and method based on FMQL to solve the problems mentioned in the background. The design of this invention is easy to upgrade and highly adaptable. It can be used as an additional module to provide display and control services for any device with RGMII protocol interface. The highly reliable design makes it adaptable to various complex and ever-changing scenarios.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a modular display and control device based on FMQL, comprising a display and control device body, including an FMQL series PSOC, a touch screen, NOR FLASH, NAND FLASH, DDR, Gigabit Ethernet, a serial port, and buttons. In the FMQL series PSOC, the ARM processor and the FPGA logic are interconnected via an AXI bus for data interaction. The NOR FLASH is controlled using a Quad-SPI controller on the PS side. The NAND FLASH is controlled using an NFC controller on the PS side.

[0006] Furthermore, the DDR communicates with the ARM via the DDR3 interface, the Gigabit Ethernet interface is implemented through a multi-mode Ethernet controller on the PS side, and adopts the RGMII mode; the touch display function controller is implemented by PL logic resources, and the HP high-speed interface is used as the data path, and the GP port is used as the control path interface, and the controller is designed and implemented.

[0007] Furthermore, the ARM interacts with the controller via the AXI bus to realize data transmission via the LVDS bus. The touch function controller in the touch display function is implemented through the IIC bus, interrupt signals, and GPIO interface. The IIC interface is used to transmit screen touch point coordinate information.

[0008] Furthermore, the interrupt interface is used to ensure real-time response to touch information, and the interrupt signal and touch point coordinates are generated simultaneously; the GPIO interface is controlled by buttons, and the buttons include five hardware buttons: up, down, left, right and confirm, so that the screen can be controlled by the buttons when the screen is in a harsh working environment and the touch fails.

[0009] Furthermore, in the touch display function, the screen is a capacitive screen with anti-electromagnetic interference capability, and UART and Gigabit Ethernet 2 are used for interactive debugging with the PC.

[0010] Furthermore, the display and control device is also used to parse external data, drive the display touch screen, and allow external data sources to interact with the display and control device via Gigabit Ethernet 1. The ARM side of the PSOC parses and reassembles the data according to a custom protocol.

[0011] Furthermore, the image signal is output through the controller on the PL side, and the touch coordinate information is input through the IIC bus, interrupt signal, and GPIO.

[0012] A display and control method using the above-mentioned display and control device includes the following steps:

[0013] S1. The ARM processor initializes and performs self-tests on the video information output controller and DMA via the AXI bus;

[0014] S2. The data to be processed and displayed is contained in an external data source and transmitted to the ARM end of the PSOC via Gigabit Ethernet 1;

[0015] The S3 and PL terminals use the AXI_HP high-speed interface via the DMA controller to transfer data to the AXI4-Stream toVideo Out video information output controller, and convert the output format from RGB to LVDS for output.

[0016] S4. The entire system uses the WingHui embedded real-time operating system for resource management. The touch display interface is developed using QT software based on the WingHui embedded real-time operating system. It parses and reassembles data that conforms to the custom protocol and outputs it to the PL end video information output controller to realize the output of image signals.

[0017] S5. When a person touches the display screen, the display screen will transmit the coordinates of the touch point to the ARM terminal through the IIC interface according to the protocol and generate an interrupt signal.

[0018] S6. Uses one network port and one serial port separately as debugging interfaces for interaction with the PC to meet the hardware requirements for adapting to the operating system and QT display interface.

[0019] Furthermore, in step S2, the ARM terminal is used to parse the data, extract and reassemble the data to be displayed, and the ARM terminal interacts with the PL terminal through the AXI bus.

[0020] Furthermore, in step S5, the ARM side parses the coordinates according to the protocol, analyzes the location of the touch point on the screen, moves the mouse coordinates on the screen to the parsed coordinates, and obtains the touch input information by comparing the identified coordinate information; the GPIO interface acts as a hardware backup to control the mouse on the screen.

[0021] The beneficial effects of this invention are:

[0022] 1. This modular display and control device based on FMQL is based on the FMQL series chip fmql45t900 from Shanghai Fudan Microelectronics. The quad-core high-performance CPU is the core of the processor system. It works together with on-chip memory, external memory interface DDR, various system functional components, I / O peripherals and programmable logic to form an on-chip programmable system, providing a flexible implementation solution for embedded systems.

[0023] 2. This FMQL-based modular display and control method pursues a modular, universal, and highly reliable design. The modular and universal design makes it easy to upgrade and highly adaptable, serving as an add-on module to provide display and control services for any device with an RGMII protocol interface. The highly reliable design allows it to adapt to various complex and changing scenarios. Attached Figure Description

[0024] Figure 1 This is a schematic diagram of a modular display and control device based on FMQL according to the present invention. Detailed Implementation

[0025] To make the technical means, creative features, objectives and effects of this invention easier to understand, the invention will be further described below in conjunction with specific embodiments.

[0026] Please see Figure 1 The present invention provides the following technical solution: a modular display and control device based on FMQL, including: an FMQL_PSOC main control chip, a display touch screen, buttons, an Ethernet port, an AXI bus, an LVDS interface, an IIC interface, a GPIO interface, Flash, DDR, eMMC, etc.

[0027] In this embodiment, the ARM processor can directly initialize and call the PS-side interface controller, or it can call the controller composed of PL-side logic resources via the AXI bus. The ARM-side processor processes and reassembles the incoming data and displays it on the touchscreen, allowing human-machine interaction through the touchscreen's display and touch functions.

[0028] In the above embodiment, the AXI bus uses the AXI4 protocol for bus communication, and the AXI bus clock is set to 100MHz. The AXI_HP port is used as the high-speed data path. LVDS is used as the video information output bus. The PSoC uses the FMQL045T900 from Shanghai Fudan Microelectronics Co., Ltd. as the main control chip.

[0029] In the above embodiments, preferably, physical buttons are used as a backup for the touch function, with five buttons for up, down, left, right, and confirm, serving as a backup input device in case of touch failure under harsh environments. A capacitive touchscreen with electromagnetic interference resistance is used. The entire system is managed using the Winghui embedded real-time operating system.

[0030] In the above embodiments, preferably, the touch display interface is developed using QT software based on the WingHui embedded real-time operating system. A separate network port and serial port of the PS are used as the debugging interface for interaction with the PC.

[0031] This embodiment also provides an FMQL-based modular display and control method for an FMQL-based modular display and control device, including the following steps:

[0032] 1. The ARM processor initializes and performs self-tests on the video information output controller and DMA via the AXI bus.

[0033] 2. The data to be processed and displayed is contained in an external data source and transmitted to the ARM end of the PSOC via Gigabit Ethernet 1. The ARM end parses the data, extracts and reassembles the information to be displayed, and the ARM end interacts with the PL end via the AXI bus.

[0034] 3. The PL terminal uses the AXI_HP high-speed interface via the DMA controller to transfer data to the AXI4-Stream to VideoOut video information output controller. The output format is then converted from RGB to LVDS for output.

[0035] 4. The entire system uses the WingHui embedded real-time operating system for resource management. The touch display interface is developed using QT software based on the WingHui embedded real-time operating system. It parses and reassembles data that conforms to the custom protocol and outputs it to the PL-end video information output controller to realize the output of image signals.

[0036] 5. When a hand touches the display screen, the screen transmits the touch point coordinates to the ARM terminal via the IIC interface according to the protocol, and generates an interrupt signal. The ARM terminal parses the coordinates according to the protocol, analyzes the location of the touch point on the screen, moves the mouse coordinates on the screen to the parsed coordinates, and compares the detected coordinate information to obtain the touch input information, thus realizing the touch screen information input function. The GPIO interface can be used as a hardware backup to control the mouse on the screen.

[0037] 6. Use one network port and one serial port separately as debugging interfaces for interaction with the PC to meet the hardware requirements for adapting to the operating system and QT display interface.

[0038] This embodiment has shown and described the basic principles, main features, and advantages of the present invention. It will be apparent to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or basic features of the present invention.

[0039] Furthermore, it should be understood that although this specification describes embodiments, not every embodiment contains only one independent technical solution. This narrative style is merely for clarity. Those skilled in the art should consider the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.

Claims

1. A modular display and control device based on FMQL, comprising a display and control device body, characterized in that: The system includes an FMQL series PSOC, a touch display, NOR FLASH, NAND FLASH, DDR, Gigabit Ethernet, serial port, and buttons. In the FMQL series PSOC, the ARM processor and FPGA logic are interconnected via an AXI bus for data exchange. The NOR FLASH is controlled by a Quad-SPI controller on the PS side, and the NAND FLASH is controlled by an NFC controller on the PS side.

2. The modular display and control device based on FMQL according to claim 1, characterized in that: The DDR communicates with the ARM via the DDR3 interface, and the Gigabit Ethernet interface is implemented through a multi-mode Ethernet controller on the PS side, using the RGMII mode. In the touch display function, the display function controller is implemented by PL logic resources, with the HP high-speed interface as the data path and the GP port as the control path interface, and the controller is designed and implemented.

3. A modular display and control device based on FMQL according to claim 2, characterized in that: The ARM communicates with the controller via the AXI bus to achieve data transmission via the LVDS bus. The touch function controller in the touch display function is implemented through the IIC bus, interrupt signals, and GPIO interface. The IIC interface is used to transmit screen touch point coordinate information.

4. A modular display and control device based on FMQL according to claim 2, characterized in that: The interrupt interface is used to ensure real-time response to touch information, and the interrupt signal and touch point coordinates are generated simultaneously; the GPIO interface is controlled by buttons, and the buttons include five hardware buttons: up, down, left, right and confirm, so that the screen can be controlled by the buttons when the screen is in a harsh working environment and the touch fails.

5. A modular display and control device based on FMQL according to claim 4, characterized in that: In the touch display function, the screen is a capacitive screen with electromagnetic interference resistance, and UART and Gigabit Ethernet 2 are used for interactive debugging with the PC.

6. A modular display and control device based on FMQL according to claim 1, characterized in that: The display and control device is also used to parse external data, drive the display touch screen, and the external data source interacts with the display and control device through Gigabit Ethernet 1. The ARM end of the PSOC parses and reassembles the data according to a custom protocol.

7. A modular display and control device based on FMQL according to claim 6, characterized in that: The image signal is output through the controller on the PL side, and the touch coordinate information is input through the IIC bus, interrupt signal and GPIO.

8. A display and control method using the display and control device as described in claim 1, characterized in that, Includes the following steps: S1. The ARM processor initializes and performs self-tests on the video information output controller and DMA via the AXI bus; S2. The data to be processed and displayed is contained in an external data source and transmitted to the ARM end of the PSOC via Gigabit Ethernet 1; S3 and PL terminals use the AXI_HP high-speed interface via the DMA controller to transfer data to the AXI4-Stream to VideoOut video information output controller, and convert the output format from RGB to LVDS for output. S4. The entire system uses the WingHui embedded real-time operating system for resource management. The touch display interface is developed using QT software based on the WingHui embedded real-time operating system. It parses and reassembles data that conforms to the custom protocol and outputs it to the PL end video information output controller to realize the output of image signals. S5. When a person touches the display screen, the display screen will transmit the coordinates of the touch point to the ARM terminal through the IIC interface according to the protocol and generate an interrupt signal. S6. Uses one network port and one serial port separately as debugging interfaces for interaction with the PC to meet the hardware requirements for adapting to the operating system and QT display interface.

9. The display and control method according to claim 8, characterized in that: In step S2, the ARM terminal is used to parse the data, extract and reassemble the data to be displayed, and the ARM terminal interacts with the PL terminal through the AXI bus.

10. The display and control method according to claim 8, characterized in that: In step S5, the ARM terminal parses the coordinates according to the protocol, analyzes the position of the touch point on the screen, moves the mouse coordinates on the screen to the parsed coordinates, and obtains the touch input information by comparing the identified coordinate information. The GPIO interface serves as a hardware backup for controlling the mouse on the screen.

Images