Test method, system and device for hmi application

By using a multimodal large language model for cross-modal data verification in the automated testing of smart cockpit HMI applications, the challenge of semantic consistency verification was solved, resulting in more accurate and stable test results and improving the automation capability of HMI interaction consistency verification.

CN122240487APending Publication Date: 2026-06-19SZ ZHUOYU TECH CO LTD
0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
SZ ZHUOYU TECH CO LTD
Filing Date
2026-03-19
Publication Date
2026-06-19

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
Patent Text Reader

Abstract

This application discloses a testing method and apparatus for an HMI application. The method includes: acquiring a set of test cases for a target HMI application; performing automated triggering operations on the target HMI application based on triggering information to cause the target HMI application to output a testable output corresponding to a target HMI interaction event; collecting the testable output to obtain a testable data set corresponding to the testable output; constructing at least one test input data pair based on the expected test content and the testable data set; inputting the at least one test input data pair into a multimodal large language model to obtain a test result characterizing the consistency between the testable output and the expected test content; and generating automated test conclusions for the corresponding test cases based on the test result. This elevates the testing from traditional text similarity or pixel-level comparison to semantic-level consistency verification oriented towards real user perception.
Need to check novelty before this filing date? Find Prior Art