Cockpit voice interaction method based on artificial intelligence

Abstract

The invention discloses a cockpit voice interaction method based on artificial intelligence. The cockpit voice interaction method comprises the following steps of 1, disassembling a large cockpit screen into basic components and materials with minimum particles; the method comprises the following steps of 1, constructing a basic component and a material, 2, constructing resources through the basic component and the material to form a plurality of groups of resource libraries, and 3, constructing a business component and a drawing board through a visual platform, and presetting keyword information in the construction process of the business component and the drawing board to trigger corresponding data extraction capability and analysis capability. The cockpit large screen constructed based on the capability of a visual engine platform can be combined with artificial intelligence to realize innovative interaction and analysis, assists a user in explanation and demonstration, and can realize the following technical effects: triggering switching of a cockpit large screen drawing board in a voice form is supported, and the operation is convenient. The method is not limited to a mouse click mode any more, and meanwhile, a voice form is supported to trigger artificial intelligence to convert large-screen data into voice for broadcasting through the artificial intelligence.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a method for cockpit voice interaction based on artificial intelligence. Background Art

[0002] Artificial intelligence is an important driving force for the new round of scientific and technological revolution and industrial transformation. It is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. When using an artificial intelligence cockpit, it is usually necessary to interact with the large screen through voice. During the voice interaction, the large screen may have certain problems, such as: The large-screen introduction and explanation are highly random: depending on the level of the explainer, it is easy to have omissions, speak too fast or too slowly, and other situations that make it impossible for users to fully understand the explanation content.

[0003] The large-screen interactive mode is single: operation is performed through a mouse. In certain scenarios, two people are required to cooperate to complete the demonstration, with one explaining in the front and the other operating in the back, which can easily lead to errors such as disordered explanation rhythm or delayed operation.

[0004] Slow delivery: Since the large screen is customized, the delivery cycle is long and the efficiency is low. It usually takes more than a week to initially realize it, which cannot meet the timeliness requirements of users. In addition, the subsequent iteration cycle of large screen transformation is long. For example, when faced with adjustments to the large screen, even minor adjustments, it is impossible to respond to adjustments in a timely manner. All deployment and updates need to be carried out in the traditional way, and the visual management of the large screen cannot be completed quickly and flexibly.

[0005] Expensive: The cost of customization is high, and changes are prone to occur during the customization process, which requires a lot of effort to adjust, affecting cost control; in addition, the resource utilization rate of customized large screens is low, and each time it is "starting over", there is no effective accumulation and precipitation, which makes it impossible to reduce costs.

[0006] Visual fatigue: Since everyone has different aesthetic views, it is easy for the customized large screen to receive mixed reviews. At the same time, it is easy for users to suffer from aesthetic fatigue during long-term demonstrations or introductions, because the unchanged style for a long time can easily affect the user's perception of the existing large screen, making the user feel that the large screen is becoming uglier and uglier, thus proposing new changes.

[0007] Inability to switch flexibly: In different scenarios, it is impossible to display the corresponding large screen according to the viewing of different users and leaders. For example, some users focus on the security view, while some users focus on the energy efficiency view. It is impossible to flexibly configure and display the corresponding view according to the different focuses of the visiting users, thereby improving the user's viewing experience.

[0008] To this end, we propose a method of cockpit voice interaction based on artificial intelligence. Summary of the invention

[0009] The purpose of the present invention is to provide a method for cockpit voice interaction based on artificial intelligence to solve the problems that need to be solved in the background technology.

[0010] To achieve the above object, the present invention provides the following technical solution: a method for cockpit voice interaction based on artificial intelligence, the method for cockpit voice interaction based on artificial intelligence comprising the following steps: Step 1: Disassemble the cockpit screen into the smallest basic components and materials; Step 2: Build resources through basic components and materials to form multiple resource libraries; Step 3: Build business components and drawing boards through the visualization platform, and preset keyword information during the construction of business components and drawing boards to trigger corresponding data extraction and analysis capabilities; Step 4: Match the voice command with the keyword. After the match is successful, the artificial intelligence is triggered to identify, extract, summarize, analyze and infer the data in the business component or drawing board to form the final analysis result; Step 5: Convert the analysis results into voice broadcast, and highlight the corresponding business components and drawing boards on the cockpit screen while the voice broadcast is in progress.

[0011] With the acceleration of informatization, all walks of life have accumulated massive data resources. These data not only show the unique characteristics of the enterprise, but also drive the sustainable development of the business and contain huge value that has not yet been discovered. Among them, the visualization screen, with its intuitive and easy-to-understand characteristics, has become a key tool for efficiently extracting and utilizing these data. However, large screens constructed in the traditional way often have problems such as slow speed, high cost and unattractive design. This is undoubtedly a shortcoming that is easily criticized for being the "face" of the corporate image. In addition to the display effect of the large screen, it is also difficult to intuitively and effectively let customers know the indicator data on the large screen clearly, because the indicator data on the large screen often requires people who understand the platform to introduce and analyze. For customers who see the large screen for the first time, it is difficult to understand and summarize the corresponding content. The cockpit large screen constructed by the present invention based on the capabilities of the visualization engine platform can be combined with artificial intelligence to achieve innovative interaction and analysis, assist users in explanations and demonstrations, and achieve the following technical effects: Innovative voice interaction method: supports triggering the switching of the cockpit large screen drawing board through voice, which is no longer limited to mouse clicks, and also supports The voice is used to trigger the recognition, extraction, analysis and reasoning of the large-screen data by artificial intelligence, and the reasoning results of artificial intelligence are converted into voice for broadcasting; interface operation, low threshold and easy to use: low threshold, flexible configuration, and rapid delivery of large screens by dragging and dropping, with a faster delivery time, far exceeding the traditional delivery method; user resource library can be operated and reused: the resources used by users to build large screens can be accumulated and reused, and can be used as the basis for subsequent iterative optimization or reconstruction of large screens. Users can directly drag and drop to use them, which improves usage efficiency and reduces development costs; large screens can be switched on demand and replaced with one click: support for configuration of multiple large screens, users can choose as needed, and switch large screen display with one click, supporting users to display corresponding large screens in different scenarios; wide application, not limited to specific fields: visualization large screen capabilities have been widely used in parks, education, medical care and other fields, helping users quickly grasp data changes and make accurate decisions.

[0012] As a further description of the above technical solution: The visualization platform includes a visualization editor, a unified data management module, a resource construction module and a theme resource library, and the visualization platform is compatible with third-party open source components.

[0013] As a further description of the above technical solution: The visual editor configures business components or drawing boards by dragging and dropping, adjusts the styles, interactions and data information of business components and drawing boards, and completes the construction of the cockpit large screen; The visual editor configures business components or drawing boards by dragging and dropping, adjusts the styles, interactions and data information of business components and drawing boards, and completes the construction of the cockpit large screen; The visual editor also includes: A layer editor, which manages the object hierarchy in the canvas; A canvas editor, which references resources to the canvas by dragging and dropping, and supports layout adjustment of objects; A sample editor, wherein the sample editor customizes the configuration style properties for the selected object, including basic properties of the component and component-specific component properties; An interaction editor, wherein the interaction editor customizes and configures interaction properties for a selected object, wherein the interaction properties include trigger events and trigger actions; Data editor, the data editor customizes the data attributes of the selected object, the data attributes include static data, interface data, files, and data sets to obtain the corresponding data, and then display the corresponding data information. The data content is obtained from the unified data management module; Resource reference module, which directly references and configures the data in the configured basic components, business components, and materials to build a drawing board; The history record module records the user's configuration records while configuring the drawing board. The user can roll back or restore the data in the configuration process through the history record module.

[0014] As a further description of the above technical solution: The resource construction module divides the cockpit large screen into materials, basic components, business components, drawing boards and homepage forms. Users combine resources based on a visual editor to build resource capabilities for building the cockpit large screen.

[0015] As a further description of the above technical solution: The business components are combined based on materials, basic components and extended components to form standard business components with business characteristics, and are divided according to functional modules or small scenarios; The canvas is based on materials and component resources, and is laid out and configured by dragging and dropping to form a scene-based drawing board; The theme resource library accumulates the user subject library when constructing the cockpit large screen through resource construction capabilities, including materials, components, drawing boards and home page resource capabilities, forming secondary resource capabilities for subsequent construction of the cockpit large screen to provide a direct use template.

[0016] As a further description of the above technical solution: The unified data management module accesses data in real time, and uses the API interface to connect to external databases and static files. Users access data according to their business, providing lightweight data processing capabilities for the cockpit large screen, and extracting the data required by the cockpit large screen. The data processing capability uses the data read from the API interface to extract the corresponding data content required by the function filter in the interface by configuring the filter code, and splices and displays it according to the component data.

[0017] As a further description of the above technical solution: The visualization platform construction method comprises the following steps: Step A1: Upload the materials of the cockpit large screen to be built, and customize the material grouping; Step A2: Evaluate whether the basic components of the visualization platform meet the construction requirements according to the cockpit large screen to be built. If they do not meet the construction requirements, the user develops new components according to the platform rules and uploads them to the visualization platform for use; Step A3: When the cockpit large screen continues to accumulate, skip step 2; Step A4: Based on the materials and basic components of steps 1 and 2, business components are constructed through a visual editor. In this step, layout, style, data, and interaction adjustments are made through a visual interface. When constructing business components, voice interaction keywords are configured in the newly added interactions in the interaction configuration, and corresponding trigger events are configured to realize the ability to analyze cockpit large screen data through voice interaction. Step A5: Based on the materials, basic components and business components in steps 1, 2 and 3, build a drawing board through the visual editor and directly introduce the configured business components for combination; Step A6: Based on the artboards configured in step 5, select multiple artboards to form the homepage. As the artboard library becomes richer, users can select artboards to form the homepage as needed. In the configuration items of the homepage, voice keywords and shortcuts for switching pages can be configured to switch artboards by voice or shortcut.

[0018] As a further description of the above technical solution: In step three, when the preset keyword information is triggered, the text information of the business component or drawing board configuration is submitted to the large model in the visualization platform. The large model extracts according to the submitted information and the corresponding prompts and keywords, and transmits the extracted data analysis to the visualization platform.

[0019] As a further description of the above technical solution: The voice instruction and keyword matching process in step 4 includes the following steps: Step S1: When a voice command is issued, features are extracted from the audio in the voice command, and the voice information is converted into text information through a speech recognition model; Step S2: performing text preprocessing on the converted text information; Step S3: Perform a specific search for keywords and key words on the preprocessed text, use a character matching algorithm to find the triggering keywords, and use the keywords to trigger artificial intelligence to extract and analyze data, so as to obtain the corresponding analysis results.

[0020] Compared with the prior art, the present invention has the following beneficial effects: 1. The cockpit large screen constructed based on the capabilities of the visualization engine platform of the present invention can be combined with artificial intelligence to achieve innovative interaction and analysis, assist users in explanation and demonstration, and achieve the following technical effects: 2. Innovative voice interaction method: It supports triggering the switching of the cockpit large screen drawing board through voice, which is no longer limited to mouse clicks. It also supports voice to trigger artificial intelligence to identify, extract, analyze and reason about large screen data, and convert the reasoning results of artificial intelligence into voice for broadcasting; 3. Interface operation, low threshold and easy to use: low threshold, flexible configuration, fast delivery of large screens by dragging and dropping, faster delivery time, far exceeding traditional delivery methods; 4. User resource library can be operated and reused: the resources used by users to build large screens can be accumulated and reused. As the basis for subsequent large screen iterative optimization or reconstruction, users can directly drag and drop to use them, which improves usage efficiency and reduces development costs. 5. Switch the large screen on demand with one-click replacement: Support configuration of multiple large screens, users can select as needed, switch the large screen display with one click, and support users to display the corresponding large screen in different scenarios; 6. Widely used, not limited to specific fields: Visual large-screen capabilities have been widely used in many fields such as parks, education, and medical care, helping users quickly grasp data changes and make accurate decisions. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of the process of the present invention; Figure 2 It is a schematic diagram of the product structure of the present invention; Figure 3 The figure is a schematic diagram of the construction process of the visualization platform of the present invention. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Embodiment 1:

[0023] See also Figure 1 , Figure 2 and Figure 3 The present invention provides a technical solution: a method for cockpit voice interaction based on artificial intelligence, the method for cockpit voice interaction based on artificial intelligence comprising the following steps: Step 1: Disassemble the cockpit screen into the smallest basic components and materials; Step 2: Build resources through basic components and materials to form multiple resource libraries; Step 3: Build business components and drawing boards through the visualization platform, and preset keyword information during the construction of business components and drawing boards to trigger corresponding data extraction and analysis capabilities; Step 4: Match the voice command with the keyword. After the match is successful, the artificial intelligence is triggered to identify, extract, summarize, analyze and infer the data in the business component or drawing board to form the final analysis result; Step 5: Convert the analysis results into voice broadcast. During the voice broadcast, the corresponding business components and drawing boards on the cockpit screen are highlighted, thereby realizing the flexible configuration of the cockpit screen and the combination of artificial intelligence voice analysis.

[0024] Among them, the invention of the large cockpit screen built based on the capabilities of the visualization engine platform can be combined with artificial intelligence to achieve innovative interaction and analysis, assist users in explanations and demonstrations, and can comprehensively decompose the large screen to form minimized basic components and materials, thereby achieving precise control of the large screen, and a visualization platform can be built to convert the voice commands issued by the user, so as to automatically realize intelligent interaction between voice commands and the large screen. Such settings are no longer limited to mouse operations, making the operation methods more diversified, and through repeated training of the large screen, the materials can be used repeatedly, and the large-screen operation can be completed by direct dragging and dropping, which improves the operating efficiency to a certain extent. Embodiment 2:

[0025] The visualization platform includes a visualization editor, a unified data management module, a resource construction module and a theme resource library, and the visualization platform is compatible with third-party open source components.

[0026] The visual editor configures business components or drawing boards by dragging and dropping, adjusts the style, interaction and data information of business components and drawing boards, and completes the construction of the cockpit large screen.

[0027] Among them, the user can operate the set visualization platform by dragging and dropping, and use the drag and drop method to quickly build a large cockpit screen. At the same time, a multi-scene theme resource library can be formed, and the large cockpit screen can be switched at any time. Embodiment three:

[0028] The visual editor also includes: Layer editor, which manages the object hierarchy in the canvas. It includes functions such as searching objects, combining, uncombining, locking, unlocking, showing, hiding, copying, deleting, bringing to the front, moving up one layer, bringing to the bottom, moving down one layer, selecting, multi-selecting, and dragging to sort; Canvas editor, which references resources to the canvas by dragging and dropping, and supports layout adjustment of objects. The main functions of the canvas editor include object dragging, object scaling, auxiliary lines, keyboard shortcuts (undo, restore, copy, paste, delete, select all, multiple select, combine, ungroup, lock, unlock, canvas move, canvas zoom in and out), object selection, automatic alignment, preview, etc. A sample editor, wherein the sample editor customizes the configuration style properties for the selected object, including basic properties of the component and component-specific component properties; The basic properties of the components are universal properties, which are possessed by all components, such as size, coordinate position, transparency, component name and other information. Specific component properties are personalized properties of the component. For example, the text component has font properties, color, shadow, line height and other properties, while the line chart component has line color, line width, whether to display area, icon position and other properties. Different components have different configurable style properties.

[0029] Interaction editor, the interaction editor customizes the interaction properties for the selected object, the interaction properties include trigger events and trigger actions, where the trigger events include mouse click, mouse double click, mouse move in, mouse move out, component display, component hide, voice interaction keywords, and the corresponding trigger actions can be configured according to the triggered events, the trigger actions include opening links, displaying objects, hiding objects, switching display / hide, moving, rotating, setting size, refreshing data, and intelligent analysis data, etc.; Data editor, the data editor customizes the data attributes of the selected object, the data attributes include static data, interface data, files, and data sets to obtain the corresponding data, and then display the corresponding data information. The data content is obtained from the unified data management module; Resource reference module, which directly references and configures the data in the configured basic components, business components, and materials to build a drawing board; The history record module records the user's configuration records when configuring the drawing board. The user can roll back or restore the data in the configuration process through the history record module.

[0030] The resource construction module divides the cockpit large screen into materials, basic components, business components, drawing boards and homepage forms. Users combine resources based on a visual editor to build resource capabilities for building the cockpit large screen.

[0031] The business components are combined based on materials, basic components and extended components to form standard business components with business characteristics, and are divided according to functional modules or small scenarios; The canvas is based on materials and component resources, and is laid out and configured by dragging and dropping to form a scene-based drawing board; The theme resource library accumulates the user subject library when constructing the cockpit large screen through resource construction capabilities, including materials, components, drawing boards and home page resource capabilities, forming secondary resource capabilities for subsequent construction of the cockpit large screen to provide a direct use template.

[0032] The unified data management module accesses data in real time, and uses the API interface to connect to external databases and static files. Users access data according to their business, providing lightweight data processing capabilities for the cockpit large screen, and extracting the data required by the cockpit large screen. The data processing capability uses the data read from the API interface to extract the corresponding data content required by the function filter in the interface by configuring the filter code, and splices and displays it according to the component data.

[0033] As a further description of the above technical solution: The visualization platform construction method comprises the following steps: Step A1: Upload the materials of the cockpit large screen to be built, and customize the material grouping. As the subsequent materials continue to accumulate to form a material library, you only need to select materials from the formed material library for use, saving art design and image cutting actions; Step A2: Evaluate whether the basic components of the visualization platform meet the construction requirements according to the cockpit large screen to be built. If they do not meet the construction requirements, the user develops new components according to the platform rules and uploads them to the visualization platform for use; Step A3: When the cockpit large screen continues to accumulate, skip step 2; Step A4: Based on the materials and basic components of steps 1 and 2, business components are constructed through a visual editor. In this step, layout, style, data, and interaction adjustments are made through a visual interface. When constructing business components, voice interaction keywords are configured in the newly added interactions in the interaction configuration, and corresponding trigger events are configured to realize the ability to analyze cockpit large screen data through voice interaction. Step A5: Based on the materials, basic components and business components in steps 1, 2 and 3, you can build a drawing board through the visual editor, directly introduce the configured business components for combination, and also perform independent configuration, including layout adjustment, style adjustment, data adjustment, interaction adjustment and other functions. With the accumulation of drawing boards, most of the subsequent operations are omitted, and you only need to copy the template and make fine adjustments before using it; Step A6: Based on the artboards configured in step 5, select multiple artboards to form the homepage. As the artboard library becomes richer, users can select artboards to form the homepage as needed. In the configuration items of the homepage, voice keywords and shortcuts for switching pages can be configured to switch artboards by voice or shortcut.

[0034] In step three, when the preset keyword information is triggered, the text information of the business component or drawing board configuration is submitted to the large model in the visualization platform. The large model extracts according to the submitted information and the corresponding prompts and keywords, and transmits the extracted data analysis to the visualization platform.

[0035] It also includes extension components, which are used to provide various types of basic components and support the development of custom components and the embedding of external plug-ins. As a further description of the above technical solution: The voice instruction and keyword matching process in step 4 includes the following steps: Step S1: When a voice command is issued, features are extracted from the audio in the voice command, and the voice information is converted into text information through a speech recognition model; Step S2: performing text preprocessing on the converted text information; Step S3: Perform a specific search for keywords and key words on the preprocessed text, use a character matching algorithm to find the triggering keywords, and use the keywords to trigger artificial intelligence to extract and analyze data, so as to obtain the corresponding analysis results.

[0036] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for cockpit voice interaction based on artificial intelligence, characterized in that: The method for cockpit voice interaction based on artificial intelligence comprises the following steps: Step 1: Disassemble the cockpit screen into the smallest basic components and materials; Step 2: Build resources through basic components and materials to form multiple resource libraries; Step 3: Build business components and drawing boards through the visualization platform, and preset keyword information during the construction of business components and drawing boards to trigger corresponding data extraction and analysis capabilities; Step 4: Match the voice command with the keyword. After the match is successful, the artificial intelligence is triggered to identify, extract, summarize, analyze and infer the data in the business component or drawing board to form the final analysis result; Step 5: Convert the analysis results into voice broadcast, and highlight the corresponding business components and drawing boards on the cockpit screen while the voice broadcast is in progress.

2. The method of cockpit voice interaction based on artificial intelligence according to claim 1, characterized in that: The visualization platform includes a visualization editor, a unified data management module, a resource construction module and a theme resource library, and the visualization platform is compatible with third-party open source components.

3. The method of cockpit voice interaction based on artificial intelligence according to claim 2, characterized in that: The visual editor configures business components or drawing boards by dragging and dropping, adjusts the styles, interactions and data information of business components and drawing boards, and completes the construction of the cockpit large screen; The visual editor also includes: A layer editor, which manages the object hierarchy in the canvas; A canvas editor, which references resources to the canvas by dragging and dropping, and supports layout adjustment of objects; A sample editor, wherein the sample editor customizes the configuration style properties for the selected object, including basic properties of the component and component-specific component properties; An interaction editor, wherein the interaction editor customizes and configures interaction properties for a selected object, wherein the interaction properties include trigger events and trigger actions; Data editor, the data editor customizes the data attributes of the selected object, the data attributes include static data, interface data, files, and data sets to obtain the corresponding data, and then display the corresponding data information. The data content is obtained from the unified data management module; Resource reference module, which directly references and configures the data in the configured basic components, business components, and materials to build a drawing board; The history record module records the user's configuration records while configuring the drawing board. The user can roll back or restore the data in the configuration process through the history record module.

4. The method of cockpit voice interaction based on artificial intelligence according to claim 3, characterized in that: The resource construction module divides the cockpit large screen into materials, basic components, business components, drawing boards and homepage forms. Users combine resources based on a visual editor to build resource capabilities for building the cockpit large screen.

5. The method of cockpit voice interaction based on artificial intelligence according to claim 4, characterized in that: The business components are combined based on materials, basic components and extended components to form standard business components with business characteristics, and are divided according to functional modules or small scenarios; The canvas is based on materials and component resources, and is laid out and configured by dragging and dropping to form a scene-based drawing board; The theme resource library accumulates the user subject library when constructing the cockpit large screen through resource construction capabilities, including materials, components, drawing boards and home page resource capabilities, forming secondary resource capabilities for subsequent construction of the cockpit large screen to provide a direct use template.

6. The method for cockpit voice interaction based on artificial intelligence according to claim 5, characterized in that: The unified data management module accesses data in real time, and uses the API interface to connect to external databases and static files. Users access data according to their business, providing lightweight data processing capabilities for the cockpit large screen, and extracting the data required by the cockpit large screen. The data processing capability uses the data read from the API interface to extract the corresponding data content required by the function filter in the interface by configuring the filter code, and splices and displays it according to the component data.

7. The method of cockpit voice interaction based on artificial intelligence according to claim 6, characterized in that: The visualization platform construction method comprises the following steps: Step A1: Upload the materials of the cockpit large screen to be built, and customize the material grouping; Step A2: Evaluate whether the basic components of the visualization platform meet the construction requirements according to the cockpit large screen to be built. If they do not meet the construction requirements, the user develops new components according to the platform rules and uploads them to the visualization platform for use; Step A3: When the cockpit large screen continues to accumulate, skip step 2; Step A4: Based on the materials and basic components of steps 1 and 2, business components are constructed through a visual editor. In this step, layout, style, data, and interaction adjustments are made through a visual interface. When constructing business components, voice interaction keywords are configured in the newly added interactions in the interaction configuration, and corresponding trigger events are configured to realize the ability to analyze cockpit large screen data through voice interaction. Step A5: Based on the materials, basic components and business components in steps 1, 2 and 3, build a drawing board through the visual editor and directly introduce the configured business components for combination; Step A6: Based on the artboards configured in step 5, select multiple artboards to form the homepage. As the artboard library becomes richer, users can select artboards to form the homepage as needed. In the configuration items of the homepage, voice keywords and shortcuts for switching pages can be configured to switch artboards by voice or shortcut.

8. The method of cockpit voice interaction based on artificial intelligence according to claim 7, characterized in that: In step three, when the preset keyword information is triggered, the text information of the business component or drawing board configuration is submitted to the large model in the visualization platform. The large model extracts according to the submitted information and the corresponding prompts and keywords, and transmits the extracted data analysis to the visualization platform.

9. The method of cockpit voice interaction based on artificial intelligence according to claim 8, characterized in that: The voice instruction and keyword matching process in step 4 includes the following steps: Step S1: When a voice command is issued, features are extracted from the audio in the voice command, and the voice information is converted into text information through a speech recognition model; Step S2: performing text preprocessing on the converted text information; Step S3: Perform a specific search for keywords and key words on the preprocessed text, use a character matching algorithm to find the triggering keywords, and use the keywords to trigger artificial intelligence to extract and analyze data, so as to obtain the corresponding analysis results.

Images