Situation awareness large screen control method and device, equipment and medium

Abstract

The invention discloses a situation awareness large screen control method and device, equipment and a medium, and relates to the technical field of safe operation. The method comprises the steps of determining a to-be-updated target control scene in a situation awareness large screen and target scene information corresponding to the target control scene according to a large screen updating text and an interface summary set in response to a user operation of inputting the large screen updating text; wherein the interface summary set comprises N metadata interfaces, any metadata interface is used for representing scene information corresponding to any control scene, and N is an integer greater than 0; and determining a large screen control instruction according to the target scene information, and updating the situation awareness large screen according to the large screen control instruction, so as to solve the limitation of controlling the situation awareness large screen.

Description

Technical Field

[0001] The present application relates to the field of security operation technology, and in particular to a situation awareness large-screen control method, device, equipment and medium. Background Art

[0002] The situation awareness screen is a real-time security monitoring and data visualization screen based on big data computing technology. It can provide real-time visualization of network security threats, network traffic data, security events and user behavior analysis, which helps network security operation and users to more intuitively understand the operation status and security situation of the network environment.

[0003] For users of different roles, the components, styles, and data displayed on the situation awareness large-screen are different, which leads to the need for frequent scene switching of the situation awareness large-screen, such as component switching, large-screen title replacement, large-screen skin change, addition of large-screen components, large-screen component replacement, large-screen component style replacement, and large-screen component title modification.

[0004] At present, when controlling the situational awareness screen, the natural language of the screen commentator is generally converted into corresponding text information, and the text information is inferred so that it can be associated with fixed sentence commands for operating the display screen. The fixed sentence commands are then associated with the page tags in the current display content of the display screen and trigger mouse events that can manipulate the display screen, thereby realizing the natural language control function of the display screen backend application system.

[0005] However, when using this mapping table defined by page tags, elements on the situation awareness screen are bound through fixed natural language, and then mouse events are triggered for control. When replacing or adding content and styles displayed on the current situation awareness screen, they need to be configured one by one in advance, otherwise they cannot be recognized and the situation awareness screen cannot be controlled accordingly, which leads to limitations in controlling the situation awareness screen. Summary of the invention

[0006] The present application provides a situation awareness large screen control method, device, equipment and medium to solve the limitations of controlling the situation awareness large screen.

[0007] In a first aspect, a situation awareness large screen control method is provided, comprising:

[0008] In response to a user operation of inputting a large-screen update text, a target control scene to be updated in the situation awareness large screen and target scene information corresponding to the target control scene are determined according to the large-screen update text and the interface summary set; wherein the interface summary set includes N metadata interfaces, any metadata interface is used to characterize scene information corresponding to any control scene, and N is an integer greater than 0;

[0009] According to the target scene information, a large screen control instruction is determined, and the situation awareness large screen is updated according to the large screen control instruction.

[0010] In response to the user operation of inputting the large-screen update text, the target control scene to be updated in the situation awareness large screen and the target scene information corresponding to the target control scene are determined according to the large-screen update text and the interface summary set; since the interface summary set includes N metadata interfaces, any metadata interface is used to characterize the scene information corresponding to any control scene, therefore, combined with the large-screen update text, the user's intention can be automatically understood, and then, based on the target scene information, the large-screen control instructions are determined, and the situation awareness large screen is updated according to the large-screen control instructions, which can realize flexible conversion control from natural language to machine instructions, and it is easy to flexibly replace and control components in the situation awareness large screen without additional operations, thereby solving the limitations of controlling the situation awareness large screen.

[0011] In some embodiments, determining the large-screen control instruction according to the target scene information includes:

[0012] Determine M second display styles that are the same as the first display size based at least on the service identifier included in the target scene information, and the first display style and the first display size corresponding to the service identifier; wherein M is an integer greater than 0;

[0013] A large-screen control instruction is generated at least according to the M second display styles, the first display size, and the service identifier.

[0014] Through the above method, appropriate and accurate large-screen control instructions can be generated.

[0015] In some embodiments, the method further comprises:

[0016] When there are multiple large-screen control instructions, display the multiple large-screen control instructions on the user interface;

[0017] In response to a user operation of selecting a target large-screen control instruction from the multiple large-screen control instructions, the situation awareness large screen is updated according to the target large-screen control instruction.

[0018] Through the above method, users can flexibly select appropriate large-screen control instructions to control the situational awareness large-screen, improve the interactive experience, and meet user needs.

[0019] In some embodiments, in response to the user operation of inputting the large-screen update text, before determining the target control scene to be updated in the situation awareness large screen according to the large-screen update text and the large-screen interface summary set, the method further includes:

[0020] Receive big screen update voice;

[0021] The large-screen update voice is converted into text to obtain the large-screen update text.

[0022] Through the above method, the voice understanding function is supported, which facilitates better understanding of user intentions in the future.

[0023] In some embodiments, the target control scenario is any one of the following:

[0024] A component switching scene is used to indicate switching of components displayed in the situation awareness large screen;

[0025] A drill-down view of data details scenario is used to indicate the viewing of detailed information of components in the situation awareness screen;

[0026] A large screen component editing scene is used to instruct editing of the large screen component of the situation awareness large screen;

[0027] A large screen component replacement scenario, used to indicate the replacement of the large screen component of the situation awareness large screen;

[0028] A large screen update scenario is used to indicate that the large screen style of the situation awareness large screen is updated;

[0029] The text broadcast scenario is used to instruct the business data broadcast of the component selected in the situation awareness large screen.

[0030] Through the above method, the situational awareness large screen control is abstracted into different control scenarios and bound separately through interfaces. The control of different data in different situational awareness large screens under the same control scenario can be uniformly summarized and converged, so that the control of expanding new large screens or new data can be adaptive, thereby improving the limitations of the existing technology in controlling the situational awareness large screen.

[0031] In some embodiments, the large screen control instructions are written based on JSON or extensible markup language.

[0032] Through the above method, it is convenient for the machine to parse and generate relatively concise and easy-to-understand large-screen control instructions.

[0033] In a second aspect, a situation awareness large screen control device is provided, comprising:

[0034] A determination module, for responding to a user operation of inputting a large-screen update text, and determining a target control scene to be updated in the situation awareness large screen, and target scene information corresponding to the target control scene, according to the large-screen update text and an interface summary set; wherein the interface summary set includes N metadata interfaces, any metadata interface is used to characterize the scene information corresponding to any control scene, and N is an integer greater than 0;

[0035] The control module is used to determine the large-screen control instructions according to the target scene information, and update the situation awareness large screen according to the large-screen control instructions.

[0036] In some embodiments, the determining module is specifically configured to:

[0037] Determine M second display styles that are the same as the first display size based at least on the service identifier included in the target scene information, and the first display style and the first display size corresponding to the service identifier; wherein M is an integer greater than 0;

[0038] A large-screen control instruction is generated at least according to the M second display styles, the first display size, and the service identifier.

[0039] According to a third aspect, an electronic device is provided, including:

[0040] A memory for storing a computer program; a processor for implementing any one of the method steps in the first aspect when executing the computer program stored in the memory.

[0041] According to a fourth aspect, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method steps described in any one of the first aspects are implemented.

[0042] For each aspect from the second to the fourth aspect and the technical effects that may be achieved by each aspect, please refer to the above description of the technical effects that can be achieved by the first aspect or various possible schemes in the first aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A schematic diagram of an application scenario applicable to the embodiments of the present application;

[0044] Figure 2 A schematic diagram of the structure of a situation awareness large-screen interactive system provided in an embodiment of the present application;

[0045] Figure 3 A logical schematic diagram of a diagram and business data binding provided in an embodiment of the present application;

[0046] Figure 4 A flowchart of a situation awareness large screen control method provided in an embodiment of the present application;

[0047] Figure 5 A schematic diagram of the structure of a situation awareness large-screen control device provided in an embodiment of the present application;

[0048] Figure 6A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme in the embodiment of the present application will be clearly and completely described below in conjunction with the drawings in the embodiment of the present application. Obviously, the described embodiment is only a part of the embodiment of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be arbitrarily combined with each other. In addition, although the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in an order different from that here.

[0050] The terms "first" and "second" in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the term "comprising" and any of their variations are intended to cover non-exclusive protection. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units that are not listed, or optionally also includes other steps or units inherent to these processes, methods, products or devices. "Multiple" in the present application can mean at least two, for example, two, three or more, and the embodiments of the present application are not limited.

[0051] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description. It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, which should be considered as exemplary, and their purpose is only to illustrate the feasibility of the implementation of the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0052] The following is a brief introduction to the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present application and are not limited. In specific implementation, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.

[0053] Figure 1Schematic diagram of an application scenario applicable to the embodiment of the present application. As shown in the figure, the application scenario mainly includes: a terminal 10 and a server 11. Among them, information exchange can be performed between the terminal 10 and the server 11 through a communication network, and the communication mode adopted by the communication network may include: a wireless communication mode and a wired communication mode.

[0054] In some scenarios, the terminal 10 can access the network and communicate with the server 11 through cellular mobile communication technology, and the cellular mobile communication technology may include the fifth generation mobile communication (5th Generation Mobile Networks, 5G) technology.

[0055] In some scenarios, the terminal 10 may access the network and communicate with the server 11 via short-range wireless communication. The short-range wireless communication may include Wireless Fidelity (Wi-Fi) technology.

[0056] The present application embodiment does not impose any restriction on the number of the above-mentioned devices. Figure 1 As shown, only the terminal 10 and the server 11 are described as examples, and the above-mentioned devices and their respective functions are briefly introduced below.

[0057] The terminal 10 is a device that can provide voice and / or data connectivity to the user, including: a handheld terminal device with a wireless connection function, a vehicle-mounted terminal device, etc.

[0058] In some scenarios, the terminal 10 includes but is not limited to: mobile phones, tablet computers, laptop computers, PDAs, mobile Internet devices (MID), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminal devices in industrial control, wireless terminal devices in unmanned driving, wireless terminal devices in smart grids, wireless terminal devices in transportation safety, wireless terminal devices in smart cities, or wireless terminal devices in smart homes, etc.

[0059] In addition, a client related to situational awareness large screen control may be installed on the terminal 10, and the client may be software (for example, an APP, a browser, etc.), or a web page, a small program, etc. In the embodiment of the present application, the terminal 10 may use the client related to the situational awareness large screen, and may interact with the server 11 to replace the large screen title, change the large screen skin, replace the large screen component, replace the large screen component style, modify the large screen component title, switch the large screen component, and perform text broadcasting.

[0060] Furthermore, the server 11 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0061] Furthermore, in an embodiment of the present application, the above-mentioned server 11 may be equipped with a situational awareness large-screen control system corresponding to the above-mentioned client, and the situational awareness large-screen control system may be equipped with a situational awareness large-screen control device, which is used to process various large-screen update texts input by the user on the user interface of the terminal 10. For example, based on the large language model on the situational awareness large-screen control device, the input large-screen update text is recognized for its intention, and the conversion control from natural language to machine instructions can be realized, thereby realizing automatic control and flexible operation of the situational awareness large screen without the need for additional manual operation.

[0062] Figure 2 This is a schematic diagram of the structure of a situation awareness large-screen interactive system provided in an embodiment of the present application. Figure 2 As shown, the system includes an interactive unit 201, a situation awareness large screen control device 202, and a situation large screen unit 203; wherein the situation awareness large screen control device is configured with a large language model (for example, a GPT-4 model, a Chat GLM model, etc.), which are introduced one by one below.

[0063] The interaction unit 201 can provide a chat interface or window to interact with the above-mentioned terminal 10 through a language user interface (LUI), for example, to support continuous voice dialogue and voice broadcast, as well as traditional text input, rich text output, etc. Among them, rich text output can refer to formatted style rendering such as tables and thumbnails in addition to text, and can also refer to successful feedback on large-screen control instructions, and when large-screen control instructions are inaccurate, give correct guidance recommendation instructions.

[0064] The situational awareness large-screen control device 202 can provide functions such as speech-to-text and text-to-speech; it can provide large-screen control command output through the prompt project. The core of the prompt project lies in how to design effective prompt word templates. These prompt word templates can contain information such as instructions, questions, context, input and expected output, etc., to ensure that the large language model can accurately understand the user's intention to complete the generation of large-screen control instructions.

[0065] The situation large screen unit 203 may include a large screen display module and a visualization construction module; wherein the large screen display module is used to display the content displayed on the situation awareness large screen; the visualization construction module can register a series of business data interfaces and metadata interfaces to provide various information contained in the situation awareness large screen.

[0066] In some embodiments, the metadata interface is used to provide scene information (also referred to as dynamic data) of different control scenes in the situation awareness large screen, and can be used to unify and converge the control of different data in different situation awareness large screens under the same control scene, so that the control of expanding new large screens or new data can be adaptive. Specifically, the control scenes of the situation awareness large screen are abstracted to include but are not limited to the following:

[0067] (1) Component switching scenarios, used to indicate the switching of components displayed in the situation awareness screen, such as switching between the China map and the world map, time period switching (last hour, today, last 7 days), etc.

[0068] (2) Drill down to view data details scenario, which is used to indicate to view detailed information of components in the situation awareness screen.

[0069] (3) Large screen component editing scene, used to instruct editing of large screen components of the situation awareness large screen, such as modifying chart style, chart title, etc.;

[0070] (4) A large screen component replacement scenario, which is used to indicate the replacement of a large screen component of the situation awareness large screen, for example, replacing the current chart of the situation awareness large screen;

[0071] (5) Large screen update scenario, used to indicate the update of the large screen style of the situation awareness large screen, such as modifying the large screen title, replacing the large screen skin, etc.;

[0072] (6) Text broadcast scenario, used to instruct the broadcast of business data for the selected component in the situation awareness screen.

[0073] Through the above method, the visualization construction module can provide its corresponding dynamic data through at least one metadata interface for different control scenarios. For example, for the large-screen component replacement scenario, it can be summarized into API1 and API2; wherein API1 is used to query the chart information already contained in the current situation awareness large-screen, and can provide the title, logo (which may include the business name), chart style, chart size, etc. of each chart; API2 is used to query the replaceable candidate chart information according to the chart information provided in API1, and will provide the title, logo (including the business name), candidate chart style, candidate chart size, etc. of each candidate chart in the candidate chart information; and so on, constitute an interface summary set and provide it to the situation awareness large-screen control device 202, so that the situation awareness large-screen control device 202 inputs the interface summary set and the large-screen update text input by the user into the large language model, determines the target control scenario to be updated in the situation awareness large-screen, and the target scenario information corresponding to the target control scenario, determines the large-screen control instruction according to the target scenario information, and updates the situation awareness large-screen according to the large-screen control instruction.

[0074] In some embodiments, the business data interface is used to bind different chart display information for different business data to form a certain mapping relationship. It can bind respective chart styles (for example, pie charts, bar charts, card charts, line charts, etc.) for attackers, key event lists, threat event type distribution, etc., and establish a user-visible association between chart titles, business data, chart styles, and chart sizes for user use. This solves the limitations of traditional manual binding replaceable relationships and the problem of improperly controlled charts being deformed due to size differences and reduced aesthetics; for example, it avoids deformation caused by replacing a chart with a 16:9 ratio for the key event list with a 1:1 ratio for the threat event type distribution; for another example, it avoids the problem of the user being unable to locate the original business data interface after modifying the chart title, and the problem of being unable to lock the unchanged chart in the voice scenario using the traditional mouse positioning method.

[0075] like Figure 3 As shown, a logical schematic diagram of a chart and business data binding provided by an embodiment of the present application is exemplified. First, at the user level, a visible chart title can be presented to the user, so that the user can obtain the corresponding business name based on the chart title, and based on the business name, the corresponding business data interface can be obtained at the system level, and the bound chart style and chart size can be obtained using the business data interface.

[0076] For example, an attacker is defined as attacker TOP5_1 and a key event list is defined as TOP5_2; the chart style bound to attacker TOP5_1 is a bar chart, and the business data interface corresponding to the bar chart is APIA; similarly, the chart style bound to key event list TOP5_2 is a card chart, and the business data interface corresponding to the card chart is APIB; further, in order to adapt to the visualization effect of different area sizes after the chart is replaced, the size of the chart corresponding to all business data can be bound (can be multiple, representing effects of different proportions); for example, the attacker TOP5_1 of the bar chart is bound to a 16:9 rectangular area, and the threat event type distribution TOP5_3 of another pie chart is bound to a 1:1 square area.

[0077] To further illustrate the technical solution provided by the embodiment of the present application, this is described in detail below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiment of the present application provides the method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on routine or no creative labor. In the steps where there is no necessary causal relationship logically, the execution order of these steps is not limited to the execution order provided by the embodiment of the present application. The method may be executed or executed in parallel in the actual processing process or when the device is executed in accordance with the method sequence shown in the embodiment or drawings.

[0078] Figure 4 A flowchart of a situation awareness large screen control method provided in an embodiment of the present application, which process can be performed by a situation awareness large screen control device (such as Figure 2 The situation awareness large screen control device 202 shown in FIG. 1 is executed, and the device can be implemented by software and / or hardware. Figure 4 As shown, the process includes the following steps:

[0079] 401: In response to a user operation of inputting a large-screen update text, a target control scene to be updated in the situation awareness large screen and target scene information corresponding to the target control scene are determined according to the large-screen update text and the interface summary set.

[0080] In this step, the interface summary set includes N metadata interfaces, any metadata interface is used to characterize the scene information corresponding to any control scene, and N is an integer greater than 0. Among them, the control scene may include but is not limited to the above-mentioned component switching scene, drill-down view data details scene, large screen component editing scene, large screen component replacement scene, large screen update scene, text broadcast scene, etc., and one control scene can be bound to multiple metadata interfaces. As shown in Table 1, an example table of the interface summary set is exemplified.

[0081]

[0082]

[0083] In some embodiments, when a terminal (such as Figure 1 When the terminal 10) as shown initiates the large screen update voice, the large screen update voice can be converted into text to obtain the large screen update text. For example, the user voice input replaces the distribution of threat event types in the chart, Figure 2 The exchange module 201 shown sends the voice to the situation awareness large screen control device 202 for voice-to-text service, and parses the large screen update text as "replace chart threat event type distribution".

[0084] For example, assuming that the large-screen update text is the above-mentioned replacement chart threat event type distribution, the replacement chart threat event type distribution and the interface summary set shown in Table 1 above can be input into the large language model for intent recognition. First, it is identified that the replacement chart threat event type distribution belongs to the large-screen component replacement scenario in Table 1, and then based on API1 in the large-screen component replacement scenario, the chart information already contained in the current situation awareness large screen (i.e., the target scenario information of the target control scenario) is obtained, which may include the title, logo (including business name), chart style, chart size, etc. of each chart.

[0085] 402: Determine the large screen control command according to the above target scene information, and update the situation awareness large screen according to the large screen control command.

[0086] In some embodiments, determining a large-screen control instruction based on target scene information may be: determining M second display styles that are the same as the first display size based at least on a business identifier included in the target scene information, and a first display style and a first display size corresponding to the business identifier; wherein M is an integer greater than 0; and generating a large-screen control instruction based at least on the M second display styles, the first display size, and the business identifier, to facilitate generation of appropriate and accurate large-screen control instructions.

[0087] For example, based on API2 in Table 1, the chart information provided in API1 is retrieved (for example, the business identifier of the threat event type distribution is TOP5_3, and the TOP5_3 is bound to a 1:1 square area) to query the replaceable candidate chart information, and the title, identifier (including the business name), candidate chart style (M second display styles), candidate chart size, etc. of each candidate chart in the candidate chart information will be provided. Then, according to the title, identifier, candidate chart style, and candidate chart size of each candidate chart, a large-screen control instruction can be generated.

[0088] In some embodiments, the large-screen control instructions may be written based on JSON, or in Extensible Markup Language (XML), or in other languages, so as to facilitate machine parsing and generate relatively concise and easy-to-understand large-screen control instructions.

[0089] Taking (1) to (6) above as an example, the large screen control instructions generated respectively can be:

[0090] For the target control scenario of component switching, the large screen control command can be {"action":"module_switch","param":{"screen_id":1,"module_alias":"xxx","switch_i ndex":x1}}, which means switching the instructions related to the components displayed in the situation awareness large screen.

[0091] For the target control scenario of drilling down to view data details, the large screen control command can be {"action":"module_redirect","param":{"screen_id":1,"module_alias":"xxx","data_in dex":x2}}, which means the command related to viewing detailed information of components in the situation awareness large screen.

[0092] For the target control scenario, which is the large-screen component editing scenario, the large-screen control instruction can be {"action":"module_edit","param":{"screen_id":1,"module_alias":"xxx","new_prope rty":{"title":"xxx","chart_id":x3}}}, which means instructions for modifying chart styles and chart titles.

[0093] For the target control scenario of large-screen component replacement, the large-screen control instruction can be {"action":"module_replace","param":{"screen_id":1,"module_alias":"xxx","new_m odule":{"data_id":1,"chart_id":x4}}}, which means replacing the instructions related to the current chart of the situation awareness large screen.

[0094] For the target control scenario being the large screen update scenario, the large screen control instruction can be {"action":"screen_update","param":{"screen_id":1,"new_property":{"title":"xxx","t heme":x4}}}, which means instructions related to large screen title modification, large screen skin change, etc.

[0095] In other embodiments, when there are multiple large-screen control instructions, the multiple large-screen control instructions are displayed on the user interface; in response to a user operation of selecting a target large-screen control instruction from the multiple large-screen control instructions, the situation awareness large screen is updated according to the target large-screen control instruction.

[0096] For example, assuming that multiple large-screen control instructions include {"action":"module_candidate","param":[{"data_id":2,"name":"attacker top5_1","size":"16:9","chart_id":2}, {"data_id":3,"name":"attacker top5_1","size":"16:9","chart_id":3}]}; then, these large-screen control instructions are sent to the terminal for users to flexibly select. In response to the user operation of selecting {"data_id":2,"name":"attacker top5_1","size":"16:9","chart_id":2} from the multiple large-screen control instructions, the situation awareness large screen can be controlled to change the chart according to the instruction, thereby improving the interactive experience and meeting user needs.

[0097] In other embodiments, if the target control scene to be replaced is a text broadcast scene, the replaced business data may be sent to the interactive module so that the interactive module performs voice synchronous broadcast and automatic explanation of the replaced business data.

[0098] In an embodiment of the present application, in response to a user operation of inputting a large-screen update text, the target control scene to be updated in the situation awareness large screen and the target scene information corresponding to the target control scene are determined according to the large-screen update text and the interface summary set; since the interface summary set includes N metadata interfaces, any metadata interface is used to characterize the scene information corresponding to any control scene, therefore, combined with the large-screen update text, the user's intention can be automatically understood, and then, based on the target scene information, the large-screen control instructions are determined, and the situation awareness large screen is updated according to the large-screen control instructions, which can realize flexible conversion and control from natural language to machine instructions, and it is easy to flexibly replace and control components in the situation awareness large screen without additional operations, thereby solving the limitations of controlling the situation awareness large screen.

[0099] Based on the same technical concept, a situation awareness large-screen control device is also provided in an embodiment of the present application, and the device can implement the above-mentioned situation awareness large-screen control method process in the embodiment of the present application.

[0100] Figure 5 A schematic diagram of the structure of a situation awareness large screen control device provided in an embodiment of the present application. The device comprises: a determination module 501 and a control module 502.

[0101] Determination module 501 is used to respond to the user operation of inputting large-screen update text, and determine the target control scene to be updated in the situation awareness large screen according to the large-screen update text and the interface summary set, and the target scene information corresponding to the target control scene; wherein the interface summary set includes N metadata interfaces, and any metadata interface is used to characterize the scene information corresponding to any control scene, and N is an integer greater than 0.

[0102] The control module 502 is used to determine the large screen control instruction according to the target scene information, and update the situation awareness large screen according to the large screen control instruction.

[0103] In some embodiments, the determination module is specifically configured to:

[0104] Determine M second display styles that are the same as the first display size based at least on the service identifier included in the target scene information, and the first display style and the first display size corresponding to the service identifier; wherein M is an integer greater than 0;

[0105] A large-screen control instruction is generated at least according to the M second display styles, the first display size, and the service identifier.

[0106] In some embodiments, the determination module 501 is further configured to:

[0107] Receive big screen update voice;

[0108] The large-screen update voice is converted into text to obtain the large-screen update text.

[0109] It should be noted here that the above-mentioned device provided in the embodiment of the present application can implement all the method steps in the above-mentioned method embodiment and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as the method embodiment will not be described in detail here.

[0110] Based on the same technical concept, an electronic device is also provided in an embodiment of the present application, and the electronic device can realize the functions of the aforementioned situation awareness large-screen control device.

[0111] Figure 6A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0112] At least one processor 601, and a memory 602 connected to the at least one processor 601. The specific connection medium between the processor 601 and the memory 602 is not limited in the embodiment of the present application. Figure 6 In the example, the processor 601 and the memory 602 are connected via a bus 600. Figure 6 The connection between other components is shown by bold lines, and is not intended to be limiting. The bus 600 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. Alternatively, the processor 601 can also be called a controller, and there is no limitation on the name.

[0113] In the embodiment of the present application, the memory 602 stores instructions that can be executed by at least one processor 601. The at least one processor 601 can execute a situation awareness large screen control method discussed above by executing the instructions stored in the memory 602. The processor 601 can implement Figure 5 The functions of each module in the device shown.

[0114] Among them, the processor 601 is the control center of the device, and can use various interfaces and lines to connect the various parts of the entire control device. By running or executing instructions stored in the memory 602 and calling the data stored in the memory 602, the various functions of the device and processing data, the device can be monitored as a whole.

[0115] In the embodiment of the present application, the processor 601 may include one or more processing units, and the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 601. In some embodiments, the processor 601 and the memory 602 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on separate chips.

[0116] Processor 601 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of a situation awareness large screen control method disclosed in the embodiments of the present application can be directly embodied as a hardware processor execution, or a combination of hardware and software modules in the processor.

[0117] The memory 602 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 602 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 602 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 602 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0118] By programming the processor 601, the code corresponding to the situation awareness large screen control method described in the above embodiment can be fixed into the chip, so that the chip can execute the code when running. Figure 4 The embodiment shown is a situation awareness large screen control method. How to design and program the processor 601 is a technology well known to those skilled in the art and will not be described in detail here.

[0119] It should be noted here that the above-mentioned electronic device provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned method embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as the method embodiment will not be described in detail here.

[0120] Based on the same technical concept, an embodiment of the present application provides a computer storage medium, the computer storage medium includes: a computer program code, when the computer program code is run on a computer, the computer executes any one of the situation awareness large screen control methods discussed above. Since the principle of solving the problem by the above-mentioned computer storage medium is similar to that of a situation awareness large screen control method, the implementation of the above-mentioned computer storage medium can refer to the implementation of the method, and the repeated parts will not be repeated.

[0121] In the specific implementation process, the computer storage medium may include: Universal Serial Bus Flash Drive (USB), mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other storage media that can store program codes.

[0122] Based on the same technical concept, the embodiment of the present application also provides a computer program product, which includes: computer program code, when the computer program code is run on a computer, the computer executes any one of the situation awareness large screen control methods discussed above. Since the principle of solving the problem by the above computer program product is similar to that of a situation awareness large screen control method, the implementation of the above computer program product can refer to the implementation of the method, and the repeated parts will not be repeated.

[0123] The computer program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0124] The method in the present application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the present application is executed in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM or other programmable device.

[0125] The computer program or instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0126] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0127] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the instructions in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0128] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0129] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A situation awareness large screen control method, characterized in that: include: In response to a user operation of inputting a large-screen update text, a target control scene to be updated in the situation awareness large screen and target scene information corresponding to the target control scene are determined according to the large-screen update text and the interface summary set; wherein the interface summary set includes N metadata interfaces, any metadata interface is used to characterize scene information corresponding to any control scene, and N is an integer greater than 0; According to the target scene information, a large screen control instruction is determined, and the situation awareness large screen is updated according to the large screen control instruction.

2. The method according to claim 1, characterized in that Determining the large screen control instruction according to the target scene information includes: Determine M second display styles that are the same as the first display size based at least on the service identifier included in the target scene information, and the first display style and the first display size corresponding to the service identifier; wherein M is an integer greater than 0; A large-screen control instruction is generated at least according to the M second display styles, the first display size, and the service identifier.

3. The method according to claim 2, characterized in that The method further comprises: When there are multiple large-screen control instructions, display the multiple large-screen control instructions on the user interface; In response to a user operation of selecting a target large-screen control instruction from the multiple large-screen control instructions, the situation awareness large screen is updated according to the target large-screen control instruction.

4. The method according to claim 1, characterized in that In response to the user operation of inputting the large-screen update text, before determining the target control scene to be updated in the situation awareness large screen according to the large-screen update text and the large-screen interface summary set, the method further includes: Receive big screen update voice; The large-screen update voice is converted into text to obtain the large-screen update text.

5. The method according to any one of claims 1 to 4, characterized in that: The target control scenario is any of the following: A component switching scene is used to indicate switching of components displayed in the situation awareness large screen; A drill-down view of data details scenario is used to indicate the viewing of detailed information of components in the situation awareness screen; A large screen component editing scene is used to instruct editing of the large screen component of the situation awareness large screen; A large screen component replacement scenario, used to indicate the replacement of the large screen component of the situation awareness large screen; A large screen update scenario is used to indicate that the large screen style of the situation awareness large screen is updated; The text broadcast scenario is used to instruct the business data broadcast of the component selected in the situation awareness large screen.

6. The method according to any one of claims 1 to 4, characterized in that: The large screen control instructions are written based on JSON or extensible markup language.

7. A situation awareness large screen control device, characterized in that: include: A determination module, for responding to a user operation of inputting a large-screen update text, and determining a target control scene to be updated in the situation awareness large screen, and target scene information corresponding to the target control scene, according to the large-screen update text and an interface summary set; wherein the interface summary set includes N metadata interfaces, any metadata interface is used to characterize the scene information corresponding to any control scene, and N is an integer greater than 0; The control module is used to determine the large screen control instructions according to the target scene information, and update the situation awareness large screen according to the large screen control instructions.

8. The device according to claim 7, characterized in that The determination module is specifically used for: Determine M second display styles that are the same as the first display size based at least on the service identifier included in the target scene information, and the first display style and the first display size corresponding to the service identifier; wherein M is an integer greater than 0; A large-screen control instruction is generated at least according to the M second display styles, the first display size, and the service identifier.

9. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor, configured to implement the method according to any one of claims 1 to 6 when executing a computer program stored in the memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images