Display control and interactive control method, device, system and storage medium

By displaying the interactive interface and controls on the second screen, the problem of inconvenience in interaction between large screens is solved and the interaction efficiency between users and large screens is improved.

CN112783398BActive Publication Date: 2024-12-03ALIBABA GROUP HOLDING LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201911090098.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-08
Publication Date
2024-12-03
Estimated Expiration
2039-11-08

AI Technical Summary

Technical Problem

In large-screen display technology, users need to move frequently to interact, resulting in low interaction efficiency, especially inconvenient operation in front of giant large screens.

Method used

By displaying the interactive interface on the second screen, including summary information of dynamic data and interaction controls, the user can interactively control the first screen on the second screen to improve interaction efficiency.

Benefits of technology

The convenience and efficiency of interactive operation in front of a large screen is achieved. Users can quickly interpret and control information on the large screen without tracking dynamic data changes, significantly improving interaction efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112783398B_ABST
    Figure CN112783398B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a display control and interactive control method, device, system and storage medium. In the embodiments of the present application, an interactive interface can be generated for the first screen, and the interactive interface can be displayed on the second screen. The interactive interface includes interactive controls, so that the user can interactively control the first screen through the interactive controls on the second screen, which is convenient for the user to interactively control the first screen, which is beneficial to improve the interaction efficiency. Furthermore, the interactive interface can also include summary information generated according to the dynamic data that needs to be displayed on the first screen. Based on the summary information, the user can quickly interpret the dynamic information on the first screen without tracking the changes in the dynamic data on the first screen, which is beneficial to quickly interactively control the first screen and further improve the interaction efficiency with the first screen.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of visualization technology, and in particular to a display control and interactive control method, device, system and storage medium. Background Art

[0002] Data visualization is a way to convey and communicate information clearly and effectively through graphical means. With the emergence of large-screen display technology, the display effect of data visualization is getting better and better, such as larger pictures, more colors, and higher resolution.

[0003] While large-screen display technology provides high-quality display effects for data visualization, it also brings some troubles to users. In some application scenarios, users need to interact and explain the data on the touch-screen large screen. Due to the large screen, users need to move frequently in front of the giant screen, which leads to inconvenience in interaction and low interaction efficiency. Summary of the invention

[0004] Multiple aspects of the present application provide a display control and interactive control method, device, system and storage medium, which are used to enable a user to interactively control another screen through one screen, thereby improving the convenience and efficiency of the user's interaction with another screen.

[0005] An embodiment of the present application provides a display control method, comprising: acquiring data to be displayed on a first screen, the data comprising dynamic data; generating summary information in an interactive interface according to the dynamic data, the interactive interface further comprising interactive controls; and displaying the interactive interface on a second screen to guide a user to interactively control the first screen through the interactive controls through the summary information.

[0006] An embodiment of the present application also provides an interactive control method, comprising: displaying an interactive interface on a second screen, the interactive interface comprising summary information and interactive controls; in response to an interactive operation issued to the interactive control, performing a corresponding operation on a data interface on a first screen; wherein the summary information is generated based on dynamic data displayed in the data interface, and is used to guide a user to issue an interactive operation to the interactive control.

[0007] An embodiment of the present application also provides a display control method, including: acquiring data displayed on a first screen; generating interactive controls in an interactive interface based on the data; and displaying the interactive interface on a second screen so that a user can interactively control the first screen through the interactive controls.

[0008] An embodiment of the present application also provides a display control system, including: a display control device, a first screen, and a second screen; the display control device is used to obtain data that needs to be displayed on the first screen, and to visually display the data on the first screen, wherein the data includes dynamic data; and to generate summary information in an interactive interface based on the dynamic data, wherein the interactive interface also includes interactive controls; and to display the interactive interface on the second screen to guide a user to interactively control the first screen through the interactive controls through the summary information.

[0009] An embodiment of the present application also provides a display control system, including: a display control device, a first screen, and a second screen; the display control device is used to obtain data displayed on the first screen; generate interactive controls in an interactive interface based on the data; and display the interactive interface on the second screen so that the user can interactively control the first screen through the interactive controls.

[0010] An embodiment of the present application also provides a display control device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled to the memory and is used to execute the computer program, so as to: obtain data to be displayed on a first screen, the data including dynamic data; generate summary information in an interactive interface based on the dynamic data, the interactive interface also including interactive controls; display the interactive interface on a second screen, so as to guide a user to interactively control the first screen through the interactive controls through the summary information.

[0011] An embodiment of the present application also provides an interactive control device, comprising: a memory and a processor; the memory is used to store a computer program; the processor is coupled to the memory and is used to execute the computer program, so as to: display an interactive interface on a second screen, the interactive interface comprising summary information and interactive controls; in response to an interactive operation issued to the interactive control, perform a corresponding operation on a data interface on a first screen; wherein the summary information is generated based on dynamic data displayed in the data interface, and is used to guide a user to issue an interactive operation to the interactive control.

[0012] An embodiment of the present application also provides a display control device, comprising: a memory and a processor; the memory is used to store a computer program; the processor is coupled to the memory and is used to execute the computer program, so as to: obtain data displayed on a first screen; generate interactive controls in an interactive interface based on the data; and display the interactive interface on a second screen so that a user can interactively control the first screen through the interactive controls.

[0013] The embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor implements the steps in the display control method or the interactive control method provided in the embodiment of the present application.

[0014] In an embodiment of the present application, an interactive interface can be generated for the first screen and displayed on the second screen. The interactive interface includes interactive controls, so that the user can interactively control the first screen through the interactive controls on the second screen, which facilitates the user to interactively control the first screen and helps to improve interaction efficiency.

[0015] Furthermore, in an embodiment of the present application, the interactive interface may also include summary information generated based on the dynamic data that needs to be displayed on the first screen. Based on the summary information, the user can quickly interpret the dynamic information on the first screen without having to track the changes in the dynamic data on the first screen, which is conducive to quickly interactively controlling the first screen and further improving the efficiency of interaction with the first screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0017] Figure 1 A schematic diagram of the structure and working principle of a display control system provided for an exemplary embodiment of the present application;

[0018] Figure 2a Another schematic diagram of the working principle of a display control system provided for an exemplary embodiment of the present application;

[0019] Figure 2b A schematic diagram of an application scenario in which a small screen controls a large screen provided by an exemplary embodiment of the present application;

[0020] Figure 2c A schematic diagram of the interface relationship between a large screen and a small screen for displaying relational data provided by an exemplary embodiment of the present application;

[0021] Figure 2d A schematic diagram of the interface relationship between a large screen and a small screen for displaying spatial data provided by an exemplary embodiment of the present application;

[0022] Figure 3 A schematic diagram of another display control system provided for an exemplary embodiment of the present application;

[0023] Figure 4 A flow chart of a display control method provided for an exemplary embodiment of the present application;

[0024] Figure 5 A flowchart of an interactive control method provided for an exemplary embodiment of the present application;

[0025] Figure 6 A flowchart of another display control method provided for an exemplary embodiment of the present application;

[0026] Figure 7a A schematic diagram of the structure of a display control device provided for an exemplary embodiment of the present application;

[0027] Figure 7b A schematic diagram of the structure of another display control device provided for an exemplary embodiment of the present application;

[0028] Figure 8 A schematic diagram of the structure of an interactive control device provided for an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0030] In existing large-screen display scenarios, there is a technical problem of low interaction efficiency between users and the large screen. To address this technical problem, in an embodiment of the present application, an interactive interface is generated for the first screen, and the interactive interface is displayed on the second screen. The interactive interface includes interactive controls, so that users can interactively control the first screen through the interactive controls on the second screen, which makes it easier for users to interactively control the first screen and helps improve interaction efficiency.

[0031] Furthermore, in an embodiment of the present application, the interactive interface may also include summary information generated based on the dynamic data that needs to be displayed on the first screen. Based on the summary information, the user can quickly interpret the dynamic information on the first screen without having to track the changes in the dynamic data on the first screen, which is conducive to quickly interactively controlling the first screen and further improving the efficiency of interaction with the first screen.

[0032] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0033] Figure 1 The structure diagram of a display control system provided by the exemplary embodiment of the present application is shown in FIG. Figure 1As shown, the display control system includes: a display control device 11, a first screen 12, and a second screen 13. The display control device 11 is respectively connected to the first screen 12 and the second screen 13 for communication, and can control the first screen 12 and the second screen 13 to display data. Further, the display control device 11 can control the second screen 13 to display an interactive interface, through which the first screen 12 can be interactively controlled.

[0034] Among them, the display control device 11 and the first screen 12 or the second screen 13 can be connected wirelessly or by wire. Optionally, the display control device 11 can be connected to the first screen 12 or the second screen 13 through a mobile network. Accordingly, the network standard of the mobile network can be any one of 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax or new network standards that will appear in the future. Optionally, the display control device 11 can also be connected to the first screen 12 or the second screen 13 through Bluetooth, WiFi, infrared, zigbee or NFC.

[0035] In this embodiment, the product form of the display control device 11 is not limited, and any computer device with certain computing, storage and communication capabilities can be used as the display control device 11 in the embodiment of this application. For example, the display control device 11 can be a terminal device such as a laptop, desktop computer, smart phone or IOT device, or an edge computing device such as a smart street lamp, camera or traffic monitoring device, or a server device such as a conventional server, cloud server, server array or data center, or an ARM chip and some processing chips or modules based on FPGA or CPLD. Figure 1 In the figure, the display control device 11 is illustrated as a server, but it is not limited to this.

[0036] In this embodiment, the product form of the first screen 12 and the second screen 13 is not limited, and any device with a display function can be used as the first screen 12 or the second screen 13 in the embodiment of the present application. For example, the first screen 12 or the second screen 13 can be a CRT display screen or an LCD display screen. Furthermore, if the first screen 12 or the second screen 13 is an LCD display screen, it can also include a touch panel (TP), then the first screen 12 or the second screen 13 can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect signals such as the duration and pressure associated with the touch or slide operation.

[0037] In this embodiment, the specifications and sizes of the first screen 12 and the second screen 13 are not limited. For example, they can be larger screens such as 49, 55, 60, 72, 100 or 120 inches, or smaller screens such as 3.5, 4.7, 5.5, 9.7, 7.9 or 12.9 inches. The specifications and sizes of the first screen 12 and the second screen 13 can be the same or different.

[0038] In an optional embodiment, the size of the first screen 12 is larger than the size of the second screen 13. Figure 1 For example, the first screen 12 may have a size of 49, 55, 60, 72, 100 or 120 inches, and the second screen 13 may have a size of 3.5, 4.7, 5.5, 9.7, 7.9 or 12.9 inches. When the size of the first screen 12 is larger than the size of the second screen 13, the user can interactively control the large screen through the small screen, which can overcome the inconvenience of interaction caused by the large size of the first screen 12 to a certain extent.

[0039] In another optional embodiment, the size of the first screen 12 is smaller than that of the second screen 13. For example, the size of the first screen 12 may be 3.5, 4.7, 5.5, 9.7, 7.9 or 12.9 inches, and the size of the second screen 13 may be 49, 55, 60, 72, 100 or 120 inches. In the case where the size of the first screen 12 is smaller than that of the second screen 13, the user can control the small screen through the larger screen, which can avoid the inconvenience of operation and low resolution caused by the smaller size of the first screen 12 to a certain extent, and is suitable for some application scenarios with dim light or for some users with poor or imperfect eyesight such as the elderly and children.

[0040] In this embodiment, the first screen 12 needs to display data. This embodiment does not limit the way in which the first screen 12 displays data, and data can be displayed in the form of graphics, charts, etc. The data display effect can be static or dynamic. Regardless of whether the data display effect is static or dynamic, the data display effect supports users to interact with it. In some application scenarios, the data that needs to be displayed on the first screen 12 includes dynamic data. Dynamic data refers to data whose change frequency is greater than a set frequency threshold, such as real-time data generated during the operation of some online applications, cloud applications, physical devices, virtual machines, or some instances.

[0041] In this embodiment, the user is allowed to interactively control the first screen 12. The interactive control here mainly refers to the interactive control initiated for the content displayed on the first screen 12. For example, the user can control the first screen 12 to switch the displayed data content, such as switching the sales volume data of each commodity in 2010 to the sales volume data of each commodity in 2011. For another example, the user can also control the first screen 12 to change the display effect, such as highlighting part of the data or part of the interface elements. Of course, the user can also initiate various interactive controls on the first screen 12 itself, such as controlling the first screen 12 to turn off, turn on, adjust the brightness and resolution of the first screen 12, etc. For the description of the user initiating interactive control on the first screen 12 itself, please refer to the subsequent embodiments, which will not be repeated here.

[0042] In actual applications, the user may not be able to directly perform interactive control on the first screen 12, or it may be inconvenient to perform interactive control on the first screen 12. For example, the first screen 12 does not support touch operation or voice control, and the user cannot perform interactive control on the first screen 12. For another example, the first screen 12 is installed at a high position, and it is inconvenient for the user to perform interactive control on the first screen 12. For another example, the size of the first screen 12 is large, so the user needs to frequently walk in front of the first screen 12 to perform interactive control on the first screen 12, which is inconvenient.

[0043] In order to facilitate the user to interactively control the first screen 12, in this embodiment, the display control device 11 can obtain the data that the first screen 12 needs to display. Figure 1 As shown, the display control device 11 can obtain the data that the first screen 12 needs to display from a data source. The data source may include at least one of a database, a cloud application, an online application, a local application, etc. The specific data source may depend on the application scenario. Alternatively, the display control device 11 may also directly obtain the data that the first screen 12 needs to display from the first screen 12. The data that the first screen 12 needs to display includes dynamic data and other data besides dynamic data; the summary information in the interactive interface is generated based on the dynamic data. In addition to the summary information, the interactive interface in this embodiment also includes interactive controls, such as Figure 1 Optionally, the interactive interface may include an information area and an interactive control area, the summary information is located in the information area, and the interactive controls are located in the interactive control area, but it is not limited thereto. Figure 1 As shown, the interactive interface does not need to be partitioned.

[0044] The interactive control is used for the user to issue interactive instructions to the first screen, and can be in any control form, such as a button, icon list, text label, input box, menu, picture box, scroll bar, etc. In addition, the number of interactive controls can be one or more.

[0045] The summary information may reflect the changes in the dynamic data and guide the user to quickly interpret the dynamic data presented on the first screen 12. The number of summary information may be one or more. The type of summary information may be text, chart, animation, or code.

[0046] In this embodiment, the style, style and layout of the interactive interface are not limited, and all interface styles, styles and layouts that include the above summary information and interactive controls are applicable to the embodiment of the present application. It should be noted that in addition to displaying the above summary information and interactive controls, the interactive interface may also include other content, such as the visualization results of the data displayed on the first screen 12.

[0047] After obtaining the interactive interface, the display control device 11 can display the interactive interface on the second screen 13. The user can perform interactive control with the second screen 13, that is, the user can operate the interactive interface displayed on the second screen 13, for example, the user can initiate an operation on the interactive control on the interactive interface, and the operation can be a click, double-click, touch, long press or mouse hover, etc., depending on the human-computer interaction mode supported by the second screen 13. With the help of the interactive control, the user can issue an interactive instruction to the first screen 12 to achieve interaction with the first screen 12, which can solve the problem that the user cannot directly interact with the first screen 12 or it is not convenient to interact with the first screen 12, facilitate interactive control of the first screen 12, and improve the interaction efficiency with the first screen 12. Furthermore, for the user, by seeing the interactive interface displayed on the second screen 13, the user can also quickly understand the changes in the dynamic data presented on the first screen 12 based on the summary information on the interactive interface, and can quickly determine what kind of interactive control is needed on the first screen 12, and then issue corresponding interactive instructions through the interactive controls to quickly interactively control the first screen 12, thereby further improving the interaction efficiency with the first screen 12.

[0048] In each embodiment of the present application, the information format and content of the summary information are not limited, and any information that can reflect the changes in the dynamic data presented on the first screen 12 can be used as the summary information in the embodiments of the present application.

[0049] In an optional embodiment, the dynamic data to be displayed on the first screen 12 can be directly used as summary information, which means that the dynamic data presented on the first screen 12 will be synchronously displayed on the second screen 13. For the user, the dynamic data on the second screen 13 can be directly viewed without tracking the dynamic data on the first screen 12. For example, in the case where the first screen 12 is a giant screen or a larger screen, the second screen 13 can be a screen on a terminal device used by the user, such as a tablet screen, a smart phone screen, or an office computer screen. Compared with tracking the dynamic data on the giant screen or the larger screen, it is more convenient and efficient for the user to view the dynamic data on the screen of the terminal device, thereby improving the interaction efficiency with the giant screen or the larger screen.

[0050] In another optional embodiment, the changing trend of dynamic data can be generated and used as summary information, which means that the dynamic data is displayed on the first screen 12, and the changing trend of the dynamic data will be displayed on the second screen 13. The changing trend of dynamic data can be represented by trend lines, bar charts and other charts, or it can be a numerical difference that reflects the changing trend of dynamic data, or it can be text information that describes the changing trend of dynamic data. Assume that the dynamic data refers to the sales of women's clothing. During the event, the sales of women's clothing change in real time and continue to increase. Then the text information can be "women's clothing sales continue to grow, and the growth rate reached 30% within 1 hour", but is not limited to this. Figure 1 In the example, trend lines are used to represent the changing trend of dynamic data. Figure 1 The trend lines shown are examples only.

[0051] In the embodiment of the present application, the generation method of the interactive controls is not limited. For example, according to the interactive functions supported by the first screen 12, interactive controls adapted to these interactive functions can be pre-set, based on which the display control device 11 can directly add the pre-set interactive controls to the interactive interface. In addition, the interactive controls in the interactive interface can also be generated dynamically and in real time according to the data that the first screen 12 needs to display. The following describes the method of dynamically and real-time generation of interactive controls:

[0052] For the first screen 12, the data that needs to be displayed include dynamic data and other data, and the other data is associated with the dynamic data. For example, the dynamic data can be the real-time sales volume or sales amount of each commodity in the current period, and the other data can be the sales volume or sales amount in multiple historical periods, or dynamic icons that reflect the changes in real-time sales volume or sales amount. Considering that the dynamic data changes frequently, the first screen 12 can directly display the dynamic data itself, and no special visualization processing can be performed on the dynamic data. For other data, the first screen 12 can display the visualization results corresponding to the other data. In order to facilitate better interaction with the visualization results of other data, the display control device 11 can analyze the visualization attributes of other data that need to be displayed on the first screen 12; according to the visualization attributes of other data, an interactive control in the interactive interface is generated, and the interactive control is mainly used to interact with the visualization results of other data on the first screen 12.

[0053] Among them, the visualization attribute of the data can indicate what kind of visualization graphic form the data is suitable for displaying. For a piece of data, its visualization attribute can be a time attribute, indicating that the data is data that changes with time, and it is more suitable to be displayed in a graphic form that can reflect the change with time. For a piece of data, its visualization attribute can be a location attribute, indicating that the data is data that changes with the geographical location, and it is more suitable to be displayed in a graphic form that can reflect the change with the geographical location. For a piece of data, its visualization attribute can be a category attribute, indicating that the data is a certain category of data, which will vary depending on the category, and it is more suitable to be displayed in a graphic form that can reflect different categories. Among them, the visualization attribute of the data can reflect the graphic form that is suitable for the data to be used when it is visualized, and can further reflect the type of control that is suitable for interacting with these graphic forms.

[0054] Based on the above, when the display control device 11 generates an interactive control in the interactive interface according to the visualization attributes of other data, it can determine the corresponding target control type according to the visualization attributes of other data; and generate the interactive control in the interactive interface according to the target control type. The target control type refers to a control type determined according to the visualization attributes of other data that is suitable for interacting with the graphic form used by other data when it is visualized.

[0055] For example, if the visualization attributes of other data include time attributes, the control type that supports interaction by time can be determined as the target control type; if the visualization attributes of other data include position attributes, the control type that supports interaction by position can be determined as the target control type; if the visualization attributes of other data include category attributes, the control type that supports interaction by category can be determined as the target control type.

[0056] Among them, the control types that support interaction by time may include: a timeline control, and the timeline control can be slid or clicked. By sliding or clicking the timeline control, the user can issue an interactive instruction to view the data or visualization effect corresponding to a certain time point, and the display control device 11 will display or highlight the data or visualization effect corresponding to a certain time point on the first screen 12. In addition to the timeline control, the control types that support interaction by time may also include: an input box control that can input time information, and the input box control supports input operations. The user can issue an interactive instruction to view the data or visualization effect corresponding to a certain time point by entering the time point information in the input box control.

[0057] Among them, the control types that support interaction by location may include: a map control, which can be scaled, rotated or dragged. By scaling, rotating or dragging the map control, the user can issue an interactive instruction to view the data or visualization effects corresponding to a certain geographical area or location, and the display control device 11 will display or highlight the data or visualization effects corresponding to a certain geographical area or location on the first screen 12. Among them, the map control is a complete or partial electronic map, on which various geographical areas or locations are mainly displayed. In addition, the electronic map can be two-dimensional or three-dimensional.

[0058] Among them, the control types that support interaction by category may include: selection controls, which can be clicked, touched or long pressed. Optionally, a selection control can be set to correspond to a category. If there are multiple categories, multiple selection controls can be set on the interactive interface, corresponding to multiple different categories respectively. The user can click, touch or long press a selection control to issue an interactive instruction to view the data or visualization results under the category corresponding to the selection control. A selection control can correspond to one category or multiple categories. In the case where a selection control corresponds to multiple categories, different categories can be distinguished by the different operation types supported by the selection control, for example, a single-click operation indicates corresponding category 1, a double-click operation indicates corresponding category 2, a long-press operation indicates corresponding category 3, and so on.

[0059] In the above embodiments of the present application, there is no limitation on how the first screen 12 displays the data to be displayed. For example, the first screen 12 can perform data display operations by itself, such as obtaining the data to be displayed from the data source and displaying the data to be displayed according to the data display model preset by the user. In addition, the display control device 11 can also control the first screen 12 to display data. Figure 2a The illustrated embodiment illustrates a process in which the display control device 11 controls the first screen 12 to display data.

[0060] like Figure 2aAs shown, the display control device 11 can obtain the data that needs to be displayed on the first screen 12 from the data source, and the data includes dynamic data and other data. After obtaining the data that needs to be displayed on the first screen 12, the display control device 11 can generate summary information and interactive controls in the interactive interface based on the dynamic data, and display the interactive interface on the second screen 13; on the other hand, it can perform visualization processing on other data to obtain the overall visualization result that needs to be displayed on the first screen 12, and the overall visualization result includes the visualization results of other data and dynamic data, and displays the overall visualization result on the first screen 12. Figure 2a As shown, the first screen 12 includes at least two display areas, one is a dynamic data display area, and the other is a visualization result display area for other data.

[0061] In an optional embodiment, the dynamic display device 11 can analyze the visualization properties of other data; then, on the one hand, generate interactive controls in the interactive interface according to the visualization properties of other data; on the other hand, determine the visualization graphic form required to display other data according to the visualization properties of other data; according to the visualization graphic form, visualize the data to be displayed on the first screen 12 to obtain a data interface, which is equivalent to the overall visualization result mentioned above; then, the data interface can be displayed on the first screen 12, and the data interface includes the visualization results of other data in the visualization graphic form, such as Figure 2a The bar graph shown in . Figure 2a The bar chart shown in FIG. 1 is only an example of a visualization graphic form and is not limited thereto.

[0062] Optionally, if the visualization attributes of other data include time attributes, determine the graphical form that can be displayed by time. For example, the graphical form that can be displayed by time can be a two-dimensional or three-dimensional coordinate graph with time as a certain coordinate axis, and the coordinate graph can use a scatter plot, a bar graph, a curve graph, etc. If the visualization attributes of other data include location attributes, determine the graphical form that can be displayed by location. For example, the graphical form that can be displayed by location can be a data map. If the visualization attributes of other data include category attributes, determine the graphical form that can be displayed by category. The graphical form that can be displayed by category can be a scatter plot, a bar graph, a curve graph, a pie chart, etc. that can reflect the category.

[0063] Combined with the aforementioned implementation of "generating interactive controls in the interactive interface according to the target control type", the display control device 11 can combine the visual graphic form required for displaying other data on the first screen 12 in the process of generating interactive controls according to the target control type, that is, it can select an interactive control that matches the visual graphic form from the interactive controls under the target control type as the interactive control in the interactive interface. There may be multiple interactive controls under the target control type, and selecting an interactive control that matches the visual graphic form can reduce the technical implementation difficulty when interactively controlling the visual graphic form according to the interactive control, and reduce development costs.

[0064] Furthermore, when developing controls, multiple versions of the same interactive control can be developed for different screen types and / or specifications. Based on this, when selecting an interactive control in the interactive interface from the target control type, the type and / or specifications of the second screen 13 can also be combined to select an interactive control that is compatible with the type and / or specifications of the second screen from the interactive controls, which is conducive to ensuring the rationality of the style and layout of the interactive interface and improving the user experience.

[0065] Furthermore, in addition to displaying interactive controls and summary information, the second screen 13 may also display visualization results corresponding to other data that needs to be displayed on the first screen 12. Optionally, the display control device 11 may also perform visualization processing on other data that needs to be displayed on the first screen 12 according to the specifications, size and type of the second screen 13, obtain visualization results corresponding to other data, and display the visualization results of other data on the second screen 13. Alternatively, the display control device may also adjust the visualization results obtained above for the first screen 12 according to the specifications, size and type of the second screen 13, obtain visualization results suitable for the second screen 13, and then display the visualization results on the second screen 13.

[0066] In this embodiment, the implementation method of displaying the visualization results of the interactive controls, summary information, and other data on the second screen 13 is not limited. For example, the visualization results of other data can be displayed as the first layer, and then the interactive controls and summary information can be displayed as the second layer on the first layer. Optionally, the interactive controls and summary information can be displayed in the edge area of ​​the first layer, which can reduce the occlusion of the core area of ​​the first layer.

[0067] Furthermore, based on the interactive interface being displayed on the second screen 13 and the dynamic data and other data visualization results being displayed on the first screen 12, the user can interactively control the first screen 12 through the interactive interface on the second screen 13. Figure 2aAs shown, the user can issue an interactive operation to the interactive control on the second screen 13. Further, the user can issue an interactive operation to the interactive control under the guidance of the summary information. For the display control device 11, in response to the interactive operation issued to the interactive control on the second screen 13, a corresponding operation can be performed on the data interface on the first screen 11. In this embodiment, the interactive operation issued by the user is not limited, and it can be any interactive operation that the first screen 13 can support.

[0068] It is noted that the display control device 11 in this embodiment can be implemented independently of the first screen 12 and the second screen 13, or can be integrated with the first screen 12 or the second screen 13 in one device. In an optional embodiment, the display control device 11 is implemented independently, the first screen 12 is an independent screen, and the second screen is a screen on a terminal device for remotely controlling the first screen 12.

[0069] The technical solution provided in the above embodiments of the present application can be applied to a large-screen display of real-time data with an interpreter or host. Figure 2b As shown, in this application scenario, it is necessary to display the real-time data and the visualization results of other data associated with the real-time data on the large screen (equivalent to the first screen 12 mentioned above). The lecturer or host needs to combine the real-time data on the large screen for explanation, and needs to show different visualization results to the audience through the large screen during the explanation process. Figure 2b As shown, in order to facilitate interaction with the large screen, the lecturer or host interactively controls the large screen through a handheld terminal. The handheld terminal used by the lecturer or host can be a mobile phone, a tablet computer or a mini notebook, etc., and its screen (equivalent to the above-mentioned second screen 13) is relatively small.

[0070] like Figure 2b As shown, the server device (equivalent to the above-mentioned display control device 11) will generate summary information of the interactive interface according to the real-time data that needs to be displayed on the large screen, and will generate corresponding interactive controls according to the visualization attributes of other data; and display the interactive interface with the summary information and interactive controls on the screen of the handheld terminal used by the lecturer or host.

[0071] like Figure 2bAs shown, the lecturer or host can view the interactive interface displayed by the handheld terminal, which includes summary information that can reflect the changes in real-time data. Based on the summary information, the lecturer or host can quickly interpret the real-time information presented on the large screen, and can quickly determine what kind of interactive control needs to be performed on the large screen, and quickly perform interactive control on the large screen. In this embodiment, the lecturer or host can accurately control the changes in real-time data without frequently walking in front of the large screen. The real-time data presented on the large screen can be logically guided through the summary information on the handheld terminal, which can present a better quality data visualization effect to the audience in a timely and rapid manner, which is conducive to improving the audience's viewing experience.

[0072] In this embodiment, the visualization result on the large screen is not limited, and can be any visualization result that supports interactive operations. Figure 2c As shown in the figure, a relational data visualization interface on a large screen and an interactive interface on a handheld terminal are displayed. The large screen focuses on displaying visual effects; the interactive interface on the handheld terminal side includes a filter button, through which the graphic form on the large screen can be controlled and adjusted; in addition to the filter button, the interactive interface also presents the details and changes of the real-time data on the large screen. Figure 2d As shown, it shows a visualization data interface of spatial data on a large screen and an interactive interface on a handheld terminal. The large screen focuses on displaying visual effects; the interactive interface on the handheld terminal side includes a filter button, through which the graphic form on the large screen can be controlled and adjusted. The filter button can select different geographical areas, such as different provinces; in addition to the filter button, the interactive interface also presents the details and changes of real-time data on the large screen, as well as the carriers of spatial data corresponding to different geographical areas, such as maps. Users can zoom and rotate the carrier of the spatial data. It should be noted that in Figure 2c and Figure 2d In this paper, the focus is to highlight the correspondence between the data interface displayed on the large screen and the interactive interface on the handheld terminal side and the difference in interface effects through the screen form in specific scenarios, and not to pay attention to the specific content displayed on the two screens. Figure 2c and Figure 2d The relevant content has been blurred.

[0073] In the above embodiment, on the basis of realizing multi-terminal linkage between the large data screen and the handheld small screen, the real-time data displayed on the large screen is adaptively displayed on the small screen, which plays a role of logical guidance for the host or explainer of the large data screen, reduces the difficulty of observing the changes in real-time data, realizes the cycle of human-computer interaction between users and the large data screen, and thus makes the understanding and interpretation of the combined nested data screen more efficient and accurate.

[0074] Figure 3 This is a schematic diagram of another display control system provided by an exemplary embodiment of the present application. Figure 3 As shown, the system includes: a display control device 31, a first screen 32 and a second screen 33. The display control device 31 is respectively connected to the first screen 32 and the second screen 33 for communication, and can control the first screen 32 and the second screen 33 to display data. Further, the display control device 31 can control the second screen 33 to display an interactive interface, through which the first screen 32 can be interactively controlled.

[0075] The display control device 31 and the first screen 32 or the second screen 33 may be connected wirelessly or by wire.

[0076] In this embodiment, the product form of the display control device 31 is not limited, and any computer device with certain computing, storage and communication capabilities can be used as the display control device 31 in the embodiment of this application. For example, the display control device 31 can be a terminal device such as a laptop, desktop computer, smart phone or IOT device, or an edge computing device such as a smart street lamp, camera or traffic monitoring device, or a server device such as a conventional server, cloud server, server array or data center, or an ARM chip and some processing chips or modules based on FPGA or CPLD. Figure 3 In the figure, the display control device 31 is illustrated as a server, but it is not limited to this.

[0077] In this embodiment, the product form of the first screen 32 and the second screen 33 is not limited, for example, it can be a CRT display screen or an LCD display screen. Similarly, the specifications and sizes of the first screen 32 and the second screen 33 are not limited. The specifications and sizes of the first screen 32 and the second screen 33 can be the same, or the specifications and sizes of the first screen 32 are larger than the specifications and sizes of the second screen 33, or the specifications and sizes of the first screen 32 are smaller than the specifications and sizes of the second screen 33.

[0078] In this embodiment, the first screen 32 displays data. This embodiment does not limit the way in which the first screen 32 displays data, and data can be displayed in the form of graphics, charts, etc. The data display effect can be static or dynamic. Regardless of whether the data display effect is static or dynamic, the data display effect supports user interaction with it.

[0079] In this embodiment, the display control device 31 may obtain data displayed on the first screen 32. For example, the display control device 31 may obtain data displayed on the first screen 32 from a data source; or, the display control device 31 may directly obtain data displayed on the first screen 32 from the first screen 32. In this embodiment, the data displayed on the first screen 32 is not limited, and may include dynamic data or may not include dynamic data.

[0080] After acquiring the data displayed on the first screen 32, the display control device 31 may generate an interactive control in the interactive interface according to the acquired data. The interactive control is used for the user to interactively control the first screen 32. The interactive control here is mainly initiated for the content displayed on the first screen 32, but is not limited thereto. The interactive control may be in any form, such as a button, an icon list, a text label, an input box, a menu, a picture box, a scroll bar, etc. In addition, the number of interactive controls may be one or more.

[0081] In this embodiment, the style, style and layout of the interactive interface are not limited, and all interface styles, styles and layouts that include the above-mentioned interactive controls are applicable to the embodiments of this application. It should be noted that in addition to displaying the above-mentioned interactive controls, the interactive interface may also include other content, such as the visualization results of the data displayed on the first screen 32.

[0082] After obtaining the interactive interface, the display control device 31 can display the interactive interface on the second screen 33. The user can perform interactive control with the second screen 33, that is, the user can operate the interactive interface displayed on the second screen 33, for example, the user can initiate an operation on the interactive control on the interactive interface, and the operation can be a click, double-click, touch, long press or mouse hover, etc., depending on the human-computer interaction mode supported by the second screen 33. With the help of the interactive control, the user can issue an interactive instruction to the first screen 32 to achieve interaction with the first screen 32, which can solve the problem that the user cannot directly interact with the first screen 32 or it is not convenient to interact with the first screen 32, facilitate interactive control of the first screen 32, and improve the interaction efficiency with the first screen 32.

[0083] In the embodiment of the present application, the generation method of the interactive controls is not limited. For example, according to the interactive functions supported by the first screen 32, interactive controls adapted to these interactive functions can be pre-set, based on which the display control device 32 can directly add the pre-set interactive controls to the interactive interface. In addition, the interactive controls in the interactive interface can also be generated dynamically and in real time according to the data that the first screen 32 needs to display. The following describes the method of dynamically and real-time generation of interactive controls:

[0084] The display control device 31 can analyze the visualization properties of the data displayed on the first screen 32; generate interactive controls in the interactive interface according to the visualization properties of the data; wherein the interactive controls are used to perform interactive operations on the visualization results of the data on the first screen 32. For the description of the visualization properties of the data, please refer to the above embodiments, which will not be repeated here.

[0085] Further optionally, one implementation of the display control device 31 generating an interactive control in the interactive interface according to the visualization attributes of the data includes: determining a corresponding target control type according to the visualization attributes of the other data; and generating an interactive control in the interactive interface according to the target control type. The target control type refers to a control type determined according to the visualization attributes of the data displayed on the first screen 32 and suitable for interacting with the graphic form used when the data is visualized.

[0086] Optionally, an implementation of generating interactive controls in an interactive interface based on a target control type includes: randomly selecting one or more interactive controls from the interactive controls under the target control type as interactive controls in the interactive interface; or, selecting one or more interactive controls from the interactive controls under the target control type based on attribute information such as the size or style of the interactive controls as interactive controls in the interactive interface.

[0087] Optionally, another implementation of generating an interactive control in the interactive interface according to the target control type includes: selecting an interactive control in the interactive interface from the interactive controls under the target control type according to at least one of the visual graphic form used by the first screen 32 to display data, the type of the second screen 32, and the specification size of the second screen 32. In this optional implementation, in the process of selecting an interactive control from the target control type, reference is made to the visual graphic form used by the first screen 32 to display data, the type of the second screen 32, and / or the specification size of the second screen 32, which is conducive to selecting a more appropriate interactive control, making the style, layout, etc. of the interactive interface more reasonable and beautiful, and helping to improve the user experience.

[0088] In the embodiment of the present application, there is no limitation on how the first screen 32 displays data. The first screen 32 can complete data display operations by itself. For example, it can obtain the data to be displayed from the data source, and display the data to be displayed according to the data display model preset by the user. Alternatively, the first screen 32 can also complete the data display task under the control of other devices. In addition, the display control device 31 can also control the first screen 32 to display data. For example, the display control device 31 can also obtain the data to be displayed on the first screen 32, visualize the obtained data, and obtain a data interface; then display the data interface on the first screen 32.

[0089] In some application scenarios, the data displayed on the first screen 32 includes dynamic data. Based on this, before displaying the interactive interface on the second screen 33, the display control device 31 can also obtain the dynamic data displayed on the first screen 32; generate summary information in the interactive interface based on the dynamic data, and the summary information can be used by the user to understand the changes in the dynamic data presented on the first screen 32. In other words, in this embodiment, the interactive interface includes not only interactive controls, but also summary information. For the user, seeing the interactive interface displayed on the second screen 33, according to the summary information on the interactive interface, the user can also quickly understand the changes in the dynamic data presented on the first screen 32, and can quickly determine what kind of interactive control needs to be performed on the first screen 32, and then issue corresponding interactive instructions through the interactive controls to quickly interactively control the first screen 32, and further improve the interaction efficiency with the first screen 32. The generation process of the summary information can be referred to the aforementioned embodiment, which will not be repeated here.

[0090] In the above embodiments, the display control device generates an interactive control in the interactive interface according to the data or dynamic data displayed on the first screen, and can interactively control the visual content displayed on the first screen based on the interactive control. In addition, in some embodiments, the display control device can also generate an interactive control in the interactive interface according to the interactive functions supported by the first screen itself. The interactive control here is mainly used for the user to initiate various controls on the first screen itself, such as controlling the first screen to turn off or on, and adjusting the brightness and resolution of the first screen.

[0091] Optionally, the interactive controls supported by the first screen itself can be directly added to the interactive interface, and the interactive interface can be displayed on the second screen, so that the user can perform various interactive controls on the first screen itself through the interactive controls on the second screen.

[0092] In one application scenario, the first screen may be the screen of a video playback device, such as a TV screen; the second screen may be the screen of a mobile terminal, such as a smartphone screen. An interactive interface required for controlling the playback of a TV may be generated, and control controls corresponding to the TV may be added to the interactive interface, and the interactive interface may be sent to the smartphone; for a user, the interactive interface on the smartphone may be opened, that is, the interactive interface is displayed on the smartphone screen, and then the interactive controls in the interactive interface may be used to perform various playback controls on the TV, such as adjusting the playback progress, switching channels, pausing, shutting down, turning on, adjusting the playback volume, adjusting the brightness and resolution of the TV screen, etc., which greatly facilitates the playback control of the TV.

[0093] In the above embodiment, by generating an interactive interface with interactive controls and displaying the interactive interface on the second screen, the user can interactively control the first screen that plays the streaming media content through the second screen; and, depending on the different physical meanings of the interactive controls, the user can interactively control the content displayed on the first screen, or interactively control the first screen itself, and of course, can also interactively control both the content displayed on the first screen and the first screen itself. In addition, the technical solution provided by the embodiment of the present application can also be applied to non-streaming media playback scenarios. For example, by generating an interactive interface with interactive controls, any hardware device or module that can perform a task can be controlled. Among them, a control interface with different control types can be generated based on the current task type of the controlled hardware device or module; the control interface is displayed on a screen for the user to control the controlled hardware device or module accordingly through different control types in the control interface, for example, the task execution speed, task execution time, task execution shutdown, task execution pause, task execution results, etc. can be adjusted.

[0094] Figure 4 A flow chart of a display control method provided by an exemplary embodiment of the present application. Figure 4 As shown, the method includes:

[0095] 40. Acquire data to be displayed on the first screen, the data including dynamic data;

[0096] 41. Generate summary information in an interactive interface based on dynamic data, the interactive interface also including interactive controls;

[0097] 42. Display an interactive interface on the second screen to guide the user to interactively control the first screen through interactive controls through summary information.

[0098] In some optional embodiments, step 41, i.e., generating summary information in the interactive interface based on dynamic data, includes: directly using the dynamic data as summary information in the interactive interface; or generating a change trend of the dynamic data as summary information in the interactive interface.

[0099] In some optional embodiments, the method of this embodiment also includes: analyzing visualization properties of other data associated with the dynamic data; generating interactive controls in the interactive interface based on the visualization properties of the other data; wherein the interactive controls are used to perform interactive operations on the visualization results of the other data.

[0100] Further optionally, the method of this embodiment also includes: determining the visualization graphic form required to display other data based on the visualization attributes of the above-mentioned other data; visualizing the data according to the visualization graphic form to obtain a data interface; displaying the data interface on the first screen; wherein the data interface includes the visualization results of other data in the visualization graphic form.

[0101] Optionally, an implementation of generating interactive controls in an interactive interface according to visualization properties of other data includes: determining a corresponding target control type according to the visualization properties of other data; and generating an interactive control in the interactive interface according to the target control type.

[0102] In an optional embodiment, the above-mentioned implementation method of determining the corresponding target control type based on the visualization attributes of other data includes: if the visualization attributes of other data include time attributes, determining the control type that supports interaction by time as the target control type; if the visualization attributes of other data include position attributes, determining the control type that supports interaction by position as the target control type; if the visualization attributes of other data include category attributes, determining the control type that supports interaction by category as the target control type.

[0103] Optionally, the above-mentioned control types supporting interaction by time may include: timeline controls, which can be slid or clicked; the above-mentioned control types supporting interaction by location may include: map controls, which can be scaled, rotated or dragged; the above-mentioned control types supporting interaction by category may include: selection controls, which can be clicked, touched or long pressed.

[0104] In an optional embodiment, the generating of the interactive control in the interactive interface according to the target control type includes: selecting, from the interactive controls under the target control type, an interactive control that matches the visualized graphic form as the interactive control in the interactive interface.

[0105] In an optional embodiment, the visualization graphic form required to display the other data is determined based on the visualization attributes of the other data, including: if the visualization attributes of the other data include time attributes, determining the graphic form that can be displayed by time; if the visualization attributes of the other data include location attributes, determining the graphic form that can be displayed by location; if the visualization attributes of the other data include category attributes, determining the graphic form that can be displayed by category.

[0106] In an optional embodiment, the method of this embodiment further includes: responding to an interactive operation issued to the interactive control on the second screen, performing a corresponding operation on the data interface on the first screen.

[0107] In an optional embodiment, the interactive interface includes an information area and an interactive control area, the summary information is located in the information area, and the interactive controls are located in the interactive control area.

[0108] Optionally, the size of the first screen is larger than that of the second screen. Further, the second screen is a screen of a terminal device that remotely controls the first screen; and the first screen is an independent screen.

[0109] For a detailed description of each step in the embodiment of the present method, please refer to the aforementioned system embodiment, which will not be repeated here.

[0110] In this embodiment, an interactive interface is generated for the first screen, and the interactive interface is displayed on the second screen. The interactive interface includes interactive controls, so that the user can interactively control the first screen through the interactive controls on the second screen, which is convenient for the user to interactively control the first screen, which is conducive to improving the interaction efficiency. Furthermore, the interactive interface can also include summary information generated according to the dynamic data that needs to be displayed on the first screen. Based on the summary information, the user can quickly interpret the dynamic information on the first screen without tracking the changes of the dynamic data on the first screen, which is conducive to quickly interactively controlling the first screen and further improving the interaction efficiency with the first screen.

[0111] Figure 5 The following is a flow chart of an interactive control method provided by an exemplary embodiment of the present application. Figure 5 As shown, the method includes:

[0112] 50. Displaying an interactive interface on the second screen, the interactive interface including summary information and interactive controls;

[0113] 51. In response to an interactive operation issued to an interactive control, a corresponding operation is performed on a data interface on a first screen; wherein the summary information is generated based on dynamic data displayed in the data interface, and is used to guide the user to issue an interactive operation to the interactive control.

[0114] Optionally, the interactive control is generated according to the visual attributes of other data displayed in the data interface. For the generation method of the interactive control and the summary information, please refer to the description in the above system embodiment, which will not be repeated here.

[0115] In this embodiment, the interactive interface corresponding to the first screen is displayed on the second screen, so that the user can interactively control the first screen through the interactive controls on the second screen, which is convenient for the user to interactively control the first screen, and is conducive to improving the interaction efficiency. Furthermore, the interactive interface can also include summary information generated according to the dynamic data to be displayed on the first screen. Based on the summary information, the user can quickly interpret the dynamic information on the first screen without tracking the changes of the dynamic data on the first screen, which is conducive to quickly interactively controlling the first screen and further improving the interaction efficiency with the first screen.

[0116] Figure 6 FIG. 1 is a flow chart of another display control method provided by an exemplary embodiment of the present application. Figure 6 As shown, the method includes:

[0117] 60. Get the data displayed on the first screen;

[0118] 61. Generate interactive controls in an interactive interface according to the data;

[0119] 62. Display the interactive interface on the second screen so that the user can interactively control the first screen through the interactive control.

[0120] In an optional embodiment, generating interactive controls in an interactive interface based on data includes: analyzing visualization properties of the data; generating interactive controls in the interactive interface based on the visualization properties of the data; wherein the interactive controls are used to perform interactive operations on visualization results of the data.

[0121] In an optional embodiment, generating an interactive control in an interactive interface according to visual attributes of data includes: determining a corresponding target control type according to visual attributes of other data; and generating an interactive control in the interactive interface according to the target control type.

[0122] Optionally, generating interactive controls in the interactive interface according to the target control type includes: selecting interactive controls in the interactive interface from the interactive controls under the target control type according to at least one of the visual graphic form used to display data on the first screen, the type of the second screen, and the specification size of the second screen.

[0123] Optionally, before displaying the interactive interface on the second screen, the method of this embodiment may further include: acquiring dynamic data in the data; generating summary information in the interactive interface based on the dynamic data, wherein the summary information allows the user to understand changes in the dynamic data on the first screen.

[0124] For a detailed description of each step in the embodiment of the present method, please refer to the aforementioned system embodiment, which will not be repeated here.

[0125] In this embodiment, an interactive interface is generated for the first screen, and the interactive interface is displayed on the second screen. The interactive interface includes interactive controls, so that the user can interactively control the first screen through the interactive controls on the second screen, which facilitates the user to interactively control the first screen and helps to improve interaction efficiency.

[0126] It should be noted that the execution subject of each step of the method provided in the above embodiment can be the same device, or the method can be executed by different devices. For example, the execution subject of steps 40 to 42 can be device A; for another example, the execution subject of steps 40 and 41 can be device A, and the execution subject of step 42 can be device B; and so on.

[0127] In addition, in some of the processes described in the above embodiments and the accompanying drawings, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel, and the sequence numbers of the operations, such as 40, 41, etc., are only used to distinguish between different operations, and the sequence numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0128] Figure 7a The structure diagram of a display control device provided by an exemplary embodiment of the present application is shown in FIG. Figure 7a As shown, the device includes: a memory 74a, a processor 75a and a communication component 76a.

[0129] The memory 74a is used to store computer programs and can be configured to store various other data to support operations on the display control device. Examples of such data include instructions, messages, pictures, videos, etc. for any application or method operating on the display control device.

[0130] The memory 74a may be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0131] The processor 75a is coupled to the memory 74a, and is used to execute the computer program in the memory 74a, so as to: obtain data to be displayed on the first screen, the data including dynamic data; generate summary information in the interactive interface according to the dynamic data, the interactive interface also including interactive controls; and display the interactive interface on the second screen to guide the user to interactively control the first screen through the interactive controls through the summary information.

[0132] In some optional embodiments, when the processor 75a generates summary information in the interactive interface based on dynamic data, it is specifically used to: directly use the dynamic data as the summary information in the interactive interface; or generate a change trend of the dynamic data as the summary information in the interactive interface.

[0133] In some optional embodiments, the processor 75a is also used to: analyze the visualization properties of other data associated with the dynamic data; generate interactive controls in the interactive interface according to the visualization properties of other data; wherein the interactive controls are used to perform interactive operations on the visualization results of other data.

[0134] Further optionally, the processor 75a is also used to: determine the visualization graphic form required to display other data based on the visualization attributes of the above-mentioned other data; visualize the data according to the visualization graphic form to obtain a data interface; display the data interface on the first screen; wherein the data interface includes the visualization results of other data in the visualization graphic form.

[0135] Optionally, when generating an interactive control in an interactive interface, the processor 75a is specifically configured to: determine a corresponding target control type according to visualization properties of other data; and generate an interactive control in the interactive interface according to the target control type.

[0136] In an optional embodiment, when determining the corresponding target control type, the processor 75a is specifically used to: if the visualization attributes of other data include time attributes, determine the control type that supports interaction by time as the target control type; if the visualization attributes of other data include position attributes, determine the control type that supports interaction by position as the target control type; if the visualization attributes of other data include category attributes, determine the control type that supports interaction by category as the target control type.

[0137] Optionally, the above-mentioned control types supporting interaction by time may include: timeline controls, which can be slid or clicked; the above-mentioned control types supporting interaction by location may include: map controls, which can be scaled, rotated or dragged; the above-mentioned control types supporting interaction by category may include: selection controls, which can be clicked, touched or long pressed.

[0138] In an optional embodiment, when generating an interactive control in an interactive interface, the processor 75a is specifically used to: select an interactive control matching the above-mentioned visual graphic form from the interactive controls under the target control type as the interactive control in the interactive interface.

[0139] In an optional embodiment, when the processor 75a determines the visual graphic form required to display other data, it is specifically used to: if the visual attributes of the other data include time attributes, determine the graphic form that can be displayed by time; if the visual attributes of the other data include location attributes, determine the graphic form that can be displayed by location; if the visual attributes of the other data include category attributes, determine the graphic form that can be displayed by category.

[0140] In an optional embodiment, the processor 75a is further used to: respond to an interactive operation issued to the interactive control on the second screen, and perform a corresponding operation on the data interface on the first screen.

[0141] In an optional embodiment, the interactive interface includes an information area and an interactive control area, the summary information is located in the information area, and the interactive controls are located in the interactive control area.

[0142] Optionally, the size of the first screen is larger than that of the second screen. Further, the second screen is a screen of a terminal device that remotely controls the first screen; and the first screen is an independent screen.

[0143] Further, if Figure 7a As shown, the display control device also includes: a display 77a, a power supply component 78a, an audio component 79a and other components. Figure 7a Only some components are shown schematically, which does not mean that the display control device only includes Figure 7a In addition, Figure 7a The components in the dashed box are optional components, not mandatory components, and the specific components depend on the product form of the display control device. The display control device of this embodiment can be implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, or an IOT device, or it can be a display control device such as a conventional server, a cloud server, or a server array. If the display control device of this embodiment is implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, etc., it can include Figure 7aIf the display control device of this embodiment is implemented as a conventional server, cloud server or server array and other display control devices, it may not include Figure 7a Components within the dashed box.

[0144] It is particularly noted that the display 77a may be a display independent of the first screen and the second screen, and may be implemented as the first screen, or may be implemented as the second screen.

[0145] In addition to the above-mentioned display control device, an embodiment of the present application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed by one or more processors, the one or more processors are caused to perform the following actions: obtaining data to be displayed on the first screen, wherein the data includes dynamic data; generating summary information in an interactive interface based on the dynamic data, wherein the interactive interface also includes interactive controls; and displaying the interactive interface on the second screen to guide the user to interactively control the first screen through the interactive controls through the summary information.

[0146] In addition to the above operations, the processor may also implement other operations by executing the above computer program. For details, please refer to the description in the above embodiments, which will not be repeated here.

[0147] Figure 7b The structure diagram of a display control device provided by an exemplary embodiment of the present application is shown in FIG. Figure 7b As shown, the device includes: a memory 74b, a processor 75b and a communication component 76b.

[0148] The memory 74b is used to store computer programs and can be configured to store various other data to support operations on the display control device. Examples of such data include instructions, messages, pictures, videos, etc. for any application or method operating on the display control device.

[0149] Memory 74b can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0150] The processor 75b is coupled to the memory 74b and is used to execute the computer program in the memory 74b to: obtain data displayed on the first screen; generate interactive controls in the interactive interface based on the data; and display the interactive interface on the second screen so that the user can interactively control the first screen through the interactive controls.

[0151] In an optional embodiment, when the processor 75b generates interactive controls in an interactive interface based on data, it is specifically used to: analyze the visualization properties of the data; generate interactive controls in the interactive interface based on the visualization properties of the data; wherein the interactive controls are used to perform interactive operations on the visualization results of the data.

[0152] In an optional embodiment, when generating an interactive control in an interactive interface, the processor 75b is specifically used to: determine a corresponding target control type according to visual attributes of other data; and generate an interactive control in the interactive interface according to the target control type.

[0153] Optionally, when processor 75b generates interactive controls in the interactive interface according to the target control type, it is specifically used to: select interactive controls in the interactive interface from the interactive controls under the target control type based on at least one of the information including the visual graphic form used to display data on the first screen, the type of the second screen, and the specification size of the second screen.

[0154] Optionally, the processor 75b is further used to: before displaying the interactive interface on the second screen, obtain dynamic data in the data; generate summary information in the interactive interface according to the dynamic data, and the summary information can be used for the user to understand the changes of the dynamic data on the first screen.

[0155] Further, if Figure 7b As shown, the display control device also includes: a display 77b, a power supply component 78a, an audio component 79a and other components. Figure 7b Only some components are shown schematically, which does not mean that the display control device only includes Figure 7b In addition, Figure 7b The components in the dashed box are optional components, not mandatory components, and the specific components depend on the product form of the display control device. The display control device of this embodiment can be implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, or an IOT device, or it can be a display control device such as a conventional server, a cloud server, or a server array. If the display control device of this embodiment is implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, etc., it can include Figure 7b If the display control device of this embodiment is implemented as a conventional server, cloud server or server array and other display control devices, it may not include Figure 7b Components within the dashed box.

[0156] It is particularly noted that the display 77b may be a display independent of the first screen and the second screen, and may be implemented as the first screen, or may be implemented as the second screen.

[0157] In addition to the above-mentioned display control device, an embodiment of the present application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed by one or more processors, the one or more processors are caused to perform the following actions: obtaining data displayed on the first screen; generating interactive controls in the interactive interface based on the data; and displaying the interactive interface on the second screen for the user to interactively control the first screen through the interactive controls.

[0158] In addition to the above operations, the processor may also implement other operations by executing the above computer program. For details, please refer to the description in the above embodiments, which will not be repeated here.

[0159] Figure 8 The following is a schematic diagram of the structure of an interactive control device provided by an exemplary embodiment of the present application. Figure 8 As shown, the device includes: a memory 84 and a processor 85.

[0160] The memory 84 is used to store computer programs and can be configured to store various other data to support operations on the interactive control device. Examples of such data include instructions, messages, pictures, videos, etc. for any application or method operating on the interactive control device.

[0161] The memory 84 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0162] The processor 85 is coupled to the memory 84 and is used to execute the computer program in the memory 84, so as to: display an interactive interface on the second screen, the interactive interface including summary information and interactive controls; in response to interactive operations issued to the interactive controls, perform corresponding operations on the data interface on the first screen; wherein the summary information is generated based on the dynamic data displayed in the data interface, and is used to guide the user to issue interactive operations to the interactive controls.

[0163] Further, if Figure 8 As shown, the interactive control device also includes: a display 87, a communication component 86, a power component 88, an audio component 89 and other components. Figure 8 Only some components are shown schematically, which does not mean that the interactive control device only includes Figure 8 In addition, Figure 8The components in the dashed box are optional components, not mandatory components, and the specific components depend on the product form of the interactive control device. The interactive control device of this embodiment can be implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, or an IOT device, or a display control device such as a conventional server, a cloud server, or a server array. If the interactive control device of this embodiment is implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, etc., it can include Figure 8 If the interactive control device of this embodiment is implemented as a display control device such as a conventional server, a cloud server or a server array, it may not include Figure 8 Components within the dashed box.

[0164] In addition to the above-mentioned interactive control device, an embodiment of the present application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed by one or more processors, the one or more processors are caused to perform the following actions: displaying an interactive interface on a second screen, the interactive interface including summary information and interactive controls; in response to an interactive operation issued to the interactive control, performing a corresponding operation on the data interface on the first screen; wherein the summary information is generated based on the dynamic data displayed in the data interface, and is used to guide the user to issue an interactive operation to the interactive control.

[0165] In addition to the above operations, the processor may also implement other operations by executing the above computer program. For details, please refer to the description in the above embodiments, which will not be repeated here.

[0166] Above Figure 7a-Figure 8 The communication component in is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may also include a near field communication (NFC) module, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, etc.

[0167] Above Figure 7a-Figure 8 The display in the embodiment includes a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0168] Above Figure 7a-Figure 8 The power supply component in the device provides power to various components of the device where the power supply component is located. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply component is located.

[0169] Above Figure 7a-Figure 8 The audio component in can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), and when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in a memory or sent via a communication component. In some embodiments, the audio component also includes a speaker for outputting an audio signal.

[0170] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0171] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0172] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0173] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0174] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0175] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0176] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0177] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0178] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A display control method, It is characterized in that Applicable to a display control device, the display control device is respectively connected to a first screen and a second screen for communication; the method comprises: Acquire data to be displayed on the first screen, and visualize the data on the first screen, wherein the data includes dynamic data and other data, and the other data is associated with the dynamic data; the dynamic data is data whose change frequency is greater than a set frequency threshold; generating summary information in an interactive interface according to the dynamic data, the interactive interface further comprising interactive controls; the summary information is the dynamic data or a change trend of the dynamic data, and is used for the user to understand the change of the dynamic data; the interactive controls are generated according to the visualization attributes of the other data, and are at least used to perform interactive operations on the visualization results of the other data on the first screen; The interactive interface is displayed on the second screen to guide the user to interactively control at least other data on the first screen through the interactive controls through the summary information.

2. The method according to claim 1, It is characterized in that Also includes: Determining, according to the visualization attributes of the other data, a visualization graphic form required to display the other data; According to the visualization graphic form, the data is visualized to obtain a data interface; The data interface is displayed on the first screen; wherein the data interface includes a visualization result of the other data in the visualization graphic form.

3. The method according to claim 2, It is characterized in that Generating an interactive control in the interactive interface according to the visualization attribute of the other data includes: Determine a corresponding target control type according to the visualization attribute of the other data; Generate an interactive control in the interactive interface according to the target control type.

4. The method according to claim 3, It is characterized in that Determining the corresponding target control type according to the visualization attribute of the other data includes: If the visualization attribute of the other data includes a time attribute, determining a control type that supports interaction by time as the target control type; If the visualization attribute of the other data includes a position attribute, determining a control type that supports interaction by position as the target control type; If the visualization attribute of the other data includes a category attribute, a control type that supports interaction by category is determined as the target control type.

5. The method according to claim 4, It is characterized in that The types of controls that support time-based interaction include: timeline controls, which can be slid or clicked; The types of controls that support interaction by location include: a map control, which can be scaled, rotated, or dragged; The types of controls that support interaction by category include: selection controls, which can be clicked, touched, or long-pressed.

6. The method according to claim 3, It is characterized in that Generating an interactive control in the interactive interface according to the target control type includes: From the interactive controls under the target control type, an interactive control matching the visual graphic form is selected as the interactive control in the interactive interface.

7. The method according to claim 2, It is characterized in that Determining a visualization graphic form required for displaying the other data according to the visualization attribute of the other data includes: If the visualization attribute of the other data includes a time attribute, determining a graphical form that can be displayed according to time; If the visualization attribute of the other data includes a position attribute, determining a graphic form that can be displayed according to the position; If the visualization attributes of the other data include category attributes, a graphic form that can be displayed by category is determined.

8. The method according to claim 2, It is characterized in that Also includes: In response to the interactive operation issued on the second screen to the interactive control, a corresponding operation is performed on the data interface on the first screen.

9. The method according to any one of claims 1 to 8, It is characterized in that The interactive interface includes an information area and an interactive control area, the summary information is located in the information area, and the interactive controls are located in the interactive control area.

10. The method according to any one of claims 1 to 8, It is characterized in that The specification size of the first screen is larger than the specification size of the second screen.

11. The method according to claim 10, It is characterized in that The second screen is a screen of a terminal device that remotely controls the first screen; the first screen is an independent screen.

12. An interactive control method, It is characterized in that Applicable to a display control device, the display control device is respectively connected to a first screen and a second screen for communication; the method comprises: Displaying an interactive interface on the second screen, the interactive interface including summary information and interactive controls; In response to the interactive operation issued to the interactive control, performing a corresponding operation on the data interface on the first screen; The summary information is generated based on the dynamic data displayed in the data interface, and is used to guide the user to perform interactive operations on the interactive control; the dynamic data is data whose change frequency is greater than a set frequency threshold; The summary information is the dynamic data or the changing trend of the dynamic data, and the summary information is used for users to understand the changes of the dynamic data; the interactive control is generated according to the visualization attributes of other data in the data interface, and is at least used to perform interactive operations on the visualization results of the other data on the first screen.

13. A display control method, It is characterized in that include: Acquire data displayed on a first screen, and visualize the data on the first screen; the data includes dynamic data and other data, and the other data is associated with the dynamic data; the dynamic data is data whose change frequency is greater than a set frequency threshold; Generate summary information in the interactive interface according to the dynamic data; The summary information is the dynamic data or the change trend of the dynamic data, and is used for users to understand the change of the dynamic data; generating an interactive control in an interactive interface according to a visualization attribute of other data in the data, wherein the interactive control is at least used to perform an interactive operation on a visualization result of the other data on the first screen; The interactive interface is displayed on the second screen, so that the user can interactively control at least other data on the first screen through the interactive controls under the guidance of the summary information.

14. The method according to claim 13, It is characterized in that Generating an interactive control in the interactive interface according to the visual attributes of other data in the data includes: Determine the corresponding target control type according to the visualization attribute of the data; Generate an interactive control in the interactive interface according to the target control type.

15. The method according to claim 14, It is characterized in that Generating an interactive control in the interactive interface according to the target control type includes: An interactive control in the interactive interface is selected from the interactive controls under the target control type according to at least one of the visual graphic form used by the first screen to display the data, the type of the second screen, and the specification size of the second screen.

16. A display control system, It is characterized in that include: display control device, a first screen and a second screen; The display control device is used to obtain data to be displayed on the first screen, and visually display the data on the first screen, wherein the data includes dynamic data and other data, and the other data is associated with the dynamic data; the dynamic data is data whose change frequency is greater than a set frequency threshold; as well as generating summary information in an interactive interface according to the dynamic data, the interactive interface further comprising interactive controls; the summary information is the dynamic data or a change trend of the dynamic data, and is used for the user to understand the change of the dynamic data; the interactive controls are generated according to the visualization attributes of the other data, and are at least used to perform interactive operations on the visualization results of the other data on the first screen; The interactive interface is displayed on the second screen to guide the user to interactively control at least other data on the first screen through the interactive controls through the summary information.

17. The system according to claim 16, It is characterized in that Also includes: A terminal device for remotely controlling the first screen; the second screen is the screen of the terminal device; The first screen is an independent screen.

18. A display control device, It is characterized in that include: Memory and processor; The memory is used to store computer programs; The processor, coupled to the memory, is configured to execute the computer program to: Acquire data to be displayed on the first screen, and visualize the data on the first screen, wherein the data includes dynamic data and other data, and the other data is associated with the dynamic data; the dynamic data is data whose change frequency is greater than a set frequency threshold; generating summary information in an interactive interface according to the dynamic data, the interactive interface further comprising interactive controls; the summary information is the dynamic data or a change trend of the dynamic data, and is used for the user to understand the change of the dynamic data; the interactive controls are generated according to the visualization attributes of the other data, and are at least used to perform interactive operations on the visualization results of the other data on the first screen; The interactive interface is displayed on the second screen to guide the user to interactively control at least other data on the first screen through the interactive controls through the summary information.

19. An interactive control device, It is characterized in that include: Memory and processor; The memory is used to store computer programs; The processor, coupled to the memory, is configured to execute the computer program to: Displaying an interactive interface on the second screen, wherein the interactive interface includes summary information and interactive controls; In response to an interactive operation issued to the interactive control, a corresponding operation is performed on the data interface on the first screen; wherein the summary information is generated based on the dynamic data displayed in the data interface, and is used to guide the user to issue an interactive operation to the interactive control; the dynamic data is data whose change frequency is greater than a set frequency threshold; the summary information is the dynamic data or the change trend of the dynamic data, and is used for the user to understand the change of the dynamic data; the interactive control is generated based on the visualization attributes of other data in the data interface on the first screen, and is at least used to perform interactive operations on the visualization results of the other data on the first screen.

20. A computer-readable storage medium storing a computer program, It is characterized in that When the computer program is executed by a processor, the processor is caused to implement the steps in the method according to any one of claims 1 to 15.