Electronic device and computer-implemented method
By determining the visual element units from the original infographic and generating descriptions, the infographics are automatically updated, and the complex problems of infographic updates and reuse in the prior art are solved, and the automatic conversion of infographics is realized into reusable templates, improving the user experience.
Patent Information
- Application Number
- CN202011069586.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-30
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2040-09-30
AI Technical Summary
Existing infographics often require manual editing, resulting in complex updates and reuse, error-prone and inconvenient for ordinary users.
Automatic update and conversion of the infographic into reusable templates is achieved by determining the visual element units from the original infographic and generating descriptions based on these units.
Simplifies the reuse process of infographics, improves the user experience, and allows infographics to be automatically converted into reusable templates, reducing the complexity of manual editing.
Smart Images

Figure CN114327418B_ABST
Abstract
Description
Background Art
[0001] As a common type of visualization, information graphics such as bar charts have been widely used in documents, presentations, and other forms of information display to enhance the attractiveness of information display, improve information visualization, and make the displayed information and data more intuitive and understandable. However, different from the standard charts supported by existing software, these information graphic styles are usually manually created by graphic designers using tools. Since these charts are usually composed of only basic visual elements (such as text blocks and graphics), updating or reusing them in the future requires fine-grained manual editing, which is usually a cumbersome and error-prone process. Moreover, manual editing operations require users to be familiar with the use of relevant tools, which causes inconvenience for ordinary users to use. Summary of the Invention
[0002] According to an implementation of the present disclosure, a solution for reusing information graphics is proposed. In this solution, if it is determined that an original information graphic is received, a set of visual element units is determined from the set of visual elements included in the original information graphic. The visual element units in the set of visual element units are used to represent an information item in the original information graphic. A first association relationship between the visual elements included in the visual element unit and the information item, and a second association relationship between the visual element unit and another visual element unit in the set of visual element units are determined. A description of the original information graphic is generated based on the first association relationship and the second association relationship. If an input of target information is detected, a target information graphic is generated by updating at least the set of visual element units based on the description and the target information. In this way, the information graphic can be automatically converted into a reusable template, thereby simplifying the complexity for users to reuse such information graphics and enhancing the user experience.
[0003] The Summary of the Invention section is provided to introduce, in a simplified form, a selection of concepts that will be further described in the Detailed Description below. The Summary of the Invention section is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter. Brief Description of the Drawings
[0004] Figure 1 A block diagram of a computing device capable of implementing multiple implementations of the present disclosure is shown;
[0005] Figure 2 A flowchart of a process according to an implementation of the present disclosure is shown;
[0006] Figures 3A to 3F A schematic diagram of an information graphic reuse process according to an implementation of the present disclosure is shown;
[0007] Figures 4A to 4EA schematic diagram of an information graph multiplexing process according to another implementation of the present disclosure is shown.
[0008] In these figures, the same or similar reference signs are used to denote the same or similar elements. Detailed implementation
[0009] The present disclosure will now be described with reference to several example implementations. It should be understood that these implementations are described only to enable those of ordinary skill in the art to better understand and thus implement the present disclosure, and do not imply any limitation on the scope of the present disclosure.
[0010] As used herein, the term "comprising" and its variants are to be construed as open-ended terms meaning "including but not limited to". The term "based on" is to be construed as "at least partially based on". The term "one implementation" and "an implementation" are to be construed as "at least one implementation". The term "another implementation" is to be construed as "at least one other implementation". The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included hereinafter.
[0011] Basic working principle and example environment
[0012] The basic principles and several example implementations of the present disclosure will be described below with reference to the accompanying drawings. Figure 1 A block diagram of a computing device 100 capable of implementing multiple implementations of the present disclosure is shown. It should be understood that Figure 1 the computing device 100 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the implementations described in the present disclosure. As Figure 1 shown, the computing device 100 includes a computing device 100 in the form of a general-purpose computing device. The components of the computing device 100 may include, but are not limited to, one or more processors or processing units 110, a memory 120, a storage device 130, one or more communication units 140, one or more input devices 150, and one or more output devices 160.
[0013] In some implementations, computing device 100 may be implemented as various user terminals or service terminals. The service terminal may be a server, a large computing device, etc. provided by various service providers. The user terminal may be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, stations, units, devices, multimedia computers, multimedia tablets, Internet nodes, communicators, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / video cameras, positioning devices, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. It is also foreseeable that computing device 100 can support any type of user interface (such as "wearable" circuits, etc.).
[0014] Processing unit 110 may be an actual or virtual processor and is capable of performing various processes according to programs stored in memory 120. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing ability of computing device 100. Processing unit 110 may also be referred to as a central processing unit (CPU), microprocessor, controller, or microcontroller.
[0015] Computing device 100 generally includes multiple computer storage media. Such media may be any accessible media available to computing device 100, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 120 may be volatile memory (such as registers, caches, random access memory (RAM)), non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 130 may be removable or non-removable media and may include machine-readable media, such as memory, flash drives, magnetic disks, or any other media that can be used to store information and / or data and can be accessed within computing device 100.
[0016] Computing device 100 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 1 , a disk drive for reading from or writing to a removable, non-volatile magnetic disk and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces.
[0017] The communication unit 140 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device 100 may be implemented in a single computing cluster or multiple computing machines that are capable of communicating via a communication link. Thus, the computing device 100 may operate in a networked environment using a logical connection to one or more other servers, personal computers (PCs), or another general network node.
[0018] The input device 150 may be one or more of various input devices such as a mouse, keyboard, trackball, voice input device, etc. The output device 160 may be one or more output devices such as a display, speaker, printer, etc. The computing device 100 may also communicate with one or more external devices (not shown) as needed via the communication unit 140, external devices such as storage devices, display devices, etc., communicate with one or more devices that enable a user to interact with the computing device 100, or communicate with any device that enables the computing device 100 to communicate with one or more other computing devices (e.g., a network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0019] In some implementations, in addition to being integrated on a single device, some or all of the various components of the computing device 100 may also be provided in the form of a cloud computing architecture. In a cloud computing architecture, these components may be remotely located and may work together to implement the functions described in this disclosure. In some implementations, cloud computing provides computing, software, data access, and storage services that do not require an end user to be aware of the physical location or configuration of the system or hardware providing these services. In various implementations, cloud computing uses appropriate protocols to provide services over a wide area network such as the Internet. For example, a cloud computing provider provides applications over a wide area network, and they may be accessed via a web browser or any other computing component. The software or components of the cloud computing architecture and the corresponding data may be stored on a server at a remote location. The computing resources in a cloud computing environment may be consolidated at a remote data center location or they may be distributed. The cloud computing infrastructure may provide services through a shared data center even though they appear as a single access point for the user. Thus, the components and functions described herein may be provided from a service provider at a remote location using a cloud computing architecture. Alternatively, they may be provided from a conventional server, or they may be installed directly or otherwise on a client device.
[0020] The computing device 100 can be used to implement the reuse of information charts in multiple implementations of the present disclosure. The memory 120 may include one or more modules having one or more program instructions that can be accessed and run by the processing unit 110 to implement the functions of the various implementations described herein. For example, the memory 120 may include a chart reuse module 122 for the reuse of information charts.
[0021] The computing device 100 is capable of receiving an original information chart 171 through the input device 150. The original information chart 171 is provided to the input device 150 for the chart reuse module 122 to implement the reuse of the original information chart 171.
[0022] The reuse of the original information chart 171 by the chart reuse module 122 may include the deconstruction of the original information chart 171 and the update of the original information chart 171. During the deconstruction process, the chart reuse module 122 may analyze the composition of the set of visual elements in the original information chart 171 and determine the association between the visual elements and the chart information. During the update process, if new chart information is received, the chart reuse module 122 may update the original information chart 171 based on the association between the visual elements and the chart information determined during the deconstruction process and the new chart information to generate a target information chart 172.
[0023] The chart reuse module 122 may determine a set of visual element units from the set of visual elements of the original information chart 171. Each visual element unit in the set of visual element units may represent an information item in the original information chart 171. For example, the visual element unit may represent, for example, "the business growth rate of the first sales group is 60%".
[0024] Next, the chart reuse module 122 may determine a first association relationship between the visual elements included in the visual element unit and the information item. The first association relationship may be determined, for example, based on the attribute information of the visual elements themselves, such as the type and filling color of the visual elements included in the visual element unit, and the influence mode of the semantic change of the information item on the visual elements included in the visual element unit. The influence mode may include, for example, that the visual elements may be deformed, moved, have a color change, change in arrangement and composition as the information item changes.
[0025] The chart reuse module 122 may also determine a second association relationship between the visual elements included in one visual element unit and the visual elements included in another visual element unit. The association relationship may include, for example, the association relationship between visual elements having the same or similar element attributes or representing the same or similar semantics between two visual element units. The association relationship may involve, for example, alignment between elements, geometric consistency, size consistency, color consistency, presence consistency, etc.
[0026] Based on the first association relationship between the visual elements included in a visual element unit and information items, and the second association relationship between the visual elements included in one visual element unit and the visual elements included in another visual element unit, the chart reuse module 122 can generate a description of the original information chart 171. The above-mentioned association relationships can be represented by predetermined tags, for example. The predetermined tags can be attached to the visual elements of the original information chart 171 through a trained machine learning model, for example.
[0027] During the update process of the original information chart 171, if the chart reuse module 122 detects that the target information 177 is input to the input device 150, the chart reuse module 122 can generate the target information chart 172 by updating a set of visual element units based on the target information 177 and the generated description of the original information chart 171.
[0028] The update of the original information chart 171 may involve, for example, the update of the visual elements within a visual element unit and the update between the visual element units in a set of visual element units. For example, the chart reuse module 122 can update the visual elements within a visual element unit based on the first association relationship and the target information 177, and update the visual elements within another visual element unit based on the visual elements within the updated visual element unit and the second association relationship. The target information chart 172 can be generated at least based on the above updates.
[0029] In addition, the update of a set of visual element units may affect the change in the relative positions of the set of visual element units in the available presentation area of the information chart. For example, due to factors such as the increase or decrease in the number of visual element units in a set of visual element units. The chart reuse module 122 can obtain the first relative positions of a set of visual element units in the available presentation area of the original information chart 171. Based on the first relative positions and the above update of the set of visual element units, the chart reuse module 122 can determine the second relative positions of the updated set of visual element units in the available presentation area of the target information chart 172. The target information chart 172 can be generated based on the above update of the set of visual element units and the second relative positions.
[0030] It should be understood that Figure 1 the types of information charts shown, the content included in the information charts, and the formats of the information charts are only examples.
[0031] In this document, infographics combine data visualization and graphic design to effectively display information and data. Infographics can include, for example, bar charts, pie charts, line charts, etc. Although the solutions of the present disclosure are illustrated with examples of bar infographics in this document, it should be understood that the solutions of the present disclosure can also be applied to other types of infographics.
[0032] The following will refer to Figure 2 and Figures 3A to 3F to describe in detail the process of deconstructing and reusing infographics by the infographic reuse module 122.
[0033] Process of reusing information charts
[0034] Figure 2 FIG. shows a flowchart of a process 200 according to some implementations of the present disclosure. The process 200 can be implemented by the computing device 100, for example, can be implemented at the infographic reuse module 122 in the memory 120 of the computing device 100.
[0035] In block 210, if it is determined that an original infographic is received, the infographic reuse module 122 determines a set of visual element units from the set of visual elements included in the original infographic. The visual element units in the set of visual element units are used to represent an information item in the original infographic.
[0036] The original infographic can include a set of visual elements. If the original infographic is to be structured, the input to the deconstruction step is the set of visual elements. The visual attributes of the visual elements in the set of visual elements, such as size, position, text, font, fill color, stroke color, etc., can be known or recognizable.
[0037] A visual element unit can include one or more visual elements. The one or more visual elements included in a visual element unit can, for example, illustrate an information item in the original infographic. The original infographic can include multiple visual element units. The multiple visual element units can characterize the complete information to be presented by the original infographic.
[0038] There is a correspondence between one visual element unit and another visual element unit. For example, one visual element unit and another visual element unit can include the same number of visual elements. Also, for example, one visual element in one visual element unit and another visual element in another visual element unit can have the same element attributes or indicate the same semantics.
[0039] In some implementations, clustering can be performed on a set of visual elements of an original information chart. The set of visual elements can be divided into multiple clusters of visual elements based on the similarity of the visual elements in the set of visual elements. The number of visual elements included in each cluster of visual elements among the multiple clusters of visual elements can be determined. The number of visual elements included in a cluster of visual elements can be regarded as the size of the cluster of visual elements.
[0040] The size of the most frequently occurring cluster of visual elements can be determined as the number of visual element units included in the original information chart, and an anchor cluster of visual elements can be determined from the cluster of visual elements having the size of the most frequently occurring cluster. The visual elements in the anchor cluster of visual elements can be used as the anchor visual elements for each visual element unit, and the visual elements in the non-anchor clusters of visual elements in the cluster of visual elements having the size of the most frequently occurring cluster can be assigned to the anchor visual elements to generate multiple visual element units. In the process of assigning non-anchor visual elements to anchor visual elements to form visual element units, it is determined in such a way whether the visual elements in the non-anchor clusters of visual elements and the anchor visual elements are in the same visual element unit, that is, the visual elements in the same visual element unit should be closer to each other than the visual elements between visual element units.
[0041] In the process of forming visual element units, visual elements having equivalent functions between the respective visual element units can also be determined to form a visual element sequence. As a non-anchor visual element in a non-anchor cluster of visual elements is assigned to an anchor visual element, the unassigned non-anchor visual elements in the non-anchor cluster of visual elements can be removed from the non-anchor cluster of visual elements and added to a visual element sequence. In this way, the visual elements of all clusters of visual elements can be classified into their respective visual element sequences.
[0042] The determination of visual element units can be described in detail, for example, by Figures 3A to 3D the implementation shown.
[0043] Figure 3A The original information chart 171 is shown in Figure 3A As shown, the original information chart 171 can include sets of visual elements 301-304, 311-314, 321-324. The sets of visual elements 301-304, 311-314, 321-324 can be the input for the deconstruction process of the original information chart 171.
[0044] In the deconstruction of the original information graph 171, by judging the similarity between each visual element in the visual element sets 301-304, 311-314, and 321-324, the visual element sets 301-304, 311-314, and 321-324 can be divided into multiple visual element clusters.
[0045] In some implementations, the similarity judgment between visual elements can include, for example, judging whether the visual elements have the same shape, color, the same text-related attributes, and whether they are aligned. The text-related attributes can include, for example, whether the visual elements all contain information related to numbers, font size, font type, and whether the number of characters is the same, etc.
[0046] According to the above similarity judgment, the visual element sets 301-304, 311-314, and 321-324 can be divided into, for example, a first visual element cluster including visual elements 301, 302, 303, and 304, a second visual element cluster including visual elements 311, 312, 313, and 314, and a third visual element cluster including visual elements 321, 322, 323, and 324.
[0047] The first visual element cluster, the second visual element cluster, and the third visual element cluster all have 4 visual elements. Therefore, the most frequently occurring cluster size is 4 elements. One visual element cluster can be selected from the first visual element cluster, the second visual element cluster, and the third visual element cluster as the anchor visual element cluster. For example, the first visual element cluster is used as the anchor visual element cluster. The visual elements 301, 302, 303, and 304 included in the first visual element cluster are the anchor visual elements. The visual elements in the second visual element cluster and the third visual element cluster can be assigned to each of the anchor visual elements 301, 302, 303, and 304 in the first visual element cluster to form visual element units respectively.
[0048] For example, in the process of assigning the non-anchor visual elements 311, 312, 313, and 314 in the second visual element cluster to the anchor visual element 301 to form a visual element unit, the non-anchor visual element 311 is closer to the anchor visual element 301 than the non-anchor visual elements 312, 313, and 314. Therefore, the non-anchor visual element 311 is assigned to the anchor visual element 301. Similarly, for example, in the process of assigning the non-anchor visual elements 321, 322, 323, and 324 in the third visual element cluster to the anchor visual element 301 to form a visual element unit, the non-anchor visual element 321 is closer to the anchor visual element 301 than the non-anchor visual elements 322, 323, and 324. Therefore, the non-anchor visual element 321 is assigned to the anchor visual element 301. In this way, asFigure 3B As shown, for example, the visual element 311 of the second visual element cluster and the visual element 321 of the third visual element cluster are assigned to the anchor visual element 301 of the first visual element cluster to form a visual element unit 341. In the same way, visual element units 342, 343, and 344 can be formed.
[0049] As described above, while forming the visual element units, the visual elements of each visual element cluster can be classified into corresponding visual element sequences. The visual elements in the same visual element sequence can be equivalent elements in each visual element unit. Still referring to Figure 3A , for example, if the non-anchor visual element 311 in the second visual element cluster is assigned to the anchor visual element 301, the other non-anchor visual elements 312, 313, and 314 in the second visual element cluster can be classified into one visual element sequence. Similarly, if the non-anchor visual element 312 in the second visual element cluster is assigned to the anchor visual element 302, the other non-anchor visual elements 311, 313, and 314 in the second visual element cluster can be classified into this visual element sequence. In this way, until all the visual elements of a visual element cluster are classified into one visual element sequence. Figure 3C It shows a schematic diagram of classifying the set of visual elements in the original information chart 171 into visual element sequences. As Figure 3C shown, the visual elements 301, 302, 303, and 304 are classified into the visual element sequence 351, the visual elements 311, 312, 313, and 314 are classified into the visual element sequence 352, and the visual elements 321, 322, 323, and 324 are classified into the visual element sequence 353.
[0050] Referring again to Figure 2 , at block 220, the chart reuse module 122 determines a first association relationship between the visual elements and information items included in the visual element units in a set of visual element units, and a second association relationship between a visual element unit and another visual element unit in the set of visual element units.
[0051] In some implementations, the chart reuse module 122 can determine the attribute information of the visual elements included in the visual element unit and the influence mode of the semantic changes of the information items represented by the visual element unit on these visual elements. Based on the attribute information of the visual elements and the influence mode, the chart reuse module 122 can determine the first association relationship between the visual elements and information items included in the visual element unit.
[0052] In some implementations, the attribute information of the visual elements can, for example, indicate the attribute information of the visual elements themselves within the unit. For example, the type of the visual element, i.e., whether the visual element is a text element or a graphic element. The attribute information of the visual element can also include, for example, whether the visual element has a fill color and an outline color, etc.
[0053] In the visual element unit 341, the attribute information of the visual elements themselves within the unit can include, for example, that the visual element 321 is a text element, the visual element 311 is a graphic element and has a fill color. The visual element 301 includes both a text element and a graphic element and has a fill color.
[0054] In some implementations, the attribute information of the visual elements can also include the feature information between the visual elements within the unit. For example, the number of times the visual elements within the unit repeat, whether the colors are consistent, whether they are aligned, whether they are evenly distributed, or the overlapping distribution of the visual elements, etc.
[0055] In the visual element unit 341, the feature information between the visual elements within the unit can include, for example, that the number of times the visual elements 301, 311, and 321 repeat is 1, and the colors of the visual elements 301 and 311 are consistent and they are centered and aligned with each other.
[0056] In some implementations, the influence mode of the semantic change of the information item on the visual elements can include that the semantic change of the information item causes deformation, movement, color change, permutation and combination change, etc. of the visual elements. The permutation and combination change can include, for example, the change in the number of repetitions of a visual element within the unit or the change in the stacking method, etc.
[0057] In some implementations, the semantic change of the information item has no effect on some of the visual elements within the unit. For example, these visual elements may be irrelevant to the data in the information item but related to the item ordinal number of the data or the name or category involved in the data. In this case, if only the data item in the information item changes, this type of visual element does not change with this change.
[0058] In the visual element unit 341, if the data item in the information item changes, for the visual element 321, since it represents the item ordinal number of the data, this visual element does not change with the change of the data item in the information item. For the visual element 311, its shape will change, elongating or shortening as the data increases or decreases. For the visual element 301, first, the text element it includes will be replaced with the corresponding value as the data changes. In addition, as the visual element 311 undergoes the shape change of elongation or shortening, the position of the visual element 301 will move up or down.
[0059] In some implementations, the chart reuse module 122 may determine the layout relationship between one visual element unit and another visual element unit. In some implementations, the layout relationship between visual element units may include, for example, the arrangement between visual element units and the positional relationship between visual elements. The positional relationship between visual element units may include, for example, the distance between the zero line of one visual element unit and the zero line of another visual element unit.
[0060] The arrangement between visual element units may be, for example, a grid type, such as the layout relationship among 341, 342, 343, and 344 in the original information chart 171. In addition, the layout relationship between visual element units may also be a stacked type. In the stacked layout relationship, visual element units are presented in a stacked form to emphasize the proportional relationship between individual visual element units. The layout relationship between visual element units may also be a tornado type. The presentation form of the tornado type layout can be used to emphasize the comparison relationship between two visual element units. For example, these two visual element units may have a common zero line but show growth trends in opposite directions.
[0061] In some implementations, the chart reuse module 122 may also determine the correlation information between the visual elements included in one visual element unit and the visual elements included in another visual element unit.
[0062] Here, the correlation information may relate to the characteristic information between equivalent visual elements belonging to the same visual element sequence in different visual element units. For example, whether the geometric shapes, colors, sizes, existence, and alignment of the visual elements between units are consistent. In addition, the correlation information may also relate to whether all visual element units include visual elements of the same data.
[0063] For both visual element units 341 and 342, they include the same number of visual elements. For example, the visual element 321 in visual element unit 341 and the visual element 322 in visual element unit 342 are consistent in color, size, and existence and are aligned with each other. The visual element 311 in visual element unit 341 and the visual element 312 in visual element unit 342 are inconsistent in geometric shape, color, and size, but are consistent in existence and are aligned with each other. The visual element 321 in visual element unit 341 and the visual element 302 in visual element unit 342 are consistent in geometric shape, size, and existence, but are inconsistent in color and are not aligned with each other.
[0064] Based on the layout relationship and correlation information described above, the second association relationship between one visual element unit and another visual element unit can be determined.
[0065] As described above, a first association relationship between visual elements and information items included in a visual element unit in a set of visual element units and a second association relationship between a visual element unit and another visual element unit in the set of visual element units can be determined. The above first association relationship and second association relationship can be determined by a trained machine learning model.
[0066] As Figure 2 shown, at block 230, the chart reuse module 122 generates a description of the original information chart 171 based on the determined first association relationship and second association relationship. If the original information chart 171 is used as the input of a trained machine learning model, the output of the machine learning model can be a predetermined label for characterizing the first association relationship and the second association relationship. The description of the original information chart 171 can be generated based on these predetermined labels.
[0067] In some implementations, these predetermined labels can include, for example, labels of the <yes>, <no> type. For example, such labels can be used to characterize features such as whether the shapes, sizes, or colors of visual elements are consistent with each other, and whether they are aligned with each other. Predetermined labels can also be used to characterize the attributes of visual elements, such as labels like <text>, <graphic>.
[0068] In addition, in some implementations, the predetermined labels can also include, for example, those used to characterize the influence mode of semantic changes of information items on visual elements. Such labels can include, for example, <deformation>, <movement>, <repetition>, <color change>, <partition>, and <fixed>. For example, in the visual element unit 341, the label characterizing the influence mode of semantic changes of the information item on the visual element 321 can be <fixed>, the label characterizing the influence mode of semantic changes of the information item on the visual element 311 can be <deformation>, and the label characterizing the influence mode of semantic changes of the information item on the visual element 301 can be <movement>.
[0069] At block 240, if the chart reuse module 122 detects the input of target information to be applied to the original information chart 171, a target information chart is generated by updating the visual element units based at least on the description and the target information.
[0070] In some implementations, the visual elements included in a set of visual element units can be updated based on the first association relationship and the target information. As described above, a visual element unit can represent, for example, an information item of the original information in the original information chart 171. For Figure 3BFor the visual element units 341, 342, 343, and 344 therein, they can respectively represent, for example, "The business growth rate of the first sales group is 60%", "The business growth rate of the second sales group is 30%", "The business growth rate of the third sales group is 70%", and "The business growth rate of the fourth sales group is 50%".
[0071] If it is detected that the input target data is "The sales amount of the first sales group is ¥1,140%", "The sales amount of the second sales group is ¥800", "The sales amount of the third sales group is ¥990", and "The sales amount of the fourth sales group is ¥600", then based on the first association relationship, it can be obtained that the visual elements 321, 322, 323, and 324 remain unchanged in the target information chart to be generated. The visual elements 311, 312, 313, and 314 can be stretched or shortened based on the data item changes in each information item between the original information and the target information. For the visual elements 301, 302, 303, and 304, they include both graphic elements and text elements. On the one hand, the text elements of the visual elements 301, 302, 303, and 304 will be updated from 60%, 30%, 70%, and 50% to ¥1,140, ¥800, ¥990, and ¥600. On the other hand, due to the stretching or shortening of the visual elements 311, 312, 313, and 314, the positions of the visual elements 301, 302, 303, and 304 also move up or down accordingly.
[0072] Each visual element unit can be updated based on the target data. In addition, based on the update of the visual elements in one visual element unit and the determined second association relationship, the chart reuse module 122 can update the visual elements in another visual element unit. This update can include, for example, adjusting the alignment relationship, changing the coloring, adjusting the corresponding size relationship, etc.
[0073] Based on the update of the visual elements within the above visual element units and the update of the visual elements between the visual element units, the chart reuse module 122 can generate Figure 3D the target information chart 172 in
[0074] In some implementations, in addition to the update of the visual elements within the visual element units and the update of the visual elements between the visual element units, corresponding updates can also be implemented for the visual impact at the entire information chart level caused by the above updates, so as to further optimize the presentation effect of the generated target information chart. This process can be regarded as a post-processing process for the information chart. If there is an increase or decrease in the number of visual element units due to the change in the number of information items of the target information and the original information, the post-processing process becomes particularly important.
[0075] In some implementations, the chart reuse module 122 may obtain a first relative position of a visual element unit in an available rendering area of the original information chart. The available rendering area may be regarded as the canvas range where the original information chart is located. The first relative position may be, for example, the distance between the reference point of each visual element unit and the edge of the available rendering area. Based on the update of the visual elements within the visual element unit, the update of the visual elements between the visual element units, and the first relative position, the chart reuse module 122 may adjust the rendering positions of multiple visual element units on the canvas range, and the adjusted rendering positions may be regarded as the second relative positions of the visual element units in the available rendering area of the target information chart. Therefore, in addition to based on the update of the visual elements within the visual element unit and the update of the visual elements between the visual element units as described above, the chart reuse module 122 may also generate a target information chart based on the second relative position.
[0076] For example, if it is detected that the target information only includes the following information items, namely, "The business growth rate of the 1st sales group is 60%", "The business growth rate of the 2nd sales group is 30%", and "The business growth rate of the 3rd sales group is 70%", then the visual element unit 344 in the original information chart will be removed. If the above post-processing operation is not performed, the generated target information chart 172' may be as Figure 3E shown. Although Figure 3E the shown target information chart 172' can also present all the target information, its rendering effect is not satisfactory. Because there is a large blank space at the rendering position originally used for the visual element unit 344.
[0077] If the above post-processing operation is performed, the rendering positions of the updated multiple visual element units on the available rendering area can be adjusted. For example, the post-processed target information chart 172” can be as Figure 3F shown. Compared with the target information chart 172' shown in Figure 3E , the target information chart 172” shown in Figure 3F has a more optimized rendering effect.
[0078] The above describes an exemplary implementation of information chart reuse in combination with Figures 3A to 3F . In the above process, the determination of the visual element units in the original information chart, the determination of the association relationships within and between the visual element units, and the generation of the description, and the generation of the target information chart based on the target information and the description can all be implemented by a trained machine learning model. For example, a regression model based on a decision tree can be used to divide the visual elements in the original information chart into multiple visual element clusters. The Hungarian algorithm can be used to assign the visual elements in the visual element cluster to the visual element units and the visual element sequences. A multi-label prediction model can be used to generate a description for the original information chart.
[0079] The machine learning model can be determined based on historical training samples of multiple information charts. The machine learning model can be included in Figure 1 the computing device 100 in. More specifically, the machine learning model can be included in Figure 1 the chart reuse module 122 in.
[0080] Exemplary implementation of information chart reuse
[0081] To more fully elaborate on the embodiments of the present disclosure, the following is combined with Figures 4A to 4E to further illustrate the reuse process of information charts according to another embodiment of the present disclosure.
[0082] As Figure 4A shown, the original information chart 471 can be input into Figure 1 the chart reuse module 122 in. The chart reuse module 122 can determine the set of visual elements included in the original information chart 471, namely visual elements 401-404, 411-414, 421-424, and 431-434.
[0083] The chart reuse module 122 can determine multiple visual element units from the visual elements 401-404, 411-414, 421-424, and 431-434 included in the original information chart 471.
[0084] In the process of determining the visual element units, the chart reuse module 122 can divide the set of visual elements 401-404, 411-414, 421-424, and 431-434 into multiple visual element clusters by judging the similarity between each visual element in the set of visual elements 401-404, 411-414, 421-424, and 431-434.
[0085] For example, the set of visual elements 401-404, 411-414, 421-424, and 431-434 can be divided into a first visual element cluster including visual elements 401-404, a second visual element cluster including visual elements 411-414, a third visual element cluster including visual elements 421-424, and a fourth visual element cluster including visual elements 431-434.
[0086] The first visual element cluster, the second visual element cluster, the third visual element cluster, and the fourth visual element cluster each have 4 visual elements. Therefore, the most frequently occurring cluster size is 4 elements. One visual element cluster can be selected from the first visual element cluster, the second visual element cluster, the third visual element cluster, and the fourth visual element cluster as the anchor visual element cluster. For example, the first visual element cluster is used as the anchor visual element cluster. The visual elements 401, 402, 403, and 404 included in the first visual element cluster are the anchor visual elements. The visual elements in the second visual element cluster, the third visual element cluster, and the fourth visual element cluster can be assigned to each of the anchor visual elements 301, 302, 303, and 304 in the first visual element cluster to form visual element units respectively.
[0087] As described above, the chart reuse module 122 determines which non-anchor visual elements will be assigned to the anchor visual elements to form visual element units based on the distances between the non-anchor visual elements and the anchor visual elements in each visual element cluster. In the process of assigning the non-anchor visual elements 411, 412, 413, and 414 in the second visual element cluster to the anchor visual element 401 to form a visual element unit, the non-anchor visual element 411 is closer to the anchor visual element 401 than the non-anchor visual elements 412, 413, and 414. Therefore, the non-anchor visual element 411 is assigned to the anchor visual element 401. In this way, as Figure 4B shown, for example, the visual element 411 of the second visual element cluster, the visual element 421 of the third visual element cluster, and the visual element 431 of the fourth visual element cluster are assigned to the anchor visual element 401 of the first visual element cluster to form a visual element unit 441. In the same way, visual element units 442, 443, and 444 can be formed.
[0088] While determining the visual element units, the chart reuse module 122 can also classify the visual elements of each visual element cluster into the corresponding visual element sequences. In Figure 4A this case, for example, if the non-anchor visual element 411 in the second visual element cluster is assigned to the anchor visual element 401, the other non-anchor visual elements 412, 413, and 414 in the second visual element cluster can be classified into one visual element sequence. Similarly, if the non-anchor visual element 412 in the second visual element cluster is assigned to the anchor visual element 402, the other non-anchor visual elements 411, 413, and 414 in the second visual element cluster can be classified into this visual element sequence. In this way, until all the visual elements of a visual element cluster are classified into one visual element sequence.
[0089] Figure 4CShows a schematic diagram of classifying a set of visual elements in the original information chart 471 into a visual element sequence. As Figure 4C shown, visual elements 401, 402, 403, and 404 are classified into visual element sequence 451, visual elements 411, 412, 413, and 414 are classified into visual element sequence 452, visual elements 421, 422, 423, and 424 are classified into visual element sequence 453, and visual elements 431, 432, 433, and 434 are classified into visual element sequence 454.
[0090] The chart reuse module 122 can determine a first association relationship between the visual elements included in the visual element unit in the visual element unit and the information items in the original information chart, as well as a second association relationship between one visual element unit and another visual element unit.
[0091] In some implementations, the chart reuse module 122 can determine the attribute information of the visual elements in the visual element unit. For example, as Figure 4B shown, in the visual element unit 441, the attribute information of the visual elements within the unit can include, for example, that visual elements 401 and 431 are text elements, and visual elements 411 and 421 are graphic elements without a fill color.
[0092] In some implementations, the chart reuse module 122 can also determine the feature information between the visual elements in the visual element unit. Still taking the visual element unit 441 as an example. In the visual element unit 441, the number of occurrences of visual elements 401, 411, 421, and 431 is all one, and these visual elements are centered with each other.
[0093] In addition, in some implementations, the chart reuse module 122 can also determine the influence mode of the semantic change of the information item on the visual elements within the unit. In the visual element unit 441, the visual element 431 whose attribute information is a text element is a data item representing the year in the information item. If the data item representing the year in the information item changes, the text of the visual element 431 will be replaced. However, the position of the visual element 431 will not change with the change of the other visual elements within the unit. For the visual element 411, its shape will elongate or shorten as the data item in the information item increases or decreases. For the visual element 421, it moves up or down as the shape of the visual element 411 elongates or shortens. For the visual element 421, on the one hand, the attribute of its text element causes it to change with the change of the data item in the information item, and on the other hand, it also shifts as the visual element 421 moves up or down.
[0094] Based on the attribute information of the determined visual elements, the feature information between the visual elements in the visual element unit, and the influence mode of the semantic change of the information item on the visual elements in the unit, the chart reuse module 122 can determine the first association relationship between the visual elements included in the visual element unit in the visual element unit and the information items in the original information chart.
[0095] To determine the second association relationship between one visual element unit and another visual element unit, in some implementations, the chart reuse module 122 can determine the layout relationship between one visual element unit and another visual element unit. In Figure 4A the original information chart 471 shown in, the layout relationship between the visual element units is grid type. In some implementations, the chart reuse module 122 can also determine the correlation information between the visual elements included in one visual element unit and the visual elements included in another visual element unit.
[0096] For both visual element units 441 and 442, they include the same number of visual elements. For example, the visual element 431 in the visual element unit 441 and the visual element 432 in the visual element unit 442 are consistent in color, size, and existence and are aligned with each other. The visual element 421 in the visual element unit 441 and the visual element 422 in the visual element unit 442 are consistent in geometric shape and existence, inconsistent in size, and aligned at their lower ends with each other. The visual element 411 in the visual element unit 441 and the visual element 412 in the visual element unit 442 are consistent in geometric shape, size, color, and existence and are not aligned with each other. The visual element 401 in the visual element unit 441 and the visual element 402 in the visual element unit 442 are consistent in existence and are not aligned with each other. Based on the layout relationship and correlation information described above, the second association relationship between every two visual element units in the original information chart 471 can be determined.
[0097] Based on the already determined first association relationship and second association relationship, the chart reuse module 122 can generate a description for the original information chart 471 by obtaining a predetermined label for characterizing the first association relationship and the second association relationship. For example, the predetermined label can be a <yes>, <no> type label for characterizing features such as whether the shapes, sizes, or colors between visual elements are consistent, and whether they are aligned with each other. Labels such as <text>, <graphic> for characterizing the attributes of visual elements and labels for characterizing the influence mode of the semantic change of information items on visual elements.
[0098] For example, for the visual element 401 in the visual element unit 441, its description may include the attribute information <text>; whether it is aligned with the visual elements 411, 421, 431 <yes>, whether it is aligned with the visual elements 402, 403, 404 <no>, whether it is consistent with the existence of the visual elements 402, 403, 404 <yes>, the influence mode of the semantic change of the information item on the visual element 401 <move>, and other information.
[0099] Based on the determined first association relationship and second association relationship, the chart reuse module 122 can generate corresponding descriptions for each visual element in the original information chart 471, so as to obtain the description of the original information chart 471.
[0100] In some implementations, the chart reuse module 122 can detect the input of new target information to be applied to the original information chart 471. For example, the new target information may be "The department performance completion rates from 2015 to 2019 are 90%, 60%, 80%, 75%, and 45% respectively". According to the input target information and the description of the original information chart 471 that has been obtained, the chart reuse module 122 can generate a new target information chart.
[0101] In some implementations, the chart reuse module 122 can update the visual elements within the visual element unit based on the input target information and the first association relationship between the visual element unit and the information item, and update the visual elements in another visual element unit relative to one visual element unit based on the second association relationship between the visual element units.
[0102] For example, the original information item represented by the visual element unit 441 is that the department sales performance in 2011 is 250,000¥. After the new target information is input, the visual element unit 441 will represent that the department performance completion rate in 2015 is 90%.
[0103] For example, based on the first association relationship, the visual element 431 of the visual element unit 441 is a text element and the influence mode between it and the information item is "fixed". Therefore, the text of the visual element 431 will be replaced from "2011" to "2015" and remain in the same position in the visual element unit 441.
[0104] The visual element 421 of the visual element unit 441 is a graphic element and the influence mode between it and the information item is "deformation". This visual element 421 will be stretched due to the data in the information item changing from "250,000¥" to "90%". The visual element 411 of the visual element unit 441 is a graphic element and the influence mode between it and the information item is "movement". This visual element 411 will move upward in position as the visual element 411 elongates. The visual element 401 of the visual element unit 441 is a text element and the influence mode between it and the information item is "movement". This visual element 401 will move upward correspondingly as the visual element unit 441 moves upward.
[0105] Similarly, the visual elements in the visual element units 442, 443, and 444 can also be updated according to the new target information and the first association relationship. In addition, each visual element unit can be further updated according to the second association relationship and each visual element unit that has been updated based on the first association relationship. For example, the alignment relationship and size relationship of the visual elements between each visual element unit can be adjusted according to the second association relationship.
[0106] In this implementation, since the number of information items included in the new target information has changed compared to the information items of the original information, that is, the number of information items included in the new target information has increased. Therefore, a visual element unit will be added to the newly generated target information chart. In this scenario, a new visual element unit can be generated based on the first association relationship and the newly added information item. As Figure 4D shown, the newly generated visual element unit 445 can include visual elements 405, 415, 425, and 435. The generated new visual element unit can be further adjusted based on the correlation information between the visual elements in each visual element unit in the second association relationship, that is, the features such as the existence consistency, shape and size consistency, alignment consistency, color consistency, etc. of the visual elements described above.
[0107] In some implementations, the chart reuse module 122 can further perform post-processing on the information chart. The chart reuse module 122 can obtain the first relative positions of the visual element units 441 to 444 in the available presentation area of the original information chart. The available presentation area can be regarded as the canvas range where the original information chart is located. The first relative position can be, for example, the distance between the reference point of each visual element unit and the edge of the available presentation area. Based on the updated visual element units 441 to 445 and the first relative positions, the chart reuse module 122 can adjust the presentation positions of the current multiple visual element units 441 to 445 on the canvas range. The adjusted presentation positions can be regarded as the second relative positions of the visual element units 441 to 445 in the available presentation area of the target information chart to be generated. Therefore, asFigure 4E As shown, the chart reuse module 122 can be based on the target information chart 472 generated by post-processing.
[0108] Exemplary implementation method
[0109] Some example implementations of the present disclosure are listed below.
[0110] In one aspect, the present disclosure provides an electronic device. The electronic device includes: a processing unit; and a memory coupled to the processing unit and containing instructions stored thereon, the instructions, when executed by the processing unit, cause the device to perform the following actions: in response to determining that an original information chart is received, determine a set of visual element units from a set of visual elements included in the original information chart, the visual element units in the set of visual element units being used to represent information items in the original information chart; determine a first association relationship between the visual elements included in the visual element units and the information items and a second association relationship between the visual element units and another visual element unit in the set of visual element units; generate a description for the original information chart based on the first association relationship and the second association relationship; and in response to detecting an input of target information, generate a target information chart by at least updating the set of visual element units based on the description and the target information.
[0111] In some implementations, determining the set of visual element units includes partitioning the set of visual elements into a set of visual element clusters according to the similarity of the visual elements in the set of visual elements; determining the number of visual elements included in each of the set of visual element clusters; determining an anchor visual element cluster from the set of visual element clusters based on the number; and determining the set of visual element units based on the anchor visual element cluster.
[0112] In some implementations, determining the anchor visual element cluster includes determining the respective cluster sizes of the set of visual element clusters based on the number; and in response to determining that a first cluster size in the cluster sizes exceeds a threshold size, determining the anchor visual element cluster from the visual element clusters having the first cluster size in the set of visual element clusters.
[0113] In some implementations, determining the set of visual element units based on the anchor visual element cluster includes determining the visual elements included in the anchor visual element cluster as anchor visual elements; assigning non-anchor visual elements in non-anchor visual element clusters to the anchor visual elements, the non-anchor visual element set having the same cluster size as the non-anchor visual element set; and determining a set of visual element units based on the anchor visual elements and the non-anchor visual elements assigned to the anchor visual elements.
[0114] In some implementations, determining the first association relationship includes determining the attribute information of the visual elements included in the visual element unit; determining the influence mode of the semantic change of the information item on the visual elements included in the visual element unit; and determining the first association relationship based on the attribute information and the influence mode.
[0115] In some implementations, the influence mode includes at least one of the following: causing deformation of the training visual element, causing movement of the training visual element, not causing change of the training visual element, causing color change of the training visual element, and causing change in the arrangement and combination of the visual elements.
[0116] In some implementations, determining the second association relationship includes determining the correlation information between the visual elements included in the visual element unit and the visual elements included in the other visual element unit; and determining the second association relationship based on the layout relationship and the correlation information.
[0117] In some implementations, generating the description includes obtaining a predetermined label for characterizing the first association relationship and the second association relationship; and generating the description based on the label.
[0118] In some implementations, generating the target information chart includes updating the visual elements included in the visual element unit based on the first association relationship and the target information; updating the visual elements included in the other visual element unit based on the update of the visual elements and the second association relationship; and generating the target information chart based at least on the updated visual elements included in the visual element unit and the updated visual elements included in the other visual element unit.
[0119] In some implementations, generating the target information chart based at least on the updated visual elements included in the visual element unit and the updated visual elements included in the other visual element unit includes obtaining the first relative position of the set of visual element units in the available presentation area of the original information chart; determining the second relative position of the set of visual element units in the available presentation area of the target information chart based on the updated visual elements included in the visual element unit, the updated visual elements included in the other visual element unit, and the first relative position; and generating the target information chart based on the second relative position, the updated visual elements included in the visual element unit, and the updated visual elements included in the other visual element unit.
[0120] In another aspect, the present disclosure provides a computer-implemented method. The method includes: in response to determining that an original information chart is received, determining a set of visual element units from a set of visual elements included in the original information chart, where the visual element units in the set of visual element units are used to represent information items in the original information chart; determining a first association relationship between the visual elements included in the visual element unit and the information item and a second association relationship between the visual element unit and another visual element unit in the set of visual element units; generating a description for the original information chart based on the first association relationship and the second association relationship; and in response to detecting an input of target information, generating a target information chart by updating the set of visual element units at least based on the description and the target information.
[0121] In some implementations, determining the set of visual element units includes partitioning the set of visual elements into a set of visual element clusters according to the similarity of the visual elements in the set of visual elements; determining the number of visual elements included in each of the set of visual element clusters; determining an anchor visual element cluster from the set of visual element clusters based on the number; and determining the set of visual element units based on the anchor visual element cluster.
[0122] In some implementations, determining the anchor visual element cluster includes determining the respective cluster sizes of the set of visual element clusters based on the number; and in response to determining that a first cluster size in the cluster sizes exceeds a threshold size, determining the anchor visual element cluster from the visual element clusters having the first cluster size in the set of visual element clusters.
[0123] In some implementations, determining the set of visual element units based on the anchor visual element cluster includes determining the visual elements included in the anchor visual element cluster as anchor visual elements; assigning non-anchor visual elements in non-anchor visual element clusters to the anchor visual elements, where the non-anchor visual element set has the same cluster size as the non-anchor visual element set; and determining the set of visual element units based on the anchor visual elements and the non-anchor visual elements assigned to the anchor visual elements.
[0124] In some implementations, determining the first association relationship includes determining the attribute information of the visual elements included in the visual element unit; determining the influence pattern of the semantic change of the information item on the visual elements included in the visual element unit; and determining the first association relationship based on the attribute information and the influence pattern.
[0125] In some implementations, the influencing patterns include at least one of the following: causing deformation of the training visual element, causing movement of the training visual element, not causing change to the training visual element, causing color change of the training visual element, and causing change in the arrangement and combination of the visual elements.
[0126] In some implementations, determining the second association relationship includes determining the correlation information between the visual elements included in the visual element unit and the visual elements included in the other visual element unit; and determining the second association relationship based on the layout relationship and the correlation information.
[0127] In some implementations, generating the description includes obtaining a predetermined label for characterizing the first association relationship and the second association relationship; and generating the description based on the label.
[0128] In some implementations, generating the target information chart includes updating the visual elements included in the visual element unit based on the first association relationship and the target information; updating the visual elements included in the other visual element unit based on the update of the visual elements and the second association relationship; and generating the target information chart based at least on the updated visual elements included in the visual element unit and the updated visual elements included in the other visual element unit.
[0129] In some implementations, generating the target information chart based at least on the updated visual elements included in the visual element unit and the updated visual elements included in the other visual element unit includes obtaining a first relative position of the set of visual element units in the available presentation area of the original information chart; determining a second relative position of the set of visual element units in the available presentation area of the target information chart based on the updated visual elements included in the visual element unit, the updated visual elements included in the other visual element unit, and the first relative position; and generating the target information chart based on the second relative position, the updated visual elements included in the visual element unit, and the updated visual elements included in the other visual element unit.
[0130] In another aspect, the present disclosure provides a computer program product tangibly stored in a non-transitory computer storage medium and including machine-executable instructions that, when executed by a device, cause the device to: in response to determining that an original information chart is received, determine a set of visual element units from a set of visual elements included in the original information chart, where the visual element units in the set of visual element units are used to represent information items in the original information chart; determine a first association relationship between a visual element included in the visual element unit and the information item and a second association relationship between the visual element unit and another visual element unit in the set of visual element units; generate a description for the original information chart based on the first association relationship and the second association relationship; and in response to detecting an input of target information, generate a target information chart by updating the set of visual element units at least based on the description and the target information.
[0131] In some implementations, the machine-executable instructions, when executed by the device, cause the device to divide the set of visual elements into a set of visual element clusters according to the similarity of the visual elements in the set of visual elements; determine the number of visual elements included in each of the set of visual element clusters; determine an anchor visual element cluster from the set of visual element clusters based on the number; and determine the set of visual element units based on the anchor visual element cluster.
[0132] In some implementations, the machine-executable instructions, when executed by the device, cause the device to determine the respective cluster sizes of the set of visual element clusters based on the number; and in response to determining that a first cluster size in the cluster sizes exceeds a threshold size, determine the anchor visual element cluster from the visual element clusters having the first cluster size in the set of visual element clusters.
[0133] In some implementations, the machine-executable instructions, when executed by the device, cause the device to determine the visual elements included in the anchor visual element cluster as anchor visual elements; assign non-anchor visual elements in the non-anchor visual element clusters to the anchor visual elements, where the non-anchor visual element set has the same cluster size as the non-anchor visual element set; and determine the set of visual element units based on the anchor visual elements and the non-anchor visual elements assigned to the anchor visual elements.
[0134] In some implementations, the machine-executable instructions, when executed by the device, cause the device to determine the attribute information of the visual element included in the visual element unit; determine the influence mode of the semantic change of the information item on the visual element included in the visual element unit; and determine the first association relationship based on the attribute information and the influence mode.
[0135] In some implementations, the influencing patterns include at least one of the following: causing deformation of the training visual element, causing movement of the training visual element, not causing change in the training visual element, causing color change of the training visual element, and causing change in the permutation and combination of the visual elements.
[0136] In some implementations, the machine-executable instructions, when executed by a device, cause the device to determine correlation information between the visual elements included in the visual element unit and the visual elements included in the other visual element unit; and determine the second association relationship based on the layout relationship and the correlation information.
[0137] In some implementations, the machine-executable instructions, when executed by a device, cause the device to obtain predetermined labels for characterizing the first association relationship and the second association relationship; and generate the description based on the labels.
[0138] In some implementations, the machine-executable instructions, when executed by a device, cause the device to update the visual elements included in the visual element unit based on the first association relationship and the target information; update the visual elements included in the other visual element unit based on the update of the visual elements and the second association relationship; and generate a target information chart based at least on the updated visual elements included in the visual element unit and the updated visual elements included in the other visual element unit.
[0139] In some implementations, the machine-executable instructions, when executed by a device, cause the device to obtain a first relative position of the set of visual element units in the available presentation area of the original information chart; determine a second relative position of the set of visual element units in the available presentation area of the target information chart based on the updated visual elements included in the visual element unit, the updated visual elements included in the other visual element unit, and the first relative position; and generate a target information chart based on the second relative position, the updated visual elements included in the visual element unit, and the updated visual elements included in the other visual element unit.
[0140] In another aspect, the present disclosure provides a computer-readable medium having machine-executable instructions stored thereon, and the machine-executable instructions, when executed by a device, cause the device to perform the methods of the above aspects.
[0141] The functions described above herein can be performed at least in part by one or more hardware logic components. For example, by way of non-limitation, exemplary types of hardware logic components that can be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0142] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing devices, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program codes can be executed entirely on the machine, partially on the machine, executed partially on the machine and partially on a remote machine as an independent software package, or executed entirely on a remote machine or server.
[0143] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0144] Furthermore, although the operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed to achieve the desired result. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the present disclosure. Certain features described in the context of separate implementations can also be implemented combinatorially in a single implementation. Conversely, the various features described in the context of a single implementation can also be implemented separately or in any suitable sub-combination in multiple implementations.
[0145] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms for implementing the claims.
Claims
1. An electronic device, comprising: A processing unit; And A memory, coupled to the processing unit and containing instructions stored thereon, which when executed by the processing unit cause the device to perform the following actions: In response to receiving an original information chart, determine a set of visual element units from a set of visual elements included in the original information chart, the set of visual element units representing corresponding information items in the original information chart; Determine a first association relationship between a first visual element included in the first visual element unit of the set of visual element units and the corresponding information item by: Determine the attribute information of the first visual element included in the first visual element unit; Determine the influence mode of the semantic change of the information item on the first visual element included in the first visual element unit; And Based on the attribute information and the influence mode, determine the first association relationship; Determine a second association relationship between the first visual element unit and a second visual element unit in the set of visual element units; Based on the first association relationship and the second association relationship, generate a description for the original information chart, the description including the attribute information and the influence mode; And In response to detecting the input of target information, generate a target information chart by at least updating the set of visual element units based on the description and the target information.
2. The device according to claim 1, wherein determining the set of visual element units includes: According to the similarity of the visual elements in the set of visual elements, divide the set of visual elements into a set of visual element clusters; Determine the number of visual elements included in each of the set of visual element clusters; Based on the number, determine an anchor visual element cluster from the set of visual element clusters; And Based on the anchor visual element cluster, determine the set of visual element units.
3. The device according to claim 2, wherein determining the anchor visual element cluster includes: Based on the number, determine the respective cluster sizes of the set of visual element clusters; And In response to determining that a first cluster size in the cluster sizes exceeds a threshold size, determine the anchor visual element cluster from the visual element clusters having the first cluster size in the set of visual element clusters.
4. The device according to claim 2, wherein determining the set of visual element units based on the anchor visual element cluster includes: Determine the visual elements included in the anchor visual element cluster as anchor visual elements; Assign non-anchor visual elements in non-anchor visual element clusters to the anchor visual elements, the non-anchor visual element clusters having the same cluster size as the anchor visual element cluster; And Based on the anchor visual elements and the non-anchor visual elements assigned to the anchor visual elements, determine a set of visual element units.
5. The device according to claim 1, wherein the influence mode includes at least one of the following: Causing deformation of the visual element, Causing movement of the visual element, Not causing change of the visual element, Causing color change of the visual element, and Cause permutation and combination changes of the visual elements.
6. The apparatus according to claim 1, wherein determining the second association relationship includes: Determining a layout relationship between the first visual element unit and the second visual element unit; Determining correlation information between the visual elements included in the first visual element unit and the visual elements included in the second visual element unit; and Based on the layout relationship and the correlation information, determining the second association relationship.
7. The apparatus according to claim 1, wherein generating the description includes: Obtaining a predetermined tag for characterizing the first association relationship and the second association relationship; And Generating the description based on the tag.
8. The apparatus according to claim 1, wherein generating the target information chart includes: Updating the visual elements included in the first visual element unit based on the first association relationship and the target information; Updating the visual elements included in the second visual element unit based on the update of the visual elements and the second association relationship; And Generating a target information chart based at least on the visual elements included in the updated first visual element unit and the visual elements included in the updated second visual element unit.
9. The apparatus according to claim 8, wherein generating a target information chart based at least on the visual elements included in the updated first visual element unit and the visual elements included in the updated second visual element unit includes: Obtaining a first relative position of the set of visual element units in the available presentation area of the original information chart; Based on the visual elements included in the updated first visual element unit, the visual elements included in the updated second visual element unit, and the first relative position, determining a second relative position of the set of visual element units in the available presentation area of the target information chart; And Generating a target information chart based on the second relative position, the visual elements included in the updated first visual element unit, and the visual elements included in the updated second visual element unit.
10. A computer-implemented method, comprising: In response to receiving an original information chart, determining a set of visual element units from a set of visual elements included in the original information chart, the set of visual element units representing corresponding information items in the original information chart; Determining a first association relationship between a first visual element included in the first visual element unit of the set of visual element units and the corresponding information item by: Determining attribute information of the first visual element included in the first visual element unit; Determining an influence mode of semantic changes of the information item on the first visual element included in the first visual element unit; And Based on the attribute information and the influence mode, determining the first association relationship; Determining a second association relationship between the first visual element unit and a second visual element unit in the set of visual element units; Generate a description for the original information chart based on the first association relationship and the second association relationship, where the description includes the attribute information and the influence mode; And In response to detecting the input of target information, generate a target information chart by updating the set of visual element units based at least on the description and the target information.
11. The method according to claim 10, wherein determining the set of visual element units includes: Partition the set of visual elements into a set of visual element clusters according to the similarity of the visual elements in the set of visual elements; Determine the number of visual elements included in each of the set of visual element clusters; Determine an anchor visual element cluster from the set of visual element clusters based on the number; And Determine the set of visual element units based on the anchor visual element cluster.
12. The method according to claim 11, wherein determining the anchor visual element cluster includes: Determine the respective cluster sizes of the set of visual element clusters based on the number; And In response to determining that the first cluster size in the cluster sizes exceeds a threshold size, determine the anchor visual element cluster from the visual element clusters having the first cluster size in the set of visual element clusters.
13. The method according to claim 11, wherein determining the set of visual element units based on the anchor visual element cluster includes: Determine the visual elements included in the anchor visual element cluster as anchor visual elements; Assign non-anchor visual elements in non-anchor visual element clusters to the anchor visual elements, where the non-anchor visual element clusters have the same cluster size as the anchor visual element cluster; And Determine a set of visual element units based on the anchor visual elements and the non-anchor visual elements assigned to the anchor visual elements.
14. The method according to claim 10, wherein the influence mode includes at least one of the following: Cause deformation of the visual element, Cause movement of the visual element, Do not cause changes to the visual element, Cause color change of the visual element, and Cause permutation and combination change of the visual elements.
15. The method according to claim 10, wherein determining the second association relationship includes: Determine the layout relationship between the first visual element unit and the second visual element unit; Determine the correlation information between the visual elements included in the first visual element unit and the visual elements included in the second visual element unit; and Determine the second association relationship based on the layout relationship and the correlation information.
16. The method according to claim 10, wherein generating the description includes: Obtain a predetermined label for characterizing the first association relationship and the second association relationship; And Generate the description based on the label.
17. The method according to claim 10, wherein generating the target information chart includes: Update the visual elements included in the first visual element unit based on the first association relationship and the target information; Update the visual elements included in the second visual element unit based on the update of the visual elements and the second association relationship; And Generate a target information chart based at least on the visual elements included in the updated first visual element unit and the visual elements included in the updated second visual element unit.
18. The method according to claim 17, wherein generating a target information chart based at least on the visual elements included in the updated first visual element unit and the visual elements included in the updated second visual element unit comprises: Obtain a first relative position of the set of visual element units in the available presentation area of the original information chart; Determine a second relative position of the set of visual element units in the available presentation area of the target information chart based on the visual elements included in the updated first visual element unit, the visual elements included in the updated second visual element unit, and the first relative position; And Generate a target information chart based on the second relative position, the visual elements included in the updated first visual element unit, and the visual elements included in the updated second visual element unit.
Citation Information
Patent Citations
Generating a computer executable chart visualization by annotating a static image
US20160110895A1