Image-text relationship display method and electronic device

Abstract

The application provides a picture-text relationship display method and an electronic device, relates to the technical field of terminals, and can help users quickly find associated pictures and texts, and improves the reading experience of the users. In the picture-text relationship display method, the electronic device acquires a first document, wherein the first document comprises non-image content and at least one image, and the non-image content comprises at least one text content associated with each image. Then, when the electronic device displays the content of the first document, the electronic device displays the associated images and text contents in the same display effect. Since the associated images and text contents are in the same display effect, the user can clearly know which image is associated with a certain text content and clearly know which text content is associated with a certain image, so that the user can better understand the document content.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a method and electronic device for displaying graphic-text relationships. Background Technology

[0002] Currently, documents that users read often contain a large amount of text description and accompanying images. For example, academic papers may include descriptive sections and experimental data visualizations, while news articles may include text sections and trending images. When reading, combining text with images, or vice versa, helps users understand the document content.

[0003] However, when images and text are related, users need to waste a lot of time finding the image corresponding to the text or the text corresponding to the image, which affects the user's reading experience. Summary of the Invention

[0004] This application provides a method and electronic device for displaying the relationship between images and text, enabling users to quickly find related images and text, thus improving the user's reading experience.

[0005] To achieve the above objectives, the embodiments of this application provide the following technical solutions:

[0006] Firstly, a method for displaying text-image relationships is provided. In this method, an electronic device acquires a first document, wherein the first document includes non-image content and at least one image, and the non-image content includes at least one text content associated with each image. Subsequently, when the electronic device displays the content of the first document, the electronic device displays the interrelated images and text content with the same display effect.

[0007] In the above method, users can quickly and clearly see the related text and images, and can clearly know which image is associated with a certain text content and which text content is associated with a certain image, which makes it easier for users to understand the document content and improves the user's reading experience.

[0008] In one possible implementation of the first aspect, the non-image content includes first text content, and at least one image includes a first image associated with the first text content. The electronic device displays the first image in response to receiving a first operation on the first text content; or, in response to receiving a second operation on the first image, displays the first text content.

[0009] In this implementation, electronic devices can also support navigation between related images and text. Especially for images and text content displayed across multiple pages, users can more quickly find text content associated with an image, or an image associated with text content, thus improving the user's reading experience.

[0010] In one possible implementation of the first aspect, the at least one image includes a second image. When the electronic device displays the content of the first document, if the currently displayed content includes the second image, the electronic device displays prompt information corresponding to at least one text content associated with the second image.

[0011] In this implementation, an image in the first document can be referenced by one or more text contents. In this case, when the electronic device displays the image, it can simultaneously display prompts about the text contents that reference the image, so that users can better understand the relationship between the image and the text content and improve the user's reading experience.

[0012] In one possible implementation of the first aspect, the prompt information corresponding to each of the at least one text content includes first prompt information. In response to receiving a third operation on the first prompt information, the electronic device displays the text content corresponding to the first prompt information.

[0013] In this implementation, the electronic device can also support switching between the aforementioned prompts and text content. When the electronic device displays an image and at least one text prompt associated with the image, the user can click on any prompt, and the electronic device can then switch to display the corresponding text content. This allows the user to experience rapid switching between prompts and text content, enabling interaction with the electronic device while reading documents and thus obtaining a better reading experience.

[0014] In one possible implementation of the first aspect, the aforementioned non-image content includes second text content. When the electronic device displays the content of the first document, if the currently displayed content includes the second text content, the electronic device displays a prompt message corresponding to a third image associated with the second text content.

[0015] In this implementation, when an electronic device displays text content, it can simultaneously display prompts about the images referenced by that text content, so that users can better understand the relationship between the images and the text content and improve the user's reading experience.

[0016] In one possible implementation of the first aspect, when the currently displayed content includes the second text content, the electronic device can display not only the prompt information of the third image, but also the prompt information corresponding to the third text content associated with the third image.

[0017] In this implementation, if an image can be referenced by one or more text contents that are not image content, when the electronic device displays one of the text contents, it can simultaneously display the image referenced by that text content and prompts for other text contents in the at least one text content, so that the user can better understand the relationship between the image and the text content and improve the user's reading experience.

[0018] In one possible implementation of the first aspect, the electronic device displays the third image in response to receiving a fourth operation that provides a prompt message corresponding to the third image.

[0019] In this implementation, the electronic device can also support the switching between the aforementioned prompts and images. When the electronic device displays a prompt with an image associated with the text content, the user can click on the prompt, and the electronic device can then switch to display the corresponding image. In this way, the user can experience quick switching between prompts and text content or images, allowing interaction with the electronic device while reading documents, thus obtaining a better reading experience.

[0020] In one possible implementation of the first aspect, the electronic device displays the third text content in response to receiving a fifth operation that provides a prompt message corresponding to the third text content.

[0021] In this implementation, the electronic device can also support the jump between the aforementioned prompts and text content. When the electronic device references prompts corresponding to other text content (such as third text content, fourth text content, etc.) of an image, the user can click on the prompt, and the electronic device can jump to display the corresponding text content. In this way, the user can experience quick jumps between prompts and text content or images, and interact with the electronic device while reading documents, thus obtaining a better reading experience.

[0022] In one possible implementation of the first aspect, the display effect includes at least one of color, border, background, or shadow. This allows the electronic device to visually highlight associated image and text content to the user.

[0023] In one possible implementation of the first aspect, the aforementioned image includes a picture or a table.

[0024] In one possible implementation of the first aspect, the text content includes data, and the image associated with the text content includes statistical content related to the data. The data and statistical content are displayed with the same visual effect. For example, the statistical content can be derived from the data, or it can be the statistical result of the data, etc. In this way, users can more intuitively understand the content displayed in the image, making it easier for them to quickly understand the document content and obtain a better reading experience.

[0025] In one possible implementation of the first aspect, the aforementioned data exists in a text description or a table.

[0026] In one possible implementation of the first aspect, after acquiring a first document, the electronic device acquires non-image content and at least one image from the first document. The electronic device performs semantic analysis on the non-image content and content analysis on the at least one image, wherein the content analysis includes analysis of at least one of the following: the image's location in the first document, the image's type, and text included in the image. Finally, based on the semantic analysis results of the non-image content and the content analysis results of the at least one image, the electronic device determines at least one text content associated with each image in the non-image content.

[0027] In the above implementation method, the content analysis of the image can be regarded as performing multi-dimensional analysis on the image to obtain multi-dimensional analysis results or multi-dimensional image features. Since the obtained image features may be multi-dimensional, the image features can be associated with the semantic analysis results of non-image content from multiple aspects and angles, thereby realizing the association between non-image content and the image. The association results will be more accurate.

[0028] In a second aspect, an electronic device is provided, including a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the graphic-text relationship display method as described in the first aspect and any of its implementable embodiments.

[0029] Thirdly, a computer-readable storage medium is provided, including computer instructions that, when executed on an electronic device, cause the electronic device to perform the graphic-text relationship display method as described in the first aspect and any of its implementable embodiments.

[0030] Fourthly, a computer program product is provided that, when run on a computer, causes the computer to execute the graphic-text relationship display method as described in the first aspect and any of its implementable methods.

[0031] The beneficial effects that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, and the computer program product provided in the fourth aspect can achieve are similar to the beneficial effects that can be achieved in the first aspect and any of its implementations, and will not be repeated here. Attached Figure Description

[0032] Figure 1 A schematic diagram illustrating a user reading scenario provided in an embodiment of this application;

[0033] Figure 2 Schematic diagram of the structure of the electronic device provided in the embodiments of this application Figure 1 ;

[0034] Figure 3 A schematic diagram of the software architecture of the electronic device provided in the embodiments of this application;

[0035] Figure 4 Schematic diagram of the structure of the electronic device provided in the embodiments of this application Figure 2 ;

[0036] Figure 5 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 1 ;

[0037] Figure 6 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 2 ;

[0038] Figure 7 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 3 ;

[0039] Figure 8 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 4 ;

[0040] Figure 9 A flowchart illustrating the method for displaying text-image relationships provided in an embodiment of this application;

[0041] Figure 10 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 5 ;

[0042] Figure 11 A schematic diagram of the electronic device display content provided in the embodiments of this application. Figure 6 ;

[0043] Figure 12 Schematic diagram of the structure of the electronic device provided in the embodiments of this application Figure 3 . Detailed Implementation

[0044] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0045] Furthermore, the business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0046] Currently, academic papers, technical reports, and news articles often contain extensive text descriptions and accompanying images. These images typically supplement and explain the text, requiring users or readers to use them to gain a deeper understanding of the document's content.

[0047] Some technical solutions also analyze the document layout to match related text and images, aiding user comprehension. For example, the input document can first be analyzed to identify its elements (such as titles, body paragraphs, images, tables, etc.) and record their precise positions on the page. Then, based on this positional information, the system determines the correspondence between text and images. For instance, if a piece of text is located close to a chart on the page, the system considers the text to be a description of the chart. This positional analysis method is simple and direct, and can handle basic text-image matching scenarios.

[0048] However, the above analysis of image-text relationships is rather simplistic, relying solely on the positional information of document elements to determine these relationships, completely ignoring the semantic information of the text content. This method cannot handle image-text content that is geographically distant but actually related, and may also incorrectly classify geographically close but unrelated content as related.

[0049] In addition, some documents contain a lot of content and many pictures. Some related pictures and text will be displayed across pages. Users need to cross pages to find the picture associated with a certain text or the text associated with a certain picture. This not only wastes time, but also interrupts the user's thinking or train of thought, and increases the difficulty for the user to understand the document, thus affecting the user's reading experience.

[0050] Based on the above, this application provides a method for displaying text-image relationships. In this method, a first document is first obtained. The first document includes non-image content and at least one image, and the non-image content includes at least one text content associated with each image. Then, when displaying the content of the first document, the related images and text content are displayed with the same effect. In this way, users can quickly and clearly see the related text and images, clearly identifying which image is associated with a particular text content and which text content is associated with a particular image, thus facilitating better understanding of the document content and improving the user's reading experience.

[0051] The above method for displaying text-image relationships can be applied to user reading scenarios. See also... Figure 1 As shown, when a user saves a document on electronic device 100, the electronic device 100 performs image-text relationship analysis on the document to determine the interrelated text content and images in the document. Multiple text contents can be associated with a single image. Subsequently, if the user opens the document on electronic device 100, the electronic device 100 can display the interrelated images and text content with the same display effect when displaying the document's content.

[0052] In some examples, the electronic device 100 supports the function of jumping between text content or images. For example, when a user clicks on a piece of text content, he / she can jump to the image associated with that text content. That is, the content currently displayed by the electronic device 100 includes the image associated with that text content.

[0053] In this context, it can be understood that an image associated with text content refers to an image mentioned or referenced in the text content; and text content associated with an image refers to text that mentions or references the image in the content.

[0054] The above-described method for displaying text-image relationships can be applied to electronic devices. In some embodiments, see [link to relevant documentation]. Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a display screen 140, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, etc.

[0055] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements.

[0056] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0057] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0058] In some possible application scenarios, the electronic device 100 can implement the graphic-text relationship display method in the embodiments of this application through the processor 110.

[0059] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0060] In some embodiments, the processor 110 may include one or more interfaces. The USB interface 130 is a USB standard-compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used for data transfer between the electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0061] In some possible application scenarios, electronic device 100 can receive documents sent by peripheral devices via USB interface 130.

[0062] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0063] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.

[0064] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on electronic devices 100.

[0065] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0066] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-CDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0067] Electronic device 100 implements display functions through a GPU, display screen 140, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0068] The display screen 140 is used to display images, videos, etc. The display screen 140 includes a display panel. In some embodiments, the electronic device 100 may include one or N display screens 140, where N is a positive integer greater than 1.

[0069] In some possible application scenarios, after a user opens a document on electronic device 100, display screen 140 can display the document's content. Furthermore, when displaying the content, related images and text content can be displayed with the same visual effect. This same visual effect could include, for example, the same color, the same border, the same shadow, and the same background.

[0070] In some possible application scenarios, when a user clicks on a piece of text, the display screen 140 can also jump to display an image associated with that text, or when a user clicks on an image, the display screen 140 can also jump to display text associated with that image.

[0071] The aforementioned NPU stands for Neural Network (NN) Computing Processor. It can rapidly process input information by drawing inspiration from the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, and can also continuously learn on its own. NPUs can enable intelligent cognitive applications in electronic devices, such as image recognition, speech recognition, and text understanding.

[0072] In some possible application scenarios, electronic device 100 can use NPU to analyze the image and text content in a document, thereby determining at least one piece of text content in the document that is associated with an image.

[0073] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0074] In some possible application scenarios, after receiving or acquiring a document, the electronic device 100 can save the document on an external memory card through the external storage interface 120.

[0075] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0076] In some possible application scenarios, after receiving or acquiring a document, the electronic device 100 can save the document in its internal storage 121.

[0077] In some possible application scenarios, electronic device 100 can retrieve documents from external memory cards or internal memory 121 and perform text-image relationship analysis on the documents.

[0078] In some potential application scenarios, electronic device 100 can also respond to a user's selection of a document, retrieve the document from an external memory card or internal memory 121, and perform image and text relationship analysis on the document. Then, in response to the user's opening of the document, electronic device 100 displays the associated images and text content with the same display effect.

[0079] In other possible application scenarios, electronic device 100 can also respond to a user's operation of opening a document by first retrieving the document from an external memory card or internal memory 121 and performing image and text relationship analysis on the document. Then, electronic device 100 displays the document content, showing associated images and text content with the same display effect.

[0080] The electronic device provided in this application embodiment can run an operating system (OS). This operating system can be various operating systems used in the industry, such as an operating system based on OpenHarmony, like HarmonyOS; or other operating systems such as Android. TMAn operating system can refer to the iOS mobile operating system; it can also refer to various open-source operating systems or their derivatives, such as Linux OS and other embedded operating systems; or it can refer to future new operating systems, such as AI operating systems based on artificial intelligence. An operating system is a set of interconnected system software programs that manage and control the operation of electronic devices, utilize and run hardware and software resources, and provide public services to organize user interactions. In electronic devices, the operating system connects downwards to the physical devices at the hardware layer and upwards to provide a runtime environment for application software.

[0081] An operating system typically includes a kernel layer, a middleware layer, and an application layer. The application layer includes applications, which can include system applications and third-party applications. The middleware layer includes a suite of software providing various services to application developers, or frameworks providing services such as databases, multimedia, and graphics, or capabilities such as distributed scheduling and system scaling. For example, the middleware layer may include a framework layer and / or a system service layer. The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The system service layer includes the system's core capabilities, providing services to applications through the framework layer. The kernel layer is the layer between hardware and software. The kernel layer may include hardware drivers and the operating system kernel. In addition to providing hardware drivers, the kernel layer also supports functions such as memory management and system process management.

[0082] The electronic devices we use in our daily lives come in various types and forms, and are applied in a wide range of scenarios. Therefore, based on the different forms and functions of electronic devices, different application scenarios, and different user needs, the operating systems used in these devices may also differ. The basic functions implemented by the electronic device provided in this application can be implemented using a general-purpose operating system or a dedicated operating system. To more clearly illustrate the implementation of the embodiments of this application under a specific operating system, the architecture of HarmonyOS is shown below. Those skilled in the art can deduce the implementation of the embodiments of this application under other specific operating systems, such as Android. TM Implementation under operating systems, etc.

[0083] The software architecture of an electronic device can be divided into several layers. In some embodiments, see [link to documentation]. Figure 3 As shown, from bottom to top, the layers are: kernel layer, system service layer, framework layer, and application layer. Layers communicate with each other through software interfaces. System functions can be tailored, added, or combined at the subsystem level depending on the deployment scenario of different device types, and each subsystem can also be tailored, added, or combined at the functional level.

[0084] The kernel layer includes at least the kernel abstraction layer, the kernel subsystem, and the driver subsystem.

[0085] The kernel abstract layer (KAL) provides basic kernel capabilities to upper layers by shielding the differences between multiple kernels, including but not limited to process / thread management, memory management, file system, network management, and peripheral device management.

[0086] Kernel Subsystem: Supports the selection of a suitable OS kernel for different resource-constrained devices, including but not limited to Linux kernel, HarmonyOS kernel, LiteOS (lite operating system), etc.

[0087] Driver Subsystem: The driver framework is the foundation for the open system hardware ecosystem, providing unified peripheral access capabilities and a framework for driver development and management. The driver framework includes: display drivers, camera drivers, audio drivers, Bluetooth drivers, sensor drivers, etc.

[0088] The system service layer comprises the core capabilities of the system, providing services to applications through the framework layer. This layer includes, but is not limited to, the following subsystems:

[0089] The system's basic capability subsystem set provides fundamental capabilities for the operation, scheduling, and migration of distributed applications across multiple devices. This set may include distributed soft bus, distributed data management, distributed task scheduling, and Ark multi-language runtime; it may also include multi-modal input subsystem, graphics subsystem, security subsystem, and AI business subsystem.

[0090] Basic software service subsystem set: provides public and general software services; the basic software service subsystem set may include event notification subsystem, telephone service subsystem, multimedia subsystem, etc.

[0091] Enhanced software service subsystem suite: Provides differentiated enhanced software services for different devices; the enhanced software service subsystem suite may include smart screen proprietary business subsystem, wearable proprietary business subsystem, IoT proprietary business subsystem, etc.

[0092] Hardware service subsystem set: Provides hardware services; the hardware service subsystem set may include location service subsystem, user IAM (Identity and Access Management) subsystem, wearable proprietary hardware service subsystem, biometric identification, IoT proprietary hardware service subsystem, etc.

[0093] Distributed task scheduling enables distributed service management (discovery, synchronization, registration, and invocation), supporting remote startup, remote invocation, remote connection, and migration of applications across devices.

[0094] Distributed data management enables data synchronization, data storage, data sharing, and data access across all scenarios and devices.

[0095] The distributed soft bus provides communication-related capabilities for seamless interconnection between multiple devices, including: WLAN service capabilities, Bluetooth service capabilities, soft bus, inter-process communication RPC (remote procedure call), and StarFlash communication capabilities.

[0096] Ark Multilingual Runtime is a unified compilation runtime platform designed to support the joint compilation and execution of multiple programming languages ​​and multiple chip platforms.

[0097] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer includes: the ArkUI framework (which provides a complete infrastructure for UI development of system applications, including UI functions such as components, layouts, animations, and interactive events, as well as a real-time interface preview tool), the user application framework, and the Ability framework (an Ability is a lightweight application; the Ability framework schedules and manages the operation and lifecycle of Abilities). Different devices may have different operating systems, and the APIs they support may also differ.

[0098] The HarmonyOS API is a series of open capabilities provided to support HarmonyOS application development. The HarmonyOS API can be set at the framework layer or independently of the framework layer. The HarmonyOS API includes the Audio API (audio service), Push API (push service), and Account API (account service), among others.

[0099] Applications at the application layer can include system applications and extended / third-party applications. System applications can include the desktop, control bar, settings, contacts, phone, camera, etc., while extended / third-party applications can include social applications, travel applications, etc.

[0100] In some embodiments, see Figure 4 As shown, the electronic device 100 may also include a layout analysis module 401, a text analysis module 402, an image analysis module 403, an association matching module 404, and a display module 405.

[0101] The layout analysis module 401 is responsible for intelligently segmenting the document into sections. For example, it can divide the document content into different elements such as titles (including main titles, subtitles, etc.), body text, and images (such as pictures, tables, formulas, etc.). For instance, this layout analysis module can use deep learning technology to accurately identify various elements and sections in the document.

[0102] The text analysis module 402 can perform deep semantic understanding on the text (such as titles and body text) segmented by the layout analysis module. This module mainly includes two sub-functions: image reference recognition and image number extraction. The image reference recognition function can analyze whether the text content contains references to images; these references may be explicit, such as… Figure 2 The text can be explicit, such as "As shown in the figure above..." or "Table 1 shows...", or implicit, such as "As shown in the figure above..." or "Experimental results show...". The image number extraction function can identify image number information mentioned in the text content, such as "...". Figure 2 "Table 1", etc.

[0103] Image analysis module 403 can perform multi-dimensional analysis on images, tables, formulas, and other images in a document. The analysis methods may include, but are not limited to:

[0104] Location analysis: Determine the spatial location information of an image in a document, such as the page number of the image and the image's orientation on the page (top, right, etc.);

[0105] Semantic analysis: Understanding the content of an image, analyzing its type, etc. For example, text can be extracted from an image, and by analyzing the text, it can be determined that the image is used to display experimental data; for example, analyzing the content of an image can determine that the image is a line graph of real data statistics; for example, analyzing the text in an image can determine what kind of data each line in the statistical content of the image describes, and identify different values ​​belonging to the same type of data in the image, etc.

[0106] Identification: Extracting image number or title information, etc.

[0107] The association matching module 404 can perform image-text relationship analysis based on multi-dimensional features, matching images and text. The matching methods may include, but are not limited to:

[0108] Number matching: For example, related images and text content can be associated based on the image numbers analyzed from the text content and the image numbers analyzed from the images.

[0109] Location matching: For example, related images and text content can be associated based on image references (or image references) analyzed from the text content and image spatial locations analyzed from the images.

[0110] Semantic matching: For example, the similarity between an image and text content can be determined based on the image reference (or image citation) analyzed from the text content, the image number, and the semantic analysis results of the image. Images and text content with a similarity higher than or equal to a preset threshold can be associated.

[0111] Display module 405 can present the results of image-text relationship analysis (or image-text association results) to the user in an intuitive way. At the same time, related images and text content are displayed with the same display effect. The display methods may include, but are not limited to:

[0112] Related display: Related images and text content can be displayed using the same color, border, shadow, background, etc.; for example... Figure 5 As shown, text content 1 and image 1 are related (i.e., text content 1 references image 1), so both text content 1 and image 1 can be displayed with borders of the same thickness. Similarly, text content 2 and image 2 are related (i.e., text content 2 references image 2), so both text content 2 and image 2 can be displayed with the same dashed border. Alternatively, both text content 1 and image 1 can be displayed with red borders, and both text content 2 and image 2 can be displayed with green borders.

[0113] Interactive navigation: It supports quick jumps between text and images; for example, if a user clicks on the border of text content 1, the display module 405 (such as a display screen) can jump to display image 1, for example, displaying... Figure 6 The page containing image 1 shown in (a) is shown; or, if the user clicks on image 1, the display module 405 (such as a display screen) can jump to display text content 1, for example, displaying... Figure 6 The page containing text content 1 shown in (b) is located, etc.;

[0114] Related Hints: Display detailed information about the relationship between text and images; for example, if text content 1, text content 3, and text content 4 all reference image 1, then... Figure 7 As shown in (a), when displaying text content 1, prompts for image 1 related to text content 1, as well as prompts for text content 3 and text content 4 referencing image 1, can be displayed simultaneously. Furthermore, in some examples, when a user clicks on any prompt, the display module 405 (such as a display screen) can jump to display the corresponding content. For example, if a user clicks on the prompt "Page 10" for image 1, the display module 405 (such as a display screen) can jump to display... Figure 7The page where image 1 is located, as shown in (b) of the image, may have the prompt message "Page 11" for text content 3 and "Page 20" for text content 4.

[0115] Or, such as Figure 8 As shown in (a), when displaying image 1, prompts for text content 1, text content 3, and text content 4 referencing image 1 can be displayed simultaneously. Furthermore, in some examples, when a user clicks on any of the prompts, the display module 405 (such as a display screen) can jump to display the corresponding content. For example, if a user clicks on the prompt "Page 1" in text content 1, the display module 405 (such as a display screen) can jump to display... Figure 8 The page containing text content 1 shown in (b) is where the prompt message for text content 3 can be "Page 11" and the prompt message for text content 4 can be "Page 20".

[0116] For example, the above prompts can be used to indicate the location of text content or images, such as "Page 10," "Page 11," etc. For example, the prompts can also simultaneously display a prompt such as "Jump," to inform the user that the current prompt supports jumping to the displayed content.

[0117] In some possible implementations, the display module 405 can be the graphics subsystem in HarmonyOS. The graphics subsystem mainly includes UI components, layout, animation, fonts, input events, window management, rendering, and drawing modules. The graphics service provides graphics rendering and display output functions, and internally, through the rational utilization of system hardware resources, it provides a smooth and efficient display experience for the system.

[0118] In some possible implementations, electronic devices can also employ semantic understanding models to achieve the functions of the layout analysis module 401, text analysis module 402, image analysis module 403, and association matching module 404 mentioned above. This allows them to analyze the semantic and contextual information of the text content in the document, perform multi-dimensional analysis of images, and associate images with the text content of the referenced images, thereby realizing the intelligent association of text and image elements between different pages.

[0119] In addition, in some possible implementations, the aforementioned electronic device may also include a programmable processing module. This module can convert the information related to the text-image relationships obtained from the aforementioned analysis into machine-processable structured data (such as JSON or XML format), facilitating processing of this structured data by the electronic device and other electronic devices. For example, the display module 405 (or display screen, etc.) can display related text-image relationships based on the structured data.

[0120] It is understandable that the content or functions processed by the above-mentioned layout analysis module 401, text analysis module 402, image analysis module 403, and association matching module 404 can all be executed or implemented by the processor.

[0121] When displaying document content, the aforementioned electronic devices can display related images and text content with the same display effect. This allows users to quickly and clearly see related text and images, clearly identifying which image is associated with a particular text and which text is associated with a particular image, thus facilitating better understanding of the document content and enhancing the user's reading experience.

[0122] Furthermore, the aforementioned electronic devices can also perform more accurate image-text relationship analysis based on multi-dimensional features, thereby enabling them to display more accurately related images and text content.

[0123] In addition, the aforementioned electronic devices can also display prompts indicating multiple instances of text referencing the same image and provide a jump function. In this way, users can find the text that references the same image multiple times in a document more quickly and conveniently through the prompts and jump function, thereby improving the user's reading speed and enhancing the reading experience.

[0124] It is understood that the aforementioned electronic devices can be mobile phones, tablets, smartwatches, in-vehicle terminals, handheld computers, laptops, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), augmented reality (AR) / virtual reality (VR) devices, smart home devices, and other devices capable of processing and displaying documents.

[0125] In some embodiments, see Figure 9 As shown, the above-mentioned method for displaying text-image relationships may include the following steps S901-S902.

[0126] S901, Electronic device obtains first document.

[0127] The first document includes non-image content and at least one image, wherein the non-image content includes at least one text content associated with each image.

[0128] In some examples, after acquiring a first document, the electronic device can acquire non-image content and at least one image from the first document, as exemplified by the functions and processes implemented by the layout analysis module in the aforementioned embodiments. Subsequently, the electronic device performs semantic analysis on the non-image content, such as image referencing recognition and image number extraction implemented by the text analysis module in the aforementioned embodiments. The electronic device also performs content analysis on at least one image, whereby the content analysis includes analysis of at least one of the following: the image's position in the first document, the image's type, and the text included in the image; specifically, this could be, for example, the image analysis module's positional analysis, semantic analysis, and identifier recognition performed on the image in the aforementioned embodiments. Finally, based on the semantic analysis results of the non-image content and the content analysis results of at least one image, the electronic device determines at least one text content associated with each image within the non-image content, as exemplified by the functions and processes implemented by the association matching module in the aforementioned embodiments.

[0129] The above-mentioned content analysis of images can be regarded as multi-dimensional analysis of images to obtain multi-dimensional analysis results or multi-dimensional image features. Since the obtained image features may be multi-dimensional, the image features can be associated with the semantic analysis results of non-image content from multiple aspects and angles, thereby realizing the association between non-image content and images. The association results will be more accurate.

[0130] S902. When displaying the content of the first document, the electronic device displays related images and text content with the same display effect.

[0131] The display effects may include at least one of color, border, background, or shadow, for example... Figure 5 As shown. In this way, electronic devices can visually highlight related images and text content to the user more prominently.

[0132] When a user browses the content of the first document, text content 1 is displayed with a red border. If the user wants to find an image associated with text content 1, they can find the image with the same red border in the document content. Alternatively, image 1 is displayed with a dashed border. If the user wants to find text content associated with image 1, they can find the text content with the same dashed border in the document content.

[0133] For example, the images in the first document may include pictures or tables, so the method in this application embodiment can associate images of various forms with text content, thus making the method in this application embodiment more widely applicable.

[0134] In some examples, the text content associated with the image may be an image number, image reference, etc.; or, if there are no other image numbers or image references in the sentence or paragraph containing the image number or image reference, the text content may also be the sentence or paragraph containing the image number or image reference. This application does not impose specific limitations on this.

[0135] In some embodiments, the aforementioned electronic device can also support navigation between related images and text, particularly for images and text displayed across multiple pages. Users can more quickly find text content associated with an image, or an image associated with text content, thus enhancing the user's reading experience. Figure 6 (a) and Figure 6 As shown in (b) of the diagram.

[0136] For example, the non-image content of the first document may include first text content (e.g., text content 1 mentioned above), and at least one image of the first document may include a first image associated with the first text content (e.g., image 1 mentioned above). The electronic device displays the first image in response to receiving an operation A on the first text content; or, in response to receiving an operation B on the first image, it displays the first text content. Operation A may include a single click, double click, or other triggering operation; in some examples, operation A may be a first operation. Operation B may include a single click, double click, or other triggering operation; in some examples, operation B may be a second operation. Furthermore, operation A may be a triggering operation on the first text content itself, or on the border of the first text content, etc. Similarly, operation B may be a triggering operation on the first image itself, or on the border of the first image, etc.

[0137] In some embodiments, an image in the first document described above may be referenced by one or more text contents. In this case, when the electronic device displays the image, it may simultaneously display prompts for at least one text content that references the image, so as to help the user better understand the relationship between the image and the text content and improve the user's reading experience. For example... Figure 8 As shown in (a) in the figure.

[0138] For example, at least one image in the first document may include a second image. When the electronic device displays the content of the first document, if the currently displayed content includes the second image, it displays prompt information corresponding to at least one text content associated with the second image.

[0139] The above prompts can be used to indicate the location of text content, such as "page 10", "page 11", etc., providing functions such as document navigation.

[0140] In other embodiments, the electronic device may also support switching between the aforementioned prompts and text content. When the electronic device displays an image and prompts containing at least one piece of text associated with the image, if the user clicks on any of the prompts, the electronic device can switch to displaying the text content corresponding to that prompt, for example... Figure 8 As shown in (b), this allows users to experience quick transitions between prompts and text content, enabling them to interact with electronic devices while reading documents and thus gain a better reading experience.

[0141] In some examples, the prompts corresponding to the text content can also be displayed synchronously, such as "Jump," to inform the user that the current prompt can support jumping to the displayed content.

[0142] For example, the prompt information corresponding to at least one text content associated with the image may include a first prompt information, and the electronic device may display the text content corresponding to the first prompt information in response to receiving an operation C on the first prompt information.

[0143] Operation C can include triggering operations such as single clicks and double clicks. In some examples, operation C can be a third operation.

[0144] In some embodiments, if an image can be referenced by one or more text contents that are not image content, the electronic device, while displaying one of the text contents, can simultaneously display the image referenced by that text content and prompts for other text contents within the at least one text content. This allows the user to better understand the relationship between the image and the text content, improving the user's reading experience. For example... Figure 7 As shown in (a) in the figure.

[0145] For example, the aforementioned non-image content may include second text content. When the electronic device displays the content of the first document, if the currently displayed content includes the second text content, it displays a prompt message corresponding to the third image associated with the second text content.

[0146] As another example, in addition to displaying the prompt information corresponding to the third image, the electronic device can also display prompt information corresponding to other text content associated with the third image, such as prompt information for the third text content, prompt information for the fourth text content, etc.

[0147] The above prompts can be used to indicate the location of text content and images, such as "page 10", "page 11", etc., providing functions such as document navigation.

[0148] In other embodiments, the electronic device may also support switching between the aforementioned prompts and text content or images. When the electronic device displays prompts for images associated with text content and prompts for other text content referencing that image, if the user clicks on any of the prompts, the electronic device can switch to displaying the corresponding text content or image, for example... Figure 7 (b) and Figure 10 As shown, in Figure 7 In (b), when the user clicks the prompt "Page 10," the electronic device jumps to the page containing image 1. Figure 10 When a user clicks on the prompt "Page 11," the electronic device jumps to the page containing text content 3. This allows users to quickly switch between the prompt and the text content or image, enabling them to interact with the electronic device while reading the document and thus gain a better reading experience.

[0149] In some examples, the prompts corresponding to the text content can also be displayed synchronously, such as "Jump," to inform the user that the current prompt can support jumping to the displayed content.

[0150] For example, in response to receiving an operation D corresponding to a prompt message for the third image, the electronic device displays the third image. Operation D may include triggering operations such as single-clicking or double-clicking; in some examples, operation D may be a fourth operation.

[0151] As another example, in response to receiving an operation E corresponding to a prompt message for the third text content, the electronic device displays the third text content. Operation E may include triggering operations such as single-clicking or double-clicking; in some examples, operation E may be a fifth operation.

[0152] The text-image relationship display method provided in this application embodiment can be applied to various scenarios where users read different documents, such as reading academic papers or exam questions for a particular subject. The documents processed by the electronic device may also differ in different scenarios.

[0153] In some embodiments, when a user reads an academic paper, the first document mentioned above is the academic paper, which may include a large amount of experimental data, and correspondingly include many data images, data tables, etc. The electronic device can associate the data images (or data tables) with the text content about the experimental data in the academic paper and display them in the same way, so that the user's reading experience will not be affected by a large number of data images, data tables, etc. when reading academic papers.

[0154] In some examples, if the image associated with the data in the first document includes statistical content related to the data, the data and statistical content will be displayed in the same way. This statistical content can be derived from the data, or it can represent the statistical results of the data, the source of the data, etc. The statistical content can be displayed in the form of line charts, pie charts, bar charts, etc.

[0155] Taking a line chart to represent statistical data as an example, different lines in the line chart indicate different types of data, and related data and lines are displayed with the same visual effect. However, in some examples, different lines in the line chart are displayed with different visual effects. For example, see... Figure 11 As shown in (a), different types of data are represented by lines in different colors. Line 1, indicating data A, is displayed in red, while line 2, indicating data B, is displayed in green. This allows users to more intuitively understand the content displayed in the image, facilitating quick comprehension of the document and providing a better reading experience.

[0156] In some examples, the aforementioned data may exist in the document's text description or in a table within the first document. If the data exists in a table, the electronic device can also display different values ​​indicating the same type of data with the same display effect, and display values ​​corresponding to different types of data with different display effects. For example, see... Figure 11 As shown in (b) of the table, values ​​1, 2, and 3 of data A are displayed with a red background, values ​​4 and 5 of data B are displayed with a green background, and values ​​6, 7, and 8 of data C are displayed with a yellow background. This allows users to more intuitively understand the content displayed in the table, facilitating quick comprehension of the document and providing a better reading experience.

[0157] In some embodiments, when a user reads exam questions for a particular subject, the aforementioned first document is the exam paper. Taking a physics exam paper as an example, this physics exam paper may include a large number of questions and their corresponding diagrams. The diagrams may be circuit diagrams, physical images, data curves, etc. The electronic device can associate the diagrams with the relevant questions in the physics exam paper and display them in the same way, allowing users to quickly find the diagrams associated with the questions while reading the exam paper. This facilitates users' rapid understanding of the document content and provides a better reading experience.

[0158] In some examples, a title may reference multiple figures, and the electronic device can display the title and the multiple figures associated with the title in the same way.

[0159] The image-text relationship display method provided in this application embodiment can display the text content of related images with the same display effect and provide a jump function between text content and images, providing users with a better reading experience. Furthermore, the image-text relationship analysis in this application embodiment is a global image-text relationship analysis, which can associate images and text content displayed across pages. When users search for images related to text content across pages, they can quickly find the related images through the display effect of the text content, or they can find the related images by clicking on the text content, without users wasting a lot of time searching across pages.

[0160] In addition, the methods provided in the embodiments of this application can also serve as a basic module of an automated document processing system, providing support for subsequent tasks such as document analysis and knowledge extraction in the automated document processing system.

[0161] The methods described above in this application also demonstrate significant application value in the field of education. Accurate analysis of text-image relationships can solve key problems in the process of understanding test papers. For example, for intelligent problem-solving systems, the accurate text-image relationship analysis results in this application's embodiments enable the system to fully understand the question information, avoiding comprehension biases caused by unclear text-image connections. Furthermore, for knowledge point extraction systems, the clear text-image relationship analysis results in this application's embodiments help the system more accurately analyze the knowledge scope involved in the questions. Finally, for test question difficulty analysis systems, the system can use the complexity of the text-image relationships (or connections) analyzed in the examples of this application to help assess the cognitive difficulty of the questions.

[0162] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the processes of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described in the embodiments of this application. In addition, it should be noted that the process details involved in one embodiment of this application are also applicable to other embodiments in a similar manner, or different embodiments may be combined.

[0163] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0164] Furthermore, the various method embodiments can be implemented individually or in combination.

[0165] It is understood that, in order to achieve the above functions, the aforementioned electronic device includes hardware and / or software modules corresponding to perform each function. Based on the algorithmic steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0166] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0167] This application also provides an electronic device. For example... Figure 12 As shown, the electronic device may include one or more processors 1201, memory 1202 and communication interface 1203.

[0168] The memory 1202, communication interface 1203, and processor 1201 are coupled together. For example, the memory 1202, communication interface 1203, and processor 1201 can be coupled together via bus 1204.

[0169] The communication interface 1203 is used for data transmission with other devices. The memory 1202 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1201, cause the electronic device to perform the graphic-text relationship display method described in this embodiment.

[0170] The processor 1201 may be a processor or controller, such as a CPU, a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0171] Bus 1204 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Bus 1204 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 12 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0172] This application also provides a computer-readable storage medium that includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the relevant method steps described in the above method embodiments.

[0173] This application also provides a computer program product that, when run on a computer, causes the computer to execute the relevant method steps described in the above method embodiments.

[0174] The electronic devices, computer-readable storage media, or computer program products provided in this application are all used to perform the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0175] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0176] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0177] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0178] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0179] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for displaying text-image relationships, characterized in that, include: Obtain a first document; the first document includes non-image content and at least one image, the non-image content including at least one text content associated with each of the images; When the content of the first document is displayed, the associated images and text content are displayed with the same display effect.

2. The method according to claim 1, characterized in that, The non-image content includes first text content, and the at least one image includes a first image, which is associated with the first text content; the method further includes: In response to receiving a first operation on the first text content, the first image is displayed; or, In response to receiving a second operation on the first image, the first text content is displayed.

3. The method according to claim 1 or 2, characterized in that, The at least one image includes a second image, and the method further includes: When the content of the first document is displayed, if the currently displayed content includes the second image, then prompt information corresponding to at least one of the text contents associated with the second image is displayed.

4. The method according to claim 3, characterized in that, At least one of the aforementioned text contents corresponds to a prompt message including a first prompt message; the method further includes: In response to receiving a third operation on the first prompt message, the text content corresponding to the first prompt message is displayed.

5. The method according to any one of claims 1-4, characterized in that, The non-image content includes second text content, and the method further includes: When the content of the first document is displayed, if the currently displayed content includes the second text content, then a prompt message corresponding to the third image associated with the second text content is displayed.

6. The method according to claim 5, characterized in that, The method further includes: Display prompt information corresponding to the third text content associated with the third image.

7. The method according to claim 5 or 6, characterized in that, The method further includes: In response to receiving a fourth operation that provides a prompt message corresponding to the third image, the third image is displayed.

8. The method according to claim 6, characterized in that, The method further includes: In response to receiving a fifth operation that provides a prompt message corresponding to the third text content, the third text content is displayed.

9. The method according to any one of claims 1-8, characterized in that, The display effect includes at least one of color, border, background, or shadow.

10. The method according to any one of claims 1-9, characterized in that, The images include pictures or tables.

11. The method according to claim 10, characterized in that, The text content includes data, and the image associated with the text content includes statistical content related to the data. The data and the statistical content are displayed with the same display effect.

12. The method according to claim 10, characterized in that, The data exists in text descriptions or tables.

13. The method according to any one of claims 1-12, characterized in that, After obtaining the first document, the method further includes: Obtain the non-image content and at least one image from the first document; Semantic analysis is performed on the non-image content, and content analysis is performed on at least one image; the content analysis includes analysis of at least one of the following: the location of the image in the first document, the type of the image, and the text included in the image; Based on the semantic analysis results of the non-image content and the content analysis results of at least one image, at least one text content associated with each of the images is determined in the non-image content.

14. An electronic device, characterized in that, The device includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the graphic-text relationship display method as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that, The method includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the graphic-text relationship display method as described in any one of claims 1-13.

16. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the graphic-text relationship display method as described in any one of claims 1-13.

Images