Picture dynamic display method and device, electronic equipment and storage medium
By performing content recognition and segmentation on images, the explanation modules were determined, enabling dynamic display of images. This solved the problem of poor explanation effects caused by static display and improved the speaker's presentation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-28
- Publication Date
- 2026-03-24
AI Technical Summary
In existing technologies, the images presented in online and offline scenarios are static and cannot be combined with the focus of the explanation, which greatly reduces the effectiveness of the explanation.
By performing content recognition on the images to be displayed, the content to be displayed in multiple images and the content to be explained in preset images are determined, thereby determining the explanation module, and the images are split to form a dynamic display.
It reduces visual distractions during the speaker's presentation, allowing the audience to focus more on the content and improving the presentation's effectiveness.
Smart Images

Figure CN115062173B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of artificial intelligence technology, and in particular to a method and apparatus for dynamic image display, electronic device, and computer-readable storage medium. Background Technology
[0002] Currently, in education, training, and related fields, speakers use systematic presentation tools for online and offline scenario demonstrations. However, because the content is static—each page displays all images simultaneously—it cannot be tailored to the speaker's specific focus during the presentation. This significantly diminishes the effectiveness of the presentation. Therefore, improving the effectiveness of speakers' presentations has become a pressing technical problem. Summary of the Invention
[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.
[0004] The main objective of this application is to provide a method and apparatus for dynamic image display, an electronic device, and a computer-readable storage medium, which aims to improve the speaker's presentation effect.
[0005] To achieve the above objectives, a first aspect of this application proposes a method for dynamically displaying images, the method comprising:
[0006] Perform content recognition on the image to be displayed to obtain the display content of multiple images in the image to be displayed;
[0007] Based on the content displayed in the multiple images and the obtained preset image explanation content, at least one explanation module is determined from the images to be displayed;
[0008] The image to be displayed is split into multiple sub-images to be explained based on the multiple explanation modules, wherein each sub-image to be explained corresponds to at least one explanation module;
[0009] Each of the images to be explained is displayed in sequence to form a dynamic display of the images to be displayed.
[0010] The image dynamic display method provided in the embodiments of this application has at least the following beneficial effects:
[0011] By performing content recognition on the images to be displayed, multiple image display contents can be identified. These contents are then combined with the speaker's pre-defined image explanations to determine the speaker's specific explanation module within each image. In other words, the speaker's required explanation portion within the image is identified. Based on this determined explanation module, the image can be broken down into its content to be explained. All images to be explained constitute the content the speaker needs to present during their presentation. These sub-images are then displayed sequentially to create a dynamic display of the images to be presented. This reduces unnecessary visual distractions during the speaker's presentation, allowing the audience to focus more on the content the speaker is currently emphasizing, thus improving the effectiveness of the presentation.
[0012] In some embodiments, the image to be displayed is split into multiple sub-images to be explained based on the multiple explanation modules, including:
[0013] For each of the explanation modules, determine the explanation order of the sub-images to be explained corresponding to the explanation module;
[0014] The content of the image to be displayed is split according to the order of explanation to obtain the sub-image to be explained.
[0015] Since the speaker explains the images to be displayed based on preset image explanation content, each explanation module of the speaker corresponds to a relevant explanation order, allowing the speaker to explain in the order. Therefore, the explanation order of the sub-images to be explained can be determined according to the explanation module, and then the content can be split from the images to be displayed according to the explanation order to obtain the sub-images to be explained as required by the speaker.
[0016] In some embodiments, the content of the image to be displayed is split according to the described explanation order to obtain the sub-image to be explained, including:
[0017] According to the described explanation order, the explanation content associated with the explanation module is extracted from the image to be displayed;
[0018] By combining the explanation module and the explanation content, the sub-image to be explained is obtained.
[0019] Since the explanation module is already determined, the associated explanation content can be extracted from the image to be displayed based on it. In other words, both the explanation module and the associated explanation content belong to the speaker's explanation part. Therefore, the explanation module and the explanation content can be combined to obtain the sub-image to be explained that the speaker needs. That is, the sub-image to be explained that the speaker needs can be extracted from the image to be displayed.
[0020] In some embodiments, each of the sub-images to be explained is sequentially displayed to form a dynamic display of the images to be displayed, including:
[0021] Each of the images to be explained is displayed sequentially according to the order of the explanations, thus creating a dynamic display of the images to be displayed.
[0022] Since the order in which each sub-image to be explained is predetermined, the sub-images can be displayed sequentially according to this predetermined order, thus creating a dynamic display of the images to be shown.
[0023] In some embodiments, based on the content displayed in the plurality of images and the obtained preset image explanation content, at least one explanation module is determined from the images to be displayed, including:
[0024] A consistency judgment is made between the displayed content of the multiple images and the obtained preset image explanation content to obtain a judgment result;
[0025] Based on the judgment result, at least one explanation module is determined from the images to be displayed.
[0026] Since the preset image explanation content may not correspond to the actual image display content, further judgment is needed in this regard. That is, it is necessary to determine whether there are any corresponding parts between the multiple image display contents and the obtained preset image explanation content. Based on the judgment result, at least one corresponding explanation module can be accurately determined from the images to be displayed.
[0027] In some embodiments, the preset image explanation content includes at least one sub-image explanation content, and the step of determining at least one explanation module from the image to be displayed based on the judgment result includes:
[0028] When it is determined that the judgment result includes the fact that the sub-image explanation content is the same as the target image display content, the target image display content is determined from the image to be displayed as the explanation module corresponding to the sub-image explanation content, wherein the target image display content includes at least one of the image display contents.
[0029] If the preset image explanation content includes at least one sub-image explanation content, and the determination result is that the sub-image explanation content is the same as the target image display content, it means that the target image display content is compatible with the sub-image explanation content. Therefore, it can be determined from the image to be displayed that the target image display content is the explanation module corresponding to the sub-image explanation content, that is, the explanation module corresponding to the speaker's speech content can be accurately and reliably found.
[0030] In some embodiments, the method further includes:
[0031] If it is determined that the judgment result includes the fact that the explanation content of the sub-image is different from the content displayed in the target image, it is determined from the image to be displayed that there is no explanation module corresponding to the explanation content of the sub-image.
[0032] If the preset image explanation content includes at least one sub-image explanation content, and the determination result is that the sub-image explanation content is different from the target image display content, it means that the display content of any one or more images in the image to be displayed does not correspond to the preset image explanation content. Therefore, it can be determined that there is no explanation module corresponding to the sub-image explanation content in the image to be displayed.
[0033] To achieve the above objectives, a second aspect of this application provides an image dynamic display device, the device comprising:
[0034] The first processing module is used to perform content recognition on the image to be displayed, and obtain the display content of multiple images in the image to be displayed;
[0035] The second processing module is used to determine at least one explanation module from the images to be displayed based on the multiple image display contents and the obtained preset image explanation contents;
[0036] The third processing module is used to split the image to be displayed into multiple sub-images to be explained according to the multiple explanation modules, wherein each sub-image to be explained corresponds to at least one explanation module;
[0037] The fourth processing module is used to sequentially display each of the images to be explained in order to form a dynamic display of the images to be displayed.
[0038] To achieve the above objectives, a third aspect of this application provides an electronic device, which includes a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for enabling communication between the processor and the memory. When the program is executed by the processor, it implements the method described in the first aspect above.
[0039] To achieve the above objectives, a fourth aspect of the present application provides a storage medium, which is a computer-readable storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement the method described in the first aspect.
[0040] The image dynamic display method, apparatus, electronic device, and storage medium proposed in this application identify the content of the image to be displayed to determine multiple image display contents. Then, the image display contents are combined with the speaker's pre-set image explanation content to determine the speaker's explanation module within the image to be displayed. In other words, the explanation portion required by the speaker within the image to be displayed is determined. Based on the determined explanation module, the image to be displayed can be broken down into content segments to obtain the images to be explained by the speaker. All images to be explained constitute the image content that the speaker needs to display during the explanation. Based on this, each segment of images to be explained is displayed sequentially to form a dynamic display of the images to be displayed. This reduces unnecessary visual distractions during the speaker's explanation, allowing the audience to focus more on the content the speaker is currently emphasizing, thus improving the speaker's explanation effectiveness.
[0041] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the description, claims and drawings. Attached Figure Description
[0042] Figure 1 This is a flowchart of the image dynamic display method provided in the embodiments of this application;
[0043] Figure 2 yes Figure 1 The flowchart of step S102 in the document;
[0044] Figure 3 yes Figure 2 The flowchart of step S202 in the text;
[0045] Figure 4 yes Figure 1 The flowchart of step S103 in the process;
[0046] Figure 5 yes Figure 4 The flowchart of step S302 in the document;
[0047] Figure 6 yes Figure 1 The flowchart of step S104 in the process;
[0048] Figure 7 This is a schematic diagram of the images to be shown provided in the embodiments of this application;
[0049] Figure 8 This is a schematic diagram of the structure of the image dynamic display device provided in the embodiments of this application;
[0050] Figure 9This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0051] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0052] It should be noted that although functional modules are divided in the device schematic diagram and a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than the module division in the device or the order in the flowchart. The terms "first," "second," etc., in the specification, claims, and the aforementioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
[0053] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0054] First, let's analyze some of the terms used in this application:
[0055] Artificial intelligence (AI) is a new branch of computer science that studies, develops, and applies theories, methods, technologies, and systems to simulate, extend, and expand human intelligence. It aims to understand the essence of intelligence and produce intelligent machines that can react in a way similar to human intelligence. Research in this field includes robotics, speech recognition, image recognition, natural language processing, and expert systems. AI can simulate the information processes of human consciousness and thought. Furthermore, AI utilizes digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceiving the environment, acquiring knowledge, and using that knowledge to achieve optimal results.
[0056] Natural Language Processing (NLP): NLP uses computers to process, understand, and utilize human language (such as Chinese and English). NLP is a branch of artificial intelligence and an interdisciplinary field of computer science and linguistics, often referred to as computational linguistics. NLP includes syntactic analysis, semantic analysis, and discourse understanding. It is commonly used in machine translation, handwritten and printed character recognition, speech recognition and text-to-speech conversion, intent recognition, information extraction and filtering, text classification and clustering, sentiment analysis, and opinion mining. It involves data mining, machine learning, knowledge acquisition, knowledge engineering, artificial intelligence research, and linguistic research related to language computation.
[0057] Based on this, embodiments of this application provide a method and apparatus for dynamic image display, an electronic device, and a computer-readable storage medium. By performing content recognition on the image to be displayed, multiple image display contents can be determined. Then, the image display contents are combined with the speaker's preset image explanation content to determine the speaker's explanation module in the image to be displayed. In other words, the explanation part required by the speaker in the image to be displayed is determined. Based on the determined explanation module, the content of the image to be displayed can be split to obtain the image to be explained by the speaker. All images to be explained are the image content that the speaker needs to display during the explanation. On this basis, each image to be explained is displayed in sequence to form a dynamic display of the image to be displayed. This can reduce unnecessary visual interference during the speaker's explanation, allowing the audience to focus more on the explanation content that the speaker is currently emphasizing, which is conducive to improving the speaker's explanation effect.
[0058] The image dynamic display method, apparatus, electronic device, and computer-readable storage medium provided in this application are specifically described through the following embodiments. First, the image dynamic display method in this application embodiment is described.
[0059] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.
[0060] Foundational technologies for artificial intelligence generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies mainly encompass computer vision, robotics, biometrics, speech processing, natural language processing, and machine learning / deep learning.
[0061] The image dynamic display method provided in this application relates to the field of artificial intelligence technology. This image dynamic display method can be applied to a terminal, a server, or software running on either a terminal or a server. In some embodiments, the terminal can be a smartphone, tablet, laptop, desktop computer, etc.; the server can be configured as an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms; the software can be an application implementing the image dynamic display method, but is not limited to the above forms.
[0062] This application can be used in a wide variety of general-purpose or special-purpose computer system environments or configurations. Examples include: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, and distributed computing environments including any of the above systems or devices. This application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform specific tasks or implement specific abstract data types. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.
[0063] Figure 1 This is an optional flowchart of the image dynamic display method provided in the embodiments of this application. Figure 1 The method may include, but is not limited to, steps S101 to S104.
[0064] Step S101: Perform content recognition on the image to be displayed to obtain the display content of multiple images in the image to be displayed;
[0065] Step S102: Based on the content displayed in multiple images and the obtained preset image explanation content, determine at least one explanation module from the images to be displayed;
[0066] Step S103: The content of the image to be displayed is split according to the multiple explanation modules to obtain multiple sub-images to be explained, wherein each sub-image to be explained corresponds to at least one explanation module;
[0067] Step S104: Display each sub-image to be explained in turn to form a dynamic display of the images to be displayed.
[0068] Steps S101 to S104, as illustrated in this embodiment, involve content recognition of the image to be displayed to determine multiple image display contents. These contents are then combined with the speaker's pre-defined image explanation content to determine the speaker's explanation module within the image to be displayed. In other words, the explanation portion required by the speaker within the image to be displayed is determined. Based on the determined explanation module, the image to be displayed can be broken down into its content to obtain the images to be explained by the speaker. All images to be explained constitute the image content that the speaker needs to display during the explanation. These sub-images are then displayed sequentially to form a dynamic display of the images to be displayed. This reduces unnecessary visual distractions during the speaker's explanation, allowing the audience to focus more on the content the speaker is currently emphasizing, thus improving the speaker's explanation effectiveness.
[0069] In step S101 of some embodiments, the method for content recognition of the image to be displayed can be varied and is not limited here. For example, the image to be displayed can be input into a pre-trained image recognition model to obtain a first output result of the image recognition model, and the first output result can be used as the display content of multiple images in the image to be displayed; another example is that multiple images to be displayed can be input into a neural network for recognition training to obtain a new training model, and then the images to be displayed can be input into the new training model to obtain its second output result, and the second output result can be used as the display content of multiple images in the image to be displayed; yet another example is that the content contained in the image to be displayed can be identified through optical character recognition (OCR) technology, and the identified content is the image display content.
[0070] In step S101 of some embodiments, the specific number and content of the image display can be various and can be identified by those skilled in the art according to the specific scenario. That is to say, the number and content of the image display can be different in different scenarios, and there is no limitation here.
[0071] In step S102 of some embodiments, the type of preset image explanation content can be various, and is not limited here. For example, the speaker may set the relevant content to be explained for the image to be displayed as the preset image explanation content; or, without the speaker's involvement, the speaker may analyze historical scenarios of explaining images similar to the image to be displayed, summarize the speaker's explanation habits, and set corresponding preset image explanation content based on these habits.
[0072] Please see Figure 2 In some embodiments, step S102 may include, but is not limited to, steps S201 to S202:
[0073] Step S201: Perform a consistency judgment on the content displayed in multiple images and the content of the preset image explanation obtained, and obtain the judgment result;
[0074] Step S202: Based on the judgment result, determine at least one explanation module from the images to be displayed.
[0075] In this step, since the preset image explanation content may not correspond to the actual image display content, it is necessary to further judge this part, that is, to judge whether there is a corresponding part between the multiple image display contents and the obtained preset image explanation content. Based on the judgment result, at least one corresponding explanation module can be accurately determined from the images to be displayed.
[0076] In step S201 of some embodiments, the main purpose of consistency judgment is to confirm whether the multiple image display contents and the obtained preset image explanation contents correspond and match. Those skilled in the art can use various methods to make the judgment in specific application scenarios, and there is no limitation here. For example, image recognition technology can be used to identify and compare the multiple image display contents and the obtained preset image explanation contents one by one to determine their consistency; another example is to use a feature extraction model to obtain the salient features of the multiple image display contents and the obtained preset image explanation contents respectively, and then compare the similarity between these salient features to determine their consistency.
[0077] In step S202 of some embodiments, the number of explanation modules determined is not limited. That is, based on the consistency difference between the multiple image display contents and the obtained preset image explanation contents, one corresponding explanation module may be obtained, or multiple corresponding explanation modules may be obtained.
[0078] Please see Figure 3 In some embodiments, when the preset image explanation content includes at least one sub-image explanation content, step S202 may include, but is not limited to, step S2021:
[0079] Step S2021: When it is determined that the judgment result includes the same sub-image explanation content and target image display content, the target image display content is determined from the images to be displayed as the explanation module corresponding to the sub-image explanation content, wherein the target image display content includes at least one image display content.
[0080] In this step, if the preset image explanation content includes at least one sub-image explanation content, and the determination result is that the sub-image explanation content is the same as the target image display content, it means that the target image display content is compatible with the sub-image explanation content. Therefore, it can be determined from the image to be displayed that the target image display content is the explanation module corresponding to the sub-image explanation content, that is, the explanation module corresponding to the speaker's speech content can be accurately and reliably found.
[0081] In step S2021 of some embodiments, the meaning of the target image display content including at least one image display content is that: the sub-image explanation content may correspond to one image display content or multiple image display contents. The specific situation needs to be analyzed according to the actual scenario, and no substantial limitation is made here.
[0082] In some embodiments, the method for dynamically displaying images may also include, but is not limited to, step S2022:
[0083] Step S2022: When it is determined that the judgment result includes the fact that the content of the sub-image explanation is different from the content displayed in the target image, it is determined from the image to be displayed that there is no explanation module corresponding to the content of the sub-image explanation.
[0084] In this step, if the preset image explanation content includes at least one sub-image explanation content, and the determination result shows that the sub-image explanation content is different from the target image display content, it means that the display content of any one or more images in the image to be displayed does not correspond to the preset image explanation content. Therefore, it can be determined that there is no explanation module corresponding to the sub-image explanation content in the image to be displayed.
[0085] In step S103 of some embodiments, each sub-image to be explained corresponds to at least one explanation module, which means that each sub-image to be explained may correspond to one or more explanation modules. The specific situation needs to be determined according to the actual scenario, and is not limited here.
[0086] Please see Figure 4 In some embodiments, step S103 may include, but is not limited to, steps S301 to S302:
[0087] Step S301: For each explanation module, determine the explanation order of the sub-images to be explained corresponding to the explanation module;
[0088] Step S302: According to the order of explanation, the content of the image to be displayed is split into sub-images to be explained.
[0089] In this step, since the speaker explains the images to be displayed based on preset image explanation content, each explanation module of the speaker corresponds to a relevant explanation order, so that the speaker can explain in the explanation order. Therefore, the explanation order of the sub-images to be explained corresponding to the explanation module can be determined according to the explanation module, and then the content can be split from the images to be displayed according to the explanation order to obtain the sub-images to be explained required by the speaker.
[0090] In step S301 of some embodiments, if multiple explanation modules correspond to the same sub-image to be explained, then the speaker can simultaneously explain the sub-image to be explained based on the multiple explanation modules. That is to say, there may be multiple sub-images to be explained with the same explanation order, which also falls within the protection scope of the embodiments of this application.
[0091] In step S302 of some embodiments, the specific method for splitting the content from the image to be displayed can be varied and is not limited here. For example, image editing software can be used to split the content of the image to be displayed to obtain the sub-image to be explained, etc.
[0092] Please see Figure 5 In some embodiments, step S302 may include, but is not limited to, steps S3021 to S3022:
[0093] Step S3021: Extract the explanation content associated with the explanation module from the images to be displayed according to the explanation order;
[0094] Step S3022: Combine the explanation module and the explanation content to obtain the sub-image to be explained.
[0095] In this step, since the explanation module is already determined, the associated explanation content can be extracted from the image to be displayed based on it. In other words, both the explanation module and the associated explanation content belong to the speaker's explanation part. Therefore, the explanation module and the explanation content can be combined to obtain the sub-image to be explained that the speaker needs. That is, the sub-image to be explained that the speaker needs can be extracted from the image to be displayed.
[0096] In step S3021 of some embodiments, the position of the explanation content associated with the explanation module in the image to be displayed is not limited. That is, it is sufficient to determine that the explanation content is associated with the explanation module, without concern about whether it is adjacent or in a corresponding position in the image to be displayed. For example, the explanation content associated with one of the explanation modules may appear in the upper left corner of the image to be displayed, or it may appear in the lower right corner of the image to be displayed, which is acceptable.
[0097] In step S302 of some embodiments, the combination of the explanation module and the explanation content can be in various ways, and is not limited here. For example, the determined explanation module and explanation content can be input into a pre-trained image combination model, and the output result of the model can be obtained and used as the sub-image to be explained; or, commonly used image stitching software in the art can be used to combine the determined explanation module and explanation content to obtain the sub-image to be explained.
[0098] In step S104 of some embodiments, the number of each sub-image to be explained displayed sequentially is not necessarily all. That is, in some scenarios, only a portion of the sub-images to be explained can be selected from each sub-image to be explained, and then the selected portion of sub-images to be explained can be displayed sequentially. This is also one of the implementation methods of this application.
[0099] Please see Figure 6 In some embodiments, step S104 may include, but is not limited to, step S401:
[0100] Step S401: Display each sub-image to be explained in turn according to the order of explanation to form a dynamic display of the images to be displayed.
[0101] In this step, since the order in which each sub-image to be explained is already determined, the sub-images can be displayed sequentially according to the determined order, thus creating a dynamic display of the images to be shown. This reduces unnecessary visual distractions for the speaker during the presentation, allowing the audience to focus more on the content the speaker is currently emphasizing, which is beneficial for improving the speaker's presentation effectiveness.
[0102] To better illustrate the working principle and process of the embodiments of this application, the following description is provided in conjunction with specific examples.
[0103] Example 1:
[0104] Please see Figure 7 , Figure 7 This is a schematic diagram of an image to be displayed provided in an embodiment of this application. Taking an image to be displayed as an example, the specific execution steps are as follows:
[0105] Step S501: Identify the image content contained in the image to be displayed using OCR, and understand the speaker's explanatory text content corresponding to the image to be displayed through semantic understanding;
[0106] Step S502: The content is gradually broken down according to semantic understanding. Specifically, the image to be displayed includes a main title and two subtitles. The corresponding explanation section first explains the main title and then gradually explains the content corresponding to the two subtitles. Based on the semantic understanding of the image content and the explanation content, the image to be displayed is broken down into three explanation modules, namely the main title, subtitle one, and subtitle two.
[0107] Step S503: Based on the separated explanation modules, extract the corresponding parts of each module in the image to be displayed. Specifically, the main title part includes the main title and the corresponding text content, the subtitle part includes subtitle one and the corresponding text content, and the subtitle two part includes subtitle two and the corresponding text content. Extract the above-mentioned related explanation modules and image content from the image to be displayed.
[0108] Step S504: For the image to be displayed, the image content is displayed step by step in the order of splitting, that is, the main title part of the image to be displayed is displayed first, then the first subtitle part is displayed, and finally the second subtitle part is displayed.
[0109] Understandably, although Figure 7 This example uses a single image to illustrate the concept, but the same steps apply to multiple images. Each image can be processed in this way, creating a complete dynamic display solution. This helps the speaker gradually display content according to the key points of their presentation, reducing unnecessary visual distractions and allowing the audience to focus more on the main points, thus improving the effectiveness of the presentation.
[0110] It should be noted that the embodiments of this application can be applied not only to education and training, but also to insurance sales, intermediary sales, and other fields. They can assist in the display of content playback modes and have broad application prospects.
[0111] Please see Figure 8 This application also provides an image dynamic display device that can implement the above-described image dynamic display method. The device includes:
[0112] The first processing module is used to perform content recognition on the image to be displayed, and obtain the display content of multiple images in the image to be displayed;
[0113] The second processing module is used to determine at least one explanation module from the images to be displayed based on the content displayed in multiple images and the obtained preset image explanation content.
[0114] The third processing module is used to split the content of the image to be displayed according to the multiple explanation modules, and obtain multiple sub-images to be explained, wherein each sub-image to be explained corresponds to at least one explanation module;
[0115] The fourth processing module is used to sequentially display each sub-image to be explained in order to form a dynamic display of the images to be shown.
[0116] The first processing module performs content recognition on the images to be displayed to determine the content to be displayed in multiple images. Then, the second processing module combines the image display content with the speaker's preset image explanation content to determine the speaker's explanation module in the image to be displayed. In other words, it determines the part of the image that the speaker needs to explain. The third processing module can then break down the image to be displayed based on the determined explanation module to obtain the images to be explained by the speaker. All the images to be explained are the image content that the speaker needs to show during the explanation. On this basis, the fourth processing module sequentially displays each image to be explained to form a dynamic display of the images to be displayed. This can reduce unnecessary visual interference during the speaker's explanation, allowing the audience to focus more on the content that the speaker is currently emphasizing, which is conducive to improving the speaker's explanation effect.
[0117] The specific implementation of this dynamic image display device is basically the same as the specific embodiment of the dynamic image display method described above, and will not be repeated here.
[0118] This application also provides an electronic device, which includes: a memory, a processor, a program stored in the memory and executable on the processor, and a data bus for communication between the processor and the memory. When the program is executed by the processor, it implements the above-described dynamic image display method. This electronic device can be any smart terminal, including tablet computers, in-vehicle computers, etc.
[0119] Please see Figure 9 , Figure 9 The hardware structure of an electronic device according to another embodiment is illustrated. The electronic device includes:
[0120] The processor 901 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.
[0121] The memory 902 can be implemented as a read-only memory (ROM), static storage device, dynamic storage device, or random access memory (RAM). The memory 902 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 902 and called and executed by the processor 901. Specifically, the image dynamic display method of this application embodiment is implemented by recognizing the content of the image to be displayed to determine multiple image display contents. Then, the image display contents are combined with the speaker's preset image explanation content to determine the speaker's explanation module in the image to be displayed. In other words, the explanation portion required by the speaker in the image to be displayed is determined. Based on the determined explanation module, the image to be displayed can be split into content segments to obtain the images to be explained by the speaker. All images to be explained are the image content that the speaker needs to display during the explanation. Based on this, each segment of images to be explained is displayed sequentially to form a dynamic display of the images to be displayed. This can reduce unnecessary visual interference during the speaker's explanation, allowing the audience to focus more on the explanation content that the speaker is currently emphasizing, thus improving the speaker's explanation effect.
[0122] The input / output interface 903 is used to implement information input and output;
[0123] The communication interface 904 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, Ethernet cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).
[0124] Bus 905 transmits information between various components of the device (e.g., processor 901, memory 902, input / output interface 903, and communication interface 904);
[0125] The processor 901, memory 902, input / output interface 903, and communication interface 904 are connected to each other within the device via bus 905.
[0126] This application embodiment also provides a storage medium, which is a computer-readable storage medium for computer-readable storage. The storage medium stores one or more programs, which can be executed by one or more processors to implement the above-mentioned dynamic image display method. That is, by performing content recognition on the image to be displayed, multiple image display contents can be determined from it. Then, the image display contents are combined with the speaker's preset image explanation content to determine the speaker's explanation module in the image to be displayed. In other words, the explanation part required by the speaker in the image to be displayed is determined. Based on the determined explanation module, the content of the image to be displayed can be split to obtain the image to be explained by the speaker. All images to be explained are the image content that the speaker needs to display during the explanation. On this basis, each image to be explained is displayed in sequence to form a dynamic display of the image to be displayed. This can reduce unnecessary visual interference during the speaker's explanation, allowing the audience to focus more on the explanation content that the speaker is currently emphasizing, which is conducive to improving the speaker's explanation effect.
[0127] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0128] The image dynamic display method, device, electronic device, and storage medium provided in this application embodiment identify the content of the image to be displayed to determine multiple image display contents. Then, the image display contents are combined with the speaker's preset image explanation content to determine the speaker's explanation module within the image to be displayed. In other words, the explanation portion required by the speaker within the image to be displayed is determined. Based on the determined explanation module, the image to be displayed can be broken down into content segments to obtain the images to be explained by the speaker. All images to be explained constitute the image content that the speaker needs to display during the explanation. Based on this, each segment of images to be explained is displayed sequentially to form a dynamic display of the images to be displayed. This reduces unnecessary visual interference during the speaker's explanation, allowing the audience to focus more on the explanation content that the speaker is currently emphasizing, thus improving the speaker's explanation effect.
[0129] The embodiments described in this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.
[0130] It will be understood by those skilled in the art that Figures 1-7 The technical solutions shown do not constitute a limitation on the embodiments of this application, and may include more or fewer steps than shown, or combine certain steps, or different steps.
[0131] The foregoing has described specific embodiments of this application; other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims may be performed in a different order than those shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily have to follow the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0132] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, devices, and computer-readable storage media are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0133] The apparatus, device, computer-readable storage medium and method provided in the embodiments of this application are corresponding. Therefore, the apparatus, device and non-volatile computer storage medium also have similar beneficial technical effects as the corresponding method. Since the beneficial technical effects of the method have been described in detail above, the beneficial technical effects of the corresponding apparatus, device and computer storage medium will not be described again here.
[0134] In the 1990s, improvements to a technology could be clearly distinguished as either hardware improvements (e.g., improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the methodology). However, with technological advancements, many improvements to the methodology today can be considered direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved methodology into the hardware circuit. Therefore, it cannot be said that an improvement to the methodology cannot be implemented using hardware physical modules.
[0135] For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is an integrated circuit whose logic function is determined by the user programming the device. Designers can program a digital system onto a PLD themselves, eliminating the need for chip manufacturers to design and fabricate dedicated integrated circuit chips. Furthermore, instead of manually fabricating integrated circuit chips, this programming is now mostly implemented using "logic compiler" software, similar to the software compiler used in program development. The source code before compilation must be written in a specific programming language called a Hardware Description Language (HDL). There is not just one type of HDL, but many, such as:
[0136] ABEL (Advanced Boolean Expression Language); AHDL (Altera Hardware Description Language); Confluence; CUPL (Cornell University Programming Language); HDCal; and JHDL (Java Hardware Description Language); Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. Currently, among the technologies in this field, VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog are more commonly used. Those skilled in the art should also understand that by simply performing some logic programming on the method flow using the aforementioned hardware description languages and programming it into an integrated circuit, the hardware circuit implementing the logical method flow can be easily obtained.
[0137] The controller can be implemented in any suitable manner. For example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) that can be executed by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers:
[0138] The memory controller, including the ARC 625D, Atmel AT91SAM, Microchip IP address PIC18F26K20, and Silicon Labs C8051F320, can also be implemented as part of the memory's control logic. Those skilled in the art will also recognize that, in addition to implementing the controller as purely computer-readable program code, the same functionality can be achieved by logically programming the method steps, making the controller function as logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers (PLCs), and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the devices included within it for implementing various functions can also be considered structures within that hardware component. Alternatively, the devices for implementing various functions can be considered as both software modules implementing the method and structures within a hardware component.
[0139] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.
[0140] For ease of description, the above apparatus is described by dividing it into various functional units. Of course, in implementing the embodiments of this application, the functions of each unit can be implemented in one or more software and / or hardware.
[0141] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, embodiments of this application can take the form of entirely hardware embodiments, entirely software embodiments, or embodiments combining software and hardware aspects. Furthermore, embodiments of this application can take the form of computer program products implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0142] This specification is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0143] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0144] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 Figure 1 The steps of the function specified in one or more boxes.
[0145] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0146] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0147] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.
[0148] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0149] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.
[0150] The embodiments of this application can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. The embodiments of this application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In a distributed computing environment, program modules can reside in local and remote computer storage media, including storage devices.
[0151] The various embodiments in this application are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0152] The above description is merely an embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of this application should be included within the scope of the claims of this application.
Claims
1. A method for dynamically displaying images, characterized in that, include: Multiple images to be displayed are input into a neural network for recognition and training to obtain a new training model. The images to be displayed are then input into the new training model to obtain a second output result. The second output result is used as the display content of multiple images in the images to be displayed. A consistency judgment is made between the displayed content of the multiple images and the obtained preset image explanation content to obtain a judgment result; wherein, the preset image explanation content includes at least one sub-image explanation content; When it is determined that the judgment result includes the same content of the sub-image explanation as the content of the target image display, the content of the target image display is determined from the image to be displayed as the explanation module corresponding to the content of the sub-image explanation, wherein the content of the target image display includes at least one of the image display contents; If it is determined that the judgment result includes that the explanation content of the sub-image is different from the display content of the target image, then it is determined from the image to be displayed that there is no explanation module corresponding to the explanation content of the sub-image. For each of the explanation modules, determine the explanation order of the sub-images to be explained corresponding to the explanation module; According to the explanation order, the content of the image to be displayed is split into sub-images to be explained, wherein each sub-image to be explained corresponds to at least one explanation module; Each of the images to be explained is displayed in sequence to form a dynamic display of the images to be displayed.
2. The method for dynamically displaying images according to claim 1, characterized in that, The step of splitting the content of the image to be displayed according to the described explanation order to obtain the sub-image to be explained includes: According to the described explanation order, the explanation content associated with the explanation module is extracted from the image to be displayed; By combining the explanation module and the explanation content, the sub-image to be explained is obtained.
3. The method for dynamically displaying images according to claim 2, characterized in that, The step of sequentially displaying each of the sub-images to be explained to form a dynamic display of the images to be displayed includes: Each of the images to be explained is displayed sequentially according to the order of the explanations, thus creating a dynamic display of the images to be displayed.
4. A dynamic image display device, characterized in that, include: The first processing module is used to input multiple images to be displayed into a neural network for recognition training to obtain a new training model, and then input the images to be displayed into the new training model to obtain a second output result, and use the second output result as the display content of multiple images in the images to be displayed; The second processing module is used for: A consistency judgment is made between the displayed content of the multiple images and the obtained preset image explanation content to obtain a judgment result; wherein, the preset image explanation content includes at least one sub-image explanation content; When it is determined that the judgment result includes the same content of the sub-image explanation as the content of the target image display, the content of the target image display is determined from the image to be displayed as the explanation module corresponding to the content of the sub-image explanation, wherein the content of the target image display includes at least one of the image display contents; If it is determined that the judgment result includes that the explanation content of the sub-image is different from the display content of the target image, then it is determined from the image to be displayed that there is no explanation module corresponding to the explanation content of the sub-image. The third processing module is used to determine the explanation order of the sub-images to be explained corresponding to each explanation module; and to split the content of the images to be displayed according to the explanation order to obtain sub-images to be explained, wherein each sub-image to be explained corresponds to at least one explanation module; The fourth processing module is used to sequentially display each of the images to be explained in order to form a dynamic display of the images to be displayed.
5. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, it implements the dynamic image display method as described in any one of claims 1 to 3.
6. A computer-readable storage medium, characterized in that, The device stores computer-executable instructions for performing the image dynamic display method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Method, device and system for realizing pseudo field interpretation
CN106534618A
Image processing method and device, electronic equipment and computer readable storage medium
CN111415399A