Display content replacement method and device and storage medium

Abstract

The invention discloses a display content replacement method and device and a storage medium. According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, carrying out replacement processing on the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content; and performing content combination on the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content except the abnormal content in the initial display content to obtain a content replacement signal. Therefore, the content identification operation and the content replacement operation can be executed on the initial content signal at the slave end, so that the problem that the content identification operation of the host end on the display content is possibly found by the application to a great extent in the related technology, and the subsequent filtering operation on the display content is invalid can be avoided; therefore, the replacement for the display content is realized.

Description

Technical Field

[0001] The present application relates to the technical field of content replacement, and in particular to a method, device and storage medium for replacing displayed content. Background Art

[0002] With the widespread dissemination and sharing of displayed content, ensuring the suitability of displayed content has become an important technical challenge. For example, illegal content in displayed content needs to be filtered to maintain a good community environment. In related technologies, content recognition and content filtering operations are usually performed on the host side. Since the application corresponding to the displayed content also acts on the host side, the content recognition operation of the host side on the displayed content may be discovered by the application to a large extent. In this case, the application may change the display strategy for the content, thereby causing the subsequent filtering operation on the displayed content to fail.

[0003] Therefore, how to achieve replacement of displayed content is a key issue that those skilled in the art are concerned about. Summary of the invention

[0004] Based on the above problems, the present application provides a method, device and storage medium for replacing display content to achieve replacement of display content.

[0005] The embodiments of the present application disclose the following technical solutions:

[0006] In a first aspect, the present application provides a method for replacing display content. The method for replacing display content is applied to a slave device, and the method for replacing display content includes:

[0007] Receiving an initial content signal corresponding to the initial display content output by the host;

[0008] Performing recognition processing on the initial content signal according to a content recognition model to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content, wherein the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0009] According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content;

[0010] Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0011] The content replacement signal is output to a display, so that the display replacement content corresponding to the content replacement signal is displayed through the display.

[0012] In an achievable implementation manner, the identifying and processing the initial content signal according to the content identification model to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content includes:

[0013] Performing content recognition on the initial content signal according to a content recognition model to obtain abnormal content in the initial display content;

[0014] The abnormal content in the initial display content is analyzed according to the content recognition model to obtain dot matrix coordinate information corresponding to the abnormal content in the initial display content.

[0015] In an achievable implementation manner, before replacing the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content, the method further includes:

[0016] Acquire a dot matrix coordinate storage library, wherein the dot matrix coordinate storage library is used to provide target dot matrix coordinate information that is the same as the dot matrix coordinate information;

[0017] The replacing the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content includes:

[0018] Extracting coordinates from the dot matrix coordinate storage repository according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtaining target dot matrix coordinate information in the dot matrix coordinate storage repository that is the same as the dot matrix coordinate information;

[0019] According to the target dot matrix coordinate information, obtaining target display content corresponding to the target dot matrix coordinate information, wherein the target display content is different from the abnormal content;

[0020] The abnormal content in the initial display content is replaced according to the target display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content.

[0021] In an achievable implementation manner, replacing the abnormal content in the initial display content according to the target display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content includes:

[0022] Superimposing the target display content and the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content;

[0023] Alternatively, deleting abnormal content in the initial display content;

[0024] The target display content is used as abnormal replacement content corresponding to the abnormal content in the initial display content.

[0025] The second aspect of the present application provides a method for replacing display content. The method for replacing display content is applied to a host, and the method for replacing display content includes:

[0026] Outputting an initial content signal corresponding to the initial display content to the slave device;

[0027] receiving dot matrix coordinate information corresponding to abnormal content in the initial display content output by the slave, wherein the dot matrix coordinate information is obtained by the slave performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0028] According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content;

[0029] Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0030] The content replacement signal is output to a display, so that the display replacement content corresponding to the content replacement signal is displayed through the display.

[0031] In an achievable implementation manner, before combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain the content replacement signal, the method further includes:

[0032] Obtaining a target duration for the slave to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content;

[0033] According to the target duration, the output time point of the display content other than the abnormal content in the initial display content is delayed to obtain the delay duration of the display content other than the abnormal content in the initial display content.

[0034] In an achievable implementation manner, combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal includes:

[0035] According to the delay time, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content are synchronously combined to obtain a content replacement signal.

[0036] The third aspect of the present application provides a display content replacement device. The display content replacement device is applied to a slave device, and the display content replacement device includes:

[0037] A content signal receiving unit, configured to receive an initial content signal corresponding to the initial display content output by the host;

[0038] a dot matrix coordinate obtaining unit, configured to perform recognition processing on the initial content signal according to a content recognition model, and obtain dot matrix coordinate information corresponding to abnormal content in the initial display content, wherein the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0039] an abnormal content replacement unit, configured to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain abnormal replacement content corresponding to the abnormal content in the initial display content;

[0040] a replacement signal obtaining unit, configured to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0041] The replacement signal output unit is used to output the content replacement signal to the display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0042] In an achievable implementation manner, the lattice coordinate obtaining unit is specifically used for:

[0043] Performing content recognition on the initial content signal according to a content recognition model to obtain abnormal content in the initial display content;

[0044] The abnormal content in the initial display content is analyzed according to the content recognition model to obtain dot matrix coordinate information corresponding to the abnormal content in the initial display content.

[0045] In one feasible embodiment, the device further includes:

[0046] A coordinate storage repository acquiring unit, used for acquiring a dot matrix coordinate storage repository, wherein the dot matrix coordinate storage repository is used for providing target dot matrix coordinate information that is the same as the dot matrix coordinate information;

[0047] The abnormal content replacement unit comprises:

[0048] a dot matrix coordinate extraction unit, configured to extract coordinates from the dot matrix coordinate storage repository according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain target dot matrix coordinate information in the dot matrix coordinate storage repository that is identical to the dot matrix coordinate information;

[0049] A display content obtaining unit, configured to obtain, according to the target dot matrix coordinate information, a target display content corresponding to the target dot matrix coordinate information, wherein the target display content is different from the abnormal content;

[0050] The replacement content obtaining unit is used to replace the abnormal content in the initial display content according to the target display content, and obtain the abnormal replacement content corresponding to the abnormal content in the initial display content.

[0051] In an achievable implementation manner, the replacement content obtaining unit is specifically configured to:

[0052] Superimposing the target display content and the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content;

[0053] Alternatively, deleting abnormal content in the initial display content;

[0054] The target display content is used as abnormal replacement content corresponding to the abnormal content in the initial display content.

[0055] In a fourth aspect, the present application provides a display content replacement device. The display content replacement device is applied to a host, and the display content replacement device includes:

[0056] A content signal output unit, configured to output an initial content signal corresponding to the initial display content to the slave device;

[0057] a dot matrix coordinate receiving unit, configured to receive dot matrix coordinate information corresponding to abnormal content in the initial display content output by the slave, wherein the dot matrix coordinate information is obtained by the slave performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0058] an abnormal content replacement unit, configured to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain abnormal replacement content corresponding to the abnormal content in the initial display content;

[0059] a replacement signal obtaining unit, configured to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0060] The replacement signal output unit is used to output the content replacement signal to the display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0061] In one feasible embodiment, the device further includes:

[0062] A target duration acquisition unit, used for acquiring a target duration for the slave to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content;

[0063] The delay duration acquisition unit is used to delay the output time point of the display content in the initial display content except the abnormal content according to the target duration, so as to obtain the delay duration of the display content in the initial display content except the abnormal content.

[0064] In an achievable implementation manner, the replacement signal obtaining unit is specifically used to:

[0065] According to the delay time, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content are synchronously combined to obtain a content replacement signal.

[0066] In a fifth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the program implements the steps of the display content replacement method provided in the first aspect, or implements the steps of the display content replacement method provided in the second aspect.

[0067] Compared with the prior art, this application has the following beneficial effects:

[0068] In the present application, an initial content signal corresponding to the initial display content output by the host is first received; thereafter, the initial content signal is identified and processed according to a content identification model to obtain dot matrix coordinate information corresponding to the abnormal content in the initial display content, and the abnormal content in the initial display content is replaced according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content; finally, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content are combined to obtain a content replacement signal, and the content replacement signal is output to a display to display the display replacement content corresponding to the content replacement signal through the display.

[0069] It can be seen that in the present application, the initial content signal output by the host side can be received, so that the initial content signal can be subjected to content recognition and content replacement operations at the slave side. In this way, the operations performed by the host side and the slave side can be isolated, so that the problem that the content recognition operation of the host side on the displayed content may be discovered by the application to a large extent in the related art, thereby causing the subsequent filtering operation on the displayed content to fail, thereby achieving the replacement of the displayed content. And in the present application, the replacement of the displayed content can be achieved based on the dot matrix coordinate information, which can meet the accuracy of the content replacement to a certain extent. In addition, since the present application is based on real-time reasoning of the display screen, that is, in the present application, there is no need to understand the implementation method of the specific application, nor does it rely on the specific module, resources and layout of the display information, and it is not restricted by the system platform, it can be used across platforms, which improves the flexibility of use. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0071] Figure 1 A flowchart of a method for replacing display content provided in an embodiment of the present application;

[0072] Figure 2 A flowchart of content identification and replacement in a method for replacing displayed content provided in an embodiment of the present application;

[0073] Figure 3 A flowchart of another method for replacing display content provided in an embodiment of the present application;

[0074] Figure 4 A flowchart of content identification and replacement in another method for replacing displayed content provided in an embodiment of the present application;

[0075] Figure 5 A schematic diagram of the structure of a device for replacing display content provided in an embodiment of the present application;

[0076] Figure 6 A schematic diagram of the structure of another device for replacing display content provided in an embodiment of the present application. DETAILED DESCRIPTION

[0077] As described above, with the widespread dissemination and sharing of display content, ensuring the suitability of display content has become an important technical challenge. For example, illegal content in display content needs to be filtered to maintain a good community environment. In related technologies, content identification and content filtering operations are usually performed on the host side, in which blacklist and whitelist methods are usually used to identify and filter display content. For example, if the encoding feature of the page element corresponding to the display content is on the blacklist, the display content is not displayed.

[0078] And because the application corresponding to the displayed content also acts on the host side, the content recognition operation of the host side for the displayed content may be discovered by the application to a large extent, so the application may change the display strategy for the content, for example, the application may change the coding features of the page elements corresponding to the displayed content to bypass the content recognition operation, thereby causing the subsequent filtering operation for the displayed content to fail. Therefore, how to achieve the replacement of the displayed content is a key issue that technicians in this field are concerned about.

[0079] In view of the above problems, a solution is provided in the embodiment of the present application, and a method, device and storage medium for replacing display content are proposed, aiming to achieve replacement of display content. The technical solution of the present application is applied to the slave. Specifically, the initial content signal corresponding to the initial display content output by the host is first received. After that, the received initial content signal can be identified and processed according to the content recognition model to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and the abnormal content in the initial display content can be replaced according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content. Finally, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content can be combined to obtain a content replacement signal, and the content replacement signal is output to the display to display the display replacement content corresponding to the content replacement signal through the display.

[0080] In this way, the slave end in the present application can receive the initial content signal output by the host end, and perform content recognition operations and content replacement operations on the initial content signal at the slave end, so that the operations performed by the host end and the slave end can be isolated, so that the problem that the content recognition operation of the host end on the display content in the related art may be discovered by the application to a large extent, thereby causing the subsequent filtering operation on the display content to fail, thereby achieving the replacement of the display content. And in the present application, the content recognition model is used to perform the content recognition operation, which can ensure the accuracy of content recognition, and can achieve the replacement of the display content based on the dot matrix coordinate information, which can meet the accuracy of content replacement to a certain extent. In addition, since the present application is based on real-time reasoning of the display screen, that is, in the present application, there is no need to understand the implementation method of the specific application, nor does it rely on the specific module, resource and layout of the display information, and it is not restricted by the system platform, it can be used across platforms, which improves the flexibility of use.

[0081] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0082] See also Figure 1 , which is a flow chart of a method for replacing display content provided by an embodiment of the present application. Figure 1 The method for replacing the displayed content shown is applied to the slave, and the method for replacing the displayed content includes:

[0083] S101: receiving an initial content signal corresponding to initial display content output by a host.

[0084] In this step, the initial display content can be understood as the content that needs to be displayed on the display screen, and the initial display content is the content that needs to be subjected to content recognition in the subsequent process. The initial display content can be a picture, and the initial display content can also be a video, wherein the video can be a recorded video or a real-time video. It should be noted that the actual form of the initial display content is not limited here, and the actual form of the initial display content can also be determined in actual applications.

[0085] It should also be noted that since the application corresponding to the initial display content is supported and implemented in the host, that is, the host can support the application to generate the initial display content, the initial display content generated by the host can be output to the slave machine, so that the slave machine can receive the initial content signal corresponding to the initial display content output by the host, so that subsequent content recognition operations and content replacement operations can be performed on the slave machine.

[0086] The substance transmitted between the host and the slave in this application is a content signal, which can guarantee the quality and efficiency of the transmitted content to a certain extent, and can reduce the risk of the content being intercepted and stolen during the transmission process. In addition, the use of content signals for transmission in this application can also be implemented in a cross-platform manner, without being restricted by the system platform, to complete the transmission and display of the displayed content.

[0087] Furthermore, the host can be understood as a server, which is supported by the first system; the slave can be understood as a server, which can also be understood as a terminal device, which is supported by the second system, wherein the terminal device includes a personal computer and a handheld computer, and the terminal device is not limited here. And the first system and the second system are independent systems, so that the operations performed by the host end and the slave end can be isolated, and it can also avoid the problem in the related art that the content recognition operation of the host end for the displayed content may be discovered by the application to a large extent, thereby causing the subsequent filtering operation for the displayed content to fail, so that the replacement of the displayed content in the subsequent process can be achieved.

[0088] S102: performing recognition processing on the initial content signal according to a content recognition model to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content.

[0089] In this step, the content recognition model is used to determine the abnormal content and the dot matrix coordinate information corresponding to the abnormal content. Among them, the dot matrix coordinate information is represented in the form of a dot matrix (or grid), and each dot or grid unit corresponds to a specific position in the abnormal content signal, so that the position information of the abnormal content can be determined more accurately, which is convenient for the subsequent content replacement operation on the abnormal content. And the abnormal content can be understood as part of the initial display content that is not in line with expectations, unusual, or has specific characteristics (such as safety hazards, erroneous display, etc.), such as abnormal content can be content with exposed human body parts, abnormal content can also be copyright infringement content, etc.

[0090] Specifically, in the present application, the content recognition of the initial content signal can be performed according to the content recognition model to obtain the abnormal content in the initial display content, and thereafter, the abnormal content in the initial display content can be parsed according to the content recognition model to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content, wherein the dot matrix coordinate information can not only determine the content position corresponding to the abnormal content, but also accurately determine the position edge of the content position corresponding to the abnormal content. In this way, in the present application, the abnormal content in the initial display content and the dot matrix coordinate information corresponding to the abnormal content can be identified under the action of the content recognition model, so that the recognition accuracy of the model can be improved to a certain extent, so that the replacement operation of the abnormal content can be more appropriately implemented in the subsequent process.

[0091] Next, the construction process of the content recognition model is introduced. Specifically, first, multiple sample display contents and display content labels corresponding to the multiple sample display contents can be obtained, wherein the display content labels include abnormal label contents in each sample display content and dot matrix coordinate label information corresponding to the abnormal label contents, and the abnormal label contents in each sample display content can be manually identified, and the dot matrix coordinate label information corresponding to the abnormal label contents can also be manually identified.

[0092] After that, the multiple sample display contents can be input into the recognition model to be trained, so as to perform content recognition on the multiple sample display contents through the recognition model to be trained, and obtain the abnormal prediction contents corresponding to the multiple sample display contents and the dot matrix coordinate prediction information corresponding to the multiple abnormal prediction contents. Finally, according to the difference between the multiple abnormal label contents and the multiple abnormal prediction contents, and the difference between the multiple dot matrix coordinate label information and the multiple dot matrix coordinate prediction information, the parameters of the recognition model to be trained are adjusted until the adjusted model meets the model training cutoff condition, and the training is completed to obtain the content recognition model, in which one abnormal label content corresponds to one abnormal prediction content, and one dot matrix coordinate label information corresponds to one dot matrix coordinate prediction information.

[0093] It should be noted that in the present application, a content recognition model can be trained based on an open source model algorithm, wherein the open source model algorithm includes yolo, and the content recognition model can be locally deployed and inferred by an independent slave machine when applied, that is, it does not rely on the network when applied. In this way, the content recognition model can have the characteristics of rapid response, and to a certain extent can avoid the limitations and potential risks that may be brought about by relying on third-party specific engines, such as data leakage, and enhance the flexibility and scalability of model training.

[0094] In this way, the content recognition model constructed through image deep learning in the present application can directly identify the initial content signal to obtain abnormal content in the initial displayed content. Compared with the related technology that relies on the database and the black and white lists composed of specific identifiers to identify and match abnormal content, the present application can still identify the application that has changed the illegal content, the display form of the advertisement or the identifier characteristics, and the present application also avoids the problem of the system being invaded and mixed into the white list.

[0095] In one example, when the usage scenario is a video conference, there is a possibility that the corners of the participant's screen may be illegal in the video (that is, the video can be understood as the initial display content). The present application can automatically block the illegal content in the video, while the rest of the content in the video is displayed normally, that is, the illegal part of the screen seen by the terminal user on the display is automatically blocked, thereby avoiding embarrassment while maintaining the smooth integrity of the meeting, and no conference software participation is required.

[0096] S103: According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain abnormal replacement content corresponding to the abnormal content in the initial display content.

[0097] It should be noted that, before executing step S103, the present application may also obtain a dot matrix coordinate storage library, wherein the dot matrix coordinate storage library is a storage library constructed in advance, and the dot matrix coordinate storage library is used to provide target dot matrix coordinate information that is the same as the dot matrix coordinate information, wherein the display content corresponding to the dot matrix coordinate information is different from the display content corresponding to the target dot matrix coordinate information. For example, the display content corresponding to the dot matrix coordinate information may be content A, and the display content corresponding to the target dot matrix coordinate information may be content B, that is, the location information of content A and content B is the same, but the representation forms of content A and content B are different.

[0098] Specifically, in the present application, firstly, coordinate extraction can be performed on the dot coordinate storage library according to the dot coordinate information corresponding to the abnormal content in the initial display content to obtain the target dot coordinate information in the dot coordinate storage library that is the same as the dot coordinate information, and then the target display content corresponding to the target dot coordinate information can be obtained according to the target dot coordinate information.

[0099] After that, it can be determined whether the abnormal content corresponding to the dot matrix coordinate information and the target display content corresponding to the target dot matrix coordinate information are the same. If the abnormal content corresponding to the dot matrix coordinate information and the target display content corresponding to the target dot matrix coordinate information are the same, the coordinate extraction operation is continuously performed on the dot matrix coordinate storage repository until the abnormal content corresponding to the dot matrix coordinate information and the target display content corresponding to the target dot matrix coordinate information are different; if the abnormal content corresponding to the dot matrix coordinate information and the target display content corresponding to the target dot matrix coordinate information are different, a subsequent content replacement operation is performed.

[0100] Finally, the abnormal content in the initial display content can be replaced according to the target display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content. In this way, in the present application, the slave machine can perform content recognition operations and content replacement operations, avoiding the possibility of the content filtering means in the related technical solutions being perceived by the application, and the present application can realize content replacement based on dot matrix coordinate information, which can improve the flexibility and accuracy of content replacement to a certain extent.

[0101] In a feasible implementation manner, in the present application, the target display content and the abnormal content in the initial display content can be superimposed to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content. It can be understood that in the present application, the target display content can be superimposed on the upper layer of the abnormal content in the initial display content, so that the replacement operation of the display content can be achieved by screen superposition.

[0102] In another achievable implementation, in the present application, the abnormal content in the initial display content can be deleted, and the target display content can be filled to the position corresponding to the target display content. At this time, the target display content can be used as the abnormal replacement content corresponding to the abnormal content in the initial display content, so that the replacement operation of the display content can be implemented by screen filling.

[0103] S104: Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal.

[0104] It should be noted that, before executing step S104, the present application may also process the initial display content according to the abnormal content in the initial display content to obtain the display content other than the abnormal content in the initial display content. Specifically, in this step, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content may be combined to obtain the combined display content, after which the combined display content may be converted to obtain a content replacement signal, so that the transmission accuracy of the display content can be guaranteed to a certain extent.

[0105] S105: Output the content replacement signal to a display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0106] In this step, the slave terminal may output the content replacement signal to the display, so that the display can display the display replacement content corresponding to the content replacement signal, so that the user can view the display replacement content on the display terminal. In this way, it can avoid the problem in the related art that the host terminal's content recognition operation on the display content may be discovered by the application to a large extent, thereby causing the subsequent filtering operation on the display content to fail, and also improve the user experience.

[0107] like Figure 2 As shown, Figure 2 A flowchart of content identification and replacement in a method for replacing displayed content provided in an embodiment of the present application, wherein Figure 2 The interactive process of the host, the slave and the display is shown in . Specifically, in the present application, the initial content signal corresponding to the initial display content output by the host can be received first, after which the slave can perform a content recognition operation on the initial content signal according to the content recognition model to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and the slave can perform a content replacement operation on the abnormal content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content, and finally the slave can output a content replacement signal obtained by combining the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to the display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0108] It can be seen that in the embodiment of the present application, through the series architecture, the slave receives the initial content signal corresponding to the initial display content output by the host, and then the slave outputs the content replacement signal obtained through the content recognition operation and the content replacement operation to the display. In this way, no changes are required to the host, which is simple and easy to use. It can also avoid the problem that the content recognition operation of the host side on the display content in the related technology may be discovered by the application to a large extent, thereby causing the subsequent filtering operation on the display content to fail, thereby realizing the replacement of the display content. In addition, since the present application is based on real-time reasoning of the display screen, that is, in the present application, there is no need to understand the implementation method of the specific application, nor does it rely on the specific modules, resources and layout of the display information, and it is not restricted by the system platform, it can be used across platforms, which improves the flexibility of use.

[0109] See also Figure 3 , which is a flow chart of another method for replacing display content provided by an embodiment of the present application. Figure 3 The method for replacing the displayed content is applied to a host, and the method for replacing the displayed content includes:

[0110] S301: Outputting an initial content signal corresponding to the initial display content to a slave device.

[0111] It should be noted that the slave machine in the present embodiment is mainly used for processing the initial content signal corresponding to the initial display content. At this time, the initial content signal corresponding to the initial display content is output to the slave machine, so that the slave machine can perform subsequent content recognition operations, so as to avoid the problem in the related technology that the content recognition operation of the host side on the display content may be discovered by the application to a large extent, thereby causing the subsequent filtering operation on the display content to fail.

[0112] S302: Receive dot matrix coordinate information corresponding to abnormal content in the initial display content output by the slave device.

[0113] In this step, the dot matrix coordinate information is obtained by the slave machine performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content. It should be noted that the content recognition operation of the slave machine on the initial content signal is the same as the content recognition operation introduced in step S102. The actual application of this process can refer to step S102, so it will not be described in detail here.

[0114] S303: According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain abnormal replacement content corresponding to the abnormal content in the initial display content.

[0115] It should be noted that the content replacement operation performed in this step is the same as the content replacement operation performed in step S103. The only difference is that the content replacement operation is supported by the host in this step, while the content replacement operation is supported by the slave in step S103. The process will not be repeated here.

[0116] S304: Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal.

[0117] It should be noted that before executing this step, the target time for the slave to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content can also be obtained, that is, the time consumed by the slave to perform the content recognition operation. After that, the output time point of the display content other than the abnormal content in the initial display content can be delayed according to the target time, so as to obtain the delay time of the display content other than the abnormal content in the initial display content. Since the slave needs to consume a certain amount of time to perform the content recognition operation, and in order to avoid the problem of synchronous display of the signal output to the display later, and to avoid the problem of deviation in the display content, the output time point of the display content other than the abnormal content in the initial display content can be delayed according to the target time consumed by the slave, so that the display content can be aligned on the time level based on the delay time later.

[0118] Specifically, in this embodiment, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content can be synchronously combined according to the delay time to obtain a content replacement signal. It can be understood that in this embodiment, the problem of display deviation can be solved according to the delay time, that is, in this process, the host will not immediately perform the content combination operation, but can wait for a period of time before performing the content combination operation to ensure that the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content can be aligned at the time level.

[0119] The display content other than the abnormal content in the initial display content can be understood as the bottom picture in the video, the abnormal content in the initial display content can be understood as the top picture in the video, and the waiting period can be the waiting delay period, or it can be the waiting delay period and the period for the host to perform the content replacement operation. In this way, the host can delay the bottom picture in the video (i.e., the display content other than the abnormal content in the initial display content) for a certain period of time and superimpose the content with the processed top picture (i.e., the abnormal replacement content corresponding to the abnormal content in the initial display content) to achieve synchronization, thereby ensuring the smoothness of subsequent content display.

[0120] It should also be noted that the content combination operation performed in this step is similar to the content combination operation performed in step S104. The difference is that this step is supported by the host, while step S104 is supported by the slave. The process will not be repeated here.

[0121] S305: Output the content replacement signal to a display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0122] It should be noted that the signal output operation performed in this step is the same as the signal output operation performed in step S105, the only difference is that the host supports the execution of the signal output operation in this step, and the slave supports the execution of the signal output operation in step S105, and the process will not be repeated here. It should also be noted that the content replacement signal output to the display at this time is the content signal corresponding to the abnormal replacement content after synchronization and the display content other than the abnormal content in the initial display content, which can ensure the consistency and coherence of the display content output by the display, thereby improving the user experience.

[0123] like Figure 4 As shown, Figure 4 A flowchart of content identification and replacement in another method for replacing displayed content provided in an embodiment of the present application, in Figure 4 The interactive process of the host, the slave and the display is shown in the figure. Specifically, in the present application, the host can first output the initial content signal corresponding to the initial display content to the slave, so that the slave performs a content recognition operation on the initial content signal, after which the host can receive the dot matrix coordinate information corresponding to the abnormal content in the initial display content output by the slave. And the host can replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content, and the host can combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal. Finally, the host can output the content replacement signal to the display to display the display replacement content corresponding to the content replacement signal through the display.

[0124] It can be seen that in the embodiment of the present application, the initial content signal corresponding to the initial display content can be output to the slave through the parallel architecture. At this time, the host can process the dot matrix coordinate information corresponding to the abnormal content in the initial display content obtained by the slave, and output the content replacement signal obtained to the display. In this way, the content recognition operation can be performed on the slave side to avoid excessive use of the host and consumption of the host computing power. It can also avoid the problem that the content recognition operation of the host side on the display content in the related technology may be discovered by the application to a large extent, thereby causing the subsequent filtering operation on the display content to fail, thereby realizing the replacement of the display content. In addition, since the present application is based on real-time reasoning of the display screen, that is, in the present application, there is no need to understand the implementation method of the specific application, nor does it rely on the specific module, resource and layout of the display information, and it is not restricted by the system platform, it can be used across platforms, which improves the flexibility of use.

[0125] Based on the display content replacement method provided in the aforementioned embodiment, the present application also provides a display content replacement device accordingly. Figure 5This is a schematic diagram of a structure of a display content replacement device provided in an embodiment of the present application. Figure 5 As shown, the display content replacement device is applied to a slave, and the display content replacement device includes:

[0126] The content signal receiving unit 501 is used to receive an initial content signal corresponding to the initial display content output by the host;

[0127] A dot matrix coordinate obtaining unit 502 is used to perform recognition processing on the initial content signal according to a content recognition model to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content, wherein the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0128] The abnormal content replacement unit 503 is used to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain the abnormal replacement content corresponding to the abnormal content in the initial display content;

[0129] A replacement signal obtaining unit 504 is used to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0130] The replacement signal output unit 505 is configured to output the content replacement signal to a display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0131] In an achievable implementation, the lattice coordinate obtaining unit 502 is specifically used for:

[0132] Performing content recognition on the initial content signal according to a content recognition model to obtain abnormal content in the initial display content;

[0133] The abnormal content in the initial display content is analyzed according to the content recognition model to obtain dot matrix coordinate information corresponding to the abnormal content in the initial display content.

[0134] In one feasible embodiment, the device further includes:

[0135] A coordinate storage repository acquiring unit, used for acquiring a dot matrix coordinate storage repository, wherein the dot matrix coordinate storage repository is used for providing target dot matrix coordinate information that is the same as the dot matrix coordinate information;

[0136] The abnormal content replacement unit 503 includes:

[0137] a dot matrix coordinate extraction unit, configured to extract coordinates from the dot matrix coordinate storage repository according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain target dot matrix coordinate information in the dot matrix coordinate storage repository that is identical to the dot matrix coordinate information;

[0138] A display content obtaining unit, configured to obtain, according to the target dot matrix coordinate information, a target display content corresponding to the target dot matrix coordinate information, wherein the target display content is different from the abnormal content;

[0139] The replacement content obtaining unit is used to replace the abnormal content in the initial display content according to the target display content, and obtain the abnormal replacement content corresponding to the abnormal content in the initial display content.

[0140] In an achievable implementation manner, the replacement content obtaining unit is specifically configured to:

[0141] Superimposing the target display content and the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content;

[0142] Alternatively, deleting abnormal content in the initial display content;

[0143] The target display content is used as abnormal replacement content corresponding to the abnormal content in the initial display content.

[0144] The display content replacement device provided in the embodiment of the present application has the same beneficial effects as the display content replacement method provided in the above embodiment, which will not be described in detail here.

[0145] Based on the display content replacement method provided in the aforementioned embodiment, the present application also provides another display content replacement device accordingly. Figure 6 This is a schematic diagram of the structure of another device for replacing display content provided in an embodiment of the present application. Figure 6 As shown, the display content replacement device is applied to a host, and the display content replacement device includes:

[0146] The content signal output unit 601 is used to output the initial content signal corresponding to the initial display content to the slave device;

[0147] The dot matrix coordinate receiving unit 602 is used to receive the dot matrix coordinate information corresponding to the abnormal content in the initial display content output by the slave, wherein the dot matrix coordinate information is obtained by the slave performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content;

[0148] The abnormal content replacement unit 603 is used to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain the abnormal replacement content corresponding to the abnormal content in the initial display content;

[0149] A replacement signal obtaining unit 604 is used to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal;

[0150] The replacement signal output unit 605 is configured to output the content replacement signal to a display, so as to display the display replacement content corresponding to the content replacement signal through the display.

[0151] In one feasible embodiment, the device further includes:

[0152] A target duration acquisition unit, used for acquiring a target duration for the slave to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content;

[0153] The delay duration acquisition unit is used to delay the output time point of the display content in the initial display content except the abnormal content according to the target duration, so as to obtain the delay duration of the display content in the initial display content except the abnormal content.

[0154] In an achievable implementation manner, the replacement signal obtaining unit 604 is specifically configured to:

[0155] According to the delay time, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content are synchronously combined to obtain a content replacement signal.

[0156] The display content replacement device provided in the embodiment of the present application has the same beneficial effects as the display content replacement method provided in the above embodiment, which will not be described in detail here.

[0157] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, it implements some or all of the steps in the method for replacing the display content applied to the slave described in the above embodiment, or implements some or all of the steps in the method for replacing the display content applied to the host described in the above embodiment.

[0158] It should be noted that the "first" and "second" (if any) in the names such as "first" and "second" mentioned in the embodiments of the present application are only used as name identifiers and do not represent the first or second in order.

[0159] It should also be noted that the various embodiments in this specification are described in a progressive manner, and the same and similar parts between the various embodiments can refer to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is merely schematic, in which the unit described as a separate component may or may not be physically separated, and the component prompted as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0160] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for replacing display content, characterized in that: Applicable to slave devices, including: Receiving an initial content signal corresponding to the initial display content output by the host; Performing recognition processing on the initial content signal according to a content recognition model to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content, wherein the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content; According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content; Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal; The content replacement signal is output to a display, so that the display replacement content corresponding to the content replacement signal is displayed through the display.

2. The method according to claim 1, characterized in that: The identifying and processing the initial content signal according to the content identification model to obtain the dot matrix coordinate information corresponding to the abnormal content in the initial display content includes: Performing content recognition on the initial content signal according to a content recognition model to obtain abnormal content in the initial display content; The abnormal content in the initial display content is analyzed according to the content recognition model to obtain dot matrix coordinate information corresponding to the abnormal content in the initial display content.

3. The method according to claim 1, characterized in that Before replacing the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content, the method further includes: Acquire a dot matrix coordinate storage library, wherein the dot matrix coordinate storage library is used to provide target dot matrix coordinate information that is the same as the dot matrix coordinate information; The replacing the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content includes: Extracting coordinates from the dot matrix coordinate storage repository according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtaining target dot matrix coordinate information in the dot matrix coordinate storage repository that is the same as the dot matrix coordinate information; According to the target dot matrix coordinate information, obtaining target display content corresponding to the target dot matrix coordinate information, wherein the target display content is different from the abnormal content; The abnormal content in the initial display content is replaced according to the target display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content.

4. The method according to claim 3, characterized in that The replacing the abnormal content in the initial display content according to the target display content to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content includes: Superimposing the target display content and the abnormal content in the initial display content to obtain abnormal replacement content corresponding to the abnormal content in the initial display content; Alternatively, deleting abnormal content in the initial display content; The target display content is used as abnormal replacement content corresponding to the abnormal content in the initial display content.

5. A method for replacing displayed content, characterized in that: Applied to the host, including: Outputting an initial content signal corresponding to the initial display content to the slave device; receiving dot matrix coordinate information corresponding to abnormal content in the initial display content output by the slave, wherein the dot matrix coordinate information is obtained by the slave performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content; According to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, the abnormal content in the initial display content is replaced to obtain the abnormal replacement content corresponding to the abnormal content in the initial display content; Combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal; The content replacement signal is output to a display, so that the display replacement content corresponding to the content replacement signal is displayed through the display.

6. The method according to claim 5, characterized in that Before combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain the content replacement signal, the method further includes: Obtaining a target duration for the slave to obtain dot matrix coordinate information corresponding to abnormal content in the initial display content; According to the target duration, the output time point of the display content other than the abnormal content in the initial display content is delayed to obtain the delay duration of the display content other than the abnormal content in the initial display content.

7. The method according to claim 6, characterized in that The step of combining the abnormal replacement content corresponding to the abnormal content in the initial display content with the display content other than the abnormal content in the initial display content to obtain a content replacement signal includes: According to the delay time, the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content are synchronously combined to obtain a content replacement signal.

8. A device for replacing display content, characterized in that: Applicable to slave devices, including: A content signal receiving unit, configured to receive an initial content signal corresponding to the initial display content output by the host; a dot matrix coordinate obtaining unit, configured to perform recognition processing on the initial content signal according to a content recognition model, and obtain dot matrix coordinate information corresponding to abnormal content in the initial display content, wherein the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content; an abnormal content replacement unit, configured to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain abnormal replacement content corresponding to the abnormal content in the initial display content; a replacement signal obtaining unit, configured to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal; The replacement signal output unit is used to output the content replacement signal to the display, so as to display the display replacement content corresponding to the content replacement signal through the display.

9. A device for replacing display content, characterized in that: Applied to the host, including: A content signal output unit, configured to output an initial content signal corresponding to the initial display content to the slave device; a dot matrix coordinate receiving unit, configured to receive dot matrix coordinate information corresponding to abnormal content in the initial display content output by the slave, wherein the dot matrix coordinate information is obtained by the slave performing a content recognition operation on the initial content signal using a content recognition model, and the content recognition model is used to determine the dot matrix coordinate information corresponding to the abnormal content; an abnormal content replacement unit, configured to replace the abnormal content in the initial display content according to the dot matrix coordinate information corresponding to the abnormal content in the initial display content, and obtain abnormal replacement content corresponding to the abnormal content in the initial display content; a replacement signal obtaining unit, configured to combine the abnormal replacement content corresponding to the abnormal content in the initial display content and the display content other than the abnormal content in the initial display content to obtain a content replacement signal; The replacement signal output unit is used to output the content replacement signal to the display, so as to display the display replacement content corresponding to the content replacement signal through the display.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method for replacing display content described in any one of claims 1 to 4 are implemented, or the steps of the method for replacing display content described in any one of claims 5 to 7 are implemented.

Images