Data processing method and device, electronic equipment and storage medium

By analyzing the credibility of devices, objects and generated scenes in multimedia data, providing prompt output, solving the data tampering problem and improving the security and transparency of data propagation.

CN119089423APending Publication Date: 2024-12-06LENOVO (BEIJING) LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411195200.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

Multimedia data is easily tampered with during the dissemination process, resulting in the dissemination of bad information. How to improve the authenticity of multimedia data content to ensure the security of data dissemination is an urgent problem.

Method used

By analyzing the received target data, trusted information about the data content is obtained, and prompt output based on the trusted information during the propagation process, improving the security of data propagation. The specific method includes parsing the first information, obtaining the third information indicating the trustworthiness of the device, object and the generated scene, and prompting it when outputting, ensuring that the user understands the trustworthiness of the data.

Benefits of technology

It effectively improves the accuracy of anti-counterfeiting detection and transparency of multimedia data, helps users to understand the authenticity of data content in a timely manner, thereby enhancing the security of data dissemination.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119089423A_ABST
    Figure CN119089423A_ABST
Patent Text Reader

Abstract

The invention provides a data processing method and device, equipment and a storage medium, and can be applied to the technical field of data processing. The method comprises the following steps: a first device obtains target data sent by at least one second device; the target data and the second equipment are in one-to-one correspondence, the target data comprises first information and second information, and the second information comprises an environment image where the second equipment is located; analyzing the first information to obtain third information; the third information is used for representing the credibility of the second equipment and / or a second object for operating the second equipment and / or a second information generation scene; responding to output of the second information, and performing prompt output based on the third information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and more specifically, to a data processing method, device, electronic device and storage medium. Background Art

[0002] With the development of artificial intelligence, the editing and synthesis of multimedia data are becoming simpler and simpler, and data content is prone to tampering, leading to problems such as the spread of bad information. How to improve the authenticity of multimedia data content to ensure the security of data dissemination is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The first aspect of the present disclosure provides a data processing method, including: a first device obtains target data sent by at least one second device; the target data corresponds to the second device one-to-one, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; the first information is parsed to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the second information generating scene; in response to outputting the second information, a prompt output is performed based on the third information.

[0004] According to an embodiment of the present disclosure, before parsing the first information to obtain the third information, the method also includes: if the first information is stored in the target data in a first form, parsing the target data in a first manner to obtain the first information and the second information; the first form is embedded in an image frame of the target data, and the second information is an image that does not contain the first information; if the first information is stored in the target data in a second form, parsing the target data in a second manner to obtain the first data stream parameters and the second data stream parameters; the second form is the first data stream parameters that constitute the target data, and the second information is an environmental image rendered and generated according to the second data stream parameters.

[0005] According to an embodiment of the present disclosure, parsing the first information and obtaining the third information includes: parsing the first information to obtain attribute information of the second device; if the attribute information represents that the second device is a designated device, obtaining third information reflecting that the second device is a trusted device; if the attribute information represents that the second device is a non-designated device, obtaining third information reflecting that the second device is a non-trusted device; the third information is used to prompt the output of the attributes of the second device when responding to the output of the second information.

[0006] According to an embodiment of the present disclosure, parsing the first information and obtaining the third information includes: parsing the first information to obtain the identity attribute of the second object; if the identity attribute represents that the second object is a target object, obtaining the third information reflecting that the second object is a trusted object; if the identity attribute represents that the second object is not a target object, obtaining the third information reflecting that the second object is an untrusted object; the third information is used to output a prompt for the identity of the second object when outputting the second information in response.

[0007] According to an embodiment of the present disclosure, parsing the first information and obtaining the third information includes: parsing the first information to obtain generation parameters of the second information; if the generation parameters represent that the generation scenario of the second information is a target scenario, obtaining third information reflecting that the generation scenario is a credible scenario; if the generation parameters represent that the generation scenario of the second information is not the target scenario, obtaining third information reflecting that the generation scenario is an untrustworthy scenario; the third information is used to prompt the output of the generation scenario of the second information when responding to the output of the second information.

[0008] According to an embodiment of the present disclosure, the method also includes: when the first device is a target device, displaying the second information and the prompt information on the screen of the first device; when the first device is a transfer device, the first device sends the second information and the prompt information to the target device for display; wherein the prompt information is the third information and / or information processed based on the third information.

[0009] According to an embodiment of the present disclosure, displaying the second information and the prompt information on the screen of the first device includes: displaying the prompt information on top of the second information; or displaying the second information and the prompt information in different areas of the screen.

[0010] The second aspect of the present disclosure provides a data processing device, including: an acquisition module, used to obtain target data sent by at least one second device; the target data corresponds to the second device one-to-one, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; a parsing module, used to parse the first information to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the second information generating scene; an output module, used to respond to the output of the second information and perform prompt output based on the third information.

[0011] The third aspect of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors perform the following operations: a first device obtains target data sent by at least one second device; the target data corresponds one-to-one with the second device, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; the first information is parsed to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the second information generating scene; in response to outputting the second information, a prompt output is performed based on the third information.

[0012] A computer-readable storage medium disclosed herein stores executable instructions, which, when executed by a processor, cause the processor to perform the following operations: a first device obtains target data sent by at least one second device; the target data corresponds to the second device one-to-one, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; the first information is parsed to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the second information generating scene; and in response to outputting the second information, a prompt output is performed based on the third information. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0014] Figure 1 A diagram schematically illustrates an application scenario of a data processing method, device, electronic device, and storage medium according to an embodiment of the present disclosure;

[0015] Figure 2 A flowchart schematically shows a data processing method according to an embodiment of the present disclosure;

[0016] Figure 3 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0017] Figure 4 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0018] Figure 5 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0019] Figure 6 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0020] Figure 7 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0021] Figure 8 Schematically showing an example diagram of displaying prompt information on a screen of a first device according to an embodiment of the present disclosure;

[0022] Fig. 9 Schematically showing the display mode of the second information and the prompt information according to the embodiment of the present disclosure;

[0023] Fig.10 A block diagram schematically shows a data processing device according to an embodiment of the present disclosure; and

[0024] Fig.11 A block diagram of an electronic device suitable for implementing the data processing method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0026] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0027] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0028] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0029] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0030] The embodiments of the present disclosure provide a data processing method and device. Before introducing the technical solutions provided by the embodiments of the present disclosure, the related technologies and scenarios involved in the present disclosure are first described.

[0031] Multimedia data communication refers to the process of delivering information to the audience in various forms (such as text, images, audio, video, etc.) through various media and channels. For example, information is delivered to the audience through broadcasting, the audience is made aware of the form and details of things through pictures, or video content is transmitted and displayed in a seamless and real-time manner so that the audience can see the events happening in time, such as video conferencing and live broadcasting.

[0032] In the process of multimedia data transmission, the data content may be tampered with, changing the integrity and authenticity of the original data, leading to the spread of bad / false content. For example, by removing, adding, or splicing the image content, the information or intention to be expressed by the original image is changed; by editing the video, inserting frames, deleting frames, tampering with the target features in the image (such as replacing the facial features of a person in the image, modifying the tone and timbre of the voice, etc.), the real content and intention to be expressed by the original video are changed.

[0033] The exemplary embodiments of the present disclosure perform multi-dimensional detection on received target data to obtain credible information about data content, and output prompts based on the credible information during data dissemination, thereby improving the security of data dissemination.

[0034] Figure 1 The application scenario diagram of the data processing method, device, electronic device and storage medium according to the embodiments of the present disclosure is schematically shown.

[0035] like Figure 1 As shown, the application scenario 100 according to this embodiment may include a first device 101, a second device 102, a second device 103, and a network 104. The network 104 is used to provide a medium for a communication link between the first device 101, the second device 102, and the second device 103. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0036] The user can use the first device 101 to interact with the second device 102 or the second device 103 through the network 104 to receive or send messages, etc.

[0037] The second device 102 and the second device 103 can be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers and desktop computers, etc., on which various communication client applications can be installed, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only as examples).

[0038] The first device 101 may be an electronic device having similar functions and configurations as the second device 102 and the second device 103. It may also be a transfer device different from the second device 102 and the second device 103 for receiving, processing, and forwarding data, wherein the first device 101 may include, for example, a server, which may be used to analyze and process the received data sent by the second device, and feed back the processing results to the second device or other devices.

[0039] It should be noted that the data processing method provided in the embodiment of the present disclosure can generally be executed by the first device 101. Accordingly, the data processing apparatus provided in the embodiment of the present disclosure can generally be set in the first device 101.

[0040] It should be understood that Figure 1 The number of devices and networks in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided as required.

[0041] The following will be based on Figure 1 The scene described by Figure 2~Figure 8 The data processing method of the disclosed embodiment is described in detail.

[0042] Figure 2 The flowchart of the data processing method according to the embodiment of the present disclosure is schematically shown.

[0043] like Figure 2 As shown, the method includes operations S210 to S230.

[0044] In operation S210, target data transmitted by at least one second device is obtained.

[0045] In some embodiments, the first device receives target data sent by the second device in real time. The target data is data transmitted after being processed by the second device, and the target data corresponds to the second device one by one. Specifically, the target data includes first information and second information, the first information is used to reflect the relevant attributes of the second information, and the second information includes the environment image where the second device is located.

[0046] Taking a video conference scenario as an example, in a video conference scenario, the number of participating devices is not less than two. The first device is a device for receiving target data sent by the second device, for example, it can be a participating device, or it can be a transit device for processing and forwarding data (such as a server or platform that hosts a video conference), and the second device is a participating device for sending target data. In the same video conference scenario, the first device and the second device can be converted to each other in different participating devices, and the same participating device can be both the first device and the second device.

[0047] In operation S220, the first information is parsed to obtain third information.

[0048] In some embodiments, a parsing operation is performed on the first information in the target data, and the third information is obtained based on the parsing result of the first information, wherein the first information includes parameters related to the second information, for example, parameters related to the content in the second information and / or parameters related to the generation process of the second information.

[0049] The second information can be verified for anti-counterfeiting through the first information, and the third information can be obtained based on the result of the anti-counterfeiting verification, wherein the third information is used to indicate the credibility of at least one of the second device, the second object operating the second device, and the second information generation scenario.

[0050] In operation S230, in response to outputting the second information, a prompt output is performed based on the third information.

[0051] In some embodiments, the second information is prompted and output based on the third information, so that the user can obtain the credibility of the second information in a timely manner while browsing the second information, effectively improving the security of information dissemination. The information outputted by the prompt may be, for example, the third information, or prompt information obtained based on the third information.

[0052] In combination with the video conferencing scenario of operation S210, if the first device is a participating device, the second information is directly output on the screen of the first device and a prompt output is performed based on the third information; if the first device is a transfer device, the first device sends the second information and the third information to the designated device, outputs the second information on the screen of the designated device, and a prompt output is performed based on the third information.

[0053] The disclosed embodiment performs a credible verification of the received data in multiple dimensions based on the received first information, obtains credible results of the data in multiple dimensions, and outputs the data based on the credible results. Verifying the credible data from multiple dimensions can effectively improve the accuracy of anti-counterfeiting detection of multimedia data, and outputting the data based on the credible results can help users understand the authenticity of the multimedia data content in a timely manner, and improve the transparency and security of data dissemination.

[0054] Figure 3 The flowchart schematically shows a data processing method according to another embodiment of the present disclosure.

[0055] like Figure 3 As shown, in Figure 2 In terms of the data processing method shown in FIG. 1 , the data processing method of this embodiment further includes operations S310 to S340. It should be noted that for other implementation details not described in the data processing method of this embodiment, please refer to Figure 2 The embodiment of the data processing method will not be described in detail here.

[0056] In operation S310, target data transmitted by at least one second device is obtained.

[0057] In some embodiments, operation S310 is performed with Figure 2 The operation details of operation S210 in the embodiments are the same and will not be described again.

[0058] In operation S320, the target data is parsed to obtain first information and second information.

[0059] In some embodiments, the first information may be stored in the target data in different forms, wherein the first information in different forms is obtained in different ways.

[0060] The storage form of the first information may include a first form and a second form. When the storage form of the first information is the first form, the first information is embedded in the image frame of the target data, and when the storage form of the first information is the second form, the first information is used as a first data stream parameter constituting the target data.

[0061] In the case where the first information is stored in the target data in the first form, the target data is parsed by the first method to obtain the first information and the second information. The first method may be an extraction operation corresponding to the embedding operation, and the first information and the second information may be extracted from the image frame by executing the extraction operation, and the second information is an image that does not contain the first information (i.e., the image frame after the first information is extracted). The embedding operation of the first information may be, for example, digital watermark technology or steganography, and accordingly, the first method may include digital watermark extraction and steganography extraction.

[0062] Among them, steganography may include, for example, the least significant bit (LSB) steganography, discrete wavelet transform (DWT) steganography, etc. Among them, the embedding method of LSB steganography is to embed the first information into the image frame by modifying the least significant bit of the image pixel. The first method can obtain the first information by checking and recovering the least significant bit of each pixel in the target data image frame, and use the target data image frame after extracting the first information as the second information. The embedding method of DWT steganography is to embed the first information into the wavelet coefficients of the image frame by performing wavelet transform on the image frame. The first method performs wavelet transform on the received target data image frame with the same transform parameters, and extracts the first information from the selected wavelet coefficients to obtain the first information and the second information.

[0063] Digital watermarking technology selects certain bits of pixels (such as the least significant bit LSB) or specific coefficients (such as discrete cosine transform coefficients) in the image frame as the embedding position, encodes the information to be embedded, converts it into a format suitable for embedding, and then embeds the encoded information into the image frame. The first method extracts the watermark information embedded in the image from the target data image frame through a specific watermark detection algorithm, and restores the image frame at the embedded position to obtain the first information and the second information, where the watermark information is the first information and the restored image is the second information.

[0064] It is understandable that, in order to ensure the security and privacy of the target data, the second device may perform an encryption operation on the first information based on the key before embedding the first information into the second information in the first form, and then embed the encrypted first information into the second information in the first form. Then, the first device parses the target data in the first way, and obtaining the first information and the second information should also include: decrypting the encrypted first information in the target data to obtain the first information. The encryption method may be, for example, symmetric encryption or asymmetric encryption.

[0065] In the case where the first information is stored in the target data in the second form, the target data is parsed by the second method to obtain the first data stream parameter and the second data stream parameter. Among them, the second method parses the target data through the communication protocol and data format between the first device and the second device to obtain the first data stream parameter and the second data stream parameter. The first data stream parameter contains the first information, and the second information is the environmental data generated by rendering according to the second data stream parameter. Specifically, when the first device receives the target data, it first parses the data body according to the transmission protocol, and then parses the parameters in the data body (i.e., the first data stream parameter and the second data stream parameter) according to the data format. It should be noted that at this time, the target data transmitted by the second device is not the image itself, but the data stream parameters (i.e., the second data stream parameters) describing the image are passed to the first device. After receiving the data stream parameters, the first device will use the corresponding algorithm or graphics engine to render and generate the second information according to the data stream parameters.

[0066] In operation S330, the first information is parsed to obtain third information.

[0067] In some embodiments, operation S330 is performed with Figure 2 The operation details of operation S220 in the embodiments are the same and will not be described in detail here.

[0068] In operation S340, in response to outputting the second information, a prompt output is performed based on the third information.

[0069] In some embodiments, operation S340 is performed with Figure 2 The operation details of operation S220 in the embodiments are the same and will not be described in detail here.

[0070] The disclosed embodiment obtains the first information and the second information by parsing the target data. The first information can help the first device trace back to the original generation scene, generation device and original content of the second information, and help the first device quickly determine the credibility of the second information through the first information, thereby improving the accuracy and efficiency of determining the credibility of the second information. Among them, storing the first information in the target data in the first form can improve the concealment of the first information without causing additional transmission burden. Storing the first information in the target data in the second form can effectively improve the flexibility and controllability of the first information. Those skilled in the art can choose the storage method of the first information according to actual conditions, and the present disclosure does not limit it here.

[0071] Figure 4 The flowchart of a data processing method according to another embodiment of the present disclosure is schematically shown.

[0072] like Figure 4 As shown, in Figure 2In terms of the technology of the data processing method shown in FIG. 1 , operation S220 in the data processing method of this embodiment may further include operations S221a to S223a. It should be noted that for other implementation details not described in the data processing method of this embodiment, please refer to Figure 2 The embodiment of the data processing method will not be described in detail here.

[0073] In operation S221a, the first information is parsed to obtain attribute information of the second device.

[0074] In some embodiments, the first information is parsed to obtain attribute information of the second device, wherein the attribute information of the second device may include, for example, a device name, a serial number, an access location, etc. of the second device.

[0075] In operation S222a, if the attribute information indicates that the second device is a designated device, third information reflecting that the second device is a trusted device is obtained.

[0076] In operation S223a, if the attribute information indicates that the second device is an undesignated device, third information reflecting that the second device is an untrusted device is obtained.

[0077] In some embodiments, after obtaining the attribute information of the second device, the attribute information of the second device is analyzed based on the reference device information to determine whether the second device is a designated device, and corresponding third information is obtained based on the analysis result. The reference device information may be reserved device attribute information and / or historical device attribute information. The reserved device attribute information may be the attribute information registered when the account is first registered, or the attribute information modified by the account after verification. The historical device attribute information may be the attribute information of commonly used devices determined based on the historical usage of the account.

[0078] The second device corresponding to the current target data is verified based on the historical device attribute information and / or the reserved device attribute information to obtain third information used to characterize the credibility of the second device. For example, it is determined whether the device name and serial number of the second device attribute information are consistent with the designated device / common device in the reserved device attribute information and / or the historical device attribute information, and the use of the device is determined; it is determined whether the access location of the second device is consistent with the access location in the reserved device attribute information and / or the historical device attribute information, wherein the access location may further include a physical location, a network interface location, a logical location, etc.

[0079] And based on the verification result, corresponding third information is obtained. Specifically, if the verification result is that the verification is passed (that is, the attribute information indicates that the second device is a designated device), the third information reflecting that the second device is a trusted device is obtained. If the verification result is that the verification is not passed (that is, the attribute information indicates that the second device is not a designated device), the third information reflecting that the second device is an untrusted device is obtained.

[0080] The present disclosure verifies the trustworthiness of the second device to ensure that the source of the second information is trustworthy, thereby quickly determining the authenticity of the data content. Trustworthy devices usually have higher security and stability. Therefore, if the attribute information characterizes that the second device is a designated device, the third information reflecting that the second device is a trusted device is obtained. In addition, by verifying whether the second device is a designated device, it is also possible to ensure that the data content has not been illegally tampered with or replaced during transmission, thereby reducing the security risk of the second information.

[0081] Figure 5 The flowchart of a data processing method according to another embodiment of the present disclosure is schematically shown.

[0082] like Figure 5 As shown, in Figure 2 In terms of the technology of the data processing method shown in FIG. 1 , operation S220 in the data processing method of this embodiment may further include operations S221b to S223b. It should be noted that for other implementation details not described in the data processing method of this embodiment, please refer to Figure 2 The embodiment of the data processing method will not be described in detail here.

[0083] In operation S221b, the first information is parsed to obtain the identity attribute of the second object.

[0084] In some embodiments, the first information is parsed to obtain the identity attribute of the second object, wherein the second object is the object that is operating the second device. The identity attribute is used to characterize the identity information and / or identity characteristics of the second object, and may include, for example, a personal image, personal information, etc. of the second object.

[0085] Specifically, the personal image may include, for example, a reserved avatar of the second object (such as a real-name registered avatar), and the personal information may include, for example, the identity identifier of the second object, so that the first device can obtain the reference feature information of the second object based on the identity identifier, or may directly include the reference feature information of the second object. The reference feature information includes the facial information, audio information, posture information, etc. of the second object, and the feature information may be presented in the form of digital coding. The reference feature information may be, for example, a security verification feature reserved during account registration, or feature information determined based on its historical images.

[0086] In operation S222b, if the identity attribute indicates that the second object is a target object, third information reflecting that the second object is a trusted object is obtained.

[0087] In operation S223b, if the identity attribute indicates that the second object is not the target object, third information reflecting that the second object is an untrustworthy object is obtained.

[0088] In some embodiments, after the identity attribute of the second object is acquired, the second object in the second information is identified based on the identity attribute to determine whether the second object is a target object.

[0089] In a specific implementation process, identifying the second object in the second information based on the identity attribute includes: extracting a target feature of the second object from the second information; identifying the target feature based on the identity attribute to obtain an identification result of the second object.

[0090] The target features of the second object extracted from the second information may include, for example, current facial features, current posture features, current audio features, etc. of the second object.

[0091] Identifying target features based on identity attributes includes: identifying each target feature based on the identity attributes to obtain identification results of each target feature. And / or, selecting at least two target features from a plurality of target features to combine to obtain at least one target feature group, identifying the target feature group based on the identity attributes to obtain identification results of the target feature group.

[0092] Among them, facial features may include, for example, multiple feature points (such as the position and shape of eyes, nose, mouth, etc.), posture features may include, for example, static posture (such as joint position, body direction, user movement, etc.) and / or dynamic posture (user posture changes), and audio features may include, for example, frequency, timbre, intonation, etc.

[0093] Identify each target feature based on the identity attribute to obtain the identification result of each target feature, including: comparing the facial information in the reference feature information with the current facial feature in the target feature to obtain the identification result of the facial feature. Compare the current posture feature with the posture information in the reference feature information to determine whether the second object appears in a specific posture and / or whether abnormal behavior occurs, and obtain the identification result of the posture feature. Compare the current audio feature with the audio information in the reference feature information to obtain the identification result of the audio feature of the second object.

[0094] At least two target features are selected from multiple target features for combination to obtain at least one target feature group, and the target feature group is identified based on the identity attribute, including: fusing the selected multiple target features to obtain a combined feature; and identifying the combined feature based on reference feature information. The combined feature combines the information of multiple single features, which helps to capture the complex features of the second object. Since different single features often contain different information, by fusing single features, the complementary advantages of single features can be fully utilized to better describe the second object, which helps to accurately identify the second object. Specifically, multimodal features can be fused by means of feature vector splicing, attention mechanism, etc. to obtain a combined feature.

[0095] Taking the selected target features as facial features and audio features and the feature fusion method as the attention mechanism as an example, the process of obtaining the combined features is illustrated: the weight matrices corresponding to the facial features and audio features are obtained respectively; the weight matrices are multiplied by the corresponding feature vectors to obtain the weighted feature vectors; the weighted feature vectors are processed using the attention gating mechanism to further adjust the importance of each feature; the weighted audio feature vectors and face feature vectors that have been processed by the attention gating are concatenated to obtain the combined features.

[0096] Among them, the splicing operation can retain the original information of the two modal features (i.e., audio features and facial features) so that these original information can be used simultaneously in the subsequent recognition process. That is to say, in the process of recognizing the combined features based on the reference feature information, in addition to recognizing the combined features, the single features in the feature combination can also be recognized, and the recognition result of the target feature group is determined based on the combined features and the single features.

[0097] In some embodiments, identifying the target feature based on the identity attribute to obtain the recognition result of the second object includes: jointly determining the recognition result of the second object based on the recognition results of each target feature / target feature group.

[0098] If the recognition result of the second object indicates that the second object is the target object, the third information reflecting that the second object is a credible object is obtained. If the recognition result indicates that the second object is not the target object, the third information reflecting that the target object is an untrustworthy object is obtained.

[0099] It should be noted that the identity attribute in the first information is the identity attribute determined by the second device after performing portrait detection and recognition on the second object in the original information. The original information is the information directly captured by the camera of the second device. The second device determines the identity attribute of the second object based on the original information, for example, by performing a portrait detection and recognition operation on the original information to obtain the portrait information and identity information of the second object.

[0100] The disclosed embodiment comprehensively determines whether the second object is the target object from multiple feature dimensions based on the identity attributes of the second object, and can more comprehensively evaluate the credibility of the second object in the second information, avoid forgery of the target object, and improve the comprehensiveness and accuracy of the anti-counterfeiting verification of the second object, thereby maintaining the authenticity and security of the video content.

[0101] Figure 6 The flowchart of a data processing method according to another embodiment of the present disclosure is schematically shown.

[0102] like Figure 6 As shown, in Figure 2 In terms of the technology of the data processing method shown in FIG. 1 , operation S220 in the data processing method of this embodiment may further include operations S221c to S223c. It should be noted that for other implementation details not described in the data processing method of this embodiment, please refer to Figure 2 The embodiment of the data processing method will not be described in detail here.

[0103] In operation S221c, the first information is parsed to obtain generation parameters of the second information.

[0104] In some embodiments, the generation parameters of the second information may include, for example, information related to a generation scenario of the second information, and whether the second information is generated in a target scenario is determined through the generation parameters.

[0105] Taking an online video conference scenario as an example, the generation parameters of the second information may include, for example, the conference subject, the conference initiator, the conference serial number, and the like.

[0106] In operation S222c, if the generation parameter represents that the generation scene of the second information is the target scene, third information reflecting that the generation scene is a credible scene is obtained.

[0107] In operation S223c, if the generation parameter represents that the generation scene of the second information is not the target scene, third information reflecting that the generation scene is an untrustworthy scene is obtained.

[0108] In some embodiments, the first device identifies the generation parameters of the second information based on the current scene information, and determines whether the generation scene of the second information is consistent with the current scene. If the generation scene of the second information is consistent with the current scene, the generation scene of the second information is determined to be the target scene, and third information reflecting that the generation scene is a credible scene is obtained. If the generation scene of the second information is inconsistent with the current scene, the generation scene of the second information is determined not to be the target scene, and third information reflecting that the generation scene is an untrustworthy scene is obtained.

[0109] Taking the online video conference scenario as an example, the current scenario information of the meeting in which the first device is located includes: meeting theme - xxx mid-year summary meeting, meeting initiator - Wang, meeting serial number - 2485923. Compare the current scenario information with the generation parameters of the second information. If the generation parameters of the second information are consistent with the current scenario information, the generation scenario of the second information is determined to be a credible scenario. If the generation parameters of the second information are inconsistent with the current scenario information, it means that the second information is not generated in the current video conference scenario, and the generation scenario of the second information is determined to be an untrustworthy scenario.

[0110] The generation parameter of the second information is specific information assigned to the second information during the generation process, which is unique and identifiable. The embodiment of the present disclosure determines the generation scenario of the second information based on the generation parameter of the second information, which can effectively prevent the second information from being impersonated or incorrectly associated. The generation scenario can reflect the credibility of the second information content to a certain extent and maintain the authenticity and security of the currently disseminated data content.

[0111] Figure 7 The flowchart of a data processing method according to another embodiment of the present disclosure is schematically shown.

[0112] like Figure 7 As shown, in Figure 2 In terms of the technology of the data processing method shown in FIG. 1 , operation S230 in the data processing method of this embodiment may further include operations S231 to S232. It should be noted that for other implementation details not described in the data processing method of this embodiment, please refer to Figure 2 The embodiment of the data processing method will not be described in detail here.

[0113] In operation S231, when the first device is a target device, second information and prompt information are displayed on a screen of the first device.

[0114] In some embodiments, the target device is a device with a display screen that can directly display the second information, such as a mobile phone, a tablet, a computer, etc. When the first device is the target screen, the second information and the prompt information can be directly displayed on the screen of the first device.

[0115] The prompt information is the third information and / or the comprehensive information processed based on the third information. For example, the credibility of the second device and / or the second object of operating the second device and / or the second information generation scene is analyzed by preset weights to obtain comprehensive information for indicating the credibility of the second information.

[0116] Figure 8 An example diagram schematically shows prompt information displayed on a screen of a first device according to an embodiment of the present disclosure.

[0117] like Figure 8 As shown, the prompt information is displayed on the screen of the first device, and the third information used to represent the credibility of the second device and / or the second object operating the second device and / or the second information generation scenario can be displayed as the prompt information (see Figure 8 A). The comprehensive information reflecting the credibility of the second information obtained based on the third information can also be displayed as prompt information (see Figure 8 B). The third information and the comprehensive information can also be displayed as prompt information (see Figure 8 C)

[0118] In some embodiments, displaying the second information and the prompt information on the screen of the first device includes: displaying the prompt information superimposed on the second information; or displaying the second information and the prompt information in different areas of the screen.

[0119] Fig. 9 The second information and prompt information display mode according to the embodiment of the present disclosure are schematically shown. Fig. 9 As shown in A, the prompt information is superimposed on the second information. Fig. 9 As shown in B, the second information and the prompt information are displayed in different areas of the screen.

[0120] Among them, displaying the prompt information superimposed on the second information may include, for example: embedding the prompt information into the second information and displaying the embedded information on the screen, or, while displaying the second information, superimposing the prompt information on the screen of the second information in real time. Embedding the prompt information into the second information helps to improve the durability of the prompt effect. The prompt information embedded in the second information is a part of the video content. Even if the video is copied or disseminated, the prompt information will be retained and difficult to be removed or tampered with. It can be applicable to the second information with a lower degree of credibility. While displaying the second information, superimposing the prompt information on the screen of the second information in real time has high flexibility and can be adjusted according to the playback scene and screen changes, and the real-time superposition will not change the original data of the second information.

[0121] like Fig. 9 As shown in FIG. 1B , the screen may include, for example, a first area for displaying the second information and a second area for displaying the prompt information, and the layout and size of the first area and the second area may be adjusted in real time based on viewing habits. Displaying the prompt information and the second information on a split screen helps the user focus on both the video content and the prompt information while avoiding excessive interference of the prompt information with the second information content, so that the user can focus more on the second information itself.

[0122] It should be noted that the display method of the second information and the prompt information can be selected according to actual conditions, and the present disclosure does not limit it here.

[0123] In operation S232, when the first device is a transfer device, the first device sends the second information and the prompt information to the target device for display.

[0124] In some embodiments, the transfer device is used to process and forward the received data, and the transfer device itself does not have a display screen in a physical sense. For example, it may include a conference cloud, an application platform processor, etc.

[0125] In the case where the first device is a transfer device, the first device sends the first information and the prompt information to the target device, so that the first information and the prompt information are displayed on the screen of the target device. The displaying of the first information and the prompt information on the screen of the target device includes: displaying the prompt information superimposed on the second information; or displaying the second information and the prompt information in different areas of the screen.

[0126] Among them, displaying the prompt information superimposed on the second information may include, for example: embedding the prompt information into the second information and displaying the embedded information on the screen, or, while displaying the second information, superimposing the prompt information on the screen of the second information in real time.

[0127] Corresponding to different display modes, the data format sent from the first device to the target device may also be different. For example, if the prompt information is embedded in the second information for display, the first device needs to edit the embedded information and the second device to embed the prompt information into the second information, and send the second information with the embedded prompt information to the target device as a complete file. If the prompt information is to be superimposed on the screen of the second information in real time for display, the first device needs to send corresponding control instructions to the target device while sending the prompt information and the second information to the target device, so that the target device can realize the real-time superposition of the prompt information.

[0128] The disclosed embodiment displays the second information and prompt information on the screen of the target device so that the viewing object in front of the screen of the first device can timely understand the credibility and authenticity of the information, thereby improving the transparency of information dissemination, promoting the authentic dissemination of information, and improving the security of multimedia data dissemination.

[0129] Fig.10 The block diagram schematically shows a data processing device according to an embodiment of the present disclosure.

[0130] like Fig.10 As shown, the data processing device 1000 includes an obtaining module 1010 , a parsing module 1020 and an output module 1030 .

[0131] The acquisition module 1010 is used to obtain target data sent by at least one second device; the target data corresponds to the second device one by one, and the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located. In one embodiment, the acquisition module 1010 can be used to perform the operation S210 described above, which will not be repeated here.

[0132] The parsing module 1020 is used to parse the first information to obtain the third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the second information generation scenario. In one embodiment, the parsing module 1020 can be used to perform the operation S220 described above, which will not be repeated here.

[0133] The output module 1030 is used to respond to the output of the second information and perform prompt output based on the third information. In one embodiment, the output module 1030 can be used to perform the operation S230 described above, which will not be described in detail here.

[0134] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0135] For example, any multiple of the acquisition module 1010, the parsing module 1020, and the output module 1030 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the acquisition module 1010, the parsing module 1020, and the output module 1030 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware, and firmware or in a suitable combination of any of them. Alternatively, at least one of the obtaining module 1010 , the parsing module 1020 , and the output module 1030 may be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function may be performed.

[0136] It should be noted that the data processing system part in the embodiments of the present disclosure corresponds to the data processing method part in the embodiments of the present disclosure. The description of the data processing system part specifically refers to the data processing method part, which will not be repeated here.

[0137] Fig.11 A block diagram of an electronic device suitable for implementing the data processing method according to an embodiment of the present disclosure is schematically shown. Fig.11 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0138] like Fig.11 As shown, the electronic device 1100 according to an embodiment of the present disclosure includes a processor 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage part 1108 to a random access memory (RAM) 1103. The processor 1101 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 1101 may also include an onboard memory for caching purposes. The processor 1101 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0139] In RAM 1103, various programs and data required for the operation of electronic device 1100 are stored. Processor 1101, ROM 1102 and RAM 1103 are connected to each other through bus 1104. Processor 1101 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 1102 and / or RAM 1103. It should be noted that the program can also be stored in one or more memories other than ROM 1102 and RAM 1103. Processor 1101 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0140] According to an embodiment of the present disclosure, the electronic device 1100 may further include an input / output (I / O) interface 1105, which is also connected to the bus 1104. The electronic device 1100 may further include one or more of the following components connected to the input / output (I / O) interface 1105: an input portion 1106 including a keyboard, a mouse, etc.; an output portion 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 1108 including a hard disk, etc.; and a communication portion 1109 including a network interface card such as a LAN card, a modem, etc. The communication portion 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the input / output (I / O) interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage portion 1108 as needed.

[0141] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1109, and / or installed from the removable medium 1111. When the computer program is executed by the processor 1101, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0142] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0143] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0144] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 1102 and / or the RAM 1103 described above and / or one or more memories other than the ROM 1102 and the RAM 1103 .

[0145] The embodiments of the present disclosure also include a computer program product, which includes a computer program, which contains program code for executing the method provided by the embodiments of the present disclosure. When the computer program product runs on an electronic device, the program code is used to enable the electronic device to implement the data processing method provided by the embodiments of the present disclosure.

[0146] When the computer program is executed by the processor 1101, the above functions defined in the system / device of the embodiment of the present disclosure are executed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0147] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 1109, and / or installed from a removable medium 1111. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0148] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0149] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0150] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A data processing method, comprising: The first device obtains target data sent by at least one second device; The target data corresponds to the second device in a one-to-one manner, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; Parsing the first information to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the scenario in which the second information is generated; In response to outputting the second information, a prompt is output based on the third information.

2. The processing method according to claim 1, before parsing the first information to obtain the third information, the method further comprises: If the first information is stored in the target data in a first form, the first information and the second information are obtained by parsing the target data in a first manner; The first form is embedded in the image frame of the target data, and the second information is an image that does not include the first information; If the first information is stored in the target data in a second form, the target data is parsed in a second manner to obtain first data stream parameters and second data stream parameters; the second form is the first data stream parameters that constitute the target data, and the second information is an environment image rendered and generated according to the second data stream parameters.

3. The data processing method according to claim 1, wherein parsing the first information to obtain the third information comprises: Parsing the first information to obtain attribute information of the second device; If the attribute information indicates that the second device is a designated device, obtaining third information reflecting that the second device is a trusted device; If the attribute information indicates that the second device is a non-designated device, obtaining third information reflecting that the second device is a non-trusted device; The third information is used to prompt the output of the attribute of the second device in response to the output of the second information.

4. The data processing method according to claim 1, wherein parsing the first information to obtain the third information comprises: Parsing the first information to obtain the identity attribute of the second object; If the identity attribute indicates that the second object is a target object, obtaining third information reflecting that the second object is a trusted object; If the identity attribute indicates that the second object is not the target object, obtaining third information reflecting that the second object is an untrusted object; The third information is used to output a prompt of the identity of the second object in response to outputting the second information.

5. The data processing method according to claim 1, wherein parsing the first information to obtain the third information comprises: Parsing the first information to obtain generation parameters of the second information; If the generation parameter indicates that the generation scene of the second information is a target scene, obtaining third information reflecting that the generation scene is a credible scene; If the generation parameter represents that the generation scene of the second information is not the target scene, obtaining third information reflecting that the generation scene is an untrustworthy scene; The third information is used to prompt and output a generation scenario of the second information when responding to outputting the second information.

6. The data processing method according to claim 1, further comprising: When the first device is a target device, displaying the second information and prompt information on a screen of the first device; In the case where the first device is a transfer device, the first device sends the second information and the prompt information to the target device for display; The prompt information is the third information and / or information processed based on the third information.

7. The data processing method according to claim 6, wherein displaying the second information and the prompt information on the screen of the first device comprises: Displaying the prompt information overlaid on the second information; or The second information and the prompt information are displayed in different areas of the screen.

8. A data processing device, comprising: An obtaining module, used to obtain target data sent by at least one second device; The target data corresponds to the second device in a one-to-one manner, the target data includes first information and second information, and the second information includes an image of the environment in which the second device is located; a parsing module, configured to parse the first information to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the scenario in which the second information is generated; An output module is used to respond to outputting the second information and perform prompt output based on the third information.

9. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors perform the following operations: The first device obtains target data sent by at least one second device; the target data corresponds to the second device one by one, the target data includes first information and second information, and the second information includes an image of the environment where the second device is located; Parsing the first information to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the scenario in which the second information is generated; In response to outputting the second information, a prompt is output based on the third information.

10. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, causes the processor to perform the following operations: The first device obtains target data sent by at least one second device; the target data corresponds to the second device one by one, the target data includes first information and second information, and the second information includes an image of the environment where the second device is located; Parsing the first information to obtain third information; the third information is used to indicate the credibility of the second device and / or the second object operating the second device and / or the scenario in which the second information is generated; In response to outputting the second information, a prompt is output based on the third information.