Image data processing method, device, equipment and readable storage medium

Abstract

The present application discloses an image data processing method, apparatus, device, and readable storage medium. The method includes: responding to a trigger operation on a scan control, displaying a scan interface for executing a scan service; responding to a scan operation on a first scan object, obtaining a first original scanned image; the first original scanned image includes a first obstructing object and the first scanned object, the first obstructing object being an object that obstructs a local area of ​​the first scanned object; responding to a scan result review operation on the scan service, displaying a scan result document including a target updated scanned image; the image content of the target updated scanned image includes the image content of the first original scanned image after removing the first obstructing object. Using the present application, an image of an object can be obtained by scanning, and in the scan service, the display effect of the scanned image can be optimized.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an image data processing method, apparatus, device, and readable storage medium. Background Art

[0002] In daily life, there are various scenes that need to be photographed. For example, in lectures, meetings, speeches, etc., speakers usually give speeches in combination with speech courseware (such as showing speech courseware while giving the speech). In order to quickly and effectively record the speaker's speech content, the audience will choose to photograph and save the speech courseware and then review it later. For example, in travel scenes, tourists will choose to photograph and save the scenery.

[0003] However, during the shooting process, it is inevitable that other objects will enter the lens for some reasons. At this time, these objects can be removed from the lens by adjusting the camera angle or focal length. However, due to the adjustment of the camera angle or focal length, the captured target (such as scenery, courseware, etc.) will also change, and the composition ratio of the captured target will not meet the expectations. In other words, the image display effect of the target captured by the existing method is not good. Summary of the Invention

[0004] The embodiments of the present application provide an image data processing method, apparatus, device, and readable storage medium, which can acquire an image of an object by scanning, and in a scanning business, can optimize the display effect of the scanned image.

[0005] An embodiment of the present application provides an image data processing method, including:

[0006] In response to a trigger operation on the scan control, a scan interface for executing a scan service is displayed;

[0007] In response to a scanning operation on a first scanning object, a first original scanned image is acquired; the first original scanned image includes a first blocking object and the first scanning object, where the first blocking object refers to an object blocking a local area of ​​the first scanning object;

[0008] In response to a scan result viewing operation for a scan service, a scan result document including a target updated scan image is displayed; the image content of the target updated scan image includes the image content after the first blocking object is removed from the first original scan image.

[0009] On the one hand, an embodiment of the present application provides another image data processing method, including:

[0010] In response to a trigger operation on the scan control, a scan interface for executing a scan service is displayed;

[0011] In response to a scanning operation on a first scanning object, acquiring a first original scanned image;

[0012] In response to a scanning operation on a second scanning object, a second original scanned image is acquired; a similar association relationship exists between the first original scanned image and the second original scanned image;

[0013] In response to a scan result viewing operation for a scanning business, a scan result document including a target updated scan image is displayed; the image content of the target updated scan image matches the image content of the deduplicated and fused scan image, and the deduplicated and fused scan image refers to a scan image obtained after deduplicated and fused processing of the first original scan image and the second original scan image.

[0014] In one aspect, an embodiment of the present application provides an image data processing device, including:

[0015] An interface display module, configured to respond to a trigger operation on a scan control and display a scan interface for executing a scan service;

[0016] a scanning image acquisition module, configured to acquire a first original scanned image in response to a scanning operation on a first scanning object; the first original scanned image includes a first blocking object and the first scanning object, wherein the first blocking object refers to an object blocking a local area of ​​the first scanning object;

[0017] The document display module is used to respond to the scanning result reading operation for the scanning business and display the scanning result document including the target updated scan image; the image content of the target updated scan image includes the image content after the first blocking object is removed from the first original scan image.

[0018] In one embodiment, the target updated scan image is determined based on the updated scan image, and the updated scan image includes content after the first occluding object is removed from the first original scan image.

[0019] In one embodiment, the number of updated scan images is greater than or equal to 2; when the scanning control is a collaborative scanning control, at least two updated scan images include a collaborative updated scan image provided by a collaborative business object; a collaborative business object refers to a business object that jointly performs a scanning business with a target business object, and a target business object refers to a trigger object that generates a trigger operation for the collaborative scanning control; when the scanning control is an ordinary scanning control, at least two updated scan images include scan images obtained by the target business object scanning the first scanning object at multiple perspectives.

[0020] In one embodiment, when the scanning control is a collaborative scanning control, the interface display module includes:

[0021] A password interface display unit is used to respond to a trigger operation on the collaborative scanning control and display a password input interface; the password input interface is used to instruct the target business object to enter a target password;

[0022] The scanning interface display unit is used to display a scanning interface for executing a scanning service together with a collaborative service object when a target password is input in the password input interface.

[0023] In one embodiment, the password input interface includes a scanning service sharing control;

[0024] The interface display module also includes:

[0025] An associated object display unit, configured to respond to a trigger operation on the scanning business sharing control and display a list of associated business objects; the associated business object list refers to business objects that have a social association relationship with the target business object in the social application;

[0026] a conversation interface display unit, configured to respond to a trigger operation on a target associated business object in the associated business object list and display a conversation interface associated with the target associated business object;

[0027] The invitation information display unit is used to display the scanning service invitation information in the conversation interface; the scanning service invitation information is used to indicate the target associated service object and to perform the scanning service together with the target service object.

[0028] In one embodiment, the scanning interface includes a document reading control, and the scanning result reading operation for the scanning service refers to a triggering operation for the document reading control;

[0029] The document display module includes:

[0030] A reading interface display unit, configured to display a document reading interface in response to a triggering operation on a document reading control in the scanning interface;

[0031] The document display unit is used to display the scan result document including the target updated scan image in the document reading interface.

[0032] In one embodiment, if the adjacent area of ​​the local area blocked by the first blocking object does not contain visible text information, the target updated scan image is determined based on the updated scan image, specifically including: when the number of updated scan images is 1, the updated scan image is repaired according to the attributes of the area around the original area where the first blocking object was located after the first blocking object is removed from the updated scan image to obtain the target updated scan image; when the number of updated scan images is greater than or equal to 2, the area where the first blocking object was originally located is repaired using multiple images to obtain the target updated scan image.

[0033] In one embodiment, the document reading interface further includes a document reading permission management control; the target password input by the target business object is the password created by the target business object for the scanning service;

[0034] The document display module also includes:

[0035] The collaborative object display unit is used to respond to the triggering operation of the document reading permission management control and display the collaborative business object list; each collaborative business object in the collaborative business object list has the reading permission for the scanned result document;

[0036] A close control display unit is used to respond to a trigger operation on a target collaborative business object in the collaborative business object list and display a permission close control for the target collaborative business object; the permission close control is used to close the permission of the target collaborative business object to participate in the scanning business;

[0037] The list updating unit is used to respond to the triggering operation of the permission closing control and update and display the collaborative business object list; the collaborative business object list after the update does not include the target collaborative business object.

[0038] In one embodiment, if the adjacent area of ​​the local area occluded by the first occluding object contains visible text information, the predicted text information associated with the visible text information is displayed in the mapped local area in the target updated scan image; the position of the mapped local area in the target updated scan image is the same as the position of the local area in the first original scan image.

[0039] In one embodiment, the image data processing apparatus further includes:

[0040] an image acquisition module, configured to acquire a second original scanned image in response to a scanning operation on a second scanned object when the first original scanned image is acquired;

[0041] If a similar association relationship exists between the first original scanned image and the second original scanned image, the target updated scanned image in the scan result document is generated based on the first original scanned image after deduplication of the second original scanned image.

[0042] In one embodiment, the scan result document includes at least two updated scan images;

[0043] The document display module is also specifically used to respond to the scanning result reading operation for the scanning business, and display the image acquisition time of each updated scan image in the scanning result document; at least two updated scan images in the scanning result document are arranged and displayed in the time sequence of at least two image acquisition times.

[0044] In one embodiment, the image data processing apparatus further comprises:

[0045] A model input module is used to input visible text information into the text prediction model and extract text features corresponding to the visible text information through the text prediction model;

[0046] The predicted text output module is used to output predicted text information associated with visible text information through text features and a text prediction model.

[0047] In one embodiment, the image data processing apparatus further comprises:

[0048] a feature point matching module, configured to obtain a first set of visual feature points in the first original scanned image and a second set of visual feature points in the second original scanned image;

[0049] The feature point matching module is further configured to determine a matching pair set based on the first visual feature point set and the second visual feature point set; the matching pair set includes N sets of feature point matching pairs, each set of feature point matching pairs consisting of a first visual feature point in the first visual feature point set and a second visual feature point in the second visual feature point set; the first visual feature point and the second visual feature point included in the set of feature point matching pairs match; and N is a positive integer.

[0050] The feature point matching module is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the N sets of feature point matching pairs.

[0051] In one embodiment, the N groups of feature point matching pairs include feature point matching pairs S i , feature point matching pair S i The first visual feature point K is included a and the second visual feature point K b ; i, a, b are all positive integers;

[0052] The feature point matching module includes:

[0053] Coordinate acquisition unit, used to obtain the first visual feature point K a The corresponding first feature point coordinates and the second visual feature point K b The corresponding second feature point coordinates;

[0054] A distance determination unit is configured to determine the coordinate distance between the first feature point coordinate and the second feature point coordinate as a feature point matching pair S. i The corresponding coordinate distance;

[0055] A first relationship determination unit is configured to determine an average coordinate distance based on the N coordinate distances and the number of matching pairs corresponding to the N groups of feature point matching pairs when the coordinate distances corresponding to the N groups of feature point matching pairs are determined;

[0056] The first relationship determining unit is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the average coordinate distance is less than a coordinate distance threshold;

[0057] The first relationship determining unit is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the average coordinate distance is greater than a coordinate distance threshold.

[0058] In one embodiment, the image data processing apparatus further comprises:

[0059] a hash code matching module, configured to obtain a first hash code string corresponding to the first original scanned image and a second hash code string corresponding to the second original scanned image;

[0060] The hash code matching module is further used to determine the coding distance between the first hash code string and the second hash code string;

[0061] The hash code matching module is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the encoding distance is less than the encoding distance threshold;

[0062] The hash code matching module is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the encoding distance is greater than the encoding distance threshold.

[0063] In one embodiment, the image data processing apparatus further comprises:

[0064] a detection frame matching module, configured to perform image recognition on the first original scanned image and the second original scanned image respectively, to obtain a first text detection frame set corresponding to the first original scanned image and a second text detection frame set corresponding to the second original scanned image;

[0065] The detection frame matching module is further configured to determine a detection frame pairing set based on the first text detection frame set and the second text detection frame set; the detection frame pairing set includes M detection frame matching pairs, where a detection frame matching pair consists of a first text detection frame in the first text detection frame set and a second text detection frame in the second text detection frame set; in a detection frame matching pair, an intersection-over-union ratio of overlapping areas between the first text detection frame and the second text detection frame included therein is greater than an intersection-over-union ratio threshold; and M is a positive integer.

[0066] The detection frame matching module is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the M groups of detection frame matching pairs.

[0067] In one embodiment, the M groups of detection box matching pairs include detection box matching pairs T j , detection box matching pair T j The first text detection box K is included c and the second text detection box K d ; j, c, d are all positive integers;

[0068] The recognition text determination unit is used to detect the first text frame K c and the second text detection box K d Perform text recognition separately to obtain the first text detection frame K c The corresponding first recognized text and the second text detection box K d corresponding second recognition text;

[0069] The recognition text determination unit is further configured to perform normalization processing on the first recognition text and the second recognition text respectively to obtain a first normalized recognition text corresponding to the first recognition text and a second normalized recognition text corresponding to the second recognition text;

[0070] The effective frame determination unit is used to determine the text distance between the first normalized recognition text and the second normalized recognition text. If the text distance is less than the text distance threshold, the first text detection frame K is c and the second text detection box K d , are determined as detection box matching pairs T j The corresponding valid matching box;

[0071] The valid frame determination unit is further configured to, when valid matching frames corresponding to the M groups of detection frame matching pairs are determined, count the total number of valid matching frames corresponding to the M groups of detection frame matching pairs, and the total number of detection frames corresponding to the first text detection frame set and the second text detection frame set;

[0072] The valid frame determining unit is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the total number of valid matching frames and the total number of detection frames.

[0073] In one embodiment, the valid frame determining unit is further configured to determine a ratio between the total number of valid matching frames and the total number of detection frames as the image similarity between the first original scanned image and the second original scanned image;

[0074] The valid frame determining unit is further specifically configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the image similarity is greater than a similarity threshold;

[0075] The valid frame determining unit is further specifically configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the image similarity is less than a similarity threshold.

[0076] In one embodiment, the image data processing apparatus further comprises:

[0077] an occlusion object determination module, configured to input the first original scanned image into an image recognition model, classify pixel values ​​of the first original scanned image by the image recognition model, and obtain pixel values ​​belonging to a target type;

[0078] The occluding object determining module is further configured to determine an object composed of pixel values ​​belonging to the target type in the first original scanned image as a first occluding object, remove the first occluding object, and obtain a target updated scanned image.

[0079] In one embodiment, the image data processing apparatus further comprises:

[0080] A frame recovery module, configured to restore the scan frame in the scan interface when the first original scan image is acquired;

[0081] an original image acquisition module, configured to acquire a second original scanned image in response to a save operation on the second scanned object when the second scanned object is within the scan frame; the second original scanned image includes a second obstructing object and a second scanned object, wherein the second obstructing object refers to an object that obstructs a partial area of ​​the second scanned object;

[0082] an image deduplication module, configured to, when a similar association relationship exists between the first original scanned image and the second original scanned image, remove a first occluding object from the first original scanned image to obtain a first initial updated scanned image, and remove a second occluding object from the second original scanned image to obtain a second initial updated scanned image;

[0083] The image deduplication module is further configured to perform deduplication fusion processing on the first initial update scan image and the second initial update scan image to obtain a fused scan image, and determine the fused scan image as the target update scan image.

[0084] In one embodiment, the image data processing apparatus further comprises:

[0085] A time determination module, configured to obtain image acquisition times corresponding to the first original scan image and the second original scan image respectively;

[0086] The time determination module is also used to obtain the earliest image acquisition time among the image acquisition times corresponding to the first original scan image and the second original scan image respectively, and determine the earliest image acquisition time as the image acquisition time of the target updated scan image; the image acquisition time of the target updated scan image is used to determine the display order of the target updated scan image when displaying the scan result document.

[0087] In one aspect, an embodiment of the present application provides another image data processing device, including:

[0088] An operation response module, configured to respond to a trigger operation on a scan control and display a scan interface for executing a scan service;

[0089] The operation response module is further configured to respond to a scanning operation on the first scanning object and obtain a first original scanned image;

[0090] The operation response module is further configured to respond to a scanning operation on a second scanning object and obtain a second original scanned image; a similar association relationship exists between the first original scanned image and the second original scanned image;

[0091] The scanned document display module is used to respond to the scan result reading operation for the scanning business and display the scan result document containing the target updated scan image; the image content of the target updated scan image matches the image content of the deduplicated and fused scan image, and the deduplicated and fused scan image refers to the scan image obtained after the deduplication and fusion processing of the first original scan image and the second original scan image.

[0092] In one aspect, an embodiment of the present application provides a computer device, including: a processor and a memory;

[0093] The memory stores a computer program, and when the computer program is executed by the processor, the processor executes the method in the embodiment of the present application.

[0094] On one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program includes program instructions. When the program instructions are executed by a processor, the method in the embodiment of the present application is executed.

[0095] In one aspect of the present application, a computer program product or computer program is provided. The computer program product or computer program includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in one aspect of the embodiments of the present application.

[0096] In an embodiment of the present application, for a certain object, it can be saved and recorded by scanning, and the object can be referred to as a scanned object. In the present application, a scan control can be displayed. Once the target object triggers the scan control, a scan interface for executing a scan service can be displayed; the target object can perform a scan operation on a first scan object, and the terminal can obtain a scan image corresponding to the first scan object (which can be referred to as a first original scan image); when the first original scan image includes a first obstructing object, if the target object performs a scan result reading operation, what is displayed is a target updated scan image that does not include the first obstructing object and the image content after the obstructing object is removed from the first original scan image. It should be understood that when the target object wishes to save and record a certain object, it can enter the scan service through the scan control and scan and save the object by scanning. At the same time, when an obstructing object exists in the scanned original scan image, the present application can remove it. Finally, what is displayed is an image that does not include an obstructing object and whose composition ratio meets the expectations, which can well optimize the scan image display effect. In summary, this application can scan and save an object, and in the scanning business, the image display effect can be optimized. BRIEF DESCRIPTION OF THE DRAWINGS

[0097] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0098] Figure 1 This is a network architecture diagram provided by an embodiment of the present application;

[0099] Figure 2a This is a schematic diagram of a scenario showing the execution of a scanning service provided by an embodiment of the present application;

[0100] Figure 2b This is a schematic diagram of a scene for displaying a scanned document provided by an embodiment of the present application;

[0101] Figure 3 This is a flow chart of an image data processing method provided in an embodiment of the present application;

[0102] Figure 4 This is a schematic diagram of a scene for image filling provided by an embodiment of the present application;

[0103] Figure 5 This is a schematic diagram of another image filling scenario provided by an embodiment of the present application;

[0104] Figure 6 This is a flow chart of an image data processing method provided in an embodiment of the present application;

[0105] Figure 7 This is a schematic diagram of a scenario for performing deduplication and fusion processing on images provided in an embodiment of the present application;

[0106] Figure 8 This is a schematic diagram of an image detection process provided by an embodiment of the present application;

[0107] Figure 9 This is a schematic diagram of an image detection process provided by an embodiment of the present application;

[0108] Figure 10 This is a schematic diagram of an image detection process provided by an embodiment of the present application;

[0109] Figure 11 This is a schematic diagram of a process for determining image association relationships provided by an embodiment of the present application;

[0110] Figure 12 This is a flow chart of a display scanning interface provided by an embodiment of the present application;

[0111] Figure 13 This is a schematic diagram of a scene showing a scanning interface provided by an embodiment of the present application;

[0112] Figure 14 This is a schematic diagram of a process for executing a scanning service provided by an embodiment of the present application;

[0113] Figure 15 This is a schematic diagram of a scenario in which scanning service invitation information can be shared, provided by an embodiment of the present application;

[0114] Figure 16 This is a schematic diagram of a permission management scenario provided by an embodiment of the present application;

[0115] Figure 17 This is a system flow chart provided by an embodiment of the present application;

[0116] Figure 18 is a flowchart of another image data processing method provided by an embodiment of the present application;

[0117] Figure 19 is a structural diagram of an image data processing device provided in an embodiment of the present application;

[0118] Figure 20 is a structural diagram of an image data processing device provided in an embodiment of the present application;

[0119] Figure 21 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0120] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0121] See Figure 1 , Figure 1 This is a network architecture diagram provided by the embodiment of this application. Figure 1 As shown, the network architecture may include a service server 1000 and a terminal device cluster. The terminal device cluster may include one or more terminal devices. The number of terminal devices is not limited here. Figure 1 As shown, the plurality of terminal devices may include a terminal device 100a, a terminal device 100b, a terminal device 100c, ..., a terminal device 100n; Figure 1 As shown, the terminal device 100a, the terminal device 100b, the terminal device 100c, ..., the terminal device 100n can respectively establish a network connection with the service server 1000, so that each terminal device can exchange data with the service server 1000 through the network connection.

[0122] It is understandable that if Figure 1 Each terminal device shown can be installed with a target application. When the target application is running in each terminal device, it can be respectively connected to the target application. Figure 1 The business server 1000 shown in FIG. 1000 performs data exchange with each other, so that the business server 1000 can receive business data from each terminal device. The target application may include an application capable of displaying data information such as text, images, audio, and video. The application can be any application capable of performing a scanning service, such as a scanning application, an instant messaging application, a short video application, an electronic document application, etc., and examples are not given here one by one.

[0123] In the embodiment of the present application, a terminal device can be selected from multiple terminal devices as the target terminal device. The terminal device can include: smart phones, tablet computers, laptops, desktop computers, smart TVs, smart speakers, desktop computers, smart watches, smart cars and other smart terminals with multimedia data processing functions (for example, video data playback function, music data playback function, text data playback function), but is not limited to these. For example, in the embodiment of the present application, Figure 1The terminal device 100a shown is used as the target terminal device. The target terminal device can be integrated with the above-mentioned target application. In this case, the target terminal device can exchange data with the business server 1000 through the target application. The business server 1000 in this application can obtain business data based on these applications. For example, the business server 1000 can obtain business data through the user's bound account. The bound account can refer to the account bound by the user in the application; the user can log in to the application, upload data, obtain data, etc. through his corresponding bound account, and the business server can also obtain the user's login status, uploaded data, send data to the user, etc. through its bound account.

[0124] It should be understood that a target application (e.g., an electronic document application) may provide a scan control that is visible to users logged into the electronic document application. If the user triggers the scan control, the target terminal device may respond to the user's triggering operation by displaying a scan interface including a scan frame for executing a scan operation. The scan frame may automatically detect a scan object (e.g., a lecture courseware, referred to as a first scan object). When the scan object is completely within the scan frame (or when more than a certain percentage (e.g., 90%) of the scan object is within the scan frame), the user may perform a scan operation on the scan object. The target terminal device may respond to this scan operation and obtain a first original scan image (i.e., a scan image of the first scan object). If, during the user's scan operation, an obstructing object (referred to as a first obstructing object) obscures a partial area of ​​the first scan object, the obtained first original scan image will include the first obstructing object in addition to the first scan object. The first obstructing object obscures the partial area of ​​the first scan object, and the content of the obscured partial area is not visible. In the present application, the target terminal device or service server 1000 can remove the first obstructing object from the first original scanned image and determine the target updated scanned image based on the image after removing the first obstructing object. The user can perform a scan result viewing operation for the scanning service in the scanning interface, and the target terminal device can respond to this scan result viewing operation by displaying the scan result document containing the target updated scanned image. In other words, the image content of the target updated scanned image does not contain the first obstructing object, and the scanned image viewed by the user is the image after removing the obstructing object.

[0125] It should be understood that when a user wishes to save a record of an object, he or she can scan and save it in the target application (such as an electronic document application); and when there is an occluded object in the original scanned image obtained by scanning, the present application can remove the occlusion, and the obtained target updated scan image does not contain the occluded object, which can well optimize the image display effect.

[0126] It is understood that the methods provided in the embodiments of the present application can be executed by computer devices, including but not limited to terminal devices or business servers. The business server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0127] The terminal device and the service server may be connected directly or indirectly via wired or wireless communication, which is not limited in this application.

[0128] Optionally, it is understood that the aforementioned computer device (such as the aforementioned service server 1000, terminal device 100a, terminal device 100b, etc.) can be a node in a distributed system, wherein the distributed system can be a blockchain system, which can be a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer (P2P) network, and the P2P protocol is an application layer protocol that runs on top of the Transmission Control Protocol (TCP). In a distributed system, any form of computer device, such as a service server, terminal device, or other electronic device, can become a node in the blockchain system by joining the peer-to-peer network. To facilitate understanding, the concept of blockchain will be explained below: Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. It is primarily used to organize data in chronological order and encrypt it into a ledger to prevent tampering and forgery, while also enabling data verification, storage, and updates. When the computer device is a blockchain node, due to the tamper-proof and anti-counterfeiting characteristics of the blockchain, the data in this application (such as the original scanned image, the updated scanned image, etc.) can be made authentic and secure, so that the results obtained after performing relevant data processing based on these data can be more reliable.

[0129] It should be noted that in the specific implementation of this application, user information, user data, and other user-related data (such as the user's bound account, user-uploaded data, scanned images, and the image acquisition time mentioned later, etc.) are only obtained and processed after obtaining the permission granted by the user. In other words, when the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0130] For easier understanding, see Figure 2a , Figure 2a This is a schematic diagram of a scenario for performing a scanning service provided by an embodiment of the present application. Figure 2a The terminal device 100a shown can be Figure 1 The terminal device 100a in the terminal device cluster of the corresponding embodiment.

[0131] Take the target application as an electronic document application as an example, Figure 2a As shown, the terminal device 100a may be the terminal device corresponding to user a, and user a may log in to the electronic document application through the account bound to the electronic document application. After starting and logging in to the electronic document application, the terminal device 100a may preferentially display the main page 2001 of the electronic document application, and display the account avatar (or account ID, nickname) of user a logged in to the electronic document application on the main page 2001. At the same time, Figure 2a As shown, the terminal device 100a can display a scan control 20a in the main page 2001, and the user a can enter a scan interface for executing a scan service by triggering the scan control 20a.

[0132] like Figure 2aAs shown, when user a triggers the scan control 20a, the terminal device 100a may display a scan interface 2002, where user a can perform a scan operation. The scan interface 2002 may include a scan box M, which can be understood as an identification box (or object selection box). When a scannable object (hereinafter referred to as a scan object) is present in the scan interface, the scan box automatically detects the scan object and places it within the scan box. When the scan object is completely within the scan box (or more than a certain percentage of the scan object is within the scan box), user a can perform a scan operation on the scan object within the scan interface 2002 to save the object. The terminal device 100a may provide a scan control (such as a capture control) within the scan interface 2002. The user's save operation on the scan object can be a triggering operation on the save control. That is, when the scan object is within the scan box, if user a triggers the scan control, it can be considered that user a has performed a scan operation on the scan object. Of course, when no scanning control for the scanning object is provided, the scanning operation for the scanning object may also be other operations. For example, the scanning operation may be a triggering operation of the pointer to the scanning object, which will not be limited here.

[0133] like Figure 2a As shown, taking the scanning interface 2002 including the shooting control 20b (i.e., the scanning control) as an example, when there is a scanning object 200a in the scanning interface 2002, the scanning frame M can automatically detect the scanning object 200a. When the scanning object 200a is completely within the scanning frame M, if the user a triggers the shooting control 20a, the terminal device 100a can obtain the original scanned image 2000h1 of the scanning object 200a; at the same time, the terminal device 100a can display the document reading control 2c in the scanning interface 2002, which is used to indicate that the scanned image of the scanning object 200a has been saved in a certain document (which can be called a scan result document). The user a can view the scan result document (i.e., view the scanned image of the scanning object) by triggering the document reading control 2c. It should be noted that, through Figure 2a It can be seen that in the scanning interface 2002, there is an obstructing object 200b, which is also in the scanning frame M and obstructs the scanning object 200a. The original scanning image 2000h1 obtained by the terminal device 100a includes not only the scanning object 200a but also the obstructing object 200b, and the obstructing object 200b obstructs part of the content of the scanning object 200a (i.e., the local area).

[0134] Further, please see Figure 2b , Figure 2b This is a schematic diagram of a scene showing a scanned document provided by an embodiment of the present application. Figure 2b As shown, after acquiring the original scanned image 2000h1, the terminal device 100a can restore the scan box M in the scan interface 2002 and continue scanning a scanned object through the scan box M. If user a does not exit the scan interface 2002, the scanned images obtained through the scan interface 2002 can be saved to the same scanned result document. In the scan interface 2002, if user a triggers the document viewing control 20c, the terminal device 100a can display the document viewing interface and the scanned result document within the document viewing interface. When displaying the scanned result document, each scanned image can be arranged according to its acquisition time. For example, images with earlier acquisition times are arranged closer to the front of the page.

[0135] like Figure 2b As shown, since only the scanned image of the scanned object 200a exists in the current scan result document, only the scanned image of the scanned object 200a can be displayed in the scanning interface 2002. It should be understood that in this embodiment of the present application, the scanned image of the scanned object 200a obtained by the terminal device 100a is the original scanned image 2000h1, and the original scanned image 2000h1 contains the obstructing object 200b. The terminal device 100a can remove the obstructing object 200b from the original scanned image 2000h1 to obtain an updated scanned image 2000h2, and the terminal device 100a can display the updated scanned image 2000h2 in the document viewing interface 2003. In other words, the scanned image viewed by user a does not include the obstructing object 200b. It is understood that when displaying the updated scanned image 2000h2, the terminal device 100a may also simultaneously display the image acquisition time of the updated scanned image 2000h2 (i.e., the time when the original scanned image 2000h1 was acquired), and may also simultaneously display the object identifier (e.g., the object's profile picture) of the business execution object corresponding to the updated scanned image 2000h2, used to indicate the specific user who scanned and captured the updated scanned image 2000h2. For example, if the image acquisition time of the original scanned image 2000h1 is 15:00 on January 3, 2022, the terminal device 100a may display the image acquisition time 15:00 and the profile picture identifier of user a along with the updated scanned image 2000h2.

[0136] It is understandable that user a can edit and record any image displayed in the document reading interface 2003, for example, Figure 2bAs shown, user a can edit the updated scanned image 2000h2 by triggering it. When user a triggers the updated scanned image 2000h2, the terminal device 100a can respond to this trigger by displaying an image editing interface 2004. This interface displays the updated scanned image 2000h2 and an edit box for the updated scanned image 2000h2. User a can enter image description information for the updated scanned image 2000h2 in the edit box. For example, user a can enter the image description information "One small step every day, a thousand miles in the end" in the edit box. User a can then confirm and save the image description information by triggering the Complete control in the image editing interface 2004. User a can also cancel the editing operation on the updated scanned image 2000h2 by triggering the Cancel control in the image editing interface 2004.

[0137] like Figure 2b As shown, when user a triggers the completion control, the terminal device 100a can save the image description information for the updated scan image 2000h2 and display the image description information when displaying the updated scan image 2000h2 in the document reading interface 2003.

[0138] It should be noted that the triggering operations for each control in this application may include contact operations such as clicking or long pressing, and may also include non-contact operations such as voice or gestures, which will not be limited here.

[0139] It should be understood that the present application can provide a scanning control in an electronic document application for the user to trigger. When the user triggers the scanning control, the user can respond to the triggering operation and display a scanning interface for performing the scanning business. The user can scan an object through the scanning interface. The user can perform a scanning operation on the object. Subsequently, the computer device (such as a terminal device) can obtain the original scanned image of the object. When the original scanned image includes an obstructing object, the obstructing object can be removed to obtain an updated scanned image, and what the user views is the updated scanned image. The present application can scan and save an object, and when viewing the scanned image of the object, what is displayed is an updated scanned image with a better display effect after removing the obstruction, which can well optimize the image display effect.

[0140] Further, see Figure 3 , Figure 3 This is a flow chart of an image data processing method provided by an embodiment of the present application. The method can be performed by a terminal device (for example, the above Figure 1 Any terminal device in the terminal device cluster 100 shown) or a service server (such as the above Figure 1 The image data processing method may be executed by the service server 1000 shown in FIG. 1 , or may be executed by the terminal device and the service server together. For ease of understanding, this embodiment uses the method executed by the terminal device as an example. The image data processing method may include at least the following steps S101 to S104:

[0141] Step S101 : In response to a triggering operation on a scan control, a scan interface for executing a scan service is displayed.

[0142] In this application, the scanning control may refer to a control provided in the target application, and the target application may be any application with a scanning function, such as a social application, an electronic document application, a short video application, and the like. The target application may be an independent application, or an embedded sub-application in a video application, an entertainment application, a shopping application, and the like, and will not be restricted here. When the user starts the target application, the scanning service may be performed through the scanning control. For example, when the user triggers the scanning control, the terminal device may display a scanning interface including a scanning box for performing the scanning service, and the user may scan different objects to be scanned (referred to as scanning objects) based on the scanning box in the scanning interface. For example, as mentioned above Figure 2a The corresponding embodiment can be used as an exemplary scenario. When user a starts an electronic document application, he can view the main page 2001 of the electronic document application. The main page 2001 includes a scanning control 20a. When user a triggers the scanning control 20a, the terminal device 100a can respond to this trigger operation and display a scanning interface 2002 for performing a scanning service. The scanning interface 2002 may include a scanning box M, and the user can perform a scanning service based on the scanning box M.

[0143] Step S102 : In response to a scanning operation on a first scanning object, a first original scanning image is acquired; the first original scanning image includes a first blocking object and a first scanning object, where the first blocking object refers to an object blocking a local area of ​​the first scanning object.

[0144] In this application, when a scanning object (referred to as a first scanning object) exists in the scanning interface, the scanning frame can automatically detect the first scanning object to select it entirely within the scanning frame; alternatively, the user can manually drag the scanning frame to place the first scanning object within the scanning frame. When the first scanning object is completely within the scanning frame (or when a certain percentage of the first scanning object is within the scanning frame), the user can perform a scanning operation on the first scanning object in the scanning interface, and the terminal device can respond to the scanning operation and obtain a scanned image of the first scanning object (referred to as a first original scanned image).

[0145] The terminal device may provide a capture control in the scanning interface. The scanning operation for the first scanned object herein may refer to a triggering operation on the capture control. When the first scanned object is within the scanning frame, the user may trigger the capture control to scan and save the object. Upon clicking the capture control, a first original scanned image of the first scanned object is obtained. Of course, the saving operation for the first scanned object herein may also refer to other operations, such as a long press operation on the first scanned object, etc. This is not limited herein.

[0146] It is understandable that when the user scans the first scanning object through the scanning interface, there are other objects in the lens, and these objects may block the first scanning object. In this case, the first original scanning image obtained by the terminal device includes not only the first scanning object, but also a blocking object (referred to as the first blocking object) that blocks the local area of ​​the first scanning object. That is to say, in the first original scanning image, the local area of ​​the first scanning object is invisible.

[0147] Step S103 , in response to the scanning result viewing operation for the scanning service, a scanning result document including a target updated scan image is displayed; the image content of the target updated scan image includes the image content after the first blocking object is removed from the first original scan image.

[0148] In this application, after a user enters the scanning interface through the scanning control, without exiting the scanning interface, the user can continue to scan different scanning objects in the scanning interface, successively obtaining different original scanned images of different scanning objects. Based on these different original scanned images, a single scan result document can be generated. In other words, the scan result document can include different scanned images corresponding to different scanning objects, and the user can view the scan result document to view the scanned images corresponding to these different scanning objects.

[0149] In the present application, after the terminal device obtains the original scanned image of the scanned object, if there is an obstructing object in the original scanned image, in order to optimize the image display effect, the terminal device can remove the obstruction processing to obtain the image after the obstruction object is removed, and determine the updated scanned image based on the image after the obstruction object is removed (the updated scanned image does not contain the obstructing object), and then summarize the updated scanned image to obtain the final scan result document to be displayed to the user. For example, for the first original scanned image, the terminal device can remove the first obstructing object to obtain the target updated scanned image, and then generate the scan result document based on the target updated scanned image.

[0150] Taking the first scan object as the first scan object after entering the scanning interface as an example, after the terminal device obtains the first original scan image, it can remove the occlusion processing to obtain the target updated scan image. At this time, no other objects have been scanned, and the scan result document can be generated based on the target updated scan image. The terminal device can provide a document reading control in the scanning interface for the user to view and read the scan result document. The terminal device can also provide a document reading control in the scanning interface for the user to view and read the scan result document. The user can view the scan result document through the document reading control. Taking the provision of a document reading control in the scanning interface as an example, if the user triggers the document reading control, the terminal device can respond to the trigger operation, display the document reading interface, and display the scan result document in the document reading interface (that is, display the target updated scan image). Among them, as mentioned above Figure 2b The corresponding embodiment can be used as an exemplary scenario for displaying a scan result document. When user a triggers the document reading control, the terminal device 100a can display the document reading interface 2003 and display the scan result document at this time in the document reading interface 2003 (if only the updated scan image 2000h2 is included at this time, only the updated scan image 2000h2 can be displayed).

[0151] The specific method for removing the first occluding object from the first original scanned image may be as follows: the first original scanned image may be input into an image recognition model, and the image recognition model may be used to classify the pixel values ​​of the first original scanned image to obtain pixel values ​​belonging to the target type; then, the object composed of the pixel values ​​belonging to the target type in the first original scanned image may be determined as the first occluding object, and the first occluding object may be removed to obtain the target updated scanned image. The image recognition model may be any artificial intelligence (AI) model capable of pixel segmentation, and the image recognition model may include a basic network mobilenet, through which multi-resolution convolution and deconvolution operations may be performed, and then each pixel in the first original scanned image may be classified. The target type here may refer to the type of the occluded object. Taking the occluded object as a key part of an object (such as the head) as an example, the pixel values ​​belonging to the key part (such as the head) in the first original scanned image can be marked as target types through the image recognition model, and the pixel values ​​that do not belong to the key part information can be marked as other types (which can be called non-target types). Then, the image recognition model can be used to divide the pixel values ​​in the first original scanned image into target types and non-target types. Subsequently, the object composed of pixel values ​​of the target type can be determined as the first occluded object.

[0152] Furthermore, after the first occluding object is identified by the image recognition model, the first occluding object can be removed to obtain an updated scanned image containing the removed content. Based on the updated scanned image, a target updated scanned image can be determined (e.g., the updated scanned image can be directly determined as the target updated scanned image). In other words, the target updated scanned image is determined based on the updated scanned image, and the updated scanned image contains the content of the first original scanned image after the first occluding object is removed. It should be understood that in the image after the first occluding object in the first original scanned image is removed, the local area obscured by the first occluding object does not contain image content. In order to further optimize the image display effect, it can be repaired. For example, when the adjacent area of ​​the local area obscured by the first occluding object does not contain visible text information, if only the updated scanned image corresponding to the first original scanned image is obtained at this time (i.e., the number of updated scanned images in the scanned document is 1), then the updated scanned image can be repaired based on the attributes of the area around the original area where the first occluding object was located after the first occluding object was removed in the updated scanned image, thereby obtaining the target updated scanned image. That is to say, the present application can fill and repair the local area based on the surrounding area outside the local area (which can be called the surrounding background area). For example, the local area can be filled with the background color so that the local area and the background area can be integrated and the display effect is better. Among them, for the specific implementation method of filling the local area, any algorithm that can perform image filling can be used to implement it. For example, the image filling algorithm Inpainting can be used to implement image filling. After the first occluding object is identified, the object boundary of the first occluding object can be obtained, and the object boundary can be used as the boundary to be repaired. Subsequently, for a certain point to be repaired on the boundary to be repaired, the color value of the point to be repaired can be determined based on the pixel value in the surrounding background area (for example, the pixel value in the surrounding background area can be normalized and weighted, and the calculated color value can be used as the color value of the point to be repaired). By entering the area to which the first occluding object belongs row by row from the boundary, all the contents of the area to which the first occluding object belongs can be gradually filled.

[0153] For easier understanding, please refer to Figure 4 , Figure 4This is a schematic diagram of a scene for image filling provided by an embodiment of the present application. For the original scanned image 2000h1, there is an occluding object 200b in the original scanned image 2000h1. The original scanned image 2000h1 can be input into the image recognition model, and the occluding object 200b in the original scanned image 2000h1 can be identified by the image recognition model. The area to which the occluding object 200b belongs is area Q. Subsequently, the area Q can be filled by an image filling algorithm, and the filled image can be used as a target to update the scanned image. For example, Figure 4 As shown, by performing image filling on the region Q, a target updated scan image 2000h3 can be obtained.

[0154] When the adjacent area of ​​the local area blocked by the first blocking object does not contain visible text information, if at this time at least two updated scan images for the first scan object are obtained (that is, the number of updated scan images in the scan result document is greater than or equal to 2), for example, the user repeatedly scans the first scan object from different visual angles, thereby obtaining different original scan images, and then after removing the blocking process, different updated scan images can be obtained. The present application can use multiple images to repair the area where the first blocking object was originally located to obtain a target updated scan image. For example, the missing content in different updated scan images can be merged and supplemented, thereby obtaining a target updated scan image with a complete display effect. Its specific implementation method can be found in the subsequent Figure 6-7 Description in the corresponding embodiment.

[0155] Optionally, in a feasible embodiment, if an area adjacent to the local area obscured by the first occluding object in the first original scanned image contains text information (referred to as visible text information), the text information in the obscured local area can be predicted based on the visible text information to obtain predicted text information. After removing the first occluding object from the first original scanned image, the predicted text information can be added to the local area after the first occluding object is removed to obtain the target updated scanned image. In other words, if an area adjacent to the local area obscured by the first occluding object contains visible text information, the predicted text information associated with the visible text information is displayed in the mapped local area of ​​the target updated scanned image (the position of the mapped local area in the target updated scanned image is the same as the position of the local area in the first original scanned image, which can be understood as the area to which the first occluding object belongs). A specific implementation method for determining the predicted text information can be: the visible text information can be input into a text prediction model, and text features corresponding to the visible text information can be extracted by the text prediction model; then, the text features can be combined with the text prediction model to output predicted text information associated with the visible text information.

[0156] For easier understanding, please refer to Figure 5 , Figure 5 This is another scene diagram of image filling provided by an embodiment of the present application. For the original scanned image 2000g1, there is an occluding object 200b in the original scanned image 2000g1. The original scanned image 2000g1 can be input into the image recognition model. The image recognition model can identify the occluding object 200b in the original scanned image 2000g1. The area to which the occluding object 200b belongs is area Q. Subsequently, by obtaining the visible text information in the adjacent area of ​​area Q as "birdsong" and "sunny day", the visible text information "birdsong" and "sunny day" can be input into the text prediction model. The text prediction model can determine that the predicted text information is "flower fragrance". The predicted text information "flower fragrance" can then be added to area Q to obtain the target updated scanned image 2000g2. In the mapping area of ​​area Q in the target updated scanned image 2000g2, the predicted text information "flower fragrance" is displayed. The target updated scanned image 2000g2 has a good display effect.

[0157] It should be understood that when the terminal device obtains the first original scan image, it can restore the scan frame in the scan interface to continue the scanning service based on the scan frame. When there is another object to be scanned in the scan interface (which can be called the second scan object), the scan frame can also automatically detect it to identify it in the scan frame; when the second scan object is completely in the scan frame (or when a certain proportion of the second scan object is in the scan frame), the user can perform a save operation for the second scan object in the scan interface, and the terminal device can respond to this save operation and obtain a scan image for the second scan object (which can be called the second original scan image). Similarly, for each original scan image, the terminal device can remove the occlusion processing to obtain an updated scan image, then the scan result document can include updated scan images of different scan objects (when the same scan object is scanned repeatedly, it can also include two or more updated scan images for the same scan object). That is, the scan result document may include at least two updated scan images, and the at least two updated scan images include a target updated scan image. When displaying the scan result document, the present application may simultaneously display the image acquisition time of the target updated scan image (which can be understood as the time when the user performs the save operation, that is, the time when the original scan image is acquired). At the same time, when displaying the scan result document, the images may be arranged and displayed in the order of the image acquisition time (such as arranging and displaying them in the time order from early to late). That is, in response to the scan result viewing operation for the scan service in the scan interface, the specific method of displaying the scan result document including the target updated scan image may be: in response to the scan result viewing operation for the scan service in the scan interface, the image acquisition time of each updated scan image may be displayed in the scan result document; wherein, the at least two updated scan images in the scan result document are arranged and displayed in the time order of the at least two image acquisition times.

[0158] In an embodiment of the present application, when a user wishes to save and record a certain object, he or she can enter the scanning service through the scanning control and scan and save the object in a scanning manner. At the same time, when there is an occluding object in the original scanned image obtained by scanning, the present application can remove it and perform image filling to optimize the image display effect. The final image displayed does not contain the occluding object and the composition ratio meets the expected image, which can well optimize the scanned image display effect. In summary, the present application can scan and save a certain object in a scanning manner, and can optimize the image display effect in the scanning service.

[0159] As described above, upon acquiring the first original scanned image, the terminal device can restore the scan frame in the scan interface to continue scanning based on the scan frame. When another object to be scanned (referred to as a second scanned object, which can be the same or similar to the first scanned object, or completely different from the first scanned object) appears in the scan interface, the scan frame can automatically detect it and place it within the scan frame. When the second scanned object is completely within the scan frame (or when a certain percentage of the second scanned object is entirely within the scan frame), the user can perform a scan operation on the second scanned object in the scan interface, and the terminal device can respond to this scan operation and acquire a scanned image of the second scanned object (referred to as a second original scanned image). If the user does not exit the scan interface, the scan tasks for the first scanned object and the second scanned object are both tasks within the same scan operation. Based on the first original scanned image and the second original scanned image, a single online scan result document can be generated. When the user clicks the scan result viewer for that scan operation, the scan result document containing the different updated scan images can be viewed. When displaying the scanned document, in order to further optimize the image display effect, in addition to removing the occlusion of each original scanned image, each original scanned image can also be deduplicated to avoid repeated display of the same image when displaying the scanned document. For easier understanding, please refer to Figure 6 , Figure 6 This is a flow chart of an image data processing method provided by an embodiment of the present application. The process can be a process of removing occlusion and deduplication processing on each original scanned image, and then determining the target to update the scanned image. Figure 6 As shown, the process may include at least the following steps S301 to S303:

[0160] Step S301, when the first original scan image is obtained, in response to the scanning operation for the second scan object, a second original scan image is obtained; the second original scan image includes a second blocking object and a second scan object, and the second blocking object refers to an object that blocks a local area of ​​the second scan object.

[0161] Specifically, after the user performs a scan operation on the first scan object in the scan interface, the terminal device may display a saving animation for the first original scanned image in the scan interface, while hiding the scan frame in the scan interface. When the first original scanned image is acquired, the scan frame may be restored in the scan interface to continue performing the scanning service based on the scan frame in the scan interface. Of course, it should be noted that after the user performs a scan operation on the first scan object in the scan interface, the terminal device may not hide the scan frame, but may keep it displayed in the scan interface. When the first original scanned image is acquired, the scanning service may continue to be performed based on the scan frame in the scan interface.

[0162] The second scanning object here can be an object that is the same as or similar to the first scanning object, or an object that is different from the first scanning object. Similarly, when there is a second scanning object in the scanning interface, it can be scanned based on the scanning frame. When the second scanning object is completely within the scanning frame (or a certain proportion of the area is within the scanning frame), the user can perform a scanning operation on the second scanning object, and the terminal device can respond to this scanning operation and obtain a scanned image of the second scanning object (which can be referred to as a second original scanning image). If there is an obstructing object (which can be referred to as a second obstructing object) in the scanning interface that obscures the second scanning object, so that a local area of ​​the second scanning object is invisible in the scanning interface, then the obtained second original scanning image will also include the second obstructing object, and the second obstructing object obscures the local area of ​​the second scanning object.

[0163] Step S302, when there is a similar correlation relationship between the first original scan image and the second original scan image, remove the first occluding object in the first original scan image to obtain a first initial updated scan image, and remove the second occluding object in the second original scan image to obtain a second initial updated scan image.

[0164] Specifically, after obtaining the first original scanned image and the second original scanned image, the first original scanned image and the second original scanned image can be detected to determine whether there is a similar correlation relationship between them (that is, whether they are similar images). If there is a similar correlation relationship, it can be characterized that the first scanned object and the second scanned object are similar objects, and their scanned images are also identical images, and they can be deduplicated and fused.

[0165] When a similar correlation exists between the first original scanned image and the second original scanned image, the first occluding object in the first original scanned image may be removed to obtain an image after the first occluding object is removed (referred to as the first initial updated scanned image); the second occluding object in the second original scanned image may also be removed to obtain an image after the second occluding object is removed (referred to as the second initial updated scanned image). Furthermore, deduplication and fusion processing may be performed on the first initial updated scanned image and the second initial updated scanned image.

[0166] Step S303 : Deduplication and fusion processing is performed on the first initial update scan image and the second initial update scan image to obtain a fused scan image, and the fused scan image is determined as the target update scan image.

[0167] Specifically, the first initial update scan image and the second initial update scan image can be deduplicated and fused. For example, based on their visible content, missing content can be merged and supplemented to produce a relatively complete and reliable fused scan image. This fused scan image can then serve as the target update scan image. In other words, the target update scan image can serve as either the update scan image corresponding to the first scanned object or the update scan image corresponding to the second scanned object. The update scan images corresponding to the first scanned object and the second scanned object are the same fused scan image.

[0168] For easier understanding, please refer to Figure 7 , Figure 7 This is a schematic diagram of a scenario for performing deduplication and fusion processing on an image provided by an embodiment of the present application. Figure 7 As shown, the original scan image 700a1 can be understood as the first original scan image, and the original scan image 700a2 can be understood as the second original scan image. For the original scan image 700a1, there is an occluding object 70a in the original scan image 700a1; for the original scan image 700a2, there is an occluding object 70b in the original scan image 700a2. Figure 7 As shown, the scan object indicated by the original scan image 700a1 and the scan object indicated by the original scan image 700a2 are similar objects. After image detection, it is determined that there is a similar correlation relationship between the original scan image 700a1 and the original scan image 700a2. Since they are similar images, the original scan image 700a1 and the original scan image 700a2 can be deduplicated and fused.

[0169] like Figure 7As shown, the occluding object 70a in the original scanned image 700a1 can be removed to obtain the initial updated scanned image 700a11. The area M1 in the initial updated scanned image 700a11 is the area occluded by the occluding object 70a, and the area M1 is the missing content. The occluding object 70b in the original scanned image 700a2 can also be removed to obtain the initial updated scanned image 700a22. The area M2 in the initial updated scanned image 700a22 is the area occluded by the occluding object 70b, and the area M2 is the missing content. Figure 7 As shown, the missing content in area M1 is visible in the initial update scan image 700a22, while the missing content in area M2 is visible in the initial update scan image 700a11. Based on the visible content in the two images, they can be merged and complemented to obtain the final target updated scan image 700a3.

[0170] It is understandable that when displaying the scanned result document, the updated scanned images in the scanned result document can be arranged and displayed in the order of the image acquisition time of each updated scanned image. Then, after the first original scanned image and the second original scanned image are deduplicated and fused, the image acquisition time of the target updated scanned image can be determined based on the image acquisition time corresponding to the first original scanned image and the second original scanned image, and then these images can be sorted based on the image acquisition time of the target updated scanned image and the image acquisition time of other updated scanned images, and then displayed in sequence based on the arrangement order. Among them, the specific implementation method for determining the image acquisition time of the target updated scanned image can be: the image acquisition time corresponding to the first original scanned image and the second original scanned image can be obtained; then, the earliest image acquisition time can be obtained from the image acquisition time corresponding to the first original scanned image and the second original scanned image, and the earliest image acquisition time can be determined as the image acquisition time of the target updated scanned image; wherein the image acquisition time of the target updated scanned image is used to determine the display order of the target updated scanned images when displaying the scanned result document.

[0171] That is to say, from the above, it can be seen that in the scanning interface, the user can continue to scan different scanning objects to obtain different original scanning images, and the present application can remove the occlusion processing of different original scanning images to obtain updated scanning images, and the present application can then perform de-duplication fusion processing on these updated scanning images to obtain the final fused scanning image. Then, for the first original scanning image, after removing the first occluding object from the first original scanning image, an updated scanning image containing the removed content can be determined (for example, the image after removing the first occluding object from the first original scanning image can be directly used as the updated scanning image), and then the target updated scanning image can be determined based on the updated scanning image.

[0172] Optionally, it is understood that after acquiring the second original scanned image, if a similar correlation is detected between the first original scanned image and the second original scanned image, the second original scanned image can be directly deduplicated (e.g., the second original scanned image can be deleted), and the first original scanned image after being deobstructed can be used as the updated scanned image corresponding to the first scanned object and the second scanned image, respectively. In other words, the target updated scanned image in the scanned result document is generated based on the first original scanned image after deduplicating the second original scanned image (e.g., the updated scanned image is generated based on the updated scanned image obtained by deobstructing the first original scanned image).

[0173] In an embodiment of the present application, in a scanning service, occluded objects in a scanned image may be removed to optimize the image display effect; in addition, similar and identical images may be deduplicated and merged to further optimize the image display effect.

[0174] It is understandable that, from the above, after obtaining the first original scan image and the second original scan image, image detection can be performed on the first original scan image and the second original scan image to determine whether there is a similar correlation relationship between them. In the embodiment of the present application, feature point matching can be used to detect them. For ease of understanding, please refer to Figure 8 , Figure 8 This is a flow chart of an image detection process provided by an embodiment of the present application. The process may be a process of detecting the association relationship between images using a feature point matching method, such as Figure 8 As shown, the process may include at least the following steps S501 to S503:

[0175] Step S501 : Acquire a first set of visual feature points in a first original scanned image and a second set of visual feature points in a second original scanned image.

[0176] Specifically, the first original scanned image and the second original scanned image can be detected respectively to determine a first set of visual feature points in the first original scanned image and a second set of visual feature points in the second original scanned image. An image detection algorithm can be used to detect visual feature points in the original scanned image. The image detection algorithm can be any algorithm capable of detecting visual feature points, for example, the image detection algorithm can be a scale-invariant feature transform (SIFT) algorithm, a speeded up robust features (SURF) algorithm, an oriented fast and rotated brief (ORB) algorithm, and the like.

[0177] Step S502: Determine a matching pair set based on the first visual feature point set and the second visual feature point set; the matching pair set includes N groups of feature point matching pairs, where one group of feature point matching pairs consists of a first visual feature point in the first visual feature point set and a second visual feature point in the second visual feature point set; the first visual feature point included in a group of feature point matching pairs matches the second visual feature point; N is a positive integer.

[0178] Specifically, after determining the first visual feature point set and the second visual feature point set, brute force matching (such as Brute Force matching) can be performed. Through brute force matching, for each first visual feature point in the first visual feature point set, a second visual feature point that best matches it (such as a feature point with the closest vector distance) can be found in the second visual feature point set; similarly, for each second visual feature point in the second visual feature point set, a first visual feature point that best matches it can be found in the first visual feature point set. Subsequently, the CrossCheck algorithm can be used to verify it, improve the confidence of these matched feature points, and through verification, a set of matching pairs can be determined. For example, the first visual feature point set is {first visual feature point 1, first visual feature point 2, first visual feature point 3}, and the second visual feature point set is {second visual feature point 1, second visual feature point 2, second visual feature point 3}. After brute force matching, for the first visual feature point 1, the second visual feature point that matches it in the second visual feature point set is the second visual feature point 1; for the first visual feature point 2, the second visual feature point that matches it in the second visual feature point set is the second visual feature point 3; for the first visual feature point 3, the second visual feature point that matches it in the second visual feature point set is the second visual feature point 2; for the second visual feature point 1, the first visual feature point that matches it in the first visual feature point set is the first visual feature point 1; for the second visual feature point 2, the first visual feature point that matches it in the first visual feature point set is the first visual feature point 2; for the second visual feature point 3, the first visual feature point that matches it in the first visual feature point set is the first visual feature point 2. At this time, they can be verified with each other. For the first visual feature point 1, the second visual feature point that matches it is the second visual feature point 1, and for the second visual feature point 1, it is also matched with the first visual feature point 1. Then it can be considered that the first visual feature point 1 and the second visual feature point 1 have passed the verification, and the first visual feature point 1 and the second visual feature point 1 can form a set of feature point matching pairs; similarly, for the first visual feature point 2, it is matched with the second visual feature point 3, and for the second visual feature point 3, it is matched with the first visual feature point 2. Then it can be considered that the first visual feature point 2 and the second visual feature point 3 have passed the verification, and the first visual feature point 2 and the second visual feature point 3 can form a set of feature point matching pairs; similarly, for the first visual feature point 3, it is matched with the second visual feature point 2, but for the second visual feature point 2, it is matched with the first visual feature point 2. Then it can be considered that the first visual feature point 3 and the second visual feature point 2 have not passed the verification, and the first visual feature point 3 and the second visual feature point 2 cannot form a set of feature point matching pairs.The final feature point matching pairs are [first visual feature point 1, second visual feature point 1] and [first visual feature point 2, second visual feature point 3], and the feature point matching set is {[first visual feature point 1, second visual feature point 1], [first visual feature point 2, second visual feature point 3]}.

[0179] Step S503 : determining the association relationship between the first original scanned image and the second original scanned image based on the N groups of feature point matching pairs.

[0180] Specifically, after determining the set of matching pairs, the first original scanned image and the second original scanned image can be subjected to image projection transformation. For each set of feature point matching pairs, the coordinate distance after projection transformation can be calculated, and the correlation relationship between the first original scanned image and the second original scanned image can be determined based on the coordinate distance. i , feature point matching pair S i The first visual feature point K is included a and the second visual feature point K b (i, a, b are all positive integers) as an example, for determining the association relationship between the first original scanned image and the second original scanned image based on N sets of feature point matching pairs, the specific implementation method can be: the first visual feature point K can be obtained a The corresponding first feature point coordinates and the second visual feature point K b The corresponding second feature point coordinates; then, the coordinate distance between the first feature point coordinates and the second feature point coordinates can be determined as the feature point matching pair S i corresponding coordinate distances; when the coordinate distances corresponding to N groups of feature point matching pairs are determined, the average coordinate distance can be determined based on the N coordinate distances and the number of matching pairs corresponding to the N groups of feature point matching pairs; if the average coordinate distance is less than the coordinate distance threshold, the association relationship between the first original scan image and the second original scan image can be determined as a similar association relationship; if the average coordinate distance is greater than the coordinate distance threshold, the association relationship between the first original scan image and the second original scan image is determined as a difference association relationship.

[0181] That is, after determining the coordinate distances corresponding to N sets of feature point matching pairs, N coordinate distance values ​​can be obtained. These N coordinate distance values ​​can then be summed to obtain the summed result. After obtaining the summed result, an average coordinate distance can be determined based on the summed result and N (i.e., the number of matching pairs). When this average coordinate distance is less than a coordinate distance threshold (which can be a manually defined value), the association relationship between the first original scanned image and the second original scanned image can be determined as a similar association relationship. If it is greater than the coordinate distance threshold, a difference association relationship can be determined (i.e., a non-similar relationship, with differences between the two).

[0182] In an embodiment of the present application, in the scanning business, the occluded objects in the scanned image can be removed to optimize the image display effect; in addition, similar images can be determined by feature point matching, and similar images can be deduplicated and merged to further optimize the image display effect.

[0183] It is understandable that, from the above, after obtaining the first original scan image and the second original scan image, image detection can be performed on the first original scan image and the second original scan image to determine whether there is a similar correlation relationship between them. In the embodiment of the present application, hash code matching can be used to detect it. For ease of understanding, please refer to Figure 9 , Figure 9 This is a flow chart of an image detection process provided by an embodiment of the present application. The process may be a process of detecting the association relationship between images using a hash code matching method, such as Figure 9 As shown, the process may include at least the following steps S701 to S704:

[0184] Step S701 : Obtain a first hash code string corresponding to a first original scanned image and a second hash code string corresponding to a second original scanned image.

[0185] Specifically, the present application may employ a deep learning computer vision algorithm (e.g., a Learning To Hash algorithm) to calculate a first hash code string corresponding to the first original scanned image and a second hash code string corresponding to the second original scanned image. Of course, in addition to employing the Learning To Hash algorithm, other algorithms capable of determining the hash code of an image may also be employed, and these are not limited herein.

[0186] Step S702: Determine the encoding distance between the first Hash encoding string and the second Hash encoding string.

[0187] Specifically, the coding distance between the first Hash coding string and the second Hash coding string may be calculated and determined. The coding distance here may refer to the Hamming distance.

[0188] Step S703: If the coding distance is less than the coding distance threshold, the association relationship between the first original scanned image and the second original scanned image is determined to be a similar association relationship.

[0189] Specifically, the coding distance can be compared with a coding distance threshold. When the coding distance is less than the coding distance threshold (which can be a manually defined value), the association relationship between the first original scanned image and the second original scanned image can be determined as a similar association relationship.

[0190] Step S704: If the coding distance is greater than the coding distance threshold, the association relationship between the first original scanned image and the second original scanned image is determined to be a difference association relationship.

[0191] Specifically, when the coding distance is greater than the coding distance threshold, the association relationship between the first original scanned image and the second original scanned image may be determined as a difference association relationship.

[0192] In an embodiment of the present application, in the scanning business, the occluded objects in the scanned image can be deoccluded to optimize the image display effect; in addition, the hash code matching method can be used to determine similar images, and the similar images can be deduplicated and merged to further optimize the image display effect.

[0193] It is understandable that, from the above, after obtaining the first original scan image and the second original scan image, image detection can be performed on the first original scan image and the second original scan image to determine whether there is a similar correlation relationship between them. In the embodiment of the present application, the text detection frame matching method can also be used to detect it. For ease of understanding, please refer to Figure 10 , Figure 10 This is a flow chart of an image detection process provided by an embodiment of the present application. The process may be a process of detecting the association relationship between images by using a text detection frame matching method, such as Figure 10 As shown, the process may include at least the following steps S901 to S904:

[0194] Step S901 : performing image recognition on the first original scanned image and the second original scanned image respectively to obtain a first text detection frame set corresponding to the first original scanned image and a second text detection frame set corresponding to the second original scanned image.

[0195] Specifically, the image recognition here may refer to optical character recognition (OCR), through which a first set of text detection frames corresponding to the first original scanned image and a second set of text detection frames corresponding to the second original scanned image may be determined. Each text detection frame may include text content.

[0196] Step S902: Determine a detection frame pairing set based on the first text detection frame set and the second text detection frame set; the detection frame pairing set includes M detection frame matching pairs, where one detection frame matching pair consists of a first text detection frame in the first text detection frame set and a second text detection frame in the second text detection frame set; in a detection frame matching pair, an intersection-over-union ratio (IoU) of overlapping areas between the first text detection frame and the second text detection frame included therein is greater than an IoU threshold; and M is a positive integer.

[0197] Specifically, for each first text detection frame in the first text detection frame set, the intersection-over-union (IOU) of the overlapping area between each second text detection frame in the second text detection frame set and the first text detection frame can be calculated. The intersection-over-union (IOU) of the overlapping area can be understood as the ratio of the intersection and union between the coverage areas of the two frames. For a certain first text detection frame, a second text detection frame with the maximum IOU can be found in the second text detection frame set. At this time, the maximum IOU can be matched with the IOU threshold (intersection-over-union threshold). If the maximum IOU is greater than the IOU threshold, it can be determined that the first text detection frame and the second text detection frame are matched, and the first text detection frame and the second text detection frame can be formed into a group of detection frame matching pairs. In the above manner, each first text detection frame can be calculated and determined, thereby obtaining one or more groups of detection frame matching pairs to form a detection frame matching pair set.

[0198] Step S903 : determining an association relationship between the first original scanned image and the second original scanned image based on the M groups of detection frame matching pairs.

[0199] Specifically, M groups of detection frame matching pairs include detection frame matching pairs T j , detection box matching pair T j The first text detection box K is included c and the second text detection box K d (j, c, d are all positive integers) as an example. For determining the association relationship between the first original scanned image and the second original scanned image based on M sets of detection frame matching pairs, the specific implementation method can be as follows: the first text detection frame K c and the second text detection box K d Perform text recognition separately to obtain the first text detection frame K c The corresponding first recognized text and the second text detection box K dThen, the first recognized text and the second recognized text can be normalized respectively to obtain a first normalized recognized text corresponding to the first recognized text and a second normalized recognized text corresponding to the second recognized text; Then, the text distance between the first normalized recognized text and the second normalized recognized text can be determined. If the text distance is less than the text distance threshold, the first text detection box K can be moved to the c and the second text detection box K d , are determined as detection box matching pairs T j corresponding valid matching frames; when the valid matching frames corresponding to the M groups of detection frame matching pairs are determined, the total number of valid matching frames corresponding to the M groups of detection frame matching pairs and the total number of detection frames corresponding to the first text detection frame set and the second text detection frame set can be counted; based on the total number of valid matching frames and the total number of detection frames, the association relationship between the first original scanned image and the second original scanned image can be determined.

[0200] Among them, the specific implementation method for determining the association relationship between the first original scanned image and the second original scanned image based on the total number of valid matching boxes and the total number of detection boxes can be: the ratio between the total number of valid matching boxes and the total number of detection boxes can be determined as the image similarity between the first original scanned image and the second original scanned image; if the image similarity is greater than the similarity threshold, the association relationship between the first original scanned image and the second original scanned image can be determined as a similar association relationship; and if the image similarity is less than the similarity threshold, the association relationship between the first original scanned image and the second original scanned image can be determined as a difference association relationship.

[0201] It is understandable that for a certain set of detection frame matching pairs, it may include a first text detection frame and a second text detection frame. At this time, the text content contained in the first text detection frame (which may be referred to as the first recognized text) and the text content contained in the second text detection frame (which may be referred to as the second recognized text) may be obtained; subsequently, the normalized edit distance between the two texts may be calculated, and the normalized edit distance may be used as the text distance between the two texts. For example, the first normalized recognized text corresponding to the first recognized text and the second normalized recognized text corresponding to the second recognized text may be determined, and the edit distance between the first normalized recognized text and the second normalized recognized text may be determined, and the edit distance may be used as the text distance. If the text distance is less than the text distance threshold (which can be a manually specified value), the first text detection frame can be determined to be a valid matching frame, and the second text detection frame can also be determined to be a valid matching frame. Then, for each set of detection frame matching pairs, the above method can be used to determine whether the first text detection frame and the second text detection frame included therein are valid matching frames. Finally, the number a of first text detection frames that are valid matching frames and the number b of second text detection frames that are valid matching frames can be counted. Based on the two numbers, the total number of valid matching frames can be determined (that is, the number a is added to the number b, and the result obtained can be used as the total number of valid matching frames). The total number c of first text detection frames and the total number d of second text detection frames can be determined. Based on the two total numbers, the total number of detection frames can be determined (that is, the number c is added to the number d, and the result obtained can be used as the total number of detection frames).

[0202] Furthermore, the ratio between the total number of valid matching frames and the total number of detection frames (i.e., (a+b) / (c+d)) can be determined, and this ratio can be used as the image similarity between the first original scanned image and the second original scanned image. If the image similarity is greater than the similarity threshold, the association relationship between the first original scanned image and the second original scanned image can be determined as a similar association relationship, that is, the first original scanned image and the second original scanned image are determined as similar images.

[0203] Optionally, it is understandable that in order to further improve the accuracy of image detection, the above Figures 8-10 The three methods of image detection described in the corresponding embodiment can be used in combination with any two or three methods. For ease of understanding, please refer to Figure 11 , Figure 11 This is a flow chart of determining image association relationships provided by an embodiment of the present application. This flow may refer to a flow of combining three methods for image detection, such as Figure 11 As shown, the process may at least include the following steps S41 to S45:

[0204] Step S41: Determine whether feature point matching is successful.

[0205] Specifically, when performing image detection, feature point matching can be performed first. After the feature point matching is passed (such as the average coordinate distance is less than the coordinate distance threshold), the subsequent step S43 is executed, that is, hash code matching is performed; if the feature point matching is passed, the subsequent step S42 can be entered, that is, the association relationship is determined to be a non-similar association relationship.

[0206] Step S42: determining the association relationship as a non-similar association relationship.

[0207] Step S43: Determine whether the hash code matches.

[0208] Specifically, after the feature point matching is passed (such as the average coordinate distance is less than the coordinate distance threshold), hash code matching can be performed. After the hash code matching is passed (such as the code distance is less than the code distance threshold), the subsequent step S44 can be entered; if the match is passed, step S42 can be entered.

[0209] Step S44: Determine whether the text detection frame matches.

[0210] Specifically, after the hash code matching is passed, the text detection box matching can be performed. After the detection box matching is passed, the subsequent step S45 can be entered; if the match is passed, step S42 can be executed.

[0211] Step S45: determining the association relationship as a similar association relationship.

[0212] In an embodiment of the present application, in the scanning business, the occluded objects in the scanned image can be removed to optimize the image display effect; in addition, similar and identical images can be determined, and similar and identical images can be deduplicated and merged to further optimize the image display effect.

[0213] Optionally, in a feasible embodiment, the same scanning service can be collaboratively executed by multiple online users (users who launch and log in to the target application). That is, the scanning control in this application may refer to a collaborative scanning control. When the scanning control is a collaborative scanning control, multiple users who wish to collaboratively execute a scanning service can trigger the collaborative scanning control to access a scanning interface for executing the same scanning service. In other words, multiple users can view different scanning interfaces and, based on their respective scanning interfaces, scan different scanning objects (or the same scanning object) from different visual angles. It should be understood that each scanning object can correspond to a different updated scan image. The scanned document may include at least two updated scan images (the number of updated scan images is greater than or equal to 2). These at least two updated scan images may include a target updated scan image corresponding to the first original scan image. Furthermore, when the scanning control is a collaborative scanning control, the at least two updated scan objects include collaborative updated scan images provided by a collaborative business object. A collaborative business object may refer to a business object that executes the same scanning service together with a target business object, and a target business object may refer to a triggering object that triggers the collaborative scanning control. That is, when a business object (which can be understood as a user) performs a scanning operation with other business objects using a collaborative scan control, the business object can be referred to as a target business object, and the other business objects performing the scanning operation with the target business object can be referred to as collaborative business objects. The target business object and the collaborative business objects can scan different scan objects (or the same scan object) using their respective scan interfaces, and the resulting scanned images can be aggregated into a single online scan result document. In other words, the updated scanned images included in the scan result document include images provided by both the target business object and the collaborative business objects. Of course, it is understood that when the scan control is a standard scan control, the at least two updated scanned images can include scanned images obtained by the target business object scanning the first scanned object using multiple visual perspectives. Multiple different original scanned images can be obtained by scanning the first scanned object using multiple visual perspectives. De-occlusion processing can also be performed on the multiple original scanned images to obtain multiple different updated scanned images (scanned images after removing occlusions). That is, the at least two updated scanned images can include updated scanned images obtained from multiple visual perspectives for the first scanned object.

[0214] It should be understood that when the scanning control is a collaborative scanning control, a preset condition can be set. Multiple users can only enter the scanning interface and execute the same scanning service if the preset condition is met. For example, the preset condition can be to enter the same password. After triggering the collaborative scanning control, multiple users can only become each other's collaborative service objects and execute the same scanning service together if they enter the same password. For easier understanding, please refer to Figure 12 , Figure 12 This is a flow chart of a display scanning interface provided by an embodiment of the present application. This flow may refer to a flow when the scanning control is a collaborative scanning control, such as Figure 12 As shown, the process may include at least the following steps S401-S402:

[0215] Step S401 : In response to a trigger operation on the collaborative scanning control, a password input interface is displayed; the password input interface is used to instruct the target business object to input a target password.

[0216] Specifically, the collaborative scanning control can be included in the main page of the target application (such as an electronic document application). After the user starts and logs in to the target application, he can first view the main page of the target application, which can include the collaborative scanning control. The user can perform collaborative scanning with other users by triggering the collaborative scanning control in the main page. The collaborative scanning control can also be included in the scanning interface. After the user starts and logs in to the target application, he can first view the main page of the target application, which can include the scanning control (which can be understood as an independent scanning control). The user can enter the scanning interface (which can be called an independent scanning interface, for example) by triggering the scanning control. Figure 2a In the corresponding embodiment, user a can enter the scanning interface 2002) by triggering the scanning control 20a in the main page 2001, and the independent scanning interface may include a collaborative scanning control. The user can perform collaborative scanning with other users by triggering the collaborative scanning control in the independent scanning interface.

[0217] It is understood that when the target business object triggers the collaborative scanning control, the terminal device can respond to this triggering operation by displaying a password input interface, where the target business object needs to enter the target password. Only when two or more users enter the same password can they become collaborative users and jointly perform the same scanning service. Specifically, if the target business object wishes to perform the same scanning service together with Business Object 1 and Business Object 2, then the target business object, Business Object 1, and Business Object 2 must enter the same password before the same scanning service can be performed. If the target business object is the creator of the target password, then the target business object can be called a password creation object. Business object 1 and business object 2 need to enter the target password to become collaborative business objects of the target business object and execute the same scanning business together with the target business object; and if business object 1 or business object 2 is the first object to enter the password, that is, business object 1 or business object 2 has already entered the password before the target business object enters the password, then business object 1 and business object 2 are password creation objects, and the password entered by business object 1 or business object 2 can be called the target password. After the target business object enters the target password in the password input interface, it can become a collaborative business object of business object 1 and business object 2 and execute the same scanning business together with business object 1 and business object 2.

[0218] That is, the target password can be created by the target business object or by the collaborative business object.

[0219] Step 402: When the target password is input in the password input interface, a scanning interface for executing a scanning service together with the collaborative service object is displayed.

[0220] Specifically, when the target business object completes inputting the target password, the target password may also be output and displayed in the password input interface. At this time, the terminal device may display a scanning interface for executing a scanning service together with the collaborative business object.

[0221] For easier understanding, please refer to Figure 13 , Figure 13 This is a schematic diagram of a scene showing a scanning interface provided by an embodiment of the present application. Figure 13 As shown above Figure 2a Taking the corresponding embodiment as an example, user a triggers the scan control 20a in the main page 2001. At this time, the terminal device 100a can respond to this trigger operation and display a scan interface 2002 including a scan box M. The scan interface 2002 may include a collaborative scan control 30a. User a can perform a scan service with other users by triggering the collaborative scan control 30a. Figure 13As shown, when user a triggers the collaborative scanning control 30a, the terminal device 100a may display a password input interface 2005. This password input interface 2005 may include a text prompt message "Enter the same four numbers with your friends to scan and combine documents together," which can be used to prompt user a to enter a target password. For example, user a wishes to perform a scanning task with user b. User b has already created a target password of "1234" (i.e., user b has already entered a password). After user a enters the target password "1234," they can enter the scanning interface for performing a scanning task with user b.

[0222] like Figure 13 As shown, every time user a enters a number, the password input interface 2005 can output and display the number. When user a completes entering the target password "1234", the password input interface 2005 can output and display the complete target password "1234". At this time, the password entered by user a is the same as the password entered by user b. Then the terminal device 100a can display a scanning interface for performing the same scanning business with user b (for ease of distinction, the scanning interface can be referred to as a scanning interface 2006). The scanning interface 2006 can also include a scanning box M and a scanning control 20a. User a can exit the collaboration with user b through the scanning control 20a, and then start to independently perform another scanning business.

[0223] In the embodiment of the present application, a multi-person collaborative scanning method can be provided in the scanning business, which can enrich the scanning form and interaction method and enhance the user experience.

[0224] Optionally, in a feasible embodiment, the terminal device can provide a scanning service sharing control in the password input interface. If a user expects to perform a scanning service with another user, after the user clicks the collaborative scanning control to enter the password input interface, the user can share an invitation message (such as a sharing invitation link) to the other user through the scanning service sharing control. The other user can perform the scanning service with the user through the shared invitation message. In other words, without entering a password, they can become each other's collaborative users by sharing the invitation message. For ease of understanding, please refer to Figure 14 , Figure 14 This is a schematic diagram of a process for executing a scanning service provided by an embodiment of the present application. The process may be a process for executing a scanning service by sharing invitation information. Figure 14 As shown, the process may include at least the following steps S601 to S603:

[0225] Step S601 : In response to a trigger operation on a scanning business sharing control, a list of associated business objects is displayed; each associated business object in the list of associated business objects refers to a business object that has a social association relationship with a target business object in a social application.

[0226] Specifically, a scanning business sharing control may be provided in the password input interface, and the target business object that expects to jointly perform the scanning business with other business objects may share the invitation information for the scanning business with other business objects through the scanning business sharing control. For example, when the target business object triggers the scanning business sharing control, the terminal device may display a list of associated business objects. It is understood that the scanning business sharing control may refer to a sharing path control (such as a social application sharing control), and different social applications may correspond to different sharing path controls, and the target business object may select a certain sharing path control from different sharing path controls as the target sharing path control. When the target business object triggers the target sharing path control, the terminal device may use the social application to which the target sharing path control belongs as the target social application, and the terminal device may display a list of associated business objects of the target business object in the target social application. Each associated business object in the associated business object list refers to a business object that has a social association relationship with the target business object in the target social application.

[0227] Step S602 : In response to a trigger operation on a target associated business object in the associated business object list, a conversation interface associated with the target associated business object is displayed.

[0228] Specifically, the target business object can select a specific associated business object from the list of associated business objects. Selecting a specific associated business object as the object to share invitation information with is referred to as the target associated business object. The terminal device can respond to a trigger operation on the target associated business object by displaying a conversation interface associated with the target associated business object (i.e., a conversation interface between the target business object and the associated business object).

[0229] Step S603: Displaying scanning service invitation information in the conversation interface; the scanning service invitation information is used to indicate the target associated service object and to perform the scanning service together with the target service object.

[0230] Specifically, the terminal device can display the scanning service invitation information in the conversation interface, and the target associated business object can enter the scanning interface for executing the scanning service through the scanning service invitation information and execute the same scanning service together with the target business object.

[0231] For easier understanding, please refer to Figure 15 , Figure 15This is a schematic diagram of a scenario in which scanning service invitation information can be shared, as provided in an embodiment of the present application. Figure 15 As shown above Figure 2a Taking the corresponding embodiment as an example, user a triggers the scan control 20a in the main page 2001. At this time, the terminal device 100a can respond to this trigger operation and display a scan interface 2002 including a scan box M. The scan interface 2002 may include a collaborative scan control 30a. User a can perform a scan service with other users by triggering the collaborative scan control 30a. Figure 15 As shown, when user a triggers collaborative scanning control 30a, terminal device 100a may display password input interface 2005. Password input interface 2005 may include a text prompt message "Enter the same four numbers with your friends to scan and combine documents together," prompting user a to enter a target password. Password input interface 2005 may also include scanning service sharing control 30b and scanning service sharing control 30c. Scanning service sharing control 30b may correspond to social application 1, and scanning service sharing control 30bc may correspond to social application 2. User a can use scanning service sharing control 30b to send invitation information to the associated service object in social application 1, and scan service sharing control 30c to send invitation information to the associated service object in social application 2.

[0232] like Figure 15 As shown, when user a triggers the scanning business sharing control 30c, the terminal device 100a can respond to the trigger operation and display the business object display interface 2007, and display some of the associated business objects of user a in the social application 2 (such as associated business object 1, associated business object 2 and associated business object 3) in the business object display interface 2007. User a can select any associated business object as the target associated business object to share the invitation information, such as Figure 15 As shown, user a generates a trigger operation on the associated business object 3. The terminal device 100a can respond to this trigger operation, display the conversation interface 2008 with the associated business object 3, and display the scanning business invitation information 30x in the conversation interface 2008. The associated business object 3 can enter the scanning interface for performing the scanning business through the invitation information to perform the scanning business with user a.

[0233] It is understood that when multiple users collaborate on a scan, a document viewing control may also be displayed in each user's scanning interface, and the user may view the scanned result document by triggering the document viewing control. In other words, the scan result viewing operation for the scanning service may be a triggering operation of the document viewing control. Taking the target business object as an example, when the target business object triggers the document viewing control, the terminal device may respond to the triggering operation, display the document viewing interface, and display the scanned result document in the document viewing interface. It is understood that the scanned result document may include updated scanned images provided by multiple users. Similar to independent scanning, the embodiment of the present application may perform de-occlusion processing and de-duplication fusion processing on the original scanned images provided by multiple users to optimize the image display effect. When displaying the scanned result document, the present application may display the updated scanned images in order of their image acquisition time, and when displaying each updated scanned image, the object identifier (such as a head image identifier) ​​of the object providing the image and the image acquisition time of the image may be displayed together. Among them, if an updated scan image is determined based on the original scan images provided by multiple business objects, then the image acquisition time of the updated scan image may refer to the earliest image acquisition time among the original scan images provided by multiple business objects. When displaying the updated scan image, the image acquisition time may be displayed, and the object identification of each business object in the multiple business objects may be displayed at the same time. For example, the updated scan image is determined based on the original scan images provided by business object 1, business object 2 and business object 3. Then, when displaying the updated scan image, the object identifications (such as avatar identifications) corresponding to business object 1, business object 2 and business object 3 may be displayed respectively.

[0234] In the embodiment of the present application, a multi-person collaborative scanning method can be provided in the scanning business, which can enrich the scanning form and interaction method and enhance the user experience.

[0235] Optionally, in a feasible embodiment, when multiple users perform a scanning service together, the user who creates the target password (or the user who initiates the scanning service invitation) can have user management permissions. The password-creating user can manage the users who perform the scanning service together and can close the permission of any collaborative user to participate in the scanning service. When a user's permission to participate in the scanning service is closed, the user can no longer participate in the scanning and cannot view the scanned result document corresponding to the scanning service. In other words, the present application can provide a document reading permission management control in the target application. The document reading permission management control can be displayed in the scanning interface of the password-creating user (or the scanning service creating user), or in the document reading interface of the scanning service creating user. The scanning service creating user can manage the scanning service participation permission of the collaborative service object through the document reading permission management control.

[0236] For easier understanding, please refer to Figure 16 , Figure 16 This is a schematic diagram of a permission management scenario provided by an embodiment of the present application. Figure 16 The interface 2003 shown can be a document reading interface. The document reading interface 2003 can include a document reading permission management control 50a. For example, if user a is the target business object and the target password entered by user a is the password created by the target business object for the scanning business, user a is the scanning business creation object and can manage the permissions of the collaborative business object. When user a triggers the document reading permission management control 50a, the terminal device 100a can execute the following actions: Figure 16 Step 31 shown in FIG. 3 is to respond to the triggering operation of the document reading permission management control 50a and display the collaborative business object list. The terminal device 100a can display the document permission management interface 2009 and display the collaborative business object list in the document permission management interface 2009 (each collaborative business object in the collaborative business object list has the permission to read the scanned document). Figure 16 As shown, the collaborative business object list may include collaborative business object Zhang San and collaborative business object Li Si. Further, when user a triggers the collaborative business object Li Si, the collaborative business object Li Si is the target collaborative business object selected by user a, and the terminal device 100a can execute the following Figure 16 Step 32 shown, that is, in response to the trigger operation on the target collaborative business object in the collaborative business object list, displays the permission closing control for the target collaborative business object (the permission closing control is used to close the permission of the target collaborative business object to participate in the scanning business). Figure 16As shown, the terminal device 100a can display the permission closing control 50b for the collaborative business object Li Si. If the user a triggers the permission closing control 50b, the terminal device 100a can execute the following operation: Figure 16 Step 33 shown, that is, in response to the triggering operation of the permission closing control, the collaborative business object list is updated and displayed, wherein the updated collaborative business object list does not include the target collaborative business object. Figure 16 As shown, the list of collaborative business objects displayed by the terminal device 100a does not include the business object Li Si.

[0237] Further, see Figure 17 , Figure 17 This is a system flow chart provided in an embodiment of the present application.

[0238] like Figure 17 Therefore, the process may include at least the following steps S51 to S57:

[0239] Step S51: Scan the scan object.

[0240] Step S52: Automatically capture the scanned object and obtain an original scanned image.

[0241] Step S53: Determine whether there is an occluding object in the original scanned image.

[0242] Specifically, if it exists, the subsequent step S54 can be executed; if it does not exist, the subsequent step S55 can be entered.

[0243] Step S54: remove the blocking object.

[0244] Step S55: Determine whether it is a repeated image.

[0245] Specifically, if it is a repeated image, step S56 may be executed; if it is not a repeated image, the image may be determined as an updated scan image, and step S57 may be executed.

[0246] Step S56: perform deduplication and fusion processing to obtain an updated scan image.

[0247] Step S57: Arrange and display the updated scanned images in chronological order.

[0248] The specific implementation of steps S51 to S57 can be found in the description of the corresponding embodiment above, which will not be described in detail here. The beneficial effects thereof will also not be described in detail.

[0249] Further, see Figure 18 , Figure 18This is a flowchart of another image data processing method provided by an embodiment of the present application. The method can be performed by a terminal device (for example, the above Figure 1 Any terminal device in the terminal device cluster 100 shown) or a service server (such as the above Figure 1 The image data processing method may be executed by the service server 1000 shown in FIG. 1 , or may be executed by the terminal device and the service server together. For ease of understanding, this embodiment takes the method executed by the terminal device as an example. The image data processing method may include at least the following steps S201 to S204:

[0250] 201 : In response to a triggering operation on a scan control, a scan interface for executing a scan service is displayed.

[0251] 202 : In response to a scanning operation on a first scanning object, obtain a first original scanned image.

[0252] 203 : In response to a scanning operation on a second scanning object, obtain a second original scanned image; a similar association relationship exists between the first original scanned image and the second original scanned image.

[0253] 204. In response to the scanning result viewing operation for the scanning business, a scanning result document including a target updated scan image is displayed; the image content of the target updated scan image matches the image content of the deduplicated and fused scan image, and the deduplicated and fused scan image refers to the scan image obtained after deduplicated and fused processing of the first original scan image and the second original scan image.

[0254] Among them, for the specific implementation of steps S201-S204, please refer to the description of the deduplication and fusion processing of the original scanned images in the corresponding embodiment above, which will not be repeated here. Specifically, the scanned result document can include at least two updated scanned images; when the scan control is a collaborative scan control, the at least two updated scanned images include a target updated scanned image and a collaborative updated scanned image; the collaborative updated scanned image refers to the scanned image obtained after deduplication and fusion of the third original scanned image provided by the target business object and the collaborative original scanned image provided by the collaborative business object; the collaborative business object refers to the business object that performs the scanning business together with the target business object, and the target business object refers to the triggering object that generates a triggering operation for the collaborative scan control.

[0255] That is to say, in the scanning business, it is possible to support multiple people collaborating to execute the same scanning business. For the original scanning images obtained by the collaborative business object and the collaborative original scanning images obtained by the target business object, when they have similar correlation relationships, this application can perform deduplication and fusion processing on them to optimize the image display effect.

[0256] In an embodiment of the present application, for a certain object, it can be saved and recorded by scanning, and the object can be referred to as a scanned object. In the present application, a scan control can be displayed. Once the target object triggers the scan control, a scan interface for executing the scan service can be displayed; the target object can perform a scan operation on a first scan object, and the terminal can obtain a scan image corresponding to the first scan object (which can be referred to as a first original scan image); the target object can also perform a scan operation on a second scan object, and the terminal can obtain a scan image corresponding to the second scan object (which can be referred to as a second original scan image). When there is a similar correlation relationship between the first original scan image and the second original scan image, they can be de-duplicated and fused to obtain a target updated scan image. It should be understood that when the target object expects to save and record a certain object, it can enter the scan service through the scan control and scan and save the object by scanning. At the same time, when there are similar and identical images in the scanned original scan images, the present application can de-duplicated and fuse them, and the images finally displayed are non-repeating images, which can well optimize the scan image display effect. In summary, this application can scan and save an object, and in the scanning business, the image display effect can be optimized.

[0257] Further, see Figure 19 , Figure 19 This is a structural diagram of an image data processing device provided in an embodiment of the present application. The image data processing device may be a computer program (including program code) running on a computer device, for example, the image data processing device is an application software; the image data processing device may be used to execute Figure 3 As shown in the method. Figure 19 As shown, the image data processing device 1 may include: an interface display module 11 , a scan image acquisition module 12 and a document display module 13 .

[0258] The interface display module 11 is used to respond to the trigger operation on the scanning control and display the scanning interface for executing the scanning service;

[0259] The scanning image acquisition module 12 is configured to acquire a first original scanned image in response to a scanning operation on a first scanned object; the first original scanned image includes a first blocking object and the first scanned object, where the first blocking object is an object that blocks a local area of ​​the first scanned object;

[0260] The document display module 13 is configured to respond to a scan result viewing operation for a scan service and display a scan result document including a target updated scan image; the image content of the target updated scan image includes the image content after the first blocking object is removed from the first original scan image.

[0261] The specific implementation of the interface display module 11, the scan image acquisition module 12 and the document display module 13 can be found in the above Figure 3 The description of steps S101 to S103 in the corresponding embodiment will not be repeated here.

[0262] In one embodiment, the target updated scan image is determined based on the updated scan image, and the updated scan image includes content after the first occluding object is removed from the first original scan image.

[0263] In one embodiment, the number of updated scan images is greater than or equal to 2; when the scanning control is a collaborative scanning control, at least two updated scan images include a collaborative updated scan image provided by a collaborative business object; a collaborative business object refers to a business object that jointly performs a scanning business with a target business object, and a target business object refers to a trigger object that generates a trigger operation for the collaborative scanning control; when the scanning control is an ordinary scanning control, at least two updated scan images include scan images obtained by the target business object scanning the first scanning object at multiple perspectives.

[0264] In one embodiment, when the scanning control is a collaborative scanning control, the interface display module 11 may include: a password interface display unit 111 and a scanning interface display unit 112 .

[0265] The password interface display unit 111 is used to respond to the trigger operation of the collaborative scanning control and display the password input interface; the password input interface is used to instruct the target business object to enter the target password;

[0266] The scanning interface display unit 112 is configured to display a scanning interface for executing a scanning service together with a collaborative service object when a target password is input in the password input interface.

[0267] The specific implementation of the password interface display unit 111 and the scanning interface display unit 112 can be found in the above Figure 12 The description of step S401-step S402 in the corresponding embodiment will not be repeated here.

[0268] In one embodiment, the password input interface includes a scanning service sharing control;

[0269] The interface display module 11 may further include: an associated object display unit 113 , a conversation interface display unit 114 , and an invitation information display unit 115 .

[0270] The associated object display unit 113 is configured to display a list of associated business objects in response to a trigger operation on the scanning business sharing control; the associated business object list refers to business objects that have a social association relationship with the target business object in the social application;

[0271] The conversation interface display unit 114 is configured to respond to a trigger operation on a target associated business object in the associated business object list and display a conversation interface associated with the target associated business object;

[0272] The invitation information display unit 115 is used to display the scanning service invitation information in the conversation interface; the scanning service invitation information is used to indicate the target associated service object and to perform the scanning service together with the target service object.

[0273] The specific implementation of the associated object display unit 113, the conversation interface display unit 114 and the invitation information display unit 115 can be found in the above Figure 14 The description of steps S601 to S603 in the corresponding embodiment will not be repeated here.

[0274] In one embodiment, the scanning interface includes a document reading control, and the scanning result reading operation for the scanning service refers to a triggering operation for the document reading control;

[0275] The document display module 13 may include a reading interface display unit 131 and a document display unit 132 .

[0276] The reading interface display unit 131 is used to display the document reading interface in response to a trigger operation on the document reading control in the scanning interface;

[0277] The document display unit 132 is configured to display the scan result document including the target updated scan image in the document reading interface.

[0278] The specific implementation of the reading interface display unit 131 and the document display unit 132 can be found in the above Figure 14 The description of step S603 in the corresponding embodiment will not be repeated here.

[0279] In one embodiment, if the adjacent area of ​​the local area blocked by the first blocking object does not contain visible text information, the target updated scan image is determined based on the updated scan image, specifically including: when the number of updated scan images is 1, the updated scan image is repaired according to the attributes of the area around the original area where the first blocking object was located after the first blocking object is removed from the updated scan image to obtain the target updated scan image; when the number of updated scan images is greater than or equal to 2, the area where the first blocking object was originally located is repaired using multiple images to obtain the target updated scan image.

[0280] In one embodiment, the document reading interface further includes a document reading permission management control; the target password input by the target business object is the password created by the target business object for the scanning service;

[0281] The document display module 13 may further include: a collaboration object display unit 133 , a close control display unit 134 , and a list updating unit 135 .

[0282] The collaborative object display unit 133 is used to respond to the trigger operation of the document reading permission management control and display the collaborative business object list; each collaborative business object in the collaborative business object list has the reading permission for the scanned document;

[0283] A close control display unit 134 is configured to respond to a trigger operation on a target collaborative business object in the collaborative business object list and display a permission close control for the target collaborative business object; the permission close control is configured to close the permission of the target collaborative business object to participate in the scanning service;

[0284] The list updating unit 135 is configured to update and display the collaborative business object list in response to a triggering operation on the permission closing control; the collaborative business object list after update and display does not include the target collaborative business object.

[0285] The specific implementation of the collaborative object display unit 133, the close control display unit 134 and the list update unit 135 can be found in the above Figure 16 The description in the corresponding embodiment will not be repeated here.

[0286] In one embodiment, if the adjacent area of ​​the local area occluded by the first occluding object contains visible text information, the predicted text information associated with the visible text information is displayed in the mapped local area in the target updated scan image; the position of the mapped local area in the target updated scan image is the same as the position of the local area in the first original scan image.

[0287] In one embodiment, the image data processing device 1 may further include: an image acquisition module 15 .

[0288] The image acquisition module 15 is configured to acquire a second original scan image in response to a scanning operation on a second scan object when the first original scan image is acquired;

[0289] If a similar association relationship exists between the first original scanned image and the second original scanned image, the target updated scanned image in the scan result document is generated based on the first original scanned image after deduplication of the second original scanned image.

[0290] The specific implementation of the scanning frame recovery module 14 and the image acquisition module 15 can be found in the above Figure 6 The description in the corresponding embodiment will not be repeated here.

[0291] In one embodiment, the scan result document includes at least two updated scan images;

[0292] The document display module 13 is also specifically used to respond to the scanning result reading operation for the scanning business, and display the image acquisition time of each updated scan image in the scanning result document; at least two updated scan images in the scanning result document are arranged and displayed in the time sequence of at least two image acquisition times.

[0293] In one embodiment, the image data processing device 1 may further include: a model input module 16 and a predicted text output module 17 .

[0294] A model input module 16 is used to input visible text information into a text prediction model and extract text features corresponding to the visible text information through the text prediction model;

[0295] The predicted text output module 17 is configured to output predicted text information associated with the visible text information by using text features and a text prediction model.

[0296] The specific implementation of the model input module 16 and the predicted text output module 17 can be found in the above Figure 3 The description in the corresponding embodiment will not be repeated here.

[0297] In one embodiment, the image data processing device 1 may further include: a feature point matching module 18 .

[0298] A feature point matching module 18 is configured to obtain a first set of visual feature points in the first original scanned image and a second set of visual feature points in the second original scanned image;

[0299] The feature point matching module 18 is further configured to determine a matching pair set based on the first visual feature point set and the second visual feature point set; the matching pair set includes N sets of feature point matching pairs, each set of feature point matching pairs consisting of a first visual feature point in the first visual feature point set and a second visual feature point in the second visual feature point set; the first visual feature point and the second visual feature point included in the set of feature point matching pairs match; and N is a positive integer.

[0300] The feature point matching module 18 is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the N sets of feature point matching pairs.

[0301] The specific implementation of the feature point matching module 18 can be found in the above Figure 8 The description of steps S501 to S503 in the corresponding embodiment will not be repeated here.

[0302] In one embodiment, the N groups of feature point matching pairs include feature point matching pairs S i , feature point matching pair S i The first visual feature point K is included a and the second visual feature point K b ; i, a, b are all positive integers;

[0303] The feature point matching module 18 may include a coordinate acquiring unit 181 , a distance determining unit 182 , and a relationship determining unit 183 .

[0304] Coordinate acquisition unit 181, used to acquire the first visual feature point K a The corresponding first feature point coordinates and the second visual feature point K b The corresponding second feature point coordinates;

[0305] The distance determining unit 182 is configured to determine the coordinate distance between the first feature point coordinate and the second feature point coordinate as a feature point matching pair S. i The corresponding coordinate distance;

[0306] a relationship determination unit 183 for determining an average coordinate distance based on the N coordinate distances and the number of matching pairs corresponding to the N sets of feature point matching pairs when the coordinate distances corresponding to the N sets of feature point matching pairs are determined;

[0307] The relationship determining unit 183 is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the average coordinate distance is less than a coordinate distance threshold;

[0308] The relationship determining unit 183 is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the average coordinate distance is greater than a coordinate distance threshold.

[0309] The specific implementation of the coordinate acquisition unit 181, the distance determination unit 182 and the relationship determination unit 183 can be found in the above Figure 8 The description in the corresponding embodiment will not be repeated here.

[0310] In one embodiment, the image data processing device 1 may further include: a hash code matching module 19 .

[0311] a hash code matching module 19 for obtaining a first hash code string corresponding to the first original scanned image and a second hash code string corresponding to the second original scanned image;

[0312] The hash code matching module 19 is further configured to determine a coding distance between the first hash code string and the second hash code string;

[0313] The hash code matching module 19 is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the encoding distance is less than the encoding distance threshold;

[0314] The hash code matching module 19 is further configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the encoding distance is greater than the encoding distance threshold.

[0315] The specific implementation of the hash code matching module 19 can be found in the above Figure 9 The description of steps S701 to S704 in the corresponding embodiment will not be repeated here.

[0316] In one embodiment, the image data processing device 1 may further include: a detection frame matching module 21 .

[0317] A detection frame matching module 21 is configured to perform image recognition on the first original scanned image and the second original scanned image, respectively, to obtain a first text detection frame set corresponding to the first original scanned image and a second text detection frame set corresponding to the second original scanned image;

[0318] The detection frame matching module 21 is further configured to determine a detection frame pairing set based on the first text detection frame set and the second text detection frame set; the detection frame pairing set includes M detection frame matching pairs, where a detection frame matching pair consists of a first text detection frame in the first text detection frame set and a second text detection frame in the second text detection frame set; in a detection frame matching pair, an intersection-over-union ratio (IoU) of overlapping areas between the first text detection frame and the second text detection frame included therein is greater than an IoU threshold; and M is a positive integer.

[0319] The detection frame matching module 21 is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the M groups of detection frame matching pairs.

[0320] The specific implementation of the detection frame matching module 21 can be found in the above Figure 10 The description of steps S901 to S903 in the corresponding embodiment will not be repeated here.

[0321] In one embodiment, the M groups of detection box matching pairs include detection box matching pairs T j , detection box matching pair T j The first text detection box K is included c and the second text detection box K d ; j, c, d are all positive integers;

[0322] The detection frame matching module 21 may include: a recognized text determination unit 211 and a valid frame determination unit 212 .

[0323] The recognition text determination unit 211 is used to detect the first text frame K c and the second text detection box K d Perform text recognition separately to obtain the first text detection frame K c The corresponding first recognized text and the second text detection box K d corresponding second recognition text;

[0324] The recognition text determination unit 211 is further configured to perform normalization processing on the first recognition text and the second recognition text respectively to obtain a first normalized recognition text corresponding to the first recognition text and a second normalized recognition text corresponding to the second recognition text;

[0325] The valid frame determination unit 212 is used to determine the text distance between the first normalized recognized text and the second normalized recognized text. If the text distance is less than the text distance threshold, the first text detection frame K is c and the second text detection box K d , are determined as detection box matching pairs T j The corresponding valid matching box;

[0326] The valid frame determining unit 212 is further configured to, when valid matching frames corresponding to the M groups of detection frame matching pairs are determined, count the total number of valid matching frames corresponding to the M groups of detection frame matching pairs, and the total number of detection frames corresponding to the first text detection frame set and the second text detection frame set;

[0327] The valid frame determining unit 212 is further configured to determine an association relationship between the first original scanned image and the second original scanned image based on the total number of valid matching frames and the total number of detection frames.

[0328] The specific implementation of the recognition text determination unit 211 and the effective frame determination unit 212 can be found in the above Figure 10 The description in the corresponding embodiment will not be repeated here.

[0329] In one embodiment, the valid frame determining unit 212 is further configured to determine the ratio between the total number of valid matching frames and the total number of detection frames as the image similarity between the first original scanned image and the second original scanned image;

[0330] The valid frame determining unit 212 is further specifically configured to determine the association relationship between the first original scanned image and the second original scanned image as a similar association relationship if the image similarity is greater than a similarity threshold;

[0331] The valid frame determining unit 212 is further specifically configured to determine the association relationship between the first original scanned image and the second original scanned image as a difference association relationship if the image similarity is less than a similarity threshold.

[0332] In one embodiment, the image data processing device 1 may further include: an occluding object determining module 22 .

[0333] The occlusion object determination module 22 is configured to input the first original scanned image into an image recognition model, classify the pixel values ​​of the first original scanned image through the image recognition model, and obtain pixel values ​​belonging to the target type;

[0334] The occluding object determining module 22 is further configured to determine an object composed of pixel values ​​belonging to the target type in the first original scanned image as a first occluding object, remove the first occluding object, and obtain a target updated scanned image.

[0335] The specific implementation of the occluding object determination module 22 can be found in the above Figure 3 The description in the corresponding embodiment will not be repeated here.

[0336] In one embodiment, the image data processing device 1 may further include: a frame recovery module 23 , an original image acquisition module 24 , and an image deduplication module 25 .

[0337] A frame recovery module 23 is used to restore the scan frame in the scan interface when the first original scan image is acquired;

[0338] an original image acquisition module 24 for acquiring a second original scanned image in response to a save operation on the second scanned object when the second scanned object is within the scan frame; the second original scanned image includes a second obstructing object and a second scanned object, where the second obstructing object refers to an object that obstructs a partial area of ​​the second scanned object;

[0339] an image deduplication module 25 configured to, when a similar association relationship exists between the first original scanned image and the second original scanned image, remove a first occluding object from the first original scanned image to obtain a first initial updated scanned image, and remove a second occluding object from the second original scanned image to obtain a second initial updated scanned image;

[0340] The image deduplication module 25 is further configured to perform deduplication fusion processing on the first initial update scan image and the second initial update scan image to obtain a fused scan image, and determine the fused scan image as the target update scan image.

[0341] The specific implementation of the frame recovery module 23, the original image acquisition module 24 and the image deduplication module 25 can be found in the above Figure 6 The description of steps S301 to S304 in the corresponding embodiment will not be repeated here.

[0342] In one embodiment, the image data processing device 1 may further include a time determination module 26 .

[0343] A time determination module 26 is configured to obtain image acquisition times corresponding to the first original scan image and the second original scan image respectively;

[0344] The time determination module 26 is further configured to obtain the earliest image acquisition time from the image acquisition times corresponding to the first original scan image and the second original scan image, respectively, and determine the earliest image acquisition time as the image acquisition time of the target updated scan image; the image acquisition time of the target updated scan image is used to determine the display order of the target updated scan image when displaying the scan result document.

[0345] The specific implementation of the time determination module 26 can be found in the above Figure 3 The description in the corresponding embodiment will not be repeated here.

[0346] In an embodiment of the present application, when a user wishes to save and record an object, he can enter the scanning service through the scanning control, and scan and save the object in a scanning manner. At the same time, when there is an occluding object in the original scanned image obtained by scanning, the present application can remove it and perform image filling to optimize the image display effect. The image finally displayed does not contain the occluding object and the composition ratio meets the expectation, which can well optimize the scanned image display effect. At the same time, for duplicate images, deduplication and fusion processing can be performed to further optimize the image display effect. In addition, a collaborative scanning method can be provided to enrich the interaction method. In summary, the present application can scan and save an object in a scanning manner, and in the scanning service, it can optimize the image display effect and enrich the interaction method.

[0347] Further, see Figure 20 , Figure 20 This is a structural diagram of an image data processing device provided in an embodiment of the present application. The image data processing device may be a computer program (including program code) running on a computer device, for example, the image data processing device is an application software; the image data processing device may be used to execute Figure 18 As shown in the method. Figure 20 As shown, the image data processing device 2 may include: an operation response module 31 and a scanned document display module 32 .

[0348] An operation response module 31 is configured to respond to a trigger operation on a scan control and display a scan interface for executing a scan service;

[0349] The operation response module 31 is further configured to respond to a scanning operation on the first scanning object and obtain a first original scanned image;

[0350] The operation response module 31 is further configured to respond to a scanning operation on a second scanning object and obtain a second original scanned image; a similar association relationship exists between the first original scanned image and the second original scanned image;

[0351] The scanned document display module 32 is used to respond to the scan result reading operation for the scanning business and display the scan result document containing the target updated scan image; the image content of the target updated scan image matches the image content of the deduplicated and fused scan image, and the deduplicated and fused scan image refers to the scan image obtained after the deduplication and fusion processing of the first original scan image and the second original scan image.

[0352] The specific implementation of the operation response module 31 and the scanned document display module 32 can be found in the above Figure 18The description of steps S201 to S204 in the corresponding embodiment will not be repeated here, and the beneficial effects brought about will not be repeated either.

[0353] Further, see Figure 21 , Figure 21 This is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 21 As shown above Figure 19 The device 1 or Figure 20 The device 2 in the corresponding embodiment can be applied to the above-mentioned computer device 8000, and the above-mentioned computer device 8000 may include: a processor 8001, a network interface 8004 and a memory 8005. In addition, the above-mentioned computer device 8000 also includes: a user interface 8003, and at least one communication bus 8002. Among them, the communication bus 8002 is used to realize the connection and communication between these components. Among them, the user interface 8003 may include a display screen (Display), a keyboard (Keyboard), and the user interface 8003 may optionally include a standard wired interface and a wireless interface. The network interface 8004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 8005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 8005 may optionally also be at least one storage device located away from the aforementioned processor 8001. As Figure 21 As shown, the memory 8005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application.

[0354] exist Figure 21 In the computer device 8000 shown, the network interface 8004 can provide network communication functions; the user interface 8003 is mainly used to provide an interface for user input; and the processor 8001 can be used to call the device control application stored in the memory 8005 to achieve:

[0355] In response to a trigger operation on the scan control, a scan interface for executing a scan service is displayed;

[0356] In response to a scanning operation on a first scanning object, a first original scanned image is acquired; the first original scanned image includes a first blocking object and the first scanning object, where the first blocking object refers to an object blocking a local area of ​​the first scanning object;

[0357] In response to a scan result viewing operation for a scan service, a scan result document including a target updated scan image is displayed; the image content of the target updated scan image includes the image content after the first blocking object is removed from the first original scan image.

[0358] Or implement:

[0359] In response to a trigger operation on the scan control, a scan interface for executing a scan service is displayed;

[0360] In response to a scanning operation on a first scanning object, acquiring a first original scanned image;

[0361] In response to a scanning operation on a second scanning object, a second original scanned image is acquired; a similar association relationship exists between the first original scanned image and the second original scanned image;

[0362] In response to a scan result viewing operation for a scanning business, a scan result document including a target updated scan image is displayed; the image content of the target updated scan image matches the image content of the deduplicated and fused scan image, and the deduplicated and fused scan image refers to a scan image obtained after deduplicated and fused processing of the first original scan image and the second original scan image.

[0363] It should be understood that the computer device 8000 described in the embodiment of the present application can execute the above Figure 3 or Figure 18 The description of the image data processing method in the corresponding embodiment can also be performed as described above. Figure 19 In the corresponding embodiment, the image data processing device 1 or Figure 20 The description of the image data processing device 2 will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated here either.

[0364] In addition, it should be noted that: the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the computer device 1000 for data processing mentioned above, and the computer program includes program instructions. When the processor executes the program instructions, the computer program can execute the above-mentioned data processing. Figure 3 or Figure 18 The description of the above-mentioned image data processing method in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated here. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application.

[0365] The computer-readable storage medium may be the data processing device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Furthermore, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0366] In one aspect of the present application, a computer program product or computer program is provided. The computer program product or computer program includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in one aspect of the embodiments of the present application.

[0367] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0368] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0369] The methods and related devices provided by the embodiments of the present application are described with reference to the method flow charts and / or structural diagrams provided by the embodiments of the present application. Specifically, each process and / or block in the method flow charts and / or structural diagrams, as well as the combination of processes and / or blocks in the flow charts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including the instruction device, which implements the function specified in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the process. Figure 1 The flow or flows and / or structures illustrate the steps of the functions specified in one block or multiple blocks.

[0370] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A method for processing image data, characterized in that: include: In response to a trigger operation on the scan control, a scan interface for executing a scan service is displayed; In response to a scanning operation on a first scanning object, a first original scanned image is acquired; the first original scanned image includes a first blocking object and the first scanning object, where the first blocking object is an object blocking a local area of ​​the first scanning object; In response to a scanning operation on a second scanning object, a second original scanned image is acquired; the second original scanned image includes a second blocking object and a second scanning object, wherein the second blocking object is an object blocking a local area of ​​the second scanning object; In response to a scan result viewing operation for the scanning business, a scan result document including a target updated scan image is displayed; the image content of the target updated scan image includes the image content after removing the first obstructing object from the first original scan image; when there is a similar association relationship between the first scan object and the second scan object, the target updated scan image is obtained by deduplication and fusion processing of the first initial updated scan image and the second initial updated scan image, the first initial updated scan image refers to the image obtained after removing the first obstructing object from the first original scan image, and the second initial updated scan image refers to the image obtained after removing the second obstructing object from the second original scan image.

2. The method according to claim 1, characterized in that The target updated scan image is determined according to the updated scan image, and the updated scan image includes the content of the first original scan image after the first occluding object is removed.

3. The method according to claim 2, characterized in that The number of the updated scan images is greater than or equal to 2; When the scan control is a collaborative scan control, the at least two updated scan images include a collaborative updated scan image provided by a collaborative business object; the collaborative business object is a business object that executes the scan service together with a target business object, and the target business object is a trigger object that generates a trigger operation for the collaborative scan control; When the scanning control is a common scanning control, the at least two updated scanning images include scanning images obtained by the target business object scanning the first scanning object at multiple viewing angles.

4. The method according to claim 3, characterized in that When the scanning control is a collaborative scanning control, the step of responding to a triggering operation on the scanning control to display a scanning interface for executing a scanning service includes: In response to a trigger operation on the collaborative scanning control, a password input interface is displayed; the password input interface is used to instruct the target business object to enter a target password; When the target password is input in the password input interface, a scanning interface for executing a scanning service together with the collaborative service object is displayed.

5. The method according to claim 4, characterized in that The password input interface includes a scanning service sharing control; The method further comprises: In response to a trigger operation on the scanning business sharing control, a list of associated business objects is displayed; each associated business object in the associated business object list refers to a business object that has a social association relationship with the target business object in the social application; In response to a trigger operation on a target associated business object in the associated business object list, displaying a session interface associated with the target associated business object; The scanning service invitation information is displayed in the conversation interface; the scanning service invitation information is used to indicate the target associated service object and to execute the scanning service together with the target service object.

6. The method according to claim 4, characterized in that The scanning interface includes a document reading control, and the scanning result reading operation for the scanning service refers to a triggering operation for the document reading control; The response to the scan result viewing operation for the scan service, displaying the scan result document including the target updated scan image, includes: In response to a triggering operation on the document reading control in the scanning interface, displaying a document reading interface; The scan result document including the target updated scan image is displayed in the document reading interface.

7. The method according to claim 2, wherein If an adjacent area of ​​the local area blocked by the first blocking object does not contain visible text information, the target updated scan image is determined based on the updated scan image, specifically including: When the number of the updated scanned images is 1, repairing the updated scanned image according to the properties of the area surrounding the area where the first occluding object was originally located after the first occluding object is removed from the updated scanned image to obtain the target updated scanned image; When the number of the updated scanned images is greater than or equal to 2, the region where the first occluded object originally existed is repaired using multiple images to obtain the target updated scanned image.

8. The method according to claim 1, characterized in that If the adjacent area of ​​the local area occluded by the first occluding object contains visible text information, the predicted text information associated with the visible text information is displayed in the mapped local area in the target updated scan image; the position of the mapped local area in the target updated scan image is the same as the position of the local area in the first original scan image.

9. The method according to claim 1, characterized in that The scan result document includes at least two updated scan images, and the response to the scan result viewing operation for the scan service further includes: In response to a scan result viewing operation for the scan service, the image acquisition time of each updated scan image is displayed in the scan result document; the at least two updated scan images in the scan result document are arranged and displayed in a chronological order according to the at least two image acquisition times.

10. The method according to claim 8, characterized in that The method further comprises: Inputting the visible text information into a text prediction model, and extracting text features corresponding to the visible text information through the text prediction model; The predicted text information associated with the visible text information is outputted by using the text features and the text prediction model.

11. The method according to claim 1, wherein The method further comprises: Acquire a first set of visual feature points in the first original scanned image and a second set of visual feature points in the second original scanned image; Determine a matching pair set based on the first visual feature point set and the second visual feature point set; the matching pair set includes N groups of feature point matching pairs, where a group of feature point matching pairs consists of a first visual feature point in the first visual feature point set and a second visual feature point in the second visual feature point set; the first visual feature point and the second visual feature point included in a group of feature point matching pairs match; N is a positive integer; An association relationship between the first original scanned image and the second original scanned image is determined based on the N groups of feature point matching pairs.

12. The method according to claim 11, characterized in that The N groups of feature point matching pairs include feature point matching pairs S i , the feature point matching pair S i The first visual feature point K is included a and the second visual feature point K b ; i, a, b are all positive integers; Determining the association relationship between the first original scanned image and the second original scanned image based on the N groups of feature point matching pairs includes: Get the first visual feature point K a The corresponding first feature point coordinates, and the second visual feature point K b The corresponding second feature point coordinates; The coordinate distance between the first feature point coordinate and the second feature point coordinate is determined as the feature point matching pair S i The corresponding coordinate distance; When the coordinate distances corresponding to the N sets of feature point matching pairs are determined, an average coordinate distance is determined based on the N coordinate distances and the number of matching pairs corresponding to the N sets of feature point matching pairs; If the average coordinate distance is less than a coordinate distance threshold, determining the association relationship between the first original scanned image and the second original scanned image as a similar association relationship; If the average coordinate distance is greater than the coordinate distance threshold, the association relationship between the first original scanned image and the second original scanned image is determined to be a difference association relationship.

13. The method according to claim 1, wherein The method further comprises: Obtaining a first hash code string corresponding to the first original scanned image and a second hash code string corresponding to the second original scanned image; determining a coding distance between the first hash-coded string and the second hash-coded string; If the coding distance is less than the coding distance threshold, determining the association relationship between the first original scanned image and the second original scanned image as a similar association relationship; If the coding distance is greater than the coding distance threshold, the association relationship between the first original scanned image and the second original scanned image is determined to be a difference association relationship.

14. The method according to claim 1, wherein The method further comprises: performing image recognition on the first original scanned image and the second original scanned image respectively to obtain a first text detection frame set corresponding to the first original scanned image and a second text detection frame set corresponding to the second original scanned image; Determine a detection frame pairing set based on the first text detection frame set and the second text detection frame set; the detection frame pairing set includes M detection frame matching pairs, where a detection frame matching pair consists of a first text detection frame in the first text detection frame set and a second text detection frame in the second text detection frame set; in a detection frame matching pair, an intersection-over-union ratio of overlapping areas between the first text detection frame and the second text detection frame included in the pair is greater than an intersection-over-union ratio threshold; and M is a positive integer. An association relationship between the first original scanned image and the second original scanned image is determined based on the M groups of detection frame matching pairs.

15. The method according to claim 14, characterized in that The M groups of detection frame matching pairs include detection frame matching pairs T j , the detection box matches T j The first text detection box K is included c and the second text detection box K d ; j, c, d are all positive integers; The determining, based on the M groups of detection frame matching pairs, an association relationship between the first original scanned image and the second original scanned image includes: For the first text detection frame K c With the second text detection box K d Perform text recognition respectively to obtain the first text detection frame K c The corresponding first recognized text and the second text detection box K d corresponding second recognition text; Normalizing the first recognized text and the second recognized text respectively to obtain a first normalized recognized text corresponding to the first recognized text and a second normalized recognized text corresponding to the second recognized text; Determine the text distance between the first normalized recognized text and the second normalized recognized text. If the text distance is less than the text distance threshold, move the first text detection frame K c With the second text detection box K d , are determined as the detection frame matching pair T j The corresponding valid matching box; When valid matching frames corresponding to the M groups of detection frame matching pairs are determined, counting the total number of valid matching frames corresponding to the M groups of detection frame matching pairs, and the total number of detection frames corresponding to the first text detection frame set and the second text detection frame set; Based on the total number of valid matching frames and the total number of detection frames, an association relationship between the first original scanned image and the second original scanned image is determined.

16. The method according to claim 15, characterized in that The determining, based on the total number of valid matching frames and the total number of detection frames, an association relationship between the first original scanned image and the second original scanned image includes: determining a ratio between the total number of valid matching frames and the total number of detection frames as the image similarity between the first original scanned image and the second original scanned image; If the image similarity is greater than a similarity threshold, determining the association relationship between the first original scanned image and the second original scanned image as a similar association relationship; If the image similarity is less than a similarity threshold, the association relationship between the first original scanned image and the second original scanned image is determined to be a difference association relationship.

17. The method according to claim 1, wherein The method further comprises: Inputting the first original scanned image into an image recognition model, and classifying pixel values ​​of the first original scanned image by the image recognition model to obtain pixel values ​​belonging to a target type; The object composed of the pixel values ​​belonging to the target type in the first original scanned image is determined as the first occluding object, and the first occluding object is removed to obtain the target updated scanned image.

18. The method according to claim 1, wherein The scan result document includes at least two updated scan images; when the scan control is a collaborative scan control, the at least two updated scan images include the target updated scan image and the collaborative updated scan image; the collaborative updated scan image refers to the scan image obtained after deduplication and fusion of the third original scan image provided by the target business object and the collaborative original scan image provided by the collaborative business object; the collaborative business object refers to the business object that jointly executes the scanning business with the target business object, and the target business object refers to the trigger object that generates a trigger operation for the collaborative scan control.

19. An image data processing device, characterized in that: include: An interface display module, configured to respond to a trigger operation on a scan control and display a scan interface for executing a scan service; a scanned image acquisition module configured to acquire a first original scanned image in response to a scanning operation on a first scanned object; the first original scanned image includes a first obstructing object and the first scanned object, wherein the first obstructing object refers to an object that obstructs a local area of ​​the first scanned object; The scanned image acquisition module is further configured to acquire a second original scanned image in response to a scanning operation on a second scanned object; the second original scanned image includes a second obstructing object and a second scanned object, wherein the second obstructing object refers to an object that obstructs a local area of ​​the second scanned object; A document display module is used to respond to a scan result reading operation for the scanning business and display a scan result document including a target updated scan image; the image content of the target updated scan image includes the image content after removing the first occluding object from the first original scan image; when there is a similar association relationship between the first scan object and the second scan object, the target updated scan image is obtained by deduplication and fusion processing of the first initial updated scan image and the second initial updated scan image, the first initial updated scan image refers to the image obtained after removing the first occluding object from the first original scan image, and the second initial updated scan image refers to the image obtained after removing the second occluding object from the second original scan image.

20. A computer device, characterized in that: include: processor, memory, and network interface; The processor is connected to the memory and the network interface, wherein the network interface is used to provide network communication functions, the memory is used to store program code, and the processor is used to call the program code to enable the computer device to execute the method according to any one of claims 1 to 18.

21. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded by a processor and executing the method according to any one of claims 1 to 18.

22. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. The computer instructions are suitable for being read and executed by a processor, so as to enable a computer device having the processor to perform the method according to any one of claims 1 to 18.

Images