Scanning image processing method and device, storage medium and electronic equipment
By collecting and analyzing image data on the target display device and determining the source of the scanning action, the problem of difficulty in determining the source of the image scanning of the media information release account is solved, and malicious order brushing is reduced and management efficiency is improved.
Patent Information
- Application Number
- CN202310661626.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-06
AI Technical Summary
In the prior art, it is difficult for media information release accounts to determine the source of the action of identifying the image scanning, resulting in malicious order brushing and other problems, and there is no effective solution.
By controlling the target display device, obtain the target identification image preset by the media information release account, and collect image data after the target display device detects the terminal, determine the target object to perform scanning actions, send confirmation information to the media information release account, and mark the source of the scanning actions .
It realizes accurate determination of the source of the scanning action of identifying the image, reduces malicious order brushing, and improves the traffic sharing management efficiency of media information publishing accounts.
Smart Images

Figure CN119089918A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computers, and in particular to a method and device for processing scanned images, a storage medium, and an electronic device. Background Art
[0002] At present, when media information publishing accounts release media information, there are generally two forms: one is paper stickers and the other is electronic posters. Both methods require the media information publishing accounts to generate different logo images for different customers and distribute them to customers, which has a large management cost.
[0003] In addition, electronic posters and paper stickers will have different profit-sharing strategies for different media information publishing accounts or customers. Currently, media information publishing accounts generate different logo images and distribute them to merchants, and then distinguish the traffic according to different entrances for profit sharing. Due to the technical problem that it is difficult to determine the source of the logo image scanning action, it is easy to cause malicious orders to obtain traffic sharing.
[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention
[0005] The embodiments of the present application provide a method and device for processing a scanned image, a storage medium, and an electronic device, so as to at least solve the technical problem in the related art that the source of the action of scanning an identification image is difficult to determine.
[0006] According to one aspect of an embodiment of the present application, a method for processing a scanned image is provided, comprising: controlling a target display device to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with target media information, the target media information is media information pre-produced by the media information publishing account, and the target display device is used to display the target identification image; when the target display device displays the target identification image and a target terminal is detected by the target display device, controlling the target display device to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device; when it is determined according to the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, sending target confirmation information to the media information publishing account, wherein the target confirmation information is used to mark the media information publishing account that the target object has performed the target scanning action, the target determination information includes a first identity used to mark the target display device, and the target terminal is configured to display the target media information when the target object has performed the target scanning action.
[0007] According to another aspect of an embodiment of the present application, a scanned image processing device is further provided, comprising: an acquisition module, configured to control a target display device to acquire a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is media information pre-produced by the media information publishing account, and the target display device is used to display the target identification image; a collection module, configured to control the target display device to collect target image data when the target display device displays the target identification image and a target terminal is detected by the target display device, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device; a sending module, configured to send target confirmation information to the media information publishing account when it is determined according to the target image data that the target image data includes a target object and the target object controls the target terminal to perform a target scanning action, wherein the target confirmation information is used to mark the media information publishing account that the target object has performed the target scanning action, the target determination information includes a first identity mark for marking the target display device, and the target terminal is configured to display the target media information when the target object has performed the target scanning action.
[0008] Optionally, the device is also used for: when the target display device displays the target identification image and the target terminal is detected by the target display device, after controlling the target display device to collect target image data, determining posture estimation data based on the target image data, wherein the posture estimation data is used to estimate the current posture of the target object; when the current posture indicates that the target object performs the target scanning action, determining that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action.
[0009] Optionally, the device is used to determine posture estimation data based on the target image data in the following manner: performing key point detection on the target image data to determine key point position information of the target object, wherein the key point position information includes position information obtained by detecting at least one part of the target object; performing posture estimation based on the key point position information to obtain the posture estimation data.
[0010] Optionally, the device is used to perform key point detection on the target image data and determine key point position information of the target object in the following manner: perform a preprocessing operation on the target image data to obtain initial image data, wherein the preprocessing operation is used to improve the accuracy of position detection of key points of the target object in the initial image data; perform key point detection on the initial image data to determine the key point position information of the target object; perform posture estimation based on the key point position information to determine key posture data, wherein the key posture data is used to indicate whether the current posture is that the target object is holding the target terminal to scan toward the target display device; perform a post-processing operation on the key posture data to obtain the posture estimation data, wherein the post-processing operation is used to improve the stability of estimating the posture of the target object.
[0011] Optionally, the device is used to determine that the target image data includes the target object and that the target object controls the target terminal to perform the target scanning action when the current posture indicates that the target object performs the target scanning action in the following manner: when the current posture indicates that the target object performs the target scanning action, obtaining target part feature information of the target object according to the target image data; searching for the target object in a preset database according to the target part feature information, and when the target object is found, determining that the target image data includes the target object and that the target object controls the target terminal to perform the target scanning action.
[0012] Optionally, the apparatus is used to control a target display device to obtain a target identification image pre-set by a media information publishing account in the following manner: controlling the target display device to obtain a target data synchronization protocol, wherein the target data synchronization protocol is a protocol that associates the media information publishing account with a target account, the target account is a login account of the target display device, and the target display device having the target data synchronization protocol is configured to allow the target confirmation information to be sent to the media information publishing account; in response to the target data synchronization protocol having been transmitted to the target display device, controlling the target display device to obtain the target identification image, and setting the target identification image as the image to be displayed.
[0013] Optionally, the apparatus is used to control the target display device to obtain the target data synchronization protocol in at least one of the following ways: inputting the target data synchronization protocol through a text input device deployed by the target display device; controlling the target display device to receive a protocol identification image, and scanning the protocol identification image through a scanning device deployed by the target display device to generate the target data synchronization protocol.
[0014] Optionally, the apparatus is used to control the target display device to obtain the target identification image in response to the target data synchronization protocol having been transmitted to the target display device in the following manner: in response to the target data synchronization protocol having been transmitted to the target display device, control the target display device to obtain the background image and sub-identification image sent by the media information publishing account; and generate the target identification image based on the background image and the sub-identification image.
[0015] Optionally, the device is used to send target confirmation information to the media information publishing account when it is determined based on the target image data that the target image data includes a target object and the target object controls the target terminal to perform a target scanning action in the following manner: determine the communication address of the media information publishing account according to the target data synchronization protocol; obtain the first identity identifier and the second identity identifier corresponding to the target account; generate the target confirmation information based on the first identity identifier and the second identity identifier, and send the target confirmation information to the communication address, wherein the media information publishing account is set to transfer a predetermined number of virtual resources to the target account when the target confirmation information is received, and the predetermined number is related to the device type of the target display device and the number of times the target identification image is scanned.
[0016] Optionally, the apparatus is used to control the target display device to collect target image data when the target display device displays the target identification image and the target terminal is detected by the target display device in the following manner: when the target display device displays the target identification image, control a target sensor deployed by the target display device to perform detection to obtain a target detection result, wherein the target detection result includes whether the target terminal is detected within a preset distance of the target sensor; when the target terminal is detected within the preset distance, control the target display device to collect the target image data.
[0017] Optionally, the device is also used for: when the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data, performing desensitization processing on the target image data to obtain desensitized image data, wherein the desensitized image data is used to verify the accuracy of the target confirmation information; saving the desensitized image data to a preset storage space, and automatically destroying the desensitized image data in the preset storage space when the saving time exceeds the preset time.
[0018] According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned scanned image processing method when running.
[0019] According to another aspect of the embodiment of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above scanned image processing method.
[0020] According to another aspect of an embodiment of the present application, there is also provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the above-mentioned scanned image processing method through the computer program.
[0021] In an embodiment of the present application, a target display device is controlled to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is the media information pre-produced by the media information publishing account, and the target display device is used to display the target identification image. When the target display device displays the target identification image and the target terminal is detected by the target display device, the target display device is controlled to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device, and when it is determined according to the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, target confirmation information is sent to the media information publishing account, wherein the target confirmation information is used to mark the target to the media information publishing account. The object performs a target scanning action, and the target determination information includes a first identity identifier for marking a target display device. The target terminal is configured to display target media information when the target object performs the target scanning action. After obtaining user authorization, when the target terminal approaches the target display device, the target display device begins to identify and determine the scanning action of the object, and identifies that the current scanning action is an action of scanning an identification image provided by the target display device, and the target display device will be associated with a media information publishing account, so that it is more convenient for the media information publishing account to share traffic, and there is no need to update and maintain multiple identification images, that is, the purpose of source differentiation can be achieved, thereby achieving the technical effect of quickly completing the source differentiation of the scanning action and improving the utilization rate of the target display device, thereby solving the technical problem of difficulty in determining the source of the identification image scanning action in the related technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0023] Figure 1 is a schematic diagram of an application environment of an optional scanned image processing method according to an embodiment of the present application;
[0024] Figure 2 is a flowchart of an optional method for processing a scanned image according to an embodiment of the present application;
[0025] Figure 3 is a schematic diagram of an optional method for processing a scanned image according to an embodiment of the present application;
[0026] Figure 4 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0027] Figure 5 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0028] Figure 6 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0029] Figure 7 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0030] Figure 8 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0031] Fig. 9 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0032] Fig.10 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0033] Fig.11 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0034] Fig.12 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application;
[0035] Fig.13 is a schematic structural diagram of an optional scanning image processing device according to an embodiment of the present application;
[0036] Fig.14 is a schematic structural diagram of an optional scanned image processing product according to an embodiment of the present application;
[0037] Fig.15 It is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0038] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.
[0039] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0040] First, some nouns or terms that appear in the description of the embodiments of the present application are subject to the following interpretation:
[0041] Mobile phone identification: technology that exchanges a person’s identity information through mobile phone multimedia information.
[0042] 3D (3 Dimensional) camera: Similar to traditional cameras, it adds living body-related software and hardware, including depth cameras and infrared cameras, to ensure information security.
[0043] SN (Serial Number): a string serial number that uniquely identifies a device.
[0044] SQLite: is a lightweight database and a relational database management system that complies with ACID.
[0045] The present application is described below in conjunction with embodiments:
[0046] According to one aspect of an embodiment of the present application, a method for processing a scanned image is provided. Optionally, in this embodiment, the method for processing a scanned image can be applied to Figure 1 In the hardware environment composed of the server 101 and the terminal device 103 shown in FIG. Figure 1 As shown, the server 101 is connected to the terminal 103 via a network, and can be used to provide services for the terminal device or an application installed on the terminal device. The application can be a video application, an instant messaging application, a browser application, an educational application, a game application, etc. A database 105 may be set up on the server or independently of the server to provide data storage services for the server 101, for example, a game data storage server. The above-mentioned network may include, but is not limited to, a wired network and a wireless network, wherein the wired network includes, a local area network, a metropolitan area network and a wide area network; the wireless network includes, Bluetooth, WIFI and other networks that implement wireless communication; the terminal device 103 may be a terminal configured with an application, and may include, but is not limited to, at least one of the following: a mobile phone (such as an Android phone, an iOS phone, etc.), a laptop computer, a tablet computer, a PDA, a MID (Mobile Internet Devices), a PAD, a desktop computer, a smart TV, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, a virtual reality (VR) terminal, an augmented reality (AR) terminal, a mixed reality (MR) terminal and other computer devices; the above-mentioned server may be a single server, a server cluster consisting of multiple servers, or a cloud server.
[0047] Combination Figure 1 As shown, the above scanned image processing method can be implemented in the terminal device 103 through the following steps:
[0048] S1, obtaining a target identification image pre-set by a media information publishing account on a terminal device 103, wherein the target identification image has a corresponding relationship with target media information, the target media information is media information pre-made by the media information publishing account, and the target display device is used to display the target identification image;
[0049] S2, when the target display device displays the target identification image and the target terminal is detected by the target display device, target image data is collected on the terminal device 103, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device;
[0050] S3. When it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, a target confirmation message is sent to the media information publishing account on the terminal device 103, wherein the target confirmation message is used to mark the target object to perform a target scanning action to the media information publishing account, and the target determination information includes a first identity identifier for marking the target display device, and the target terminal is configured to display the target media information when the target object performs a target scanning action.
[0051] Optionally, in this embodiment, the above-mentioned scanned image processing method can also be implemented by a server, for example, Figure 1 It is implemented in the server 101 shown; or it is implemented by the terminal device and the server together.
[0052] The above is only an example and is not specifically limited in this embodiment.
[0053] Optionally, as an optional implementation, as Figure 2 As shown, the above-mentioned scanned image processing method includes:
[0054] S202, controlling the target display device to obtain a target identification image pre-set by the media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is the media information pre-made by the media information publishing account, and the target display device is used to display the target identification image;
[0055] Optionally, in this embodiment, the above-mentioned target display device may include but is not limited to terminal devices that allow the display of logo images, for example, mobile phones (such as Android phones, iOS phones, etc.), laptops, tablets, PDAs, MIDs (Mobile Internet Devices), PADs, desktop computers, smart TVs, intelligent voice interaction devices, smart home appliances, car terminals, etc.
[0056] It should be noted that the above-mentioned scanned image processing method may include but is not limited to application scenarios such as game scenarios, live broadcast scenarios, payment scenarios, etc. that need to display identification images for users to scan.
[0057] Optionally, in this embodiment, the above-mentioned media information publishing account can be understood as an account of an advertiser, a system administrator, a game company, etc. that is allowed to publish media information.
[0058] It should be noted that the above media information publishing account is pre-set with a target identification image, and the target identification image may be a QR code, a bar code, or the like.
[0059] Exemplarily, taking the target identification image as a QR code, the QR code may be a circular QR code, a rectangular QR code, etc. The target identification image is provided to the user for scanning, so that after the user scans, the user can jump to the display screen corresponding to the target media information published by the media information publishing account.
[0060] In an exemplary embodiment, Figure 3 is a schematic diagram of an optional method for processing a scanned image according to an embodiment of the present application, such as Figure 3 As shown, it includes a target terminal 302 and a target display device 304, wherein the target identification image is displayed in the display area of the above target display device, and the user controls the target terminal 302 to start the scanning function, scans the target identification image, and completes the above scanning action.
[0061] Optionally, in this embodiment, the corresponding relationship between the target identification image and the target media information can be understood as the user of the media information publishing account or the target display device pre-sets a binding relationship between the target identification image and the target media information.
[0062] It should be noted that the above target media information may include but is not limited to web pages, music, animations, texts and other media information that can be played or displayed after jumping.
[0063] In an exemplary embodiment, the target display device needs to have the function of collecting image data in addition to displaying the target identification image.
[0064] S204, when the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device;
[0065] Optionally, in this embodiment, the target display device displaying the target identification image can be understood as allowing the target identification image to be scanned from the display area of the target display device through the terminal device.
[0066] Optionally, in this embodiment, the target display device detecting the target terminal may be understood as the target display device being pre-deployed with a sensor that allows detection of an object, and the sensor is capable of detecting and identifying whether an object within a predetermined range is a target terminal.
[0067] It should be noted that the above-mentioned control of the target display device to collect target image data can be understood as the target display device is pre-deployed with a camera (for example, a 3D camera) that allows image acquisition, so that image acquisition can be started when the target terminal is detected.
[0068] In an exemplary embodiment, Figure 4 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Figure 4 As shown, it includes a target terminal and a target display device, wherein the target display device is deployed with an image acquisition device, and the acquisition direction of the image acquisition device can be approximately perpendicular to the display direction of the target identification image, that is, when the target identification image is displayed upward, the acquisition direction is also upward. The purpose of the image acquisition device is to photograph the object of the terminal device that currently holds the scanned target identification image.
[0069] S206, when it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, a target confirmation message is sent to the media information publishing account, wherein the target confirmation message is used to mark the target object to perform a target scanning action to the media information publishing account, the target determination information includes a first identity identifier for marking a target display device, and the target terminal is configured to display the target media information when the target object performs a target scanning action.
[0070] Optionally, in this embodiment, the above-mentioned determination that the target image data includes the target object based on the target image data can be understood as identifying the target object from the target image data, and the above-mentioned target object controlling the target terminal to perform the target scanning action can be understood as judging that the target object has performed the above-mentioned target scanning action through posture recognition of the object from the target image data.
[0071] It should be noted that the sending of the target confirmation information to the media information publishing account can be understood as informing the media information publishing account that the source of the current scanning action is authentic and that the target identification image is scanned by the target scanning action performed by the target object.
[0072] Optionally, in this embodiment, the first identity identifier may be understood as a unique device identifier of the target display device, which is used to indicate that the scanning operation corresponding to the target scanning action originates from the device.
[0073] In an exemplary embodiment, Figure 5 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Figure 5 As shown, it includes a target terminal and a target display device. After the target identification image is scanned by the target terminal, the display screen of the target terminal jumps to the page where the target media information is located, so as to respond to the scanning operation of the target identification image and display the above target media information on the target terminal.
[0074] Through this embodiment, a target display device is controlled to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is the media information pre-made by the media information publishing account, and the target display device is used to display the target identification image. When the target display device displays the target identification image and the target terminal is detected by the target display device, the target display device is controlled to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device, and when it is determined according to the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, target confirmation information is sent to the media information publishing account, wherein the target confirmation information is used to mark the target to the media information publishing account. The object performs a target scanning action, and the target determination information includes a first identity identifier for marking a target display device. The target terminal is configured to display target media information when the target object performs a target scanning action. After obtaining user authorization, when the target terminal approaches the target display device, the target display device begins to identify and determine the scanning action of the object, and identifies that the current scan is a scanning action completed by an identification image provided by the target display device. The target display device will be associated with a media information publishing account, so that it is more convenient for the media information publishing account to share traffic, and there is no need to update and maintain multiple identification images, that is, the purpose of source differentiation can be achieved, thereby achieving the technical effect of quickly completing the source differentiation of the scanning action and improving the utilization rate of the target display device, thereby solving the technical problem in the related art that it is difficult to determine the source of the identification image scanning action.
[0075] As an optional solution, when the target display device displays the target identification image and the target terminal is detected through the target display device, after controlling the target display device to collect target image data, the above method also includes: determining posture estimation data based on the target image data, wherein the posture estimation data is used to estimate the current posture of the target object; when the current posture indicates that the target object performs a target scanning action, determining that the target image data includes the target object, and the target object controls the target terminal to perform a target scanning action.
[0076] Optionally, in this embodiment, the above-mentioned posture estimation data is used to estimate the current posture of the target object, and the current posture can be understood as whether the target object has performed a target scanning action, or the type of action the target object is performing, etc., depending on the calculation model for posture estimation.
[0077] In an exemplary embodiment, Figure 6 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Figure 6As shown, the target object holds the target terminal to scan the target display device. At this time, the image acquisition device deployed on the target display device starts to acquire images in the direction of the target terminal. After the target object is acquired, the posture estimation data corresponding to the target object is calculated. If the posture estimation data indicates that the target object is performing a target scanning action, it can be understood that the scan is a scanning operation caused by the scanning action completed by the target object. If the posture estimation data indicates that the target object does not perform the target scanning action, it can be understood that the scan is not a scanning operation caused by the scanning action, that is, the scanning operation is invalid and may be a brushing operation.
[0078] As an optional solution, the posture estimation data is determined according to the target image data, including:
[0079] Performing key point detection on the target image data to determine key point position information of the target object, wherein the key point position information includes position information obtained by detecting at least one part of the target object;
[0080] The attitude is estimated based on the position information of the key points to obtain the attitude estimation data.
[0081] Optionally, in this embodiment, the key point detection on the target image data can be understood as position information obtained by detecting at least one part of the target object in the target image data, and the at least one part can be the head, hand, chest, etc. of the target object.
[0082] It should be noted that the above key point detection methods include but are not limited to using a deep learning model to detect key points in an image or video, usually using a convolutional neural network (CNN) or its variants. These key points include the head, arms, legs, torso and other parts of the object. By detecting the positions of these key points, the posture of the object can be inferred.
[0083] The above convolutional neural network can be understood as a computing method based on artificial intelligence, where artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.
[0084] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0085] Computer Vision (CV) is a science that studies how to make machines "see". To put it more specifically, it refers to machine vision such as using cameras and computers to replace human eyes to identify and measure targets, and further perform graphic processing so that computer processing becomes an image that is more suitable for human eye observation or transmission to instrument detection. As a scientific discipline, computer vision studies related theories and technologies, and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous positioning and map construction, and other technologies, as well as common biometric recognition technologies such as face recognition and fingerprint recognition.
[0086] As an optional solution, key point detection is performed on target image data to determine key point position information of the target object, including: performing a preprocessing operation on the target image data to obtain initial image data, wherein the preprocessing operation is used to improve the accuracy of position detection of key points of the target object in the initial image data; performing key point detection on the initial image data to determine key point position information of the target object; performing posture estimation based on the key point position information to determine key posture data, wherein the key posture data is used to indicate whether the current posture is that the target object is holding a target terminal to scan toward a target display device; performing a post-processing operation on the key posture data to obtain posture estimation data, wherein the post-processing operation is used to improve the stability of estimating the posture of the target object.
[0087] Optionally, in this embodiment, the pre-processing operation is used to improve the accuracy of key point position detection, and the post-processing operation is used to improve the stability of posture estimation of the target object.
[0088] In an exemplary embodiment, the above-mentioned pre-processing operation includes, but is not limited to, adjusting the image size, color space conversion, denoising and other processing to improve the accuracy of subsequent processing. The above-mentioned post-processing operation includes post-processing the estimated posture information, including posture optimization, posture smoothing, invalid point filtering and other processing to improve the accuracy and stability of posture estimation. The above-mentioned posture estimation based on the key point position information and determining the key posture data may include, but is not limited to, inferring the posture information of the object based on the position information of the key points, including the position, angle, rotation, etc. of the object. The commonly used method is to use mathematical models such as analytic geometry or rotation matrix to describe the posture information.
[0089] As an optional scheme, when the current posture indicates that the target object performs a target scanning action, it is determined that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action, including: when the current posture indicates that the target object performs a target scanning action, obtaining target part feature information of the target object according to the target image data; searching for the target object in a preset database according to the target part feature information, and when the target object is found, determining that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action.
[0090] Optionally, in this embodiment, the target display device also has object recognition capability, and can obtain target part feature information of the target object, such as facial feature information, hand feature information, etc., according to the target image data.
[0091] It should be noted that the above-mentioned preset database is data information uploaded after the user's authorization, and the data information is used to determine the user's identity. Taking the above-mentioned target part feature information as facial feature information, the facial feature information of the target object is extracted through the target image data, and then compared with the facial feature information in the preset database based on the facial feature information to confirm the identity of the target object and the user account of the target object who logs in to the application to complete the scanning action. Furthermore, the current scan can be compared with the scanning record of the user account recorded in the background.
[0092] In an exemplary embodiment, the above-mentioned comparison process can be implemented based on a timestamp. For example, when the target display device detects that user 1 holds a terminal to scan QR code G at 3:50, a piece of data of scanning QR code G at 3:50 is detected in the background of the application. The data indicates that the account that completed the scanning operation is account M. The target display device performs facial recognition on user 1, and determines through search that the account used by user 1 is account M. Since the two are the same, it can be determined that the scan was completed by user 1 at 3:50 by logging into the application through account M. The source of the scanning action is real, and the media information publishing account can transfer part of the virtual resources to the owner of the target display device based on the scanning result.
[0093] The facial recognition process may include but is not limited to the following:
[0094] After receiving the facial data uploaded from the terminal, the feature extraction is performed on the current image, and the feature is compared with the feature in the database to find the feature data with the highest score, and the relevant facial feature data is compared with the facial feature data in the back-end database.
[0095] As an optional solution, controlling the target display device to obtain a target identification image pre-set by a media information publishing account includes: controlling the target display device to obtain a target data synchronization protocol, wherein the target data synchronization protocol is a protocol that associates a media information publishing account with a target account, the target account is a login account of the target display device, and the target display device with the target data synchronization protocol is configured to allow target confirmation information to be sent to the media information publishing account; in response to the target data synchronization protocol having been transmitted to the target display device, controlling the target display device to obtain a target identification image, and setting the target identification image as an image to be displayed.
[0096] Optionally, in this embodiment, the above-mentioned target account can be understood as an account for logging into the target display device. For example, the account is a merchant account. Since the merchant and the media information publisher have jointly formulated a cooperation agreement, based on the cooperation agreement, the media information publisher pays a certain amount of remuneration to the merchant based on the number of times the target identification image is scanned.
[0097] It should be noted that the above data synchronization protocol can be a protocol formulated by the media information publisher or the owner of the target account, which is used to obtain the target identification image and allow the target account to receive virtual resources transferred by the media information publishing account.
[0098] In an exemplary embodiment, taking the case where the owner of the target account is a merchant and the owner of the media information publishing account is an advertiser, the merchant side needs to set the advertiser's data synchronization protocol on the target display device, and transmit the data synchronization protocol to the backend through the target display device, and then only needs to perform cloud-to-cloud docking. There are two main ways to set it up, one is manual input on the merchant side, and the other is that the merchant side uses a conversion tool between text and QR code to convert, and then transmits the data synchronization protocol information to the target display device through the scanner on the target display device. The data synchronization protocol is in JSON format, {url: XXX}.
[0099] As an optional solution, controlling the target display device to obtain the target data synchronization protocol includes at least one of the following: inputting the target data synchronization protocol through a text input device deployed by the target display device; controlling the target display device to receive a protocol identification image, and scanning the protocol identification image through a scanning device deployed by the target display device to generate a target data synchronization protocol.
[0100] It should be noted that the above-mentioned target display device is also deployed with a scanning device, which can at least scan the protocol identification image to generate the above-mentioned target data synchronization protocol according to a preset algorithm. Taking the protocol identification image as a QR code as an example, the above-mentioned target data synchronization protocol can be obtained by scanning the QR code through the scanning device, thereby achieving the purpose of quickly completing the protocol setting.
[0101] As an optional solution, in response to the target data synchronization protocol having been transmitted to the target display device, controlling the target display device to obtain a target identification image includes: in response to the target data synchronization protocol having been transmitted to the target display device, controlling the target display device to obtain a background image and a sub-identification image sent by a media information publishing account; and generating a target identification image based on the background image and the sub-identification image.
[0102] Optionally, in this embodiment, the above-mentioned background image can be understood as a poster image provided by the above-mentioned media information publishing account, which is used to display the content that the media information publishing account hopes to promote, and the above-mentioned sub-logo image can be understood as the core part of the above-mentioned target logo image, which is used to push relevant target media information to the user after being scanned by the user.
[0103] It should be noted that the background image and sub-logo image can be sent to the target display device in steps by the media information publishing account, and then the target display device automatically combines the background image and the sub-logo image into the target logo image.
[0104] In other words, the media information publishing account can first send the background image that best showcases its own characteristics to the target display device, and then send different sub-logo images to the target display device based on different promotional content. The target display device can automatically synthesize multiple target logo images based on the same background image and different sub-logo images to display them according to different actual needs, for example, by time period or occasion.
[0105] As an optional solution, when it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, target confirmation information is sent to the media information publishing account, including: determining the communication address of the media information publishing account based on the target data synchronization protocol; obtaining a first identity identifier and a second identity identifier corresponding to the target account; generating target confirmation information based on the first identity identifier and the second identity identifier, and sending the target confirmation information to the communication address, wherein the media information publishing account is configured to transfer a predetermined number of virtual resources to the target account upon receiving the target confirmation information, and the predetermined number is related to the device type of the target display device and the number of times the target identification image is scanned.
[0106] Optionally, in this embodiment, the second identity identifier is used to identify the target account. Through the first identity identifier and the second identity identifier, the media information publishing account can determine the amount of remuneration to be paid for the scanning action.
[0107] It should be noted that the above-mentioned predetermined number is related to the device type of the target display device and the number of times the target logo image is scanned, which can be understood as the predetermined number is related to at least one of the device type of the target display device and the number of times the target logo image is scanned. For example, different amounts of virtual resources can be paid based on different types of target display devices, and relevant virtual resources can also be paid according to the number of times the target logo image is scanned on the target display device.
[0108] As an optional solution, when a target display device displays a target identification image and a target terminal is detected by the target display device, the target display device is controlled to collect target image data, including: when the target display device displays the target identification image, a target sensor deployed by the target display device is controlled to perform detection to obtain a target detection result, wherein the target detection result includes whether the target terminal is detected within a preset distance of the target sensor; when the target terminal is detected within the preset distance, the target display device is controlled to collect target image data.
[0109] Optionally, in this embodiment, the target sensor can identify the distance between the object and the target display device. When the distance is within a preset distance, the target display device is controlled to collect target image data to avoid collecting too much useless image data and wasting computing resources.
[0110] It should be noted that the above-mentioned target sensor can also be configured as a sensor with an object type recognition function, so that after detecting an object within a preset distance, the object can be identified as a target terminal of a preset type, and then the target display device can be controlled to collect target image data.
[0111] In an exemplary embodiment, Figure 7 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Figure 7 As shown, the target sensor is used to determine whether the distance between the target terminal and the target display device is within a preset distance, so as to determine whether to start controlling the target display device to collect target image data, and then execute subsequent processes.
[0112] As an optional solution, when the target display device displays the target identification image and the target terminal is detected by the target display device, after controlling the target display device to collect target image data, the above method also includes: performing desensitization processing on the target image data to obtain desensitized image data, wherein the desensitized image data is used to verify the accuracy of the target confirmation information; saving the desensitized image data to a preset storage space, and automatically destroying the desensitized image data in the preset storage space when the storage time exceeds the preset time.
[0113] Optionally, in this embodiment, the above-mentioned desensitization processing may include but is not limited to hiding the real identity information of the target object, and only retaining relevant image information that can determine that the type of the object is the target object.
[0114] It should be noted that the above-mentioned preset duration can be pre-set by the background, and the above-mentioned preset storage space can be a local storage space or a server with certain confidentiality capabilities.
[0115] The present application is further explained below with reference to specific examples:
[0116] In an exemplary embodiment, the processing method of the above-mentioned scanned image can be understood as that an electronic poster (corresponding to the aforementioned target identification image) is displayed on the identification device deployed by the instant messaging application. The above-mentioned electronic poster allows the ability to carry related marketing advertisements. Some advertisers will place relevant QR codes for users to scan. After user authorization, when the mobile phone is close to the QR code display device (corresponding to the aforementioned target display device), the device starts the identification and judgment of the person's scanning action to identify the current scan as the source of the scan through the object facial recognition device, and the QR code display device will be associated with the merchant number, which can make it more convenient for advertisers to share traffic without updating and maintaining multiple QR codes, that is, source differentiation can be achieved.
[0117] It should be noted that there are two main forms of advertising for advertisers, one is paper stickers and the other is electronic posters. Advertisers can generate different forms of QR codes (corresponding to the aforementioned target identification images) for different merchants and distribute them to the merchant side, which has a large management cost. In addition, electronic posters and paper stickers have different profit-sharing strategies for different advertisers or merchants. At present, advertisers generate different QR codes and distribute them to merchants, and then distinguish traffic according to different entrances and then divide the profits, which can easily lead to malicious order-brushing to obtain traffic share.
[0118] In an exemplary embodiment, Figure 8 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Figure 8 As shown, the present application is to combine the 3D camera and recognition-related capabilities of an object facial recognition device (which can be understood as different functions deployed on the same device as the aforementioned QR code display device) installed with an instant messaging application. After user authorization, when the mobile phone is close to the QR code display device, the device starts recognition and uploads the current merchant device scanning status to the back end. On the one hand, it effectively assists in determining the source of the scanned code, and the merchant side no longer needs to maintain two QR codes for electronic posters and paper stickers. On the other hand, due to the assistance of user scanning-related videos, it effectively reduces the losses related to malicious order brushing.
[0119] In an exemplary embodiment, Fig. 9 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Fig. 9 As shown, the overall architecture includes but is not limited to user mobile phones, IoT (Internet of Things) object facial recognition terminal devices, and IoT object facial recognition backend related services, advertiser backend services, merchant backend services, etc.
[0120] 1. Mobile instant messaging application:
[0121] S1, the user runs an instant messaging application APP on his mobile phone, which carries the login module, H5, public account module and mini program module, etc.
[0122] S2, when the user logs in to the instant messaging application on the mobile phone, the APP has the user's instant messaging application login state, and the user can start the code scanning interface, scan the QR code, and then jump according to the QR code information.
[0123] S3, after the user scans the QR code on the device through the mobile instant messaging application, the relevant interface of the advertiser is opened.
[0124] 2. IoT object facial recognition terminal equipment:
[0125] In an exemplary embodiment, Fig.10 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, wherein a terminal device such as Fig.10 As shown, including:
[0126] 3D camera, in order to enhance the security of object facial recognition, a 3D camera is used on the IoT object facial recognition terminal. The data output by the camera, in addition to the RGB image, also includes relevant information such as the depth map. The scanning terminal is a common QR code scanning terminal.
[0127] The core of the object facial recognition APP includes the object facial recognition module, advertiser service setting module, electronic poster module, Bluetooth startup recognition module, network module, etc., among which:
[0128] Object facial recognition module, Fig.11 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Fig.11 As shown, it mainly includes the following steps:
[0129] S1, object face recognition acquisition, is used to call the 3D camera for acquisition and obtain RGB image stream, depth image stream, infrared image stream, etc.
[0130] S2, object face recognition optimization, selects the best object face recognition picture through comprehensive evaluation of coefficient indicators such as object face recognition size, object face recognition angle, image contrast, image brightness and clarity.
[0131] S3, after the collection and optimization is successful, the IoT object facial recognition terminal will send the data to the backend for identification through the network module.
[0132] In the advertiser service setting module, the merchant side needs to set the advertiser's data synchronization protocol on the QR code display device, and transmit the data synchronization protocol to the instant messaging application payment backend through the QR code display device. The subsequent connection only needs to be made. There are two setting methods, one is manual input on the merchant side, and the other is that the merchant side converts the data through the conversion tool between text and QR code, and then transmits the data synchronization protocol information to the QR code display device through the scanning terminal on the QR code display device. The data synchronization protocol is in JSON format, {url: XXX}.
[0133] In the electronic poster module, advertisers generally convert the information that needs to be advertised into electronic posters, and configure a QR code on the electronic poster so that users can jump to the advertising content after scanning the code. After the advertiser generates the electronic poster, it will be sent to the merchant side, and then the merchant side will set the electronic poster on the QR code display device.
[0134] The Bluetooth startup identification module, after the QR code display device is started, will start the non-interface Bluetooth startup identification module service, the device will continue to identify the image captured by the current camera to confirm whether someone is scanning the code. The QR code display device is deployed with a distance sensor to complete the distance detection. When an object is found close to the device, the object recognition algorithm is started to recognize the current image and determine whether there is a user scanning the code. The current algorithm used is mainly the human posture estimation algorithm. Fig.12 is a schematic diagram of another optional method for processing a scanned image according to an embodiment of the present application, such as Fig.12 As shown in the figure, the relevant detailed implementation principle mainly includes the following steps:
[0135] S1, image or video preprocessing: preprocess the input image or video, including image resizing, color space conversion, denoising, etc., to improve the accuracy of subsequent processing.
[0136] S2, key point detection: Use a deep learning model to detect key points of the human body in an image or video, usually using a convolutional neural network (CNN) or its variants. These key points include the head, arms, legs, torso and other parts of the human body. By detecting the positions of these key points, the posture of the human body can be inferred. Relevant to this application, it is the key posture of the subject holding a mobile phone and pointing it at the QR code display device.
[0137] S3, posture estimation: Based on the position information of key points, the posture information of the human body is inferred, including the position, angle, rotation, etc. of the human body. The commonly used method is to use mathematical models such as analytic geometry or rotation matrix to describe the posture information.
[0138] S4, post-processing: post-processing the estimated posture information, including posture optimization, posture smoothing, invalid point filtering and other processing to improve the accuracy and stability of the estimation.
[0139] When a hit posture estimation is found, the currently collected data, as well as SN (serial number), merchant ID and other information, will be sent to the backend, and the backend will then deliver the information to the advertiser.
[0140] 3. Instant messaging application backend related services, including object facial recognition payment service, advertiser service setting service, data desensitization service, and advertiser contact service:
[0141] 1) Object facial recognition service, which is used to extract features from the current image after receiving the object facial recognition data uploaded by the terminal, and compare the features with the features in the database, find the feature data with the highest score, and compare the relevant object facial recognition data with the object facial recognition in the backend database. In the instant messaging application system, it will eventually return relevant information such as the user's instant messaging application account or instant messaging application payment code.
[0142] 2) Advertiser service setting service, used for the advertiser address information requested by the backend after receiving the gesture hit estimation from the device side.
[0143] 3) Data desensitization service. After collecting relevant video data of the subject holding the mobile phone, the back-end service will desensitize the facial recognition information of the subject in the current video to protect user privacy. The data will only be stored for three days and will be automatically destroyed after three days. The core is to retain the sampling, which can be used for traceability when advertisers do not trust the data.
[0144] 4) Advertiser contact service: After receiving the posture hit estimation from the device side, the instant messaging application payment backend carries the current device SN, merchant number and other related information and sends it to the advertiser processing address previously set on the merchant side in the form of a POST request.
[0145] 4. Advertiser backend services:
[0146] 1) When the user scans the code, the advertiser's related interface will be opened, and the advertiser will collect statistics on the current page exposure.
[0147] 2) At the same time, based on the current page exposure and whether the advertiser's backend has received relevant requests such as posture judgment from the instant messaging application payment backend, the traffic source can be quickly distinguished, and the relevant profit-sharing logic between the advertiser and the merchant can be executed later.
[0148] Through this embodiment, a 3D camera combined with an instant messaging application object facial recognition device and Bluetooth-enabled recognition-related capabilities are utilized to assist in continuous recognition, and the current merchant's device scanning status is uploaded to the backend. On the one hand, this effectively assists in determining the source of the scanned code, and the merchant side no longer needs to maintain multiple QR codes such as electronic posters and paper stickers. On the other hand, due to the assistance of user scanning-related videos, losses related to malicious order brushing are effectively reduced.
[0149] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0150] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0151] According to another aspect of the embodiment of the present application, a scanning image processing device for implementing the above-mentioned scanning image processing method is also provided. Fig.13 As shown, the device comprises:
[0152] The acquisition module 1302 is used to control the target display device to acquire the target identification image pre-set by the media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is the media information pre-made by the media information publishing account, and the target display device is used to display the target identification image;
[0153] The acquisition module 1304 is used to control the target display device to acquire target image data when the target display device displays the target identification image and detects the target terminal through the target display device, wherein the target image data is image data acquired by the image acquisition device pre-deployed in the target display device;
[0154] The sending module 1306 is used to send target confirmation information to the media information publishing account when it is determined based on the target image data that the target image data includes a target object and the target object controls the target terminal to perform a target scanning action, wherein the target confirmation information is used to mark the media information publishing account that the target object has performed a target scanning action, the target determination information includes a first identity identifier used to mark the target display device, and the target terminal is configured to display the target media information when the target object has performed a target scanning action.
[0155] As an optional solution, the above-mentioned device is also used for: when the target display device displays the target identification image and the target terminal is detected through the target display device, after controlling the target display device to collect target image data, determining posture estimation data based on the target image data, wherein the posture estimation data is used to estimate the current posture of the target object; when the current posture indicates that the target object performs a target scanning action, determining that the target image data includes the target object, and the target object controls the target terminal to perform a target scanning action.
[0156] As an optional solution, the above-mentioned device is used to determine posture estimation data based on the target image data in the following manner: perform key point detection on the target image data to determine the key point position information of the target object, wherein the key point position information includes position information obtained by detecting at least one part of the target object; perform posture estimation based on the key point position information to obtain posture estimation data.
[0157] As an optional solution, the above-mentioned device is used to perform key point detection on the target image data and determine the key point position information of the target object in the following manner: perform a preprocessing operation on the target image data to obtain initial image data, wherein the preprocessing operation is used to improve the accuracy of position detection of the key points of the target object in the initial image data; perform key point detection on the initial image data to determine the key point position information of the target object; perform posture estimation based on the key point position information to determine key posture data, wherein the key posture data is used to indicate whether the current posture is that the target object holds the target terminal and scans toward the target display device; perform a post-processing operation on the key posture data to obtain posture estimation data, wherein the post-processing operation is used to improve the stability of estimating the posture of the target object.
[0158] As an optional scheme, the above-mentioned device is used to determine that the target image data includes the target object and the target object controls the target terminal to perform the target scanning action in the following manner when the current posture indicates that the target object performs a target scanning action: when the current posture indicates that the target object performs a target scanning action, obtain the target part feature information of the target object according to the target image data; search for the target object in a preset database according to the target part feature information, and when the target object is found, determine that the target image data includes the target object and the target object controls the target terminal to perform the target scanning action.
[0159] As an optional solution, the above-mentioned device is used to control the target display device to obtain the target identification image pre-set by the media information publishing account in the following manner: control the target display device to obtain a target data synchronization protocol, wherein the target data synchronization protocol is a protocol that associates the media information publishing account with the target account, the target account is a login account of the target display device, and the target display device with the target data synchronization protocol is configured to allow target confirmation information to be sent to the media information publishing account; in response to the target data synchronization protocol having been transmitted to the target display device, control the target display device to obtain a target identification image, and set the target identification image as an image to be displayed.
[0160] As an optional solution, the above-mentioned device is used to control the target display device to obtain the target data synchronization protocol in at least one of the following ways: input the target data synchronization protocol through a text input device deployed by the target display device; control the target display device to receive a protocol identification image, and scan the protocol identification image through a scanning device deployed by the target display device to generate a target data synchronization protocol.
[0161] As an optional solution, the above-mentioned device is used to control the target display device to obtain the target identification image in response to the target data synchronization protocol having been transmitted to the target display device in the following manner: in response to the target data synchronization protocol having been transmitted to the target display device, control the target display device to obtain the background image and sub-identification image sent by the media information publishing account; generate the target identification image according to the background image and the sub-identification image.
[0162] As an optional solution, the above-mentioned device is used to send target confirmation information to the media information publishing account in the following manner when it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action: determine the communication address of the media information publishing account according to the target data synchronization protocol; obtain a first identity identifier and a second identity identifier corresponding to the target account; generate target confirmation information based on the first identity identifier and the second identity identifier, and send the target confirmation information to the communication address, wherein the media information publishing account is configured to transfer a predetermined number of virtual resources to the target account when the target confirmation information is received, and the predetermined number is related to the device type of the target display device and the number of times the target identification image is scanned.
[0163] As an optional solution, the above-mentioned device is used to control the target display device to collect target image data in the following manner when the target display device displays the target identification image and the target terminal is detected by the target display device: when the target display device displays the target identification image, control the target sensor deployed by the target display device to perform detection to obtain a target detection result, wherein the target detection result includes whether the target terminal is detected within a preset distance of the target sensor; when the target terminal is detected within the preset distance, control the target display device to collect target image data.
[0164] As an optional solution, the above-mentioned device is also used to: when the target display device displays the target identification image and the target terminal is detected by the target display device, after controlling the target display device to collect target image data, perform desensitization processing on the target image data to obtain desensitized image data, wherein the desensitized image data is used to verify the accuracy of the target confirmation information; save the desensitized image data to a preset storage space, and when the storage time exceeds the preset time, automatically destroy the desensitized image data in the preset storage space.
[0165] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.
[0166] According to one aspect of the present application, a computer program product is provided, the computer program product comprising a computer program / instruction, the computer program / instruction comprising a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication section 1409, and / or installed from a removable medium 1411. When the computer program is executed by a central processor 1401, various functions provided in the embodiments of the present application are executed.
[0167] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0168] Fig.14 The structure block diagram of a computer system for implementing an electronic device according to an embodiment of the present application is schematically shown.
[0169] It should be noted that Fig.14 The computer system 1400 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0170] like Fig.14 As shown, the computer system 1400 includes a central processing unit 1401 (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory 1402 (ROM) or the program loaded from the storage part 1408 to the random access memory 1403 (RAM). Various programs and data required for system operation are also stored in the random access memory 1403. The central processing unit 1401, the read-only memory 1402 and the random access memory 1403 are connected to each other through a bus 1404. An input / output interface 1405 (Input / Output interface, i.e., I / O interface) is also connected to the bus 1404.
[0171] The following components are connected to the input / output interface 1405: an input section 1406 including a keyboard, a mouse, etc.; an output section 1407 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1408 including a hard disk, etc.; and a communication section 1409 including a network interface card such as a LAN card, a modem, etc. The communication section 1409 performs communication processing via a network such as the Internet. A drive 1410 is also connected to the input / output interface 1405 as needed. A removable medium 1411, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1410 as needed so that a computer program read therefrom is installed into the storage section 1408 as needed.
[0172] In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1409, and / or installed from the removable medium 1411. When the computer program is executed by the central processor 1401, various functions defined in the system of the present application are executed.
[0173] According to another aspect of the embodiment of the present application, an electronic device for implementing the above-mentioned scanned image processing method is also provided. The electronic device may be Figure 1 The terminal device or server shown in the figure. This embodiment is described by taking the electronic device as a terminal device as an example. Fig.15 As shown, the electronic device includes a memory 1502 and a processor 1504. The memory 1502 stores a computer program, and the processor 1504 is configured to execute the steps in any of the above method embodiments through the computer program.
[0174] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.
[0175] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:
[0176] S1, controlling a target display device to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with target media information, the target media information is media information pre-made by the media information publishing account, and the target display device is used to display the target identification image;
[0177] S2, when the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device;
[0178] S3. When it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, a target confirmation message is sent to the media information publishing account, wherein the target confirmation message is used to mark the target object to perform a target scanning action to the media information publishing account, the target determination information includes a first identity identifier for marking a target display device, and the target terminal is configured to display the target media information when the target object performs a target scanning action.
[0179] Alternatively, a person skilled in the art may understand that: Fig.15 The structure shown is for illustration only, and the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (MID), a PAD, and other terminal devices. Fig.15 The electronic device and the electronic equipment described above are not limited in structure. Fig.15 More or fewer components (such as network interfaces, etc.) as shown in, or with Fig.15 Different configurations shown.
[0180] Among them, the memory 1502 can be used to store software programs and modules, such as the program instructions / modules corresponding to the scanned image processing method and device in the embodiment of the present application. The processor 1504 executes various functional applications and data processing by running the software programs and modules stored in the memory 1502, that is, realizing the above-mentioned scanned image processing method. The memory 1502 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 1502 may further include a memory remotely located relative to the processor 1504, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 1502 can be specifically, but not limited to, used to store virtual resources, target identification images and other information. As an example, if Fig.15 As shown, the memory 1502 may include but is not limited to the acquisition module 1302, acquisition module 1304 and sending module 1306 in the scanning image processing device. In addition, it may also include but is not limited to other module units in the scanning image processing device, which will not be repeated in this example.
[0181] Optionally, the transmission device 1506 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wired network and a wireless network. In one example, the transmission device 1506 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 1506 is a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0182] In addition, the electronic device further includes: a display 1508 for displaying the target identification image; and a connection bus 1510 for connecting various module components in the electronic device.
[0183] In other embodiments, the terminal device or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the multiple nodes through network communication. Among them, the nodes may form a peer-to-peer (P2P, Peer To Peer) network, and any form of computing device, such as a server, terminal and other electronic devices, may become a node in the blockchain system by joining the peer-to-peer network.
[0184] According to one aspect of the present application, a computer-readable storage medium is provided, and a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the scanned image processing method provided in various optional implementations of the above-mentioned scanned image processing.
[0185] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:
[0186] S1, controlling a target display device to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with target media information, the target media information is media information pre-made by the media information publishing account, and the target display device is used to display the target identification image;
[0187] S2, when the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device;
[0188] S3. When it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, a target confirmation message is sent to the media information publishing account, wherein the target confirmation message is used to mark the target object to perform a target scanning action to the media information publishing account, the target determination information includes a first identity identifier for marking a target display device, and the target terminal is configured to display the target media information when the target object performs a target scanning action.
[0189] Optionally, in this embodiment, a person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing hardware related to the terminal device through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.
[0190] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0191] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.
[0192] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.
[0193] In the several embodiments provided in the present application, it should be understood that the disclosed client can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.
[0194] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0195] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0196] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.
Claims
1. A method for processing a scanned image, It is characterized in that include: Controlling a target display device to obtain a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with target media information, the target media information is media information pre-made by the media information publishing account, and the target display device is used to display the target identification image; When the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device; When it is determined based on the target image data that the target image data includes a target object, and the target object controls the target terminal to perform a target scanning action, target confirmation information is sent to the media information publishing account, wherein the target confirmation information is used to mark the media information publishing account that the target object has performed the target scanning action, the target determination information includes a first identity identifier for marking the target display device, and the target terminal is configured to display the target media information when the target object has performed the target scanning action.
2. The method according to claim 1, It is characterized in that In the case where the target display device displays the target identification image and the target terminal is detected by the target display device, after controlling the target display device to collect target image data, the method further includes: Determining posture estimation data according to the target image data, wherein the posture estimation data is used to estimate the current posture of the target object; In a case where the current posture indicates that the target object performs the target scanning action, it is determined that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action.
3. The method according to claim 2, It is characterized in that The step of determining the posture estimation data according to the target image data comprises: Performing key point detection on the target image data to determine key point position information of the target object, wherein the key point position information includes position information obtained by detecting at least one part of the target object; Perform attitude estimation according to the key point position information to obtain the attitude estimation data.
4. The method according to claim 3, It is characterized in that The step of performing key point detection on the target image data to determine key point position information of the target object includes: Performing a preprocessing operation on the target image data to obtain initial image data, wherein the preprocessing operation is used to improve the accuracy of position detection of key points of the target object in the initial image data; Performing key point detection on the initial image data to determine the key point position information of the target object; Performing posture estimation according to the key point position information to determine key posture data, wherein the key posture data is used to indicate whether the current posture is that the target object holds the target terminal and scans toward the target display device; A post-processing operation is performed on the key posture data to obtain the posture estimation data, wherein the post-processing operation is used to improve the stability of estimating the posture of the target object.
5. The method according to claim 2, It is characterized in that In the case where the current posture indicates that the target object performs the target scanning action, determining that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action, comprises: When the current posture indicates that the target object has performed the target scanning action, acquiring target part feature information of the target object according to the target image data; The target object is searched in a preset database according to the target part feature information, and when the target object is found, it is determined that the target image data includes the target object, and the target object controls the target terminal to perform the target scanning action.
6. The method according to claim 1, It is characterized in that The controlling target display device to obtain a target identification image preset by a media information publishing account includes: Controlling the target display device to obtain a target data synchronization protocol, wherein the target data synchronization protocol is a protocol that associates the media information publishing account with a target account, the target account is a login account of the target display device, and the target display device having the target data synchronization protocol is configured to allow sending the target confirmation information to the media information publishing account; In response to the target data synchronization protocol being transmitted to the target display device, the target display device is controlled to acquire the target identification image and set the target identification image as the image to be displayed.
7. The method according to claim 6, It is characterized in that The step of controlling the target display device to obtain the target data synchronization protocol includes at least one of the following: Input the target data synchronization protocol through a text input device deployed by the target display device; The target display device is controlled to receive a protocol identification image, and a scanning device deployed on the target display device scans the protocol identification image to generate the target data synchronization protocol.
8. The method according to claim 6, It is characterized in that In response to the target data synchronization protocol being transmitted to the target display device, controlling the target display device to acquire the target identification image includes: In response to the target data synchronization protocol being transmitted to the target display device, controlling the target display device to obtain the background image and the sub-logo image sent by the media information publishing account; The target logo image is generated according to the background image and the sub-logo image.
9. The method according to claim 6, It is characterized in that The step of sending target confirmation information to the media information publishing account includes: Determine the communication address of the media information publishing account according to the target data synchronization protocol; Obtaining the first identity identifier and a second identity identifier corresponding to the target account; The target confirmation information is generated according to the first identity identifier and the second identity identifier, and the target confirmation information is sent to the communication address, wherein the media information publishing account is configured to transfer a predetermined number of virtual resources to the target account upon receiving the target confirmation information, and the predetermined number is related to the device type of the target display device and the number of times the target identification image is scanned.
10. The method according to any one of claims 1 to 9, It is characterized in that When the target display device displays the target identification image and the target terminal is detected by the target display device, controlling the target display device to collect target image data includes: When the target display device displays the target identification image, controlling the target sensor deployed by the target display device to perform detection to obtain a target detection result, wherein the target detection result includes whether the target terminal is detected within a preset distance of the target sensor; When the target terminal is detected within the preset distance, the target display device is controlled to collect the target image data.
11. The method according to any one of claims 1 to 9, It is characterized in that In the case where the target display device displays the target identification image and the target terminal is detected by the target display device, after controlling the target display device to collect target image data, the method further includes: Performing desensitization processing on the target image data to obtain desensitized image data, wherein the desensitized image data is used to verify the accuracy of the target confirmation information; The desensitized image data is saved to a preset storage space, and when the saving time exceeds the preset time, the desensitized image data is automatically destroyed in the preset storage space.
12. A scanning image processing device, It is characterized in that include: an acquisition module, used to control the target display device to acquire a target identification image pre-set by a media information publishing account, wherein the target identification image has a corresponding relationship with the target media information, the target media information is the media information pre-made by the media information publishing account, and the target display device is used to display the target identification image; a collection module, configured to control the target display device to collect target image data when the target display device displays the target identification image and detects the target terminal through the target display device, wherein the target image data is image data collected by an image collection device pre-deployed in the target display device; A sending module, used for sending target confirmation information to the media information publishing account when it is determined according to the target image data that the target image data includes a target object and the target object controls the target terminal to perform a target scanning action, wherein the target confirmation information is used to mark the media information publishing account that the target object has performed the target scanning action, the target determination information includes a first identity identifier for marking the target display device, and the target terminal is configured to display the target media information when the target object has performed the target scanning action.
13. A computer-readable storage medium, It is characterized in that The computer-readable storage medium includes a stored program, wherein the program can be executed by a terminal device or a computer to execute the method described in any one of claims 1 to 11.
14. A computer program product comprising a computer program / instructions, It is characterized in that When the computer program / instructions are executed by a processor, the steps of the method described in any one of claims 1 to 11 are implemented.
15. An electronic device comprising a memory and a processor, It is characterized in that A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 11 through the computer program.
