A data labeling method and apparatus

Abstract

The application discloses a data marking method and device, relates to the technical field of intelligent office, and mainly aims to timely remind a specific position of copying of a copying personnel, and improves the accuracy of recording. The main technical scheme of the application is as follows: an image to be recognized including recording data is acquired, the recording data is derived from data content currently displayed by a display device; the recording data in the image to be recognized is recognized; the data content displayed by the display device is detected according to the recording data; and marking display is performed according to a detection result. The application is used for marking data content on the display device copied by a user.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, and in particular to a data marking method and device. BACKGROUND

[0002] In daily life, work and study, it is often necessary to hand-copy some electronic text information on a computer screen, an iPad screen or a mobile phone, etc. The electronic text information usually includes text information or digital information, such as an ID number, a home address, work records, teaching records, etc.

[0003] In the actual copying process, when copying a large amount of text or an ID number on the screen, it is necessary to repeatedly confirm where the current notebook record is. When there is a large amount of text or a large amount of numbers, the copying personnel usually cannot confirm the specific position of the copied information, and thus, the copying personnel may make mistakes such as copying in series, missing characters, miswriting characters and repeated copying. If the copying personnel cannot find the above problems in time, the final copying result will have copying errors. SUMMARY

[0004] In view of the above problems, the present application provides a data marking method and device, and the main purpose is to automatically mark the recorded data on a display device when recording the data content on the display device.

[0005] To solve the above technical problems, the present application provides the following solutions:

[0006] In a first aspect, the present application provides a data marking method, which comprises:

[0007] obtaining an image to be recognized including recorded data, wherein the recorded data is derived from the data content currently displayed on a display device;

[0008] recognizing the recorded data in the image to be recognized;

[0009] detecting the data content displayed on the display device according to the recorded data;

[0010] performing marking display according to the detection result.

[0011] Optionally, the marking display according to the detection result comprises:

[0012] performing marking display on the recorded data existing in multiple positions on the display device according to the detection result;

[0013] canceling the marking display on the recorded data in other positions according to the user's selection of the recorded data in a specified position.

[0014] Optionally, the method further comprises:

[0015] adjusting a display position of the marked record data so that the record data is located in a middle position of the interface displayed by the display device.

[0016] Optionally, the method further comprises:

[0017] acquiring the image to be recognized including the record data;

[0018] detecting the image to be recognized according to a target object, the target object at least including the record data;

[0019] adjusting a shooting angle of the camera according to the detection result so as to acquire the image to be recognized including the record data.

[0020] Optionally, the method further comprises:

[0021] detecting a position of the marked record data on the display device;

[0022] adjusting a current displayed data content of the display device according to the detection result.

[0023] Optionally, the marking display according to the detection result comprises:

[0024] performing a first marking display on record data not detected according to the detection result, and performing a second marking display on detected record data.

[0025] Optionally, the method further comprises:

[0026] issuing an alarm information according to a position distribution result of the first marking display and the second marking display, so as to prompt a user to check the record data.

[0027] Optionally, the method further comprises:

[0028] performing a second marking display on subsequent data content adjacent to the marked record data according to a continuous length of the marked record data.

[0029] In a second aspect, the present application further provides a device for record data, the device comprising:

[0030] an acquisition unit, configured to acquire an image to be recognized including record data, the record data being derived from a current displayed data content of a display device;

[0031] a recognition unit, configured to recognize the record data in the image to be recognized;

[0032] a detection unit, configured to detect the displayed data content of the display device according to the record data;

[0033] The display unit is configured to mark and display according to the detection result.

[0034] Optionally, the display unit further comprises:

[0035] The display module is configured to mark and display the record data in multiple positions on the display device according to the detection result.

[0036] The deletion module is configured to cancel the mark and display of the record data in other positions according to the record data in the specified position selected by the user.

[0037] Optionally, the display unit further comprises:

[0038] The adjustment module is configured to adjust the display position of the marked record data, so that the record data is located in the middle position of the display interface of the display device.

[0039] Optionally, the acquisition unit comprises:

[0040] The acquisition module is configured to acquire the to-be-recognized image captured by the camera.

[0041] The detection module is configured to detect the target object in the to-be-recognized image, wherein the target object at least contains the record data.

[0042] The adjustment module is configured to adjust the camera shooting angle according to the detection result, so as to acquire the to-be-recognized image containing the record data.

[0043] Optionally, the display unit further comprises:

[0044] The detection module is configured to detect the position of the marked record data on the display device.

[0045] The execution module is configured to adjust the data content currently displayed by the display device according to the detection result.

[0046] Optionally, the display unit is further configured to mark and display the record data not detected as first mark and display, and mark and display the detected record data as second mark and display.

[0047] Optionally, the device further comprises:

[0048] The alarm unit is configured to send alarm information according to the position distribution result of the first mark and display and the second mark and display, so as to prompt the user to check the record data.

[0049] Optionally, the display unit is further configured to mark and display the subsequent data content adjacent to the marked record data as second mark and display according to the continuous length of the marked record data.

[0050] In order to achieve the above object, according to a third aspect of the present application, there is provided a storage medium comprising a stored program, wherein the storage medium, when the program is run, controls a device in which the storage medium is located to execute the above-mentioned data marking method.

[0051] In order to achieve the above object, according to a fourth aspect of the present application, there is provided a processor for running a program, wherein the processor, when the program is run, executes the above-mentioned data marking method.

[0052] By means of the above technical solution, the method and device for recording data provided by the present application can avoid the problems of copy stringing, copy missing, copy miswriting and repeated copying caused by the fact that the copy personnel cannot confirm the specific position of copying, can automatically mark the data content of the copied part on the display device, and can timely remind the copy personnel of the specific position of copying, thereby improving the accuracy of recording.

[0053] The above description is only a summary of the technical solution of the present application, in order to more clearly understand the technical means of the present application, the present application can be implemented according to the content of the specification, and in order to make the above and other objects, features and advantages of the present application more obvious and easy to understand, the following specific embodiments of the present application are described. BRIEF DESCRIPTION OF DRAWINGS

[0054] Various other advantages and benefits will become apparent to those of ordinary skill in the art, upon reading the following detailed description of the preferred embodiments. The accompanying drawings are included to provide a description of preferred embodiments, and are not meant to limit the present application. Furthermore, the same reference numerals are used throughout the several drawings to denote the same or similar components. In the drawings:

[0055] Figure 1 A data marking method flow chart provided by an embodiment of the present application is shown;

[0056] Figure 2 Another data marking method flow chart provided by an embodiment of the present application is shown;

[0057] Figure 3 A composition block diagram of a data marking device provided by an embodiment of the present application is shown;

[0058] Figure 4A component block diagram of another data marking device provided by an embodiment of the present application is shown.

[0059] Figure 5 A schematic diagram of a data marking method provided by an embodiment of the present application is shown.

[0060] Figure 6 A schematic diagram of another data marking method provided by an embodiment of the present application is shown.

[0061] Figure 7 A schematic diagram of a third data marking method provided by an embodiment of the present application is shown.

[0062] Figure 8 A schematic diagram of a fourth data marking method provided by an embodiment of the present application is shown.

[0063] Figure 9 A schematic diagram of a fifth data marking method provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0064] Exemplary embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.

[0065] In daily life, work and study, users need to hand-copy some electronic text information on a computer screen, iPad screen or mobile phone and the like to a paper notebook or another electronic device. Since the electronic text information usually includes identity card numbers, home addresses, work records, teaching records and the like, the user needs to repeatedly confirm where the current note is recorded when copying large amounts of text, identity card numbers and the like on the screen, and the user usually cannot confirm the specific position of the copied information when there are a large number of characters or numbers, so that the user is prone to copy in series, misspellings, misspellings and repeated copying. If the copier cannot find the above problems in time, the final copying result will have copying errors. Therefore, an embodiment of the present application provides a data marking method, which can mark the electronic text information copied by the user in time on the display device, improve the accuracy of the record, and the specific execution steps are as shown in Figure 1 The method comprises the following steps:

[0066] 101, obtaining an image to be recognized including recording data.

[0067] The record data is derived from the data content displayed on the display device. Before acquiring the to-be-recognized image including the record data, a user opens a display device, which can be a computer, a mobile phone, an iPad or other electronic device; the display device displays data content, which includes text information, digital information and the like; the user refers to the data content on the display device to make a copy, which includes full-text transcription and partial excerpt; the copying method includes hand transcription on a paper document or recording on an electronic device. Then, an image acquisition device acquires an image of the text information, digital information and the like copied by the user on the paper document or the electronic device. The acquisition method is not limited to camera shooting, screen image capturing or the like.

[0068] It should be noted that the record data is text information, digital information and the like copied by the user referring to the data content displayed on the display device. The to-be-recognized image including the record data is an image including the text information, digital information and the like copied by the user on the paper document or the electronic device. The to-be-recognized image including the record data is used to provide the data content copied by the user.

[0069] 102. Recognize the record data in the to-be-recognized image.

[0070] The record data in the to-be-recognized image includes handwritten character information or standard character. For the record data of handwritten characters, a handwritten character detection algorithm is first used to locate each line of text in the image including the record data of handwritten characters, and then a handwritten character recognition technology is used to recognize each line of text in the to-be-recognized image to obtain the handwritten character information. The standard character is record data recorded on an electronic device. For the above standard character, a conventional text recognition technology can be used, which is not limited in the embodiment of the present application. The record data in the to-be-recognized image is used to match the data content on the display device.

[0071] 103. Detect the data content displayed on the display device according to the record data.

[0072] The record data identified in step 102 is matched with the data content displayed on the display device. The record data can be all the content in the image to be identified, or the newly added data content compared with the image identified last time. Therefore, the data amount of the record data in this step is not limited to one character or multiple characters. When the record data is one character, it is determined whether the data content has the same content as the record data based on the record data; when the record data is multiple characters, the similarity between the record data and the data content with the same number of characters is calculated; and it is determined whether the data content has the same content as the record data according to the similarity. In this embodiment, the specific determination method of the similarity is not limited.

[0073] The detection process in this step is to match the identified record data. Therefore, the data type of the identified record data needs to be analyzed first. In this embodiment, the data type is not limited to the character type, the number type and the symbol type. Then, the corresponding matching strategy is selected for the record data according to the data type. The matching strategy is a specific way for matching the record data with the data content displayed on the display device. Finally, the record data is matched according to the determined matching strategy.

[0074] Specifically, when the identified data is character information of the character type, the corresponding matching strategy is to match the same character first. If the identified data contains characters that cannot be matched with the data content on the display device, semantic analysis is performed. If the result of the semantic analysis is similar, for example, the display device displays “the weather is very sunny”, and the identified content is “the weather is very sunny” due to the careless copying, the semantic analysis shows that this case is similar, and it is considered that the copied data content is “the weather is very sunny”. Therefore, “the weather is very sunny” is marked on the display device.

[0075] When the recognized data is digital type digital information, the corresponding matching strategy is to match the same number. If the number of recognized numbers is less than the number of numbers on the display device, the text at the front of the numbers on the display device is subjected to semantic analysis. If the result of semantic analysis is a number group related to identity or location, such as an ID number, a mobile phone number, a house number, etc., for example, the display device is "Li Si's ID number is 1234567891098765", and the recognized content is "R34567891098765" due to the relatively sloppy copying. The text information "Li Si's ID number" at the front of the numbers is subjected to semantic analysis to obtain the key information "ID card", and therefore, it is determined that the number at the beginning of the number group is not a capital letter, and it is confirmed that the copied data content is "1234567891098765". Therefore, "1234567891098765" is marked on the display device.

[0076] When the recognized data is symbol type symbol information, such as comma, period, colon, bracket, etc., the same symbol is matched. There is a special case. If a single number 0 or 9 is recognized between texts, the text at the front and / or back of the numbers on the display device is subjected to semantic analysis. If the result of semantic analysis contains quantity-related semantics, such as 0, 9 vehicles, etc., it is confirmed as a number; if the result of semantic analysis does not contain quantity-related semantics, it is considered that the period or comma is recognized as the number 0 and 9 due to non-standard writing, and therefore, it is confirmed as a period or comma.

[0077] 104. Marking display according to the detection result.

[0078] The detection result includes detecting the same recorded data and not detecting the same recorded data. If the same recorded data is detected, marking display is performed; if the same recorded data is not detected, step 101 is continued. The marking method includes but is not limited to highlighting, underlining, and prompting by stopping the cursor at the currently written text, etc. This embodiment is not limited.

[0079] The embodiments of the application will be described below in conjunction with specific application scenarios, such as Figure 5As shown, in an office scenario, an office worker needs to copy the name, ID number, mobile phone number and home address on the 501 computer screen into the 502 paper notebook. The embodiment of the present application matches the recognized "Zhang San 11111111111111111" with all the information such as name, ID number, mobile phone number and home address on the 501 computer screen, matches "Zhang San 11111111111111111" on the 501 computer screen, and marks "Zhang San 11111111111111111" on the 501 computer screen with a mark 503. The mark 503 is not limited to underlined, highlighted, bolded and the like.

[0080] As shown, in a learning scenario, a student needs to copy the pictures in the mobile phone or the learning content on the word into the exercise book, and copy the learning content on the 601 computer screen into the 602 paper notebook. The embodiment of the present application matches the recognized copying content with all the information on the 601 computer screen, matches the above copying content on the 601 computer screen, and marks "one, polyvinyl chloride (PVC) waterproof roll product is made of polyvinyl chloride resin, antioxidant, anti-aging agent, plasticizer and ultraviolet absorber and other additives" on the 601 computer screen with a mark 603 underlined. The mark 603 can be underlined, highlighted, bolded and the like, and is not limited in particular. Figure 6 As shown, in a learning scenario, a student needs to copy the pictures in the mobile phone or the learning content on the word into the exercise book, and copy the learning content on the 601 computer screen into the 602 paper notebook. The embodiment of the present application matches the recognized copying content with all the information on the 601 computer screen, matches the above copying content on the 601 computer screen, and marks "one, polyvinyl chloride (PVC) waterproof roll product is made of polyvinyl chloride resin, antioxidant, anti-aging agent, plasticizer and ultraviolet absorber and other additives" on the 601 computer screen with a mark 603 underlined. The mark 603 can be underlined, highlighted, bolded and the like, and is not limited in particular.

[0081] Figure 1 As shown, in a learning scenario, a student needs to copy the pictures in the mobile phone or the learning content on the word into the exercise book, and copy the learning content on the 601 computer screen into the 602 paper notebook. The embodiment of the present application matches the recognized copying content with all the information on the 601 computer screen, matches the above copying content on the 601 computer screen, and marks "one, polyvinyl chloride (PVC) waterproof roll product is made of polyvinyl chloride resin, antioxidant, anti-aging agent, plasticizer and ultraviolet absorber and other additives" on the 601 computer screen with a mark 603 underlined. The mark 603 can be underlined, highlighted, bolded and the like, and is not limited in particular.

[0082] ​Further, as a refinement and extension of the embodiments shown in Figure 1 the present embodiments also provide another data marking method, as shown in Figure 2 the specific steps of which are as follows:

[0083] 201, acquire an image to be identified including recorded data.

[0084] This step is combined with the description of step 101 in the above method, and the same content will not be repeated here.

[0085] It should be noted that the method uses a camera to capture the image to be identified, which can be a camera mounted on the top of a computer, mobile phone, iPad or other electronic device, or a camera connected by a dedicated support independent camera device, which can rotate and control the shooting angle of the camera. The camera is opposite to the user's front, and the lens is slightly downward, which can cover the tool carrier used by the user for transcription on the camera shooting range. The tool carrier is a paper carrier, an electronic device carrier, etc. The camera-captured image to be identified includes a target object, which includes one or more of recorded data, writing tools and human features. The writing tools include at least pens, pens, etc. The human features include but are not limited to arms, hands, fingers, etc. It should be noted that the target object must contain recorded data.

[0086] Based on the above target object detection, the image to be identified includes at least the recorded data; according to the detection result, the shooting angle of the camera is adjusted to acquire the image to be identified including the recorded data. The mounting method and the shooting angle adjustment method of the camera are not limited in this embodiment.

[0087] 202, identify the recorded data in the image to be identified.

[0088] This step is combined with the description of step 102 in the above method, and the same content will not be repeated here.

[0089] 203, detecting the data content displayed by the display device according to the recorded data.

[0090] This step is combined with the description of step 103 in the above method, and the same content will not be repeated here.

[0091] 204, marking and displaying according to the detection result.

[0092] The step combines the description of step 104 in the above method, and the same content is not repeated here. It should be noted that if the same record data is detected to exist in multiple positions in the display device at the same time, the data in the above multiple positions is marked first, and then the user can make a subjective selection of the record data of the specified position after observation. The user selects the record data of the specified position, cancels the marking of the record data of other positions according to the record data of the user selected position, and when the user selected position is relatively low on the display device, in order to facilitate the user to watch, the display position of the marked record data is adjusted, so that the record data is located in the middle position of the display interface of the display device.

[0093] As shown in Figure 7 In the learning scenario, the student needs to copy the pictures in the mobile phone or the learning content on the word to the exercise book, and copy the learning content on the 701 computer screen to the 702 paper notebook. The embodiment of the application obtains the image of the 702 paper notebook and recognizes the copied content (i.e. waterproof roll) in the image, matches the recognized "waterproof roll" with all the information on the 701 computer screen, matches 2 "waterproof rolls" on the 701 computer screen, and marks all "waterproof rolls" with 703. The student clicks the tail of the actual copied "waterproof roll" with the mouse to position, and the marks of the remaining "waterproof rolls" are cancelled. The mark 703 can be underlined, highlighted in yellow, bolded, etc., and is not limited in particular.

[0094] The embodiment of the application can also display the undetected record data with a first mark and the detected record data with a second mark according to the detection result. In this way, the undetected record data and the detected record data are differentially marked and compared, which can help the user to discover the overall situation of his / her copying in time. If it is excerpting, the user can also know the proportion of his / her excerpting in time, so as to avoid the situation that the copied words are wrong, missing, or consecutive, which cannot be discovered in time.

[0095] As shown in Figure 8As shown, in an office scenario, an office worker needs to copy the name, ID number, mobile phone number and home address on the 801 computer screen into the 802 paper notebook, and the embodiment of the application matches the recognized "Zhang San 111111111111111111" with all the information such as name, ID number, mobile phone number and home address on the 801 computer screen, matches "Zhang San 111111111111111111" on the 801 computer screen, and marks "Zhang San 111111111111111111" on the 801 computer screen with the second mark 803, and marks the remaining data information with the first mark 804, and the marks 803 and 804 can be underlined, highlighted in yellow, bolded, etc., and the marks 803 and 804 are different, and the specific marking method is not limited.

[0096] The embodiment of the application can also issue an alarm information according to the position distribution result of the first mark and the second mark, to prompt the user to check the recorded data. The content marked by the first mark is the undetected recorded data on the display device, and the content marked by the second mark is the detected recorded data on the display device. Each row of data on the display device is marked, and each row of marking result includes three cases, the first case is that all the data in the row is displayed by the first mark; the second case is that all the data in the row is displayed by the second mark; and the third case is that part of the data in the row is displayed by the first mark, and the remaining part of the row is displayed by the second mark.

[0097] When the distribution result is that the third case (i.e., part of the data in the row is displayed by the first mark, and the remaining part of the row is displayed by the second mark) appears continuously, and the number of continuous rows exceeds a preset number of rows, an alarm information is issued; otherwise, no alarm information is issued. The preset number of rows is not limited, and can be set according to actual needs. The alarm information can be sound information, prompt box information, etc., which are not limited by the embodiment.

[0098] As shown in FIG. 8, the embodiment of the application can also issue an alarm information according to the position distribution result of the first mark and the second mark, to prompt the user to check the recorded data. Figure 9As shown, specific examples are as follows: when the student partially copies the content of each of the first to fifth rows on the computer screen 901, the part of the text in each of the first to fifth rows on the computer screen that is copied by the user is marked (i.e., the first row "one, polyvinyl chloride waterproof roll", the second row "the product is made of polyvinyl chloride resin, anti-aging agent, plasticizer and ultraviolet light absorbing", the third row "agent and other additives", the fourth row "thermoplastic polyolefin waterproof roll", and the fifth row "the product is made of ethylene-propylene rubber weather resistance and heat resistance and polypropylene weldability") as the second mark 903 with bold text, and the rest is marked as the first mark 904 with underlined text, at which time a reminder message 905 is sent, and the reminder is in the form of a prompt box message to prompt the user to check the copied data content, so that the user can review and check the overall situation of the copied content in a timely manner to avoid missing words. The marks 903 and 904 can be underlined, yellow highlighted, bold text, etc., and the marks 903 and 904 are different, and the specific marking method is not limited.

[0099] Further, another preferred embodiment of the present application can also mark and display the subsequent data content adjacent to the marked record data according to the continuous length of the marked record data. In this way, when the user copies a large amount of continuous data, the data content that is not copied can be highlighted, making it easier to copy.

[0100] 205, detecting the position of the marked record data on the display device, and adjusting the data content currently displayed by the display device according to the detection result.

[0101] Before detecting the position of the marked record data on the display device, the preset position of the record data on the display device is set, and then it is detected whether the marked record data is located at the preset position on the display device. If yes, the data content currently displayed by the display device is updated.

[0102] The preset position can be the last data position of the record data on the display device. For this embodiment, no specific limitation is made. The way to update the data content currently displayed by the display device is not limited to page turning, scrolling up, etc. For this embodiment, no specific limitation is made.

[0103] Based on the above Figure 2As can be seen from the implementation mode of the present application, the present application provides a data marking method, for marking transcribed content on a screen, generally, when the transcribed content of a user is less, and the transcribed content is a common word with a high frequency of occurrence, the accurate position of the transcribed content of the user cannot be marked; for the above problem, the present application can determine the accurate transcribed position of the user by marking the same content of multiple positions at the same time, in combination with the mode of manually selecting content. For the user's excerpting process, if the excerpted content is more and scattered, after the user transcribes for a period of time, the user will inevitably miss some words in the process, for this, the present application displays the transcribed part and the non-transcribed part of the user by using different marking modes, and reminds the user according to the distribution of the first mark and the second mark in each row of the continuous multiple rows, so that the user can review and check the overall transcribed situation in time, avoid the problem of missing words, and improve the accuracy of recording. The present application can also make the user more comfortable when referring by adjusting the position of the marked content on the screen, and can also avoid manual page changing by automatically adjusting the data content on the screen, thereby improving the convenience of the user.

[0104] Further, as an implementation of the above-mentioned Figure 1 method, the embodiment of the present application further provides a data marking device for implementing the above-mentioned Figure 1 method. The device embodiment corresponds to the foregoing method embodiment, for the convenience of reading, the details of the foregoing method embodiment will not be described one by one, but it should be clear that the device in the present embodiment can correspondingly implement all the contents in the foregoing method embodiment. As shown in Figure 3 , the device comprises:

[0105] The acquisition unit 31 can be used to acquire a to-be-recognized image comprising recording data, wherein the recording data is derived from the data content currently displayed by the display device.

[0106] The recognition unit 32 can be used to recognize the recording data in the to-be-recognized image obtained by the acquisition unit 31.

[0107] The detection unit 33 can be used to detect the data content displayed by the display device according to the recording data recognized by the recognition unit 32.

[0108] The display unit 34 can be used to mark and display according to the detection result obtained by the detection unit 33.

[0109] Further, as an implementation of the above-mentioned Figure 2 method, the embodiment of the present application further provides another data marking device for implementing the above-mentioned Figure 2The method is implemented. The device embodiment corresponds to the foregoing method embodiment, and details of the foregoing method embodiment will not be described one by one for the convenience of reading, but it should be clear that the device in the embodiment can correspondingly implement all the contents in the foregoing method embodiment. As Figure 4 The device includes:

[0110] The acquisition unit 41 can be used to acquire an image to be identified including recording data, and the recording data is derived from data content currently displayed by a display device.

[0111] The identification unit 42 can be used to identify the recording data in the image to be identified obtained by the acquisition unit 41.

[0112] The detection unit 43 can be used to detect the data content displayed by the display device according to the recording data obtained by the identification unit 42.

[0113] The display unit 44 can be used to display a mark according to the detection result obtained by the detection unit 43.

[0114] The alarm unit 45 can be used to send alarm information according to the position distribution result of the first mark display and the second mark display obtained by the display unit 44, so as to prompt a user to check the recorded data.

[0115] Further, the display unit 44 further includes a display module 441, configured to display a mark for the recording data existing in multiple positions on the display device according to the detection result.

[0116] A deletion module 442 is configured to cancel the mark display of the recording data in other positions according to the recording data in the specified position selected by the user obtained by the display module 441.

[0117] Further, the display unit 44 further includes:

[0118] An adjustment module 443 is configured to adjust the display position of the marked recording data obtained by the display module 441, so that the recording data is located in the middle position of the display interface of the display device.

[0119] Further, the acquisition unit 41 includes:

[0120] An acquisition module 411 is configured to acquire an image to be identified captured by a camera;

[0121] A detection module 412 is configured to detect the image to be identified obtained by the acquisition module 411 according to a target object, and the target object at least contains the recording data.

[0122] The adjusting module 413 is configured to adjust the shooting angle of the camera according to the detection result obtained by the detection module 412, so as to obtain the to-be-recognized image including the recorded data.

[0123] Further, the display unit 44 further comprises:

[0124] The detection module 444 is configured to detect the position of the marked recorded data on the display device.

[0125] The execution module 445 is configured to adjust the data content currently displayed by the display device according to the detection result obtained by the detection module 444.

[0126] Further, the display unit 44 is further configured to display the undetected recorded data with a first mark and display the detected recorded data with a second mark according to the detection result obtained by the detection unit 43.

[0127] Further, the embodiment of the present application further provides a processor, which is used for running a program, wherein the program is used for executing the data marking method in the above Figures 1-2 .

[0128] Further, the embodiment of the present application further provides a storage medium, which is used for storing a computer program, wherein the computer program is used for controlling the device where the storage medium is located to execute the data marking method in the above Figures 1-2 .

[0129] In the above embodiments, the description of each embodiment has its own focus, and the part not described in detail in an embodiment can be referred to the relevant description of other embodiments.

[0130] It can be understood that the related features in the above method and device can be mutually referred. In addition, the "first", "second" and the like in the above embodiments are used to distinguish the embodiments, and do not represent the advantages and disadvantages of the embodiments.

[0131] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

[0132] The algorithms and displays presented herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems can be used with programs in accordance with the teachings herein, or it can prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these systems will be apparent from the description above. In addition, the present application is not intended to be limited to any particular programming language. It will be appreciated that there are many programming languages that can be used to implement the teachings of the present application as described herein, and any such programming language can be used in this regard.

[0133] In addition, the storage can include non- volatile storage such as flash memory, ROM, or the like, and volatile storage such as RAM, which typically stores data and program instructions used by the processor. The storage can also include removable storage devices, such as magnetic and / or optical disks, etc. The storage can further include a memory chip, such as RAM, ROM, etc.

[0134] As will be appreciated by one skilled in the art, aspects of the present application can be embodied as a method, system, or computer program product. Accordingly, aspects of the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, aspects of the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, magnetic disks, CD-ROMs, optical storage media such as DVD s, etc.) embodying computer program instructions.

[0135] The computer program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. Figure 1 one or more functions specified by one or more of the program instructions. Figure 1 one or more functions specified by one or more of the program instructions.

[0136] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the Figure 1 one or more functions specified by one or more of the program instructions. Figure 1 one or more functions specified by one or more of the program instructions.

[0137] These computer program instructions can also be loaded into a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 Figure 1 Figure 1

[0138] In one typical configuration, the computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0139] The memory can include non-persistent memory and / or volatile memory, such as random access memory (RAM) about which the processor can execute instructions. The memory can also include non-volatile memory, such as read only memory (ROM), electrically programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), flash memory, or a combination of non-volatile memories in different types. The memory can also include a compact disk read only memory (CD-ROM), digital versatile disk (DVD), Blu-ray, or another non-transitory computer readable medium, which is non-volatile and non-transitory in nature, about which at least some of the instructions executable by the processor are stored. The memory is an example of a computer readable medium.

[0140] Computer readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), electrically programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD), or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer readable media does not include transitory media such as modulated data signals and carriers.

[0141] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or apparatus that comprises a list of elements does not only include those elements, but can also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0142] ​​Those skilled in the art will appreciate that embodiments of the present application can be devised for a method, a system, or a computer program product. Accordingly, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer-readable program code thereon for use by or in connection with an instruction execution system. For the purposes of this description, a computer-usable or computer readable storage medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.

[0143] The foregoing is merely illustrative of the embodiments of this application, and is not intended to limit the application. Numerous variations and modifications can be possible to the embodiments without departing from the spirit and scope of the application. Any equivalent modifications or variations, made within the spirit and scope of the application, should be considered within the scope of the application.

Claims

1. A data tagging method, characterized in that, include: Acquire an image to be identified, including recorded data, wherein the recorded data originates from the data currently displayed on the display device, and the recorded data is copied with reference to the data content; Identify the recorded data in the image to be identified; The data content displayed by the display device is detected based on the recorded data; The marking and display based on the detection results includes: marking and displaying the recorded data that exists in multiple locations on the display device based on the detection results; Based on the record data selected by the user at a specified location, the display of the record data at other locations is deselected.

2. The method according to claim 1, characterized in that, The method further includes: Adjust the display position of the marked record data so that the record data is located in the center of the interface displayed by the display device.

3. The method according to claim 1, characterized in that, Acquire the image to be identified, including the recorded data, including: Acquire the image to be identified captured by the camera; The image to be identified is detected based on the target object, wherein the target object contains at least the recorded data; The camera's shooting angle is adjusted based on the detection results to obtain an image to be identified, including the recorded data.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: Detect the position of the marked recorded data on the display device; The data content currently displayed on the display device is adjusted based on the test results.

5. The method according to claim 1, characterized in that, The step of marking and displaying the results based on the detection results includes: Based on the detection results, undetected recorded data will be displayed with a first label, and detected recorded data will be displayed with a second label.

6. The method according to claim 5, characterized in that, The method further includes: An alarm message is issued based on the location distribution of the first and second markers to prompt the user to check the recorded data.

7. The method according to claim 1, characterized in that, The method further includes: Based on the continuous length of the marked record data, the subsequent data content adjacent to the marked record data will be displayed with a second mark.

8. A device for recording data, characterized in that, include: An acquisition unit is used to acquire an image to be identified, including recorded data, wherein the recorded data originates from the data content currently displayed on the display device, and the recorded data is copied with reference to the data content; The recognition unit is used to recognize the recorded data in the image to be recognized; The detection unit detects the data content displayed by the display device based on the recorded data; The display unit is marked and displayed according to the test results; The display unit further includes: a display module, used to mark and display the recorded data that exists in multiple locations on the display device according to the detection results; The deletion module is used to remove the marking and display of the record data at other locations based on the record data at the user-selected specified location obtained by the display module.

9. A processor, characterized in that, The processor is used to run a program, wherein the program executes the data marking method according to any one of claims 1 to 7.

Images