Data processing method, device and recording equipment

By adding image acquisition and text recognition functions to the recording device, obtaining and identifying text information of the target image, and combining audio data for voice recognition, the problem of insufficient functions of the recording device is solved, and user experience and multi-dimensional data recording capabilities are improved.

CN112115869BActive Publication Date: 2024-11-05BEIJING SOGOU TECHNOLOGY DEVELOPMENT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010990374.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-09-18
Publication Date
2024-11-05
Estimated Expiration
2040-09-18

AI Technical Summary

Technical Problem

The existing recording equipment has insufficient functions, resulting in poor user experience and cannot meet users' needs for image text recognition.

Method used

Add image acquisition and text recognition functions to the recording device. By acquiring the target image, determining its language and text recognition, text information is generated, and voice recognition and translation are combined with audio data, it supports sharing, forwarding and forwarding instructions.

Benefits of technology

It improves the user's recording equipment experience, realizes the enhancement of image text recognition and speech recognition functions, and meets the user's multi-dimensional data recording needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112115869B_ABST
    Figure CN112115869B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention provide a data processing method, device and recording device, wherein the method comprises: the recording device acquires a target image; acquires a target language corresponding to the target image; performs text recognition on the target image according to the target language to determine corresponding text information; and enables a user to use the recording device to perform text recognition on the image, thereby improving the user's experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a data processing method, device and recording equipment. Background Art

[0002] In recent years, recording equipment, as a product in the professional field, has developed rapidly and entered the public field. Various groups such as journalists, students, and teachers usually need recording equipment for recording. In addition, recording equipment is also needed for recording various TV programs, movies, music, etc.

[0003] As the use of recording devices becomes more common, users' requirements for the functions of recording devices are gradually increasing; currently, the functions of recording devices cannot meet user needs, resulting in a poor user experience. Summary of the invention

[0004] The embodiment of the present invention provides a data processing method to improve the user experience of using a recording device by increasing the function of the recording device.

[0005] Correspondingly, the embodiment of the present invention also provides a data processing device and a recording device to ensure the implementation and application of the above method.

[0006] In order to solve the above problems, an embodiment of the present invention discloses a data processing method, which specifically includes: a recording device obtains a target image; obtains a target language corresponding to the target image; and performs text recognition on the target image according to the target language to determine corresponding text information.

[0007] Optionally, acquiring the target language corresponding to the target image includes: acquiring a language selected by a user; and determining the target language corresponding to the target image according to the language selected by the user.

[0008] Optionally, when the target image includes multiple images and each target image corresponds to a different target language, the user-selected language includes multiple languages; determining the target language corresponding to the target image based on the language selected by the user includes: obtaining the selection order of the languages ​​selected by the user and the acquisition order of the target images by the recording device; determining the target language corresponding to each target image based on the acquired language selected by the user, the selection order of the languages ​​selected by the user and the acquisition order of the target images.

[0009] Optionally, acquiring the target language corresponding to the target image includes: performing language recognition on the target image to determine the target language corresponding to the target image.

[0010] Optionally, when the target image includes multiple images, performing text recognition on the target image according to the target language to determine the corresponding text information includes: performing text recognition on each target image according to the target language corresponding to each target image, and determining the text information corresponding to each target image.

[0011] Optionally, the method further includes: acquiring target audio data, the target audio data being associated with the target image, the target image being collected by a recording device during the process of recording the target audio data; performing speech recognition on the target audio data based on the text information to determine a corresponding speech recognition result.

[0012] Optionally, the method further comprises: performing translation according to the text information to generate a translation result.

[0013] Optionally, the translation result includes: a picture translation result and / or a text translation result.

[0014] Optionally, the method further includes: receiving a transmission instruction, the transmission instruction including at least one of the following: a sharing instruction, a forwarding instruction and a transfer instruction; transmitting data corresponding to the transmission instruction to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information and a translation result.

[0015] The embodiment of the present invention also discloses a data processing device, which is applied to a recording device and specifically includes: an image acquisition module, which is used to acquire a target image; a language acquisition module, which is used to acquire a target language corresponding to the target image; and a text recognition module, which is used to perform text recognition on the target image according to the target language and determine corresponding text information.

[0016] Optionally, the language acquisition module includes: a first language determination submodule, configured to acquire a language selected by a user; and determine a target language corresponding to the target image according to the language selected by the user.

[0017] Optionally, when the target image includes multiple images and each target image corresponds to a different target language, the user-selected language includes multiple languages; the first language determination submodule is used to obtain the selection order of the user-selected languages ​​and the acquisition order of the target images by the recording device; and determine the target language corresponding to each target image based on the acquired language selected by the user, the selection order of the user-selected languages ​​and the acquisition order of the target images.

[0018] Optionally, the language acquisition module includes: a second language determination submodule, configured to perform language recognition on the target image to determine a target language corresponding to the target image.

[0019] Optionally, when the target image includes multiple images, the text recognition module is used to perform text recognition on each target image according to the target language corresponding to each target image, and determine the text information corresponding to each target image.

[0020] Optionally, the device also includes: a speech recognition module, used to obtain target audio data, the target audio data is associated with the target image, and the target image is collected by the recording device during the process of recording the target audio data; performing speech recognition on the target audio data based on the text information to determine the corresponding speech recognition result.

[0021] Optionally, the device further comprises: a translation module, configured to translate according to the text information and generate a translation result.

[0022] Optionally, the translation result includes: a picture translation result and / or a text translation result.

[0023] Optionally, the device also includes: a data transmission module, used to receive transmission instructions, the transmission instructions include at least one of the following: sharing instructions, forwarding instructions and transfer instructions; transmitting data corresponding to the transmission instructions to other devices; the data corresponding to the transmission instructions include at least one of the following: target image, text information and translation results.

[0024] An embodiment of the present invention further discloses a readable storage medium. When instructions in the storage medium are executed by a processor of a recording device, the recording device can execute a data processing method as described in any one of the embodiments of the present invention.

[0025] An embodiment of the present invention also discloses a recording device, including a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: acquiring a target image; acquiring a target language corresponding to the target image; performing text recognition on the target image according to the target language to determine corresponding text information.

[0026] Optionally, acquiring the target language corresponding to the target image includes: acquiring a language selected by a user; and determining the target language corresponding to the target image according to the language selected by the user.

[0027] Optionally, when the target image includes multiple images and each target image corresponds to a different target language, the user-selected language includes multiple languages; determining the target language corresponding to the target image based on the language selected by the user includes: obtaining the selection order of the languages ​​selected by the user and the acquisition order of the target images by the recording device; determining the target language corresponding to each target image based on the acquired language selected by the user, the selection order of the languages ​​selected by the user and the acquisition order of the target images.

[0028] Optionally, acquiring the target language corresponding to the target image includes: performing language recognition on the target image to determine the target language corresponding to the target image.

[0029] Optionally, when the target image includes multiple images, performing text recognition on the target image according to the target language to determine the corresponding text information includes: performing text recognition on each target image according to the target language corresponding to each target image, and determining the text information corresponding to each target image.

[0030] Optionally, it also includes instructions for performing the following operations: obtaining target audio data, the target audio data is associated with the target image, and the target image is collected by the recording device during the process of recording the target audio data; performing voice recognition on the target audio data based on the text information to determine the corresponding voice recognition result.

[0031] Optionally, the recording device further includes: translating according to the text information to generate a translation result.

[0032] Optionally, the translation result includes: a picture translation result and / or a text translation result.

[0033] Optionally, it also includes instructions for performing the following operations: receiving a transmission instruction, the transmission instruction including at least one of the following: a sharing instruction, a forwarding instruction, and a transfer instruction; transmitting the data corresponding to the transmission instruction to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information, and a translation result.

[0034] The embodiments of the present invention include the following advantages:

[0035] In an embodiment of the present invention, a text recognition function of an image can be added to a recording device; then, when a user uses the recording device to perform text recognition on a target image, the recording device can obtain the target image; then obtain the target language corresponding to the target image, and perform text recognition on the target image based on the target language to determine the corresponding text information; thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1is a flow chart of steps of an embodiment of a data processing method of the present invention;

[0037] Figure 2 is a flowchart of steps of an optional embodiment of a data processing method of the present invention;

[0038] Figure 3 is a flowchart of steps of another data processing method embodiment of the present invention;

[0039] Figure 4 is a flowchart of steps of another data processing method embodiment of the present invention;

[0040] Figure 5 is a structural block diagram of an embodiment of a data processing device of the present invention;

[0041] Figure 6 is a structural block diagram of an optional embodiment of a data processing device of the present invention;

[0042] Figure 7 A structural block diagram of a recording device for data processing is shown according to an exemplary embodiment. DETAILED DESCRIPTION

[0043] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0044] A data processing method provided in an embodiment of the present invention is applied to a recording device, where the recording device may refer to a device with a recording function, such as a recording pen, a translation device such as a translation pen, a translation machine, etc.; the embodiment of the present invention does not limit this.

[0045] In an embodiment of the present invention, an image acquisition module may be provided in the recording device to add an image acquisition function to the recording device; thereby enabling the user to use the recording device to acquire images. In many cases, after acquiring an image, the user needs to perform text recognition on the image to obtain text information in the image. Therefore, an embodiment of the present invention further adds an image text recognition function to the recording device to meet the user's usage needs and improve the user experience.

[0046] Reference Figure 1 , shows a flow chart of steps of a data processing method embodiment of the present invention, which may specifically include the following steps:

[0047] Step 102: The recording device acquires the target image.

[0048] In the embodiment of the present invention, the user can select an image for which text recognition is to be performed in the recording device; for the convenience of subsequent description, the image for which image recognition is to be performed selected by the user can be referred to as a target image. The target image can include one or more images, which is not limited in the embodiment of the present invention.

[0049] The target image in the recording device may be collected by the recording device; or may be sent to the recording device by other devices, which is not limited in the present invention.

[0050] The recording device may call the image acquisition module provided therein to acquire the target image; and the other device may refer to a device other than the recording device.

[0051] Step 104: Obtain the target language corresponding to the target image.

[0052] After acquiring the target image, the target language corresponding to the target image may be acquired; the target language may be automatically recognized and acquired by a recording device, or may be acquired according to a language manually selected by a user; the embodiment of the present invention does not limit this.

[0053] Step 106: Perform text recognition on the target image according to the target language to determine corresponding text information.

[0054] Then, according to the target language corresponding to the target image, text recognition is performed on the target image to determine the text information of the target image. Wherein, the recording device is provided with a display component, and the display component may include a display screen, and the text information of the target image may be displayed on the display screen; the text information of the target image may also be sent to other devices, and the text information is displayed by other devices, and the embodiment of the present invention is not limited to this.

[0055] In the embodiment of the present invention, steps 102 to 106 may be performed by the recording device; or after the recording device performs step 102, the target image may be sent to the server, and the server may perform steps 104 to 106; and then the text information of the target image may be returned to the recording device; the embodiment of the present invention does not limit this.

[0056] In summary, in an embodiment of the present invention, a text recognition function of an image can be added to a recording device; then, when a user uses the recording device to perform text recognition on a target image, the recording device can obtain the target image; then obtain the target language corresponding to the target image, and perform text recognition on the target image based on the target language to determine the corresponding text information; thereby improving the user experience.

[0057] The following description will be made by taking the example of obtaining the target language corresponding to the target image according to the language manually selected by the user.

[0058] Reference Figure 2 , shows a flow chart of steps of an optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0059] Step 202: The recording device acquires a target image.

[0060] The target image may be acquired by calling an image acquisition module provided in the recording device during the process of recording audio data; or may be acquired by calling an image acquisition module provided in the recording device independently of the recording process of the recording device, and the embodiment of the present invention does not impose any limitation on this.

[0061] When the target image includes multiple images, on the one hand, in order to facilitate the user to confirm whether the selected image is the image that he needs to perform text recognition; on the other hand, in order to facilitate the user to select the language of the target image, whether it corresponds to the target language corresponding to the text in the target image; after acquiring the target image, the thumbnail of the target image can be displayed on the display screen of the recording device. Among them, the recording device can acquire the target image in the order in which the user selects the target image, and display the thumbnail of the target image on the display screen of the recording device in sequence. In other words, the acquisition order corresponding to the acquisition of the target images by the recording device and the display order of the thumbnail of the target image are both corresponding to the order in which the user selects the target images.

[0062] Step 204: Obtain the language selected by the user.

[0063] If there is only one target image, the user can select the same language as the target language of the text in the target image. If there are multiple target images, and each target image corresponds to a different target language, the user can select the same language as the target language of the text in each target image in turn according to the display order of the thumbnails of the target images. After the user selects the language, the text recognition operation can be performed; and then the recording device can obtain the language selected by the user.

[0064] Of course, the user can select the language in advance before the recording device obtains the target image; then select the target image in the order of language selection; and then the recording device can obtain the target image in the order selected by the user. After the recording device obtains the target image, the recording device can directly obtain the language selected by the user without the user performing a text recognition operation.

[0065] Then, the target language corresponding to the target image may be determined according to the language selected by the user; see steps 206 to 208 .

[0066] Step 206: obtaining the order in which the user selects the languages ​​and the order in which the recording device obtains the target images;

[0067] Step 208: Determine the target language corresponding to each target image according to the acquired language selected by the user, the selection order of the language selected by the user, and the acquisition order of the target images.

[0068] In the embodiment of the present invention, the selection order of the language selected by the user and the acquisition order of the target image acquired by the recording device can be obtained. Then, for each target image, the selection order that is the same as the acquisition order of the target image can be searched; then the language corresponding to the selection order is determined as the target language corresponding to the target image.

[0069] Step 210: Perform text recognition on each target image according to the target language corresponding to each target image to determine the text information corresponding to each target image.

[0070] Among them, OCR (Optical Character Recognition) recognition technology can be used to perform text recognition on the target image according to the target language to determine the corresponding text information.

[0071] When the target image includes multiple images, for each target image, text recognition may be performed on the target image according to the target language corresponding to the target image to determine the text information corresponding to the target image.

[0072] In summary, in the embodiments of the present invention, the language selected by the user can be obtained, as well as the selection order of the selected languages ​​by the user and the acquisition order of the target images by the recording device; then, the target language corresponding to each target image is determined based on the language selected by the user, the selection order and the acquisition order; then, text recognition is performed on each target image according to the target language corresponding to each target image, and the text information corresponding to each target image is determined, and then, according to the multiple languages ​​selected by the user, multi-language recognition is performed on multiple images at the same time.

[0073] The following description takes the automatic recognition by a recording device as an example.

[0074] Reference Figure 3 , shows a flow chart of steps of another data processing method embodiment of the present invention, which may specifically include the following steps:

[0075] Step 302: The recording device acquires a target image.

[0076] This step 302 is similar to the above step 202 and will not be described again.

[0077] Step 304: Perform language recognition on the target image to determine the target language corresponding to the target image.

[0078] In one embodiment of the present invention, when the recording device automatically recognizes, a thumbnail of the target image may be displayed after the target image is acquired, so that the user can confirm whether the selected image is the image for which the user needs to perform image text recognition.

[0079] When the user decides to perform text recognition on the target image, he or she may choose to trigger the automatic language recognition function, such as by clicking an "automatic language recognition" button or a "text recognition" button; and the recording device may then perform automatic language recognition.

[0080] In addition, in one embodiment of the present invention, when the recording device automatically recognizes the target image, after acquiring the target image, the thumbnail of the target image may not be displayed. That is, after the user selects the target image, the recording device can acquire the target image and can directly perform automatic language recognition.

[0081] Step 306: Perform text recognition on each target image according to the target language corresponding to each target image to determine the text information corresponding to each target image.

[0082] In summary, in the embodiments of the present invention, the language of the target image can be recognized to determine the target language corresponding to the target image; then, text recognition can be performed on each target image according to the target language corresponding to each target image to determine the text information corresponding to each target image; and the recording device can automatically perform multi-language recognition on multiple images at the same time.

[0083] In an optional embodiment of the present invention, when the target image is captured by the recording device during the process of recording target audio data, the target image can be associated with the target audio data; the association of data recorded from multiple dimensions is achieved, which facilitates the user to use the recorded data of multiple dimensions at the same time later, thereby improving the user experience.

[0084] The following describes how to collect image data during the process of recording audio data, and how to associate the image data with the audio data.

[0085] During the recording process, the recording device receives an image acquisition instruction.

[0086] In an embodiment of the present invention, when a user needs to record, the recording function of the recording device can be turned on and the recording device can be used to record. During the recording process, when the user needs to record data of other dimensions such as image data, such as printed data, projection images, etc., an image acquisition operation can be performed. After the user performs the image acquisition operation, the corresponding recording device can receive the image acquisition instruction corresponding to the image acquisition operation.

[0087] In an example of the present invention, a user may perform an image acquisition operation in a recording device, and correspondingly, the recording device may generate an image acquisition instruction based on the image acquisition operation performed by the user.

[0088] In one example of the present invention, when the recording device is connected to other devices, the user can also execute the image acquisition device in the application corresponding to the recording device of the other device. At this time, the other device can generate an image acquisition instruction according to the user's image acquisition operation; and then send the image acquisition instruction to the recording device. The other device may refer to a device other than the recording device, such as a terminal device, etc., which is not limited in the embodiment of the present invention.

[0089] Image acquisition is performed according to the image acquisition instruction.

[0090] Then the recording device can call the image acquisition module to acquire images according to the image acquisition instruction to obtain image data.

[0091] During the recording process, the user may perform multiple image acquisition operations, and correspondingly, the recording device may receive multiple image acquisition instructions. The recording device may perform an image acquisition once each time it receives an image acquisition instruction to obtain a corresponding image frame.

[0092] The captured image data and the recorded audio data are associated and stored.

[0093] In the embodiment of the present invention, in order to facilitate the user to use the recorded data of multiple dimensions at the same time later, after the image data is collected, the collected image data can be associated with the audio data obtained by recording, and stored in the recording device. The image data and the audio data can be associated based on the time of the collected image data and the time corresponding to the audio data obtained by recording, which is not limited in the embodiment of the present invention.

[0094] In one example, the recording device may associate each image frame with an audio frame corresponding to the image frame obtained during the recording process after each image frame is captured, thereby associating the captured image data with the audio data obtained during the recording. In another example, the recording device may store each image frame in the image frame after each image frame is captured, and after the recording is completed, associate each image frame of the image data with the corresponding audio frame in the audio data obtained during the recording.

[0095] Among them, the method of associating each image frame with the corresponding audio frame can be as follows: for the target image frame in the image data, determine the target timestamp corresponding to the target image frame; determine the target audio frame in the audio data whose timestamp is the same as the target timestamp; and associate the target image frame with the target audio frame.

[0096] If the recording device associates each image frame with the audio frame corresponding to the image frame obtained during the recording process after each image frame is captured, then one image frame captured each time can be used as the target image frame. If the recording device associates each image frame of the image data with the corresponding audio frame in the audio data obtained during the recording after the recording is completed, then one image frame can be arbitrarily selected from the image data as the target image frame each time until all image frames in the image data are associated with the corresponding audio frames in the audio data.

[0097] In an embodiment of the present invention, for a target image frame, a target timestamp corresponding to the target image frame can be determined, and a target audio frame with a timestamp identical to the target timestamp can be obtained from the audio data obtained from the recording; then the target image frame and the target audio frame are associated.

[0098] Furthermore, when the user needs to perform speech recognition on the target audio data, the target audio data can be combined with the target image data for speech recognition; thereby, the accuracy of speech recognition is improved by combining information associated with the target audio data to perform speech recognition on the target audio data.

[0099] Reference Figure 4 , shows a step flow chart of another data processing method embodiment of the present invention.

[0100] Step 402: The recording device acquires a target image.

[0101] Step 404: Obtain the target language corresponding to the target image.

[0102] Step 406: Perform text recognition on the target image according to the target language to determine corresponding text information.

[0103] Step 408: Acquire target audio data, where the target audio data is associated with the target image, and the target image is collected by a recording device during the process of recording the target audio data.

[0104] Step 410: Perform speech recognition on the target audio data according to the text information to determine a corresponding speech recognition result.

[0105] In an embodiment of the present invention, the target audio data can be subjected to speech recognition in real time during the process of recording the target audio data by the recording device. In the process of recording the target audio data, if the recording device acquires the target image captured by calling the image acquisition module therein, the target audio data recorded after the target image is captured can be subjected to speech recognition based on the text information recognized from the target image to determine the corresponding speech recognition result.

[0106] In the embodiment of the present invention, after the target audio data is recorded by the recording device, speech recognition can be performed on the target audio data (i.e., non-real-time target audio data). In particular, speech recognition can be performed on the target audio data based on the text information of all target images collected by the image collection module during the recording of the target audio data, and the corresponding speech recognition result can be determined; the embodiment of the present invention does not limit this.

[0107] The text information may be used in the speech recognition process of the target audio data to improve the accuracy of the speech recognition of the target audio data.

[0108] In summary, in an embodiment of the present invention, target audio data can be obtained; then, speech recognition is performed on the target audio data based on the text information of the target image to determine the corresponding speech recognition text information; wherein, the target image is collected by a recording device during the process of recording the target audio data, and the target audio data is associated with the target image, and then speech recognition is performed on the target audio data by combining the information associated with the target audio data to improve the accuracy of speech recognition.

[0109] In addition, in an embodiment of the present invention, after determining the text information of the target image, a translation may be performed based on the text information to obtain a translation result. The target language may be determined, and then the text information may be translated to obtain a translation result corresponding to the target language. The target language may be a language that the user is proficient in.

[0110] In an optional embodiment of the present invention, after obtaining the translation result, only the translation result may be displayed without displaying the text information; or the translation result and the text information may be displayed simultaneously; this is not limited in the embodiment of the present invention.

[0111] In an optional embodiment of the present invention, the translation result may be a picture translation result. The text information may be translated, and after the corresponding translated text information is determined, a picture translation result may be generated based on the translated text information. The target image may be synthesized with the translated text information to generate a picture translation result. For example, the translated text information may be overlaid on the text information corresponding to the translated text information in the target image; for another example, the translated text information may be added to the target image at an associated position with the text information corresponding to the translated text information; thereby facilitating user comparison and viewing. For example, when the target image is an image of a presentation, the translated text information corresponding to each line of text may be added to a position between the line of text and the next / previous line of text. For example, when the target image is an image of a menu, the translated dish name may be overlaid on the dish name corresponding to the translated dish name in the target image. Of course, the translated text information may also be used to generate a new picture as a picture translation result according to the typesetting method of the text in the target image.

[0112] In the embodiment of the present invention, the translation result may also be a text translation result; that is, the translated text information may be directly used as the text translation result. When the translation result is a text translation result, if the translation result and the text information are displayed at the same time, the translation result and the text information may be displayed in comparison.

[0113] In one embodiment of the present invention, a transmission instruction is received, and the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a transfer instruction; the data corresponding to the transmission instruction is transmitted to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information, and a translation result. Then, the user can transmit one or more of the target image, the text information of the target image, and the translation result of the target image to other devices; so that the user can use the target image, the text information of the target image, and the translation result of the target image in other devices. The other device may refer to a device other than a recording device, such as a terminal device, etc., which is not limited in the embodiment of the present invention.

[0114] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0115] The embodiment of the present invention further provides a data processing device, which is applied in a recording device.

[0116] Reference Figure 5 , shows a structural block diagram of a data processing device embodiment of the present invention, which may specifically include the following modules:

[0117] An image acquisition module 502 is used to acquire a target image;

[0118] A language acquisition module 504 is used to acquire the target language corresponding to the target image;

[0119] The text recognition module 506 is used to perform text recognition on the target image according to the target language to determine corresponding text information.

[0120] Reference Figure 6 , showing a structural block diagram of an optional embodiment of a data processing device of the present invention.

[0121] In an optional embodiment of the present invention, the language acquisition module 504 includes:

[0122] The first language determination submodule 5042 is used to obtain the language selected by the user; and determine the target language corresponding to the target image according to the language selected by the user.

[0123] In an optional embodiment of the present invention, when the target image includes multiple images, and each target image corresponds to a different target language, the language selected by the user includes multiple languages;

[0124] The first language determination submodule 5042 is used to obtain the selection order of the languages ​​selected by the user and the acquisition order of the target images by the recording device; and determine the target language corresponding to each target image based on the acquired languages ​​selected by the user, the selection order of the languages ​​selected by the user and the acquisition order of the target images.

[0125] In an optional embodiment of the present invention, the language acquisition module 504 includes:

[0126] The second language determination submodule 5044 is used to perform language recognition on the target image to determine the target language corresponding to the target image.

[0127] In an optional embodiment of the present invention, when the target image includes multiple images,

[0128] The text recognition module 506 is used to perform text recognition on each target image according to the target language corresponding to each target image, and determine the text information corresponding to each target image.

[0129] In an optional embodiment of the present invention, the device further comprises:

[0130] The speech recognition module 508 is used to obtain target audio data, where the target audio data is associated with the target image, where the target image is collected by the recording device during the process of recording the target audio data; perform speech recognition on the target audio data based on the text information to determine a corresponding speech recognition result.

[0131] In an optional embodiment of the present invention, the device further comprises:

[0132] The translation module 510 is used to translate the text information and generate a translation result.

[0133] In an optional embodiment of the present invention, the translation result includes: a picture translation result and / or a text translation result.

[0134] In an optional embodiment of the present invention, the device further comprises:

[0135] The data transmission module 512 is used to receive transmission instructions, and the transmission instructions include at least one of the following: sharing instructions, forwarding instructions and transfer instructions; transmitting the data corresponding to the transmission instructions to other devices; the data corresponding to the transmission instructions include at least one of the following: target image, text information and translation results.

[0136] In summary, in an embodiment of the present invention, a text recognition function of an image can be added to a recording device; then, when a user uses the recording device to perform text recognition on a target image, the recording device can obtain the target image; then obtain the target language corresponding to the target image, and perform text recognition on the target image based on the target language to determine the corresponding text information; thereby improving the user experience.

[0137] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0138] Figure 7 1 is a structural block diagram of a recording device 700 for data processing according to an exemplary embodiment. For example, the recording device 700 may be a recording pen, a translation pen, a translation machine, etc.

[0139] Reference Figure 7 The recording device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0140] The processing component 702 generally controls the overall operation of the recording device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 702 may include one or more modules to facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

[0141] The memory 704 is configured to store various types of data to support the operation of the recording device 700. Examples of such data include instructions for any application or method operating on the recording device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0142] The power component 706 provides power to the various components of the recording device 700. The power component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the recording device 700.

[0143] The multimedia component 708 includes a screen that provides an output interface between the recording device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the recording device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0144] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the recording device 700 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0145] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0146] The sensor assembly 714 includes one or more sensors for providing various aspects of the status assessment of the recording device 700. For example, the sensor assembly 714 can detect the open / closed state of the recording device 700, the relative positioning of components, such as the display and keypad of the recording device 700, the sensor assembly 714 can also detect the position change of the recording device 700 or a component of the recording device 700, the presence or absence of user contact with the recording device 700, the position or acceleration / deceleration of the recording device 700, and the temperature change of the recording device 700. The sensor assembly 714 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0147] The communication component 716 is configured to facilitate wired or wireless communication between the recording device 700 and other devices. The recording device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 714 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 714 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0148] In an exemplary embodiment, the recording device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0149] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by the processor 720 of the recording device 700 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0150] A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by the processor of a recording device, enables the recording device to execute a data processing method, the method comprising: the recording device acquires a target image; acquires a target language corresponding to the target image; performs text recognition on the target image according to the target language to determine corresponding text information.

[0151] Optionally, acquiring the target language corresponding to the target image includes: acquiring a language selected by a user; and determining the target language corresponding to the target image according to the language selected by the user.

[0152] Optionally, when the target image includes multiple images and each target image corresponds to a different target language, the user-selected language includes multiple languages; determining the target language corresponding to the target image based on the language selected by the user includes: obtaining the selection order of the languages ​​selected by the user and the acquisition order of the target images by the recording device; determining the target language corresponding to each target image based on the acquired language selected by the user, the selection order of the languages ​​selected by the user and the acquisition order of the target images.

[0153] Optionally, acquiring the target language corresponding to the target image includes: performing language recognition on the target image to determine the target language corresponding to the target image.

[0154] Optionally, when the target image includes multiple images, performing text recognition on the target image according to the target language to determine the corresponding text information includes: performing text recognition on each target image according to the target language corresponding to each target image, and determining the text information corresponding to each target image.

[0155] Optionally, the method further includes: acquiring target audio data, the target audio data being associated with the target image, the target image being collected by a recording device during the process of recording the target audio data; performing speech recognition on the target audio data based on the text information to determine a corresponding speech recognition result.

[0156] Optionally, the method further comprises: performing translation according to the text information to generate a translation result.

[0157] Optionally, the translation result includes: a picture translation result and / or a text translation result.

[0158] Optionally, the method further includes: receiving a transmission instruction, the transmission instruction including at least one of the following: a sharing instruction, a forwarding instruction and a transfer instruction; transmitting data corresponding to the transmission instruction to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information and a translation result.

[0159] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0160] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0161] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0162] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0163] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0164] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0165] The data processing method, the data processing device and the recording device provided by the present invention are introduced in detail above. The principle and implementation mode of the present invention are explained by using specific examples in this article. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and the scope of application. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A data processing method, characterized in that: include: The recording device obtains the target image, including: The recording device collects the target image; The recording device obtains the target image sent by other devices; Acquire a target language corresponding to the target image; Performing text recognition on the target image according to the target language to determine corresponding text information; When the target image includes multiple images, and each target image corresponds to a different target language, the language selected by the user includes multiple languages; According to the language selected by the user, the target language corresponding to the target image is determined, including: Obtaining the order in which the user selects the language and the order in which the recording device acquires the target image; The target language corresponding to each target image is determined according to the acquired language selected by the user, the selection order of the language selected by the user and the acquisition order of the target images.

2. The method according to claim 1, characterized in that The acquiring the target language corresponding to the target image includes: Get the language selected by the user; According to the language selected by the user, the target language corresponding to the target image is determined.

3. The method according to claim 1, characterized in that The acquiring the target language corresponding to the target image includes: Perform language recognition on the target image to determine the target language corresponding to the target image.

4. The method according to claim 1, characterized in that: When the target image includes multiple images, performing text recognition on the target image according to the target language to determine the corresponding text information includes: Text recognition is performed on each target image according to the target language corresponding to each target image to determine the text information corresponding to each target image.

5. The method according to claim 1, characterized in that The method further comprises: Acquire target audio data, wherein the target audio data is associated with the target image, and the target image is collected by a recording device during the process of recording the target audio data; Perform speech recognition on the target audio data according to the text information to determine a corresponding speech recognition result.

6. The method according to claim 1, characterized in that The method further comprises: Translate the text information to generate a translation result.

7. The method according to claim 6, characterized in that The translation results include: image translation results and / or text translation results.

8. The method according to claim 6, characterized in that The method further comprises: receiving a transmission instruction, wherein the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a transfer instruction; The data corresponding to the transmission instruction is transmitted to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information, and a translation result.

9. A data processing device, characterized in that: Used in recording equipment, including: The image acquisition module is used to acquire the target image, including: Used to collect the target image; Used to obtain the target image sent by other devices; A language acquisition module, used to acquire the target language corresponding to the target image; A text recognition module, used to perform text recognition on the target image according to the target language and determine the corresponding text information; When the target image includes multiple images, and each target image corresponds to a different target language, the language selected by the user includes multiple languages; The first language determination submodule is used to obtain the selection order of the languages ​​selected by the user and the acquisition order of the target images by the recording device; and determine the target language corresponding to each target image based on the acquired languages ​​selected by the user, the selection order of the languages ​​selected by the user and the acquisition order of the target images.

10. The device according to claim 9, characterized in that The language acquisition module includes: The first language determination submodule is used to obtain the language selected by the user; and determine the target language corresponding to the target image according to the language selected by the user.

11. The device according to claim 9, characterized in that The language acquisition module includes: The second language determination submodule is used to perform language recognition on the target image to determine the target language corresponding to the target image.

12. The device according to claim 9, characterized in that When the target image includes multiple images, The text recognition module is used to perform text recognition on each target image according to the target language corresponding to each target image, and determine the text information corresponding to each target image.

13. The device according to claim 9, characterized in that The device also includes: The speech recognition module is used to obtain target audio data, where the target audio data is associated with the target image, where the target image is collected by the recording device during the process of recording the target audio data; perform speech recognition on the target audio data based on the text information to determine a corresponding speech recognition result.

14. The device according to claim 9, characterized in that The device also includes: The translation module is used to translate the text information and generate a translation result.

15. The device according to claim 14, characterized in that The translation results include: image translation results and / or text translation results.

16. The device according to claim 14, characterized in that The device also includes: The data transmission module is used to receive transmission instructions, wherein the transmission instructions include at least one of the following: sharing instructions, forwarding instructions and transfer instructions; and transmit the data corresponding to the transmission instructions to other devices; the data corresponding to the transmission instructions include at least one of the following: target images, text information and translation results.

17. A recording device, characterized in that: The system comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: Get the target image, including: Acquiring the target image; Acquire the target image sent by other devices; Acquire a target language corresponding to the target image; Performing text recognition on the target image according to the target language to determine corresponding text information; When the target image includes multiple images, and each target image corresponds to a different target language, the language selected by the user includes multiple languages; According to the language selected by the user, the target language corresponding to the target image is determined, including: Obtaining the order in which the user selects the language and the order in which the recording device acquires the target image; The target language corresponding to each target image is determined according to the acquired language selected by the user, the selection order of the language selected by the user and the acquisition order of the target images.

18. The recording device according to claim 17, characterized in that The acquiring the target language corresponding to the target image includes: Get the language selected by the user; According to the language selected by the user, the target language corresponding to the target image is determined.

19. The recording device according to claim 17, characterized in that The acquiring the target language corresponding to the target image includes: Perform language recognition on the target image to determine the target language corresponding to the target image.

20. The recording device according to claim 17, characterized in that When the target image includes multiple images, performing text recognition on the target image according to the target language to determine the corresponding text information includes: Text recognition is performed on each target image according to the target language corresponding to each target image to determine the text information corresponding to each target image.

21. The recording device according to claim 17, characterized in that Also contains instructions for: Acquire target audio data, wherein the target audio data is associated with the target image, and the target image is collected by a recording device during the process of recording the target audio data; Perform speech recognition on the target audio data according to the text information to determine a corresponding speech recognition result.

22. The recording device according to claim 17, characterized in that The recording device also includes: Translate the text information to generate a translation result.

23. The recording device according to claim 22, characterized in that The translation results include: image translation results and / or text translation results.

24. The recording device according to claim 22, characterized in that Also contains instructions for: receiving a transmission instruction, wherein the transmission instruction includes at least one of the following: a sharing instruction, a forwarding instruction, and a transfer instruction; The data corresponding to the transmission instruction is transmitted to other devices; the data corresponding to the transmission instruction includes at least one of the following: a target image, text information, and a translation result.

25. A readable storage medium, characterized in that: When the instructions in the storage medium are executed by the processor of the recording device, the recording device can execute the data processing method as described in any one of method claims 1-8.