Translation method and device and dictionary pen

Abstract

The invention provides a translation method and device and a dictionary pen, and relates to the technical field of electronic products, and the method comprises the steps: responding to an operation of inputting a target object image by a user, and recognizing a target object semantic text of the target object image; according to a dictionary library of a target language, translating the target object semantic text into a target object semantic translation text corresponding to the target language; and associatively storing the target object image, the target object semantic text and the target object semantic translation text into a dictionary library of the target language.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic products, and in particular to a translation method, device and dictionary pen. Background Art

[0002] With the continuous innovation of science and technology in the field of education, the dictionary pen, as a portable electronic learning tool, integrates scanning recognition and instant translation functions. It can quickly perform basic direct translation on the scanned text, greatly improving the user's efficiency in learning and work.

[0003] However, in the related art, dictionary pens usually only support the processing of query content that is text. Young children may find the pure text learning process boring in the process of learning a language, which is not conducive to their language learning.

[0004] Therefore, how to more effectively help young children learn language through dictionary pens has become an urgent problem to be solved in the industry. Summary of the Invention

[0005] The present invention provides a translation method, a device and a dictionary pen, which are used to solve the problem in the prior art of how to more effectively help young children learn language through dictionary pens.

[0006] The present invention provides a translation method, comprising: In response to a user inputting a target object image, identifying a target object semantic text of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The target object image, the target object semantic text, and the target object semantic translation text are associated and stored in a dictionary library of the target language.

[0007] According to a translation method provided by the present invention, after the step of associating and storing the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language, the method further comprises: When the target object semantic text is obtained, translating the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0008] According to a translation method provided by the present invention, after the step of associating and storing the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language, the method further comprises: When the target object semantic translation text is obtained, translating the target object semantic translation text into the target object semantic text according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0009] According to a translation method provided by the present invention, the operation of the user inputting the target object image includes: The user clicks the shooting icon to shoot the target object; Or, the user imports the target object image.

[0010] According to a translation method provided by the present invention, the identifying of the target object semantic text of the target object image includes: The target object image is input into a physical object recognition model, and a target object semantic text of the target object in the target object image is output.

[0011] According to a translation method provided by the present invention, the method further comprises: Get the target text entered by the user; Translating the target text into a target translation text corresponding to the target language based on a dictionary library of the target language; If there is no image information associated with the target text or the target translated text in the target language dictionary, a target image is matched in a preset image library based on the target text or the target translated text.

[0012] The present invention also provides a translation device, comprising: a recognition model for recognizing a target object semantic text of the target object image in response to a user inputting an operation of the target object image; A translation module, configured to translate the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The associating module is used to associate and store the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language.

[0013] According to a translation device provided by the present invention, the device is further used for: When the target object semantic text is obtained, translating the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0014] According to a translation device provided by the present invention, the device is further used for: When the target object semantic translation text is obtained, translating the target object semantic translation text into the target object semantic text according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0015] According to a translation device provided by the present invention, the device is further used for: The user clicks the shooting icon to shoot the target object; Or, the user imports the target object image.

[0016] According to a translation device provided by the present invention, the device is further used for: The target object image is input into a physical object recognition model, and a target object semantic text of the target object in the target object image is output.

[0017] According to a translation device provided by the present invention, the device is further used for: Get the target text entered by the user; Translating the target text into a target translation text corresponding to the target language based on a dictionary library of the target language; If there is no image information associated with the target text or the target translated text in the target language dictionary, a target image is matched in a preset image library based on the target text or the target translated text.

[0018] The present invention also provides a dictionary pen, comprising a dictionary pen body, a processor arranged inside the dictionary pen body, and a display screen arranged on the surface of the dictionary pen body; The processor is configured to recognize a target object semantic text of the target object image in response to a user inputting an operation of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; Associating and storing the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language; The display screen is used to display the target object image, the target object semantic text, and the target object semantic translation text.

[0019] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the above-described translation methods when executing the computer program.

[0020] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which implements any of the above-mentioned translation methods when executed by a processor.

[0021] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned translation methods.

[0022] The translation method, device, and dictionary pen provided by the present invention utilize image recognition technology to accurately identify the semantic text of the target object in the image in response to a user input of a target object, establishing an association between the object and vocabulary. This provides a more intuitive learning method for children. Furthermore, the target object's semantic text is translated into a translated text in the target language and presented to the child in an intuitive manner, enabling them to learn two languages ​​simultaneously, deepen their memory and understanding of vocabulary, avoid the tediousness of traditional text-only learning, and improve learning outcomes. Through associative storage, captured images of physical objects are directly mapped and stored in the device's pre-set dictionary, enriching the dictionary's displayed content. Furthermore, since the images of the target objects are captured and recorded by the user, when the user re-learns through associative learning using the physical object images, it serves as a specific heuristic memory recalling the captured images, helping the user memorize vocabulary and improving the quality of their learning. Furthermore, by actively capturing images, users can continuously learn new content, without being limited to specific textual content, effectively increasing their learning initiative. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0024] Figure 1 It is a schematic flow chart of the translation method provided by the present invention; Figure 2 A schematic diagram of the structure of the translation device provided by the present invention; Figure 3 A schematic diagram of the dictionary pen structure provided by the present invention; Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0025] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0026] Figure 1 It is a flowchart of the translation method provided by the present invention, such as Figure 1 As shown, the method includes the following: Step 110 , in response to a user inputting a target object image, identifying a target object semantic text of the target object image; In this invention, the dictionary pen serves as a portable learning tool. Users can input images of target objects into the pen through its built-in camera or data transmission function. When the user needs to find the vocabulary corresponding to a physical object, they simply input the image of the physical object through the corresponding operation of the dictionary pen. The dictionary pen will receive this operation instruction and then initiate the subsequent recognition process.

[0027] For example, the user can activate the camera function of the dictionary pen through the camera button on the dictionary pen or the corresponding operation on the touch screen, take a picture of the target object, and thus input the image of the target object into the dictionary pen.

[0028] The dictionary pen can respond promptly to the user's operation of inputting the target object image, preparing for subsequent recognition and translation.

[0029] For example, when a child is learning, he becomes interested in a table and wants to know how to say table in English. So, he presses the camera button on the dictionary pen with a camera function, points it at the table and takes a picture of the table, inputting the image of the table into the dictionary pen. The dictionary pen then responds to the user's input of the target object image and prepares for the next step of processing. After receiving the image of the target object, the dictionary pen will analyze the image content using its built-in image recognition algorithm and semantic recognition model. Through calculation and comparison, key semantic information is extracted from the image, and the physical object represented in the image is transformed into a text form with clear semantics, that is, the target object semantic text corresponding to the target object is determined.

[0030] After the dictionary pen captures an image of a table, the image recognition algorithm will analyze features such as the shape and texture of the table, compare them with the data in the semantic recognition model, and finally recognize that the target object semantic text represented by this image is "table". In this way, the dictionary pen completes the process of recognizing the target object semantic text of the target object image, laying a foundation for subsequent translation and storage.

[0031] More specifically, in the present invention, after recognizing the target object semantic text of the target object image, the target object image and the target object semantic text can be displayed simultaneously on the screen of the dictionary pen.

[0032] Step 120, according to the dictionary library of the target language, translate the target object semantic text into the target object semantic translation text corresponding to the target language; In the present invention, the target language refers to the specific language that the user hopes to translate the original text into. In language learning and translation scenarios, users usually set a target language so as to convert the content in the source language into the content in the target language for learning and understanding.

[0033] If the user is using the dictionary pen to learn English, then for the Chinese word "苹果", they want to know the corresponding English expression "apple", and here English is the target language.

[0034] The dictionary library of the target language is a database that stores a large number of words and their related information (including but not limited to translations, example sentences, pronunciations, etc.), and it is established for the target language. The words in the dictionary library can be the words of the target language itself, or the translation correspondence between other languages and the target language, etc.

[0035] Taking the Chinese-English dictionary library as an example, it will contain a large number of Chinese-English word correspondences. When the user wants to translate "苹果" into English, the dictionary pen will look up the corresponding English translation "apple" of "苹果" in the Chinese-English dictionary library, and this Chinese-English dictionary library is the dictionary library of the target language (English).

[0036] The target object semantic text refers to the text information with clear semantics extracted from the target object image through image recognition and other means. It is a semantic expression of the things contained in the image and can accurately reflect the core semantic content such as the name and concept of the things represented by the image.

[0037] The target object semantic translation text is the result of accurately translating the target object semantic text into the target language. It expresses the same or similar semantic content represented by the target object semantic text in the target language, allowing users to understand and learn this semantic content in the target language.

[0038] In this invention, after determining the target object's semantic text, the dictionary pen uses its built-in translation algorithm and the target language's dictionary library to convert this semantic text into text with the same or similar semantics in the target language. This process is not a simple word replacement; it takes into account the accurate communication of semantics, ensuring that the translated text accurately expresses the meaning represented by the original target object's semantic text, thereby achieving effective conversion between different languages.

[0039] Optionally, in the present application, after the target object semantic text is translated into the target object semantic translation text corresponding to the target language, the target object semantic text and the corresponding target object semantic translation text will be displayed simultaneously on the display screen of the dictionary pen.

[0040] In another optional embodiment, in the present application, after the target object semantic text is translated into the target object semantic translation text corresponding to the target language, the target object image, the target object semantic text, and the corresponding target object semantic translation text will be displayed simultaneously on the display screen of the dictionary pen.

[0041] After the target object semantic text is translated into the target object semantic translation text corresponding to the target language, the target object semantic text and the corresponding target object semantic translation text are immediately displayed on the display screen of the dictionary pen. This can effectively help users in the process of collecting target object images, and can also effectively help users learn through the target object semantic translation text displayed on the display screen of the dictionary pen.

[0042] Step 130 : Associate the target object image, the target object semantic text, and the target object semantic translation text and store them in a dictionary of the target language.

[0043] In the present invention, after the dictionary pen completes the semantic text recognition and translation of the target object image, in order to make this information better utilized in subsequent learning and query, it needs to be associated and stored in the dictionary library of the target language.

[0044] Specifically, the target object image, the corresponding target object semantic text and the target object semantic translation text can be taken as a whole entry, an association relationship can be established between them, and they can be stored in a specific location or data structure of the target language dictionary.

[0045] When the user subsequently uses the dictionary pen for querying or learning, they can quickly find other associated information (such as the corresponding image, text in another language, etc.) through any one of the information, such as the semantic text of the target object or the semantic translation text of the target object, thereby enriching the content display and learning experience of the dictionary pen and helping the user to more comprehensively understand and remember vocabulary.

[0046] For example, the user uses a dictionary pen with a camera function to take a picture of a "banana". The dictionary pen recognizes the semantic text of the target object as "banana" and translates it into the target language English as "banana". The dictionary pen will associate the image of this banana, the Chinese semantic text "banana", and the English translation text "banana" and store them as an entry in the English dictionary library.

[0047] When the user scans or enters the word "banana" during subsequent learning, the dictionary pen can not only display the translation "banana", but also simultaneously show the previously taken picture of the banana, helping the user to more intuitively understand the physical object represented by this vocabulary; conversely, if the user searches for "banana" in the dictionary library, they can also see the corresponding Chinese "banana" and the picture of the banana. This associated storage method makes the content of the dictionary library of the dictionary pen richer and more three-dimensional, providing more vivid and interesting learning materials for young children and facilitating their better learning and memory of language vocabulary.

[0048] In the present invention, by responding to the target object image input by the user, using image recognition technology to accurately identify the semantic text of the target object in the image, establishing an association between the physical object and the vocabulary, providing a more intuitive learning method for children, and translating the semantic text of the target object into the translation text of the target language and presenting it to children in an intuitive manner, enabling them to learn two languages simultaneously, deepening their memory and understanding of vocabulary, avoiding the dullness of traditional pure text learning, and improving the learning effect. Through associated storage, the taken physical object pictures will be directly mapped and stored in the device's preset dictionary, thereby enriching the display content of the dictionary. And because the pictures of the target object are taken and collected by the user themselves, when the user conducts associative learning again through the physical object pictures, it is a specific heuristic memory for the user, which is conducive to helping the user remember words and improving the user's learning quality. On the other hand, the user can actively take pictures to continuously learn new content, effectively improving the initiative of the user to learn.

[0049] Optionally, after the step of associatively storing the target object image, the target object semantic text, and the target object semantic translation text into the dictionary library of the target language, the method further includes: When the target object semantic text is obtained, translating the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0050] In this invention, while using the dictionary pen, users may search for the same target semantic text again at different times and in different scenarios. When the dictionary pen detects this semantic text, it translates it again using the target language dictionary. This ensures that users can obtain the translation result again, strengthening their vocabulary memory.

[0051] Suppose a user has previously associated an image of "banana," the Chinese semantic text "banana," and the English translation "banana" in an English dictionary. Some time later, when the user enters the word "banana" again while doing homework, the dictionary pen will again translate "banana" into "banana" based on the English dictionary.

[0052] In the Dictionary Pen, when a user searches for a target object's semantic text or its translation, the Dictionary Pen can leverage the associated information in the target language's dictionary to reverse-search previously stored images of the target object. This provides a more comprehensive learning experience, allowing users to visually see the physical images associated with the vocabulary during the learning process, deepening their understanding and memory of the vocabulary's semantics.

[0053] Continuing with the example of "banana," when a user enters the English word "banana" into the Dictionary Pen, the Pen will search and retrieve previously stored images of bananas based on the associated information in the English dictionary. This allows the user to see the image of a banana again, intuitively understanding the physical object represented by the word "banana," leading to better learning and memorization.

[0054] In this invention, the target object semantic text is translated back into the target object semantic translation text corresponding to the target language, and the associated target object image is simultaneously obtained, providing learners with richer learning materials. This combination of text and image meets the needs of different learning styles, making the learning process more vivid and interesting, and helping to deepen vocabulary understanding and memory. Moreover, since the images in the dictionary library are created by users themselves, it not only enriches the dictionary content but also facilitates physical association memory of users' own photos, which helps improve learning quality.

[0055] Optionally, after the step of associatively storing the target object image, the target object semantic text, and the target object semantic translation text into the dictionary library of the target language, the method further includes: When the target object semantic translation text is obtained, according to the dictionary library of the target language, translate the target object semantic translation text into the target object semantic text; According to the dictionary library of the target language, obtain the target object image associated with the target object semantic text and the target object semantic translation text.

[0056] In the present invention, when the user obtains the target object semantic translation text, the dictionary pen will use the dictionary library of the target language to reverse translate the translation text into the target object semantic text. This realizes the translation conversion from the target language to the source language, enabling the user to reconfirm the accuracy of the translation, or quickly understand the corresponding source language expression when only knowing the target language vocabulary.

[0057] Suppose the user previously took a picture of an "apple". The dictionary pen recognized the target object semantic text as "apple" and translated it into the target language English as "apple". Later, when the user encountered the word "apple" in English learning and entered it into the dictionary pen. The dictionary pen will reverse translate "apple" into the target object semantic text "apple" according to the dictionary library of the target language (English).

[0058] At the same time, the dictionary pen will, according to the association relationship established in advance in the dictionary library of the target language, search for the target object image associated with both the target object semantic text and the target object semantic translation text.

[0059] The dictionary pen simultaneously displays the target object image, the target object semantic text, and the target object semantic translation text on the screen, so that the user can view this information simultaneously and obtain a more comprehensive learning experience.

[0060] This simultaneous display method improves the learning efficiency and effect. The user can obtain all relevant information on one interface without switching between different interfaces. This intuitive display method is especially suitable for young children and helps to stimulate their learning interest and improve the memory effect.

[0061] Continuing with the above example of "apple", after the user inputs the target object semantic translation text "apple", the dictionary pen obtains the previously taken apple image of the user according to the associated storage information in the dictionary library of the target language. In this way, the user can see the apple picture he took again, intuitively understand the real object represented by the word "apple", and at the same time can better remember the word "apple".

[0062] In this invention, by back-translating and acquiring associated images, learners can gain a deeper understanding and memorize the meaning and usage of vocabulary, as well as the images of related objects. This multi-dimensional learning approach helps consolidate knowledge, deepen memory, and enable learners to express and communicate more accurately using vocabulary.

[0063] Optionally, the operation of the user inputting the target object image includes: The user clicks the shooting icon to shoot the target object; Or, the user imports the target object image.

[0064] In the present invention, the shooting mark refers to a mark used to trigger the shooting function of the dictionary pen, which is usually expressed as a physical button or a virtual button on the touch screen.

[0065] A physical button can be set on the side or front of the dictionary pen, and the user can start the shooting function by pressing this button. A touch screen virtual button is to display a shooting icon on the touch screen of the dictionary pen, and the user can start the shooting function by clicking the icon.

[0066] The target object refers to the physical object or image content that the user wants to query or learn. It can be any specific object, person, animal, plant, scene, etc., or even a visual representation of an abstract concept.

[0067] In children's learning scenarios, target objects can be learning supplies such as tables, chairs, blackboards, books, pencils, etc. in the classroom; they can also be natural objects such as trees, flowers, birds, etc. outside the classroom; they can also be illustrations in children's books, such as cartoon animals, fairy tale scenes, etc.

[0068] More specifically, the user taps the capture icon with their finger, triggering the dictionary pen's capture function. Physical buttons typically have an appropriate key travel and feedback force, allowing the user to feel a noticeable tactile feedback when pressed. Touchscreen virtual buttons are designed with an appropriate icon size and position, and provide visual feedback when the user taps, such as a flashing icon, color change, or a beep, to indicate that the user's action has been recognized.

[0069] When the target object is accurately located and in the appropriate position, the user clicks the shooting button again to complete the shooting action. After receiving the shooting command, the dictionary pen will capture the current picture through the camera, record the image data of the target object, and store it in the dictionary pen's memory or memory card.

[0070] Optionally, in the present application, the target object image file already existing on other devices or storage media can be transferred to a dictionary pen with a camera function for subsequent semantic recognition and translation processing.

[0071] For example, if a user connects a dictionary pen with a camera function to a computer, mobile phone, or other storage device via a USB data cable, ensure a stable connection between the devices.

[0072] Launch the file management software or file transfer software on the Dictionary Pen to ensure that the files in the external storage device can be recognized and accessed.

[0073] On an external storage device (such as a computer or mobile phone), open the file manager and locate the folder or directory where the target object image is stored. Transfer the target object image file from the external storage device to the Dictionary Pen's memory card or internal memory by dragging and dropping, copying and pasting, or using other file transfer methods. The Dictionary Pen's file management software displays the transfer progress to ensure the file transfer is complete.

[0074] For another example, make sure the Dictionary Pen and external device (such as a phone, tablet, or computer) are on the same local area network. This is usually done via Wi-Fi or Bluetooth. Configure file sharing on the external device to ensure the Dictionary Pen can access and receive files.

[0075] Open the file manager on the external device and locate the target object image file. Use file sharing functions such as Bluetooth sharing or Wi-Fi file transfer to send the target object image file to the Dictionary Pen. The Dictionary Pen will prompt the user to receive the file, and the file transfer is completed after the user confirms.

[0076] For another example, the user prepares a memory card containing an image of the target object, ensuring that the card format is compatible with the Dictionary Pen. The user inserts the memory card into the Dictionary Pen's memory card slot, ensuring it is secure and in good contact. The Dictionary Pen automatically recognizes the card, and the user browses the files on the card using the Dictionary Pen's file management software. The user finds the target object image file on the card, selects it, and confirms the import process to the Dictionary Pen's memory.

[0077] In the present invention, the target object image can be effectively and successfully imported into the dictionary pen through the operation of the user inputting the target object image.

[0078] Optionally, identifying the target object semantic text of the target object image includes: The target object image is input into a physical object recognition model, and a target object semantic text of the target object in the target object image is output.

[0079] In the present invention, the object recognition model refers to an artificial intelligence model that can input and output a semantic text description of the target object in the image based on the input image.

[0080] Object recognition models are often built based on the convolutional neural network architecture in deep learning and are trained with large amounts of labeled data to learn the mapping relationship between image features and semantic concepts.

[0081] The training process of the object recognition model specifically includes: Collect a large amount of image data covering a variety of common target objects, such as fruits, vegetables, animals, furniture, etc., and annotate each image with the semantic text of the target object (such as "apple", "dog", etc.). This annotated data will serve as a supervisory signal for model learning.

[0082] The annotated image data is input into the neural network. The network extracts the features of the image through operations such as convolutional layers and pooling layers, and then maps the extracted features to the category space of semantic text through the fully connected layer.

[0083] By calculating the loss function (such as cross entropy loss) between the predicted results and the true labels, the back propagation algorithm is used to continuously adjust the weight parameters of the network so that the predicted results of the model gradually approach the true labels.

[0084] During the training process, the model is evaluated and optimized through methods such as cross-validation, and the model's hyperparameters (such as learning rate, regularization parameters, etc.) are adjusted to improve the model's accuracy and generalization ability.

[0085] In some optional embodiments and real-world scenarios, an image may contain multiple target objects. The object recognition model can identify multiple target objects in an image by designing an output layer for multi-label classification. Each neuron in the output layer corresponds to a semantic category, and the model outputs a probability value for each category, indicating the likelihood that the target object exists in the image. By setting an appropriate threshold, the semantic context of the target objects contained in the image can be determined.

[0086] In an optional embodiment, to meet the requirements of real-time recognition, the object recognition model can adopt a lightweight model architecture, such as MobileNet. While maintaining a certain recognition accuracy, the model's parameter count and computational complexity are reduced, enabling it to run quickly on the dictionary pen and achieve real-time recognition of target object images.

[0087] In devices like the dictionary pen, hardware acceleration technologies (such as GPU acceleration) can be used to further improve the model's inference speed. GPUs can process a large number of matrix operations in parallel, significantly reducing the model's image recognition time, thereby achieving rapid object recognition and semantic text output.

[0088] In the present invention, the physical object recognition model receives the target object image input by the user, accurately identifies the target object in the image by extracting and analyzing the image features, and outputs the corresponding target object semantic text, providing a basis for subsequent operations such as translation and associated storage.

[0089] Optionally, the method further includes: Get the target text entered by the user; Translating the target text into a target translation text corresponding to the target language based on a dictionary library of the target language; If there is no image information associated with the target text or the target translated text in the target language dictionary, a target image is matched in a preset image library based on the target text or the target translated text.

[0090] In the present invention, the user can obtain the target text through the scanning function of the dictionary pen, and can also input the target text through the text input function of the dictionary pen.

[0091] Specifically, the user activates the text scanning function through a scan button (a physical button or a virtual button on the touch screen) on the dictionary pen.

[0092] The user points the camera or scanning element of the dictionary pen at the text content to be scanned, ensuring that the text is within the scanning range and that the dictionary pen maintains an appropriate angle and distance from the text surface.

[0093] The user moves the Dictionary Pen along a line of text, and the Pen uses built-in optical character recognition technology to recognize the text content in real time. During the scanning process, the Pen may provide visual or audio feedback to prompt the user whether the scan is successful or whether the scanning angle and speed need to be adjusted.

[0094] After scanning is complete, the dictionary pen will display the scanned and recognized text content on the screen, allowing users to review and confirm whether the scan result is accurate. If the recognition result is incorrect or incomplete, users can rescan or manually edit and correct it.

[0095] In the present invention, the target language dictionary is a database that stores a large number of words and their translations, which includes translation mappings from the source language to the target language. The words in the dictionary can be words, phrases, fixed expressions, etc.

[0096] The dictionary pen receives a target text input by the user, which can be input through a touch screen keyboard, a physical keyboard, or obtained through a text scanning function. It searches the dictionary library for words or phrases that match the target text and obtains the corresponding translation results.

[0097] In an optional embodiment, the dictionary pen displays the translated target translation text on the screen, and the user can view the translation result. Some dictionary pens also provide a pronunciation function, and the user can click on the translation result to listen to the standard pronunciation to help learn the correct pronunciation and intonation.

[0098] In the present invention, when there is no image information associated with the target text or the target translation text in the dictionary library of the target language, it indicates that the dictionary library itself does not have image resources directly associated with the target text or the target translation text. In this case, the dictionary pen needs to provide more intuitive learning auxiliary images for the user through other means.

[0099] The dictionary pen may be connected to a preset image library, which contains a large number of image resources. The dictionary pen can search for images related to the target text or the target translation text in the preset image library through a text matching algorithm. If the dictionary pen has an Internet connection function, it can search for images related to the target text or the target translation text through an online image search engine.

[0100] The user can pre-import some images into the dictionary pen to establish their own image library. When there is no relevant image in the dictionary library, the dictionary pen can search for matching images from the user-defined image library. The dictionary pen can prompt the user to take relevant images through its camera function or import images from other devices to enrich learning resources.

[0101] For example, assume that the user enters the Chinese text "苹果" (apple) and wishes to translate it into English. Based on the dictionary library of the target language, the target text is translated into the corresponding target translation text in the target language, and the dictionary pen translates "苹果" into the English word "apple".

[0102] The dictionary pen detects that there is no image associated with "苹果" (apple) or "apple" in the dictionary library. Preprocess "苹果" and "apple" to extract core semantic information; extract the keywords "苹果" and "apple"; search for images related to "苹果" and "apple" in the preset image library; calculate the similarity between the searched images and "苹果" and "apple"; sort according to the similarity and select the most relevant image. Finally, the dictionary pen displays the matching apple image on the screen.

[0103] In the present invention, the dictionary pen can provide more intuitive learning aids for the user through the preset image library when there is no directly associated image in the dictionary library of the target language, helping them better understand and learn vocabulary.

[0104] The translation device provided by the present invention will be described below. The translation device described below can be mutually referred to in correspondence with the translation method described above.

[0105] Figure 2 A schematic diagram of the translation device structure provided by the present invention is shown in FIG. Figure 2 As shown, including: The recognition model 210 is configured to recognize a target object semantic text of the target object image in response to a user inputting a target object image; The translation module 220 is used to translate the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; The associating module 230 is configured to associate and store the target object image, the target object semantic text, and the target object semantic translation text in a dictionary of the target language.

[0106] According to a translation device provided by the present invention, the device is further used for: When the target object semantic text is obtained, translating the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0107] According to a translation device provided by the present invention, the device is further used for: When the target object semantic translation text is obtained, translating the target object semantic translation text into the target object semantic text according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

[0108] According to a translation device provided by the present invention, the device is further used for: The user clicks the shooting icon to shoot the target object; Or, the user imports the target object image.

[0109] According to a translation device provided by the present invention, the device is further used for: The target object image is input into a physical object recognition model, and a target object semantic text of the target object in the target object image is output.

[0110] According to a translation device provided by the present invention, the device is further used for: Get the target text entered by the user; Translating the target text into a target translation text corresponding to the target language based on a dictionary library of the target language; If there is no image information associated with the target text or the target translated text in the target language dictionary, a target image is matched in a preset image library based on the target text or the target translated text.

[0111] The embodiment of the present invention responds to the target object image input by the user and uses image recognition technology to accurately identify the semantic text of the target object in the image, establishes an association between the physical object and the vocabulary, provides a more intuitive learning method for children, and translates the semantic text of the target object into a translation text in the target language, which is presented to the children in an intuitive manner, enabling them to learn two languages ​​at the same time, deepen their memory and understanding of vocabulary, avoid the boredom of traditional pure text learning, and improve learning effects. Through associative storage, the captured physical object pictures are directly mapped and stored in the device's preset dictionary, thereby enriching the dictionary's display content. Moreover, since the pictures of the target object are taken and collected by the user themselves, when the user uses the physical object pictures to conduct associative learning again, it is a special inspiration for the user's memory, which is conducive to helping the user remember words and improving the user's learning quality. On the other hand, the user can continuously learn new content by actively taking pictures, effectively improving the user's initiative in learning.

[0112] Figure 3 The present invention provides a dictionary pen structure diagram, such as Figure 3 As shown, it includes a dictionary pen body 31, a processor 32 disposed inside the dictionary pen body 31, and a display screen 33 disposed on the surface of the dictionary pen body 31; The processor 32 is configured to recognize a target object semantic text of the target object image in response to a user inputting a target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; Associating and storing the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language; The display screen 33 is used to display the target object image, the target object semantic text, and the target object semantic translation text.

[0113] The dictionary pen provided by the present invention responds to the target object image input by the user and uses image recognition technology to accurately identify the semantic text of the target object in the image, establishes an association between the physical object and the vocabulary, provides a more intuitive learning method for children, and translates the semantic text of the target object into a translation text in the target language, presenting it to the children in an intuitive manner, enabling them to learn two languages ​​at the same time, deepen their memory and understanding of vocabulary, avoid the boredom of traditional pure text learning, and improve learning effects. Through associative storage, the captured physical image will be directly mapped and stored in the device's preset dictionary, thereby enriching the dictionary's display content. Moreover, since the image of the target object is taken and collected by the user himself, when the user uses the physical image to conduct associative learning again, it is a specific inspiration for the user's memory, which is conducive to helping the user remember words and improving the user's learning quality. On the other hand, the user can continuously learn new content by actively taking pictures, effectively improving the user's initiative in learning.

[0114] Figure 4 Schematic diagram of the structure of the electronic device provided by the present invention, such as Figure 4 As shown, the electronic device may include: a processor 410, a communications interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communications interface 420, and the memory 430 communicate with each other via the communication bus 440. The processor 410 may call logic instructions in the memory 430 to execute a translation method, which includes: in response to a user input operation of a target object image, identifying a target object semantic text of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The target object image, the target object semantic text, and the target object semantic translation text are associated and stored in a dictionary library of the target language.

[0115] Furthermore, the logic instructions in the aforementioned memory 430 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product, stored in a storage medium, includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0116] On the other hand, the present invention further provides a computer program product, the computer program product including a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can perform the translation method provided by the above methods, the method including: in response to a user inputting an operation of a target object image, identifying a target object semantic text of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The target object image, the target object semantic text, and the target object semantic translation text are associated and stored in a dictionary library of the target language.

[0117] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the computer program is implemented to perform the translation method provided by the above methods, the method comprising: in response to a user inputting an operation of a target object image, identifying a target object semantic text of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The target object image, the target object semantic text, and the target object semantic translation text are associated and stored in a dictionary library of the target language.

[0118] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0119] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or of course, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for causing a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or certain portions of the embodiments.

[0120] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A translation method, characterized in that: include: In response to a user inputting a target object image, identifying a target object semantic text of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The target object image, the target object semantic text, and the target object semantic translation text are associated and stored in a dictionary library of the target language.

2. The translation method according to claim 1, wherein: After the step of associating and storing the target object image, the target object semantic text, and the target object semantic translation text in the target language dictionary, the method further includes: When the target object semantic text is obtained, translating the target object semantic text into a target object semantic translation text corresponding to the target language according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

3. The translation method according to claim 1, wherein: After the step of associating and storing the target object image, the target object semantic text, and the target object semantic translation text in the target language dictionary, the method further includes: When the target object semantic translation text is obtained, translating the target object semantic translation text into the target object semantic text according to the dictionary library of the target language; According to the dictionary library of the target language, a target object image associated with the target object semantic text and the target object semantic translation text is acquired.

4. The translation method according to claim 1, wherein: The operation of the user inputting the target object image includes: The user clicks the shooting icon to shoot the target object; Or, the user imports the target object image.

5. The translation method according to claim 1, wherein: The identifying the target object semantic text of the target object image includes: The target object image is input into a physical object recognition model, and a target object semantic text of the target object in the target object image is output.

6. The translation method according to claim 1, wherein: The method further comprises: Get the target text entered by the user; Translating the target text into a target translation text corresponding to the target language based on a dictionary library of the target language; If there is no image information associated with the target text or the target translated text in the target language dictionary, a target image is matched in a preset image library based on the target text or the target translated text.

7. A translation device, characterized in that: include: a recognition model for recognizing a target object semantic text of the target object image in response to a user inputting an operation of the target object image; A translation module, configured to translate the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; The associating module is used to associate and store the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language.

8. A dictionary pen, characterized in that: The invention comprises a dictionary pen body, a processor arranged inside the dictionary pen body, and a display screen arranged on the surface of the dictionary pen body; The processor is configured to recognize a target object semantic text of the target object image in response to a user inputting an operation of the target object image; Translating the target object semantic text into a target object semantic translation text corresponding to the target language according to a dictionary library of the target language; Associating and storing the target object image, the target object semantic text, and the target object semantic translation text in a dictionary library of the target language; The display screen is used to display the target object image, the target object semantic text, and the target object semantic translation text.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the translation method according to any one of claims 1 to 6 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the translation method according to any one of claims 1 to 6 is implemented.

11. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the translation method according to any one of claims 1 to 6 is implemented.

Images