Object recognition method, device and terminal

Abstract

The present invention discloses an object recognition method, device and terminal, the method comprising: obtaining a target image including a target object and the type of the target object, uploading the target image to a target image recognition unit based on the type of the target object, so that the target image recognition unit matches the target image with an image contained in a preset target image information library, and obtains the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, the object contained in the reference image and the target object are of the same type, if the name and description information of the target object fed back by the image recognition unit is received, determining a first display template according to the type of the target object, and displaying the name and description information of the target object according to the first display template.

Description

Technical Field

[0001] The present invention relates to the field of electronic information technology, and in particular to an object recognition method, device and terminal. Background Art

[0002] In daily life, when people see something they don't recognize, they always become curious about it. However, in many cases, it is impossible to use text to search for relevant results from the known information about it. Therefore, there is an urgent need for a method that can help people understand unknown things. Summary of the invention

[0003] The embodiments of the present application provide an object recognition method, device and terminal, which can effectively recognize and display the name and description information of the target object, thereby facilitating users to recognize unknown objects.

[0004] In a first aspect, the present invention provides the following technical solution through an embodiment of the present invention:

[0005] An object recognition method, applied to a user terminal, comprising:

[0006] Acquire a target image including a target object and a type of the target object;

[0007] Based on the type of the target object, the target image is uploaded to the target image recognition unit, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, and the object contained in the reference image and the target object are of the same type;

[0008] If the name and description information of the target object fed back by the image recognition unit is received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

[0009] Preferably, the acquiring includes a target image of the target object and the type of the target object, including: acquiring the type of the target object selected by the user; and acquiring the target image in response to an image acquisition instruction triggered by the user.

[0010] Preferably, uploading the target image to a target image recognition unit based on the type of the target object comprises:

[0011] According to the preset corresponding relationship, the target interface corresponding to the type of the target object is determined, and the target image is uploaded to the target image recognition unit through the target interface, wherein the preset corresponding relationship is the corresponding relationship between the object type and the interface, and different interfaces correspond to different image recognition units.

[0012] Preferably, determining the first display template according to the type of the target object includes:

[0013] Based on the type of the target object, a display template is determined from a preset display template library, wherein the display template library contains display templates of various forms, and one form of display template corresponds to one type of the target object.

[0014] Preferably, the display template library includes a broadcast template, the broadcast template includes a text template and a voice template, the description information of the target object includes a first description content and a second description content, and the displaying of the name and description information of the target object according to the first display template includes:

[0015] If the first display template is a template with announcement, the name of the target object and the first description content are displayed in text according to the text template, and the preset voice announcement button is displayed according to the voice template; if the user triggers the voice announcement button, the second description content of the target object is voice announced.

[0016] Preferably, uploading the target image to a target image recognition unit comprises:

[0017] Check whether the pre-stored token information is expired, and if so, re-acquire the token information;

[0018] The token information and the target image are uploaded to the target image recognition unit together, so that the target image recognition unit verifies the identity of the user terminal through the token information, and recognizes the target image after the verification is passed.

[0019] Preferably, the uploading of the target image to the target image recognition unit further comprises: encrypting the target image and uploading the encrypted image to the target recognition unit.

[0020] Preferably, the method further comprises: if indication information fed back after the target image recognition unit fails to match is received, displaying the indication information according to a preset second display template.

[0021] In a second aspect, the present invention provides the following technical solution through an embodiment of the present invention:

[0022] An object recognition device, applied to a user terminal, comprising:

[0023] An image acquisition module, used to acquire a target image including a target object and a type of the target object;

[0024] An image sending module is used to upload the target image to the target image recognition unit, so that the target image recognition unit matches the target image with the images contained in the preset target image information library to obtain the name and description information of the target object;

[0025] The data display module is used to display the feedback data. If the name and description information of the target object fed back by the image recognition unit are received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

[0026] Preferably, the image acquisition module is specifically used to: acquire the type of the target object selected by the user; and acquire the target image in response to an image acquisition instruction triggered by the user.

[0027] Preferably, the image sending module is specifically used to: determine the target interface corresponding to the type of the target object according to a preset corresponding relationship, and upload the target image to the target image recognition unit through the target interface.

[0028] Preferably, the data display module is specifically used to: determine a first display template from a preset display template library based on the type of the target object, wherein the display template library contains display templates of various forms, and one form of display template corresponds to one type of target object.

[0029] In a third aspect, the present invention provides the following technical solution through an embodiment of the present invention:

[0030] A terminal includes a processor and a memory, wherein the memory is coupled to the processor and stores instructions, and when the instructions are executed by the processor, the terminal performs the following operations:

[0031] A target image including a target object and the type of the target object are obtained; based on the type of the target object, the target image is uploaded to a target image recognition unit so that the target image recognition unit matches the target image with an image contained in a preset target image information library to obtain the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, and the object contained in the reference image and the target object are of the same type; if the name and description information of the target object fed back by the image recognition unit is received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

[0032] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0033] An object recognition method provided by an embodiment of the present invention first obtains a target image including a target object and the type of the target object through a user terminal, and then, based on the type of the target object, uploads the target image to a target image recognition unit, so that the target image recognition unit matches the target image with an image contained in a preset target image information library to obtain the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, and the object contained in the reference image belongs to the same type as the target object; then, if the user terminal receives the name and description information of the target object fed back by the image recognition unit, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template. In this way, the user can effectively identify and display the name and description information of the target object through the user terminal, which greatly facilitates the user to recognize unknown things and improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0035] Figure 1 A flowchart of an object recognition method provided by an embodiment of the present invention;

[0036] Figure 2 A display interface diagram corresponding to a display template in a form provided by an embodiment of the present invention;

[0037] Figure 3 A specific plant template display interface diagram provided by an embodiment of the present invention;

[0038] Figure 4 A display interface diagram corresponding to another form of display template provided by an embodiment of the present invention;

[0039] Figure 5 A schematic diagram of the structure of an object recognition device provided by an embodiment of the present invention;

[0040] Figure 6 A schematic diagram of the structure of a user terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] The embodiment of the present application provides a method and device based on image scanning and query, which can effectively identify and display the name and description information of the target object, facilitate users to recognize unknown things, and improve user experience. The technical solution of the embodiment of the present application is to solve the above technical problems, and the overall idea is as follows:

[0042] An object recognition method, applied to a user terminal, comprises: obtaining a target image including a target object and the type of the target object; uploading the target image to a target image recognition unit based on the type of the target object, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of objects in each reference image, and the objects contained in the reference images and the target object belong to the same type; if the name and description information of the target object fed back by the image recognition unit is received, determining a first display template according to the type of the target object, and displaying the name and description information of the target object according to the first display template.

[0043] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0044] Embodiment 1

[0045] An object recognition method provided in an embodiment of the present invention is applied to a user terminal, which may be a mobile terminal with an image scanning function, such as a smart phone, a tablet computer, a wearable device, etc. This embodiment does not specifically limit what type of terminal the user terminal is.

[0046] Specifically, if Figure 1 As shown, the object recognition method may include the following steps S101 to S104.

[0047] Step S101: Acquire a target image including a target object and the type of the target object.

[0048] Among them, the target object is the object that the user needs to know, and the type of the target object is the type to which the target object belongs. For example, if the target object is a certain plant, the type is plant. If the target object is a certain landscape, the type is landscape. Of course, the landscape described in this embodiment is a named landscape.

[0049] As an implementation manner, the process of acquiring the target image including the target object and the type of the target object may include: acquiring the type of the target object selected by the user; and acquiring the target image in response to an image acquisition instruction triggered by the user.

[0050] As another implementation, the above process of acquiring the target image including the target object and the type of the target object may also include: the user captures the target image by triggering an image capture instruction; and then selecting the type of the target object in the captured target image.

[0051] In the specific implementation process, the terminal may provide a variety of object types to choose from. When the user wants to obtain an image of a target object, the user may first select the type of the target object. Specifically, the user may switch arbitrarily between the various object types provided by the terminal through simple operations according to actual object recognition needs to determine the type of the target object. For example, if the target object to be recognized by the user is a certain plant, the type of the target object selected may be "plant", and if the target object to be recognized by the user is a certain landscape, the type of the target object selected may be "landscape".

[0052] Specifically, you can slide and switch the selection in the text part showing the type, or select it by checking. It can be understood that the above is just a specific example of the trigger operation for selecting the object type. The specific implementation of the present invention is not limited to this.

[0053] After selecting the object type, the image of the target object can be scanned in a video scanning manner, and then the preset image acquisition instruction can be triggered to achieve the acquisition of the target image. The method of triggering the image acquisition instruction can be a method in which the user clicks a shooting button displayed on the terminal touch screen, or a method of voice control, or a method of triggering the acquisition instruction through a predefined gesture. The specific triggering method is not specifically limited in this embodiment.

[0054] Step S102 : uploading the target image to the target image recognition unit based on the type of the target object, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object.

[0055] The target image information library stores multiple reference images and the name and description information of the object in each reference image. It is understandable that the object contained in the reference image belongs to the same type as the target object. For example, if the target object belongs to the plant type, the corresponding target image information library stores reference images of various plants.

[0056] In this embodiment, the image recognition unit is located on the server side, and the server side is provided with a plurality of image recognition units, and different image recognition units can access different image information libraries for identifying different types of objects. The plurality of image recognition units can be integrated into the same server, or can be respectively provided on different servers. The above-mentioned target image recognition unit is an image recognition unit corresponding to the target object type, and the target image information library is an image information library corresponding to the target object type.

[0057] Of course, in other embodiments of the present invention, the server side may also only set up one image recognition unit. In this case, in order to be able to recognize multiple different types of objects, the image recognition unit needs to set up multiple image information libraries accordingly, and different image information libraries store different types of reference images.

[0058] It should be noted that the image information library is pre-set, and different image information libraries are used to store different types of reference images and the names and descriptions of objects contained in the reference images. In the specific implementation process, the user can manually add a new reference image and related descriptions of the reference image to the image information library.

[0059] In an optional embodiment, the user terminal may first encrypt the target image to be uploaded, generate an encrypted image, and then upload the encrypted image to the target image recognition unit. The encryption method may be base64 encoding encryption, asymmetric encryption, or symmetric encryption. Taking base64 encoding encryption as an example, base64 encoding is unreadable and needs to be decoded before it can be read, thereby ensuring the security of the image. Accordingly, after the target image recognition unit receives the encrypted image sent by the terminal, it first decrypts the encrypted image using a preset corresponding decryption method to obtain the decrypted image, and then recognizes it. Of course, in other embodiments of the present invention, it is also possible not to encrypt the target image to be uploaded, which is not limited here.

[0060] In an optional embodiment, the above process of uploading the target image to the target image recognition unit may include: detecting whether the pre-stored token information is expired, and if so, re-acquiring the token information; uploading the token information together with the target image to the target image recognition unit, so that the target image recognition unit verifies the identity of the user terminal through the token information, and after the verification is passed, recognizes the target image.

[0061] In this embodiment, the token information is generated by the server. When the user terminal uses the username / password to request authentication from the server, and the server successfully authenticates, the server will return the token information to the user terminal. The user terminal can bring the token information to prove its legal status every time it initiates an image recognition request. For example, the token information can be a token or other token information.

[0062] In order to ensure security, the server usually sets an expiration date for the token information issued, and if the expiration date is exceeded, it needs to be re-acquired. In this embodiment, the process of detecting whether the pre-stored token information is expired may include: comparing the current time with the set expiration date, if the current time has exceeded the set expiration date, it is determined that the token information has expired, and it is necessary to re-acquire the token information by accessing the server, if it has not exceeded the set expiration date, it is determined that the token information is valid and can continue to be used.

[0063] In an optional embodiment, the process of uploading the target image to the target image recognition unit based on the type of the target object may include: determining the target interface corresponding to the type of the target object according to a preset correspondence, and uploading the target image to the target image recognition unit through the target interface, wherein the preset correspondence is the correspondence between the object type and the interface, and different interfaces correspond to different image recognition units. For example, the target image upload process may use upload technologies such as okhttpUtil, XUtils or Volley.

[0064] For example, in one application scenario, the types of identifiable objects include plant types and landscape types, wherein the plant type corresponds to interface 1, the landscape type corresponds to interface 2, interface 1 corresponds to a plant identification unit, and interface 2 corresponds to a landscape identification unit. The following uses two usage scenarios as examples to illustrate the process of uploading a target image.

[0065] The first one is that when the target object is a certain plant, the above interface 1 is determined as the target interface, and the target image is uploaded to the plant identification unit through the interface 1. Among them, the plant identification unit can access the plant image information library to identify the plant in the target image. The plant image information library stores reference images of various plants and the name and description information of the plant in each reference image. For example, the plant image information library stores reference images of daffodils and the name and description information of daffodils. For example, the plant name can include aliases, other names and local names, etc., and the description information can include plant attributes, growth environment, main production areas, medicinal value, etc.

[0066] The second method is that when the target object is a certain landscape, the above interface 2 is determined as the target interface, and the target image is uploaded to the landscape recognition unit through the interface 2. The landscape recognition unit can access the landscape image information library to recognize the landscape in the target image. The landscape image information library stores a lot of reference images of landscapes and the name and description information of the landscape in each reference image. For example, the landscape image information library stores the reference image of Huangshan Mountain and the name and description information of Huangshan Mountain. For example, the landscape name can include an alias, another name, and a place name, etc. The description information can include historical background, ticket information, geographical location, and scenic spot structure, etc.

[0067] After receiving the target image, the target image recognition unit realizes recognition of the target image by matching the target image with the images contained in the preset target image information library. Specifically, the recognition process may include: searching the target image information library for a reference image whose similarity with the target image meets the preset conditions; if so, it indicates that the match is successful, and the name and description information of the object in the reference image are used as the name and description information of the target object; if not, it indicates that the match fails, and the target image recognition unit feeds back prompt information to the terminal to indicate that the match fails.

[0068] Specifically, the image matching process may include: extracting feature points of the target image, comparing them with feature points of the reference image, and matching to obtain a reference image that meets preset conditions. It should be noted that if there are multiple reference images whose similarity meets the preset conditions, the reference image with the highest similarity is used as the target reference image, and the name and description information of the object in the target reference image is used as the name and description information of the target object.

[0069] After the target image recognition unit obtains the recognition result of the target image, it will feed back the recognition result to the user terminal. It is understandable that if the target image is successfully matched, the recognition result may at least include the name and description information of the target object, and if the target image is not matched, the recognition result may include a prompt message of the matching failure.

[0070] Step S103: if the name and description information of the target object fed back by the image recognition unit are received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

[0071] In this embodiment, the name and description information of the target object fed back by the image recognition unit can be received through interface+handler (processing program interface). Specifically, interface+handler is equivalent to a bridge connecting the network interface and the interface interface in this embodiment. After the user terminal receives the name and description information of the target object fed back by the image recognition unit, the user terminal adopts a design pattern that can separate data from display, such as: MVP (full name: Model-View-Presenter) model view demonstrator design pattern, MVC (full name: Model-View-Controller) model view controller design pattern, etc.

[0072] In this embodiment, a display template library is pre-set, and the display template library contains display templates of various forms. In this embodiment, the display template library can be stored in the user terminal. Of course, in other embodiments of the present invention, the display template library can also be stored on the server side. The display template is used to display the recognition result fed back by the image recognition unit. One form of display template corresponds to one or more types of target objects.

[0073] In this embodiment, the first display template is a display template corresponding to the type of the target object determined from the display template library. The name and description information of the target object fed back by the target image recognition unit are displayed according to the first display template and displayed on the user terminal.

[0074] During the specific implementation, for each object type, the corresponding display template in the display template library can be set according to actual needs. Figure 2 An exemplary presentation template is shown, such as Figure 2 As shown, the form can be that the upper left area 201 is used to display the target image, the lower left area 202 is used to display the matched target reference image, the upper right area 203 is used to display the name of the target object, and the lower right area 204 is used to display the description information of the target object. Figure 3 In the specific display, narcissus is used as an example. The upper left area 301 displays the target image containing narcissus acquired by the user, the lower left area 302 displays the matched target reference image, the upper right area 303 is used to display the name of narcissus, and the lower right area 304 is used to display the description information of narcissus.

[0075] Figure 4A template with announcement is shown. The announcement template includes a text template and a voice template. The text template is used to display part of the content in the recognition result in text. It should be noted that the text template can be displayed in a way suitable for people to read, for example: the text template can be a simple text description, or a text description containing a table or a block diagram, etc. The above template layout is not specifically limited. The voice template is used to voice announce part of the content in the recognition result. Figure 4 As shown, the display form of the announcement template can be that the upper left area 401 is used to display the target image, the lower left area 402 is used to display the matched target reference image, the upper right area 403 is used to display the name of the target object, and the lower right area 404 is used to display the first description content of the target object. Figure 2 different, Figure 4 A voice broadcast button 405 is added to broadcast the second description content of the target object.

[0076] In an application scenario, if the first display template determined in step S103 is a template with an announcement, and the description information of the target object includes a first description content and a second description content, then the above process of displaying the name and description information of the target object according to the first display template may include: displaying the name of the target object and the first description content in text according to the text template, and displaying a preset voice announcement button according to the voice template, and when a user triggering operation on the voice announcement button is detected, the second description content of the target object is voice announced.

[0077] The first description content and the second description content may be completely the same, or may have identical and different parts.

[0078] For example, taking landscape as an example, the display template corresponding to the landscape is the above-mentioned display template with announcement. If the target object is a certain landscape, the above-mentioned template with announcement is determined as the first display template. At this time, the name of the landscape is displayed in text with the first description content according to the text template, and the preset voice announcement button is displayed according to the voice template. For example, the first description content can describe the historical background, ticket information, geographical location and structure of the scenic area, etc. of the landscape. When the user triggers the voice announcement button, the second description content of the landscape is announced. For example, the second description content can be the entrance information, climate environment and scenic area explanation of the landscape, etc.

[0079] Specifically, the voice broadcast can be triggered by a key press, voice control, or a predefined gesture to trigger the playback, etc. The language of the voice broadcast can be a dialect of a region or a language of a country.

[0080] Step S104: if the indication information fed back after the target image recognition unit fails to match is received, the indication information is displayed according to a preset second display template.

[0081] In this embodiment, matching failure means that a reference image whose similarity with the target image meets preset conditions cannot be found in the reference images in the target image information library. At this time, the user terminal will receive an indication message fed back after the matching failure. The indication message is intended to prompt the terminal that the matching has failed. The indication message may be information such as no data result display or matching failure.

[0082] In this embodiment, the prompt information after the match fails will be displayed with a pre-set second display template. The second display template can be a simple text prompt that only displays a row. Specifically, the second display template can be a pop-up prompt information at the upper third of the user terminal screen. In the specific implementation process, when there is no image that matches the target image in the target image information library of the target image recognition unit, it means that the match fails. The terminal will receive the indication information fed back after the match fails. The indication information can be information such as no data result display or match failure. At this time, the terminal will display the indication information according to the second display template in the display template library. The second display template can be a display of a section of indication information at the upper end of the page, such as "I am sorry, there is no successfully matched image yet."

[0083] For example, taking plants as an example, if the user terminal obtains an image that is not in the image information library of the plant identification unit, the user uploads the image for identification. After that, the terminal will receive an indication of failed matching from the plant identification unit, and a message "Sorry, there is no successful matching image yet" will pop up at the top third of the terminal screen.

[0084] To sum up, through the object recognition method provided by the embodiment of the present invention, the user only needs to obtain the image of the target object through the user terminal to effectively identify and display the name and description information of the target object, which greatly facilitates the user to recognize unknown things and improves the user experience.

[0085] Embodiment 2

[0086] Based on the same inventive concept, this embodiment provides an object recognition device 500, which is applied to a user terminal, such as Figure 5 As shown, including:

[0087] An image acquisition module 501 is used to acquire a target image including a target object and a type of the target object;

[0088] An image sending module 502 is used to upload a target image to a target image recognition unit based on the type of the target object, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object;

[0089] The data display module 503 is used to display the feedback data. If the name and description information of the target object fed back by the image recognition unit are received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

[0090] As an optional embodiment, the image acquisition module 501 includes:

[0091] The type selection submodule is used to obtain the type of the target object selected by the user;

[0092] The image acquisition submodule is used to acquire a target image in response to an image acquisition instruction triggered by a user.

[0093] As an optional embodiment, the above-mentioned image sending module 502 is used to: determine the target interface corresponding to the type of the target object according to a preset corresponding relationship, and upload the target image to the target image recognition unit through the target interface, wherein the preset corresponding relationship is the corresponding relationship between the object type and the interface, and different interfaces correspond to different image recognition units.

[0094] As an optional embodiment, the image sending module 502 is used to encrypt the target image and upload the encrypted image to the target image recognition unit.

[0095] As an optional embodiment, the above-mentioned image sending module 502 includes: a token detection submodule, which detects whether the pre-stored token information is expired, and if so, re-acquires the token information; an upload submodule, which is used to upload the token information together with the target image to the target image recognition unit, so that the target image recognition unit verifies the identity of the user terminal through the token information, and after the verification is passed, the target image is recognized.

[0096] As an optional embodiment, the data display module 503 is used to:

[0097] Based on the type of the target object, a first display template is determined from a preset display template library, wherein the display template library includes display templates of various forms, and one form of display template corresponds to one type of the target object.

[0098] As an optional embodiment, the display template library includes a template with announcement, and the template with announcement includes a text template and a voice template, and the description information of the target object includes a first description content and a second description content. If the first display template is a template with announcement, the data display module 503 is used to: display the name of the target object and the first description content in text according to the text template, and display a preset voice announcement button according to the voice template; if the user triggers the voice announcement button, the second description content of the target object is announced in voice.

[0099] As an optional embodiment, the data display module 503 is further configured to: if indication information fed back after the target image recognition unit fails to match is received, display the indication information according to a preset second display template.

[0100] The above modules can be implemented by software codes, in which case, the above modules can be stored in the memory of the user terminal. The above modules can also be implemented by hardware such as integrated circuit chips.

[0101] The object recognition device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0102] Embodiment 3

[0103] Based on the same inventive concept, Figure 6 As shown, this embodiment provides a user terminal 800, including one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0104] The processing component 802 generally controls the overall operation of the terminal 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the object recognition method provided in the above-mentioned embodiment 1. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0105] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the terminal 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0106] Power component 806 provides power to various components of terminal 800. Power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal 800.

[0107] The multimedia component 808 includes a screen that provides an output interface between the terminal 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the terminal 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0108] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the terminal 800 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0109] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0110] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the terminal 800. For example, the sensor assembly 814 can detect the open / closed state of the terminal 800, the relative positioning of the components, such as the display and keypad of the terminal 800, and the sensor assembly 814 can also detect the position change of the terminal 800 or a component of the terminal 800, the presence or absence of contact between the user and the terminal 800, the orientation or acceleration / deceleration of the terminal 800 and the temperature change of the terminal 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0111] The communication component 816 is configured to facilitate the communication between the terminal 800 and other devices in a wired or wireless manner. The terminal 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0112] In an exemplary embodiment, terminal 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.

[0113] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0114] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A module that specifies functions in one or more boxes.

[0115] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction module, which is implemented in the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0116] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0117] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0118] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An object recognition method, characterized in that: Applied to a user terminal, the method comprises: Acquiring a target image including a target object and a type of the target object, wherein acquiring the target image including a target object and a type of the target object comprises: acquiring the type of the target object selected by a user; and acquiring the target image in response to an image acquisition instruction triggered by the user, wherein the target image is a plant or a landscape; Based on the type of the target object, uploading the target image to a target image recognition unit, so that the target image recognition unit matches the target image with images contained in a preset target image information library, and obtains the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, and the object contained in the reference image is of the same type as the target object; If the name and description information of the target object fed back by the image recognition unit is received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

2. The method according to claim 1, characterized in that The uploading the target image to a target image recognition unit based on the type of the target object comprises: According to the preset corresponding relationship, the target interface corresponding to the type of the target object is determined, and the target image is uploaded to the target image recognition unit through the target interface, wherein the preset corresponding relationship is the corresponding relationship between the object type and the interface, and different interfaces correspond to different image recognition units.

3. The method according to claim 1, characterized in that The determining of the first display template according to the type of the target object includes: Based on the type of the target object, the first display template is determined from a preset display template library, wherein the display template library includes display templates of multiple different forms, and one form of display template corresponds to one type of the target object.

4. The method according to claim 3, characterized in that The display template library includes a broadcast template, the broadcast template includes a text template and a voice template, the description information of the target object includes a first description content and a second description content, and the displaying of the name and description information of the target object according to the first display template includes: If the first display template is the template with announcement, the name of the target object and the first description content are displayed in text according to the text template, and a preset voice announcement button is displayed according to the voice template; if the user's trigger operation on the voice announcement button is detected, the second description content of the target object is voice announced.

5. The method according to claim 1, characterized in that The step of uploading the target image to the target image recognition unit comprises: Check whether the pre-stored token information is expired, and if so, re-acquire the token information; The token information and the target image are uploaded to the target image recognition unit together, so that the target image recognition unit verifies the identity of the user terminal through the token information, and recognizes the target image after the verification is passed.

6. The method according to claim 1, characterized in that The uploading of the target image to the target image recognition unit further includes: The target image is encrypted, and the encrypted image is uploaded to the target image recognition unit.

7. The method according to claim 1, characterized in that The method further comprises: If the indication information fed back by the target image recognition unit after the matching failure is received, the indication information is displayed according to the preset second display template.

8. An object recognition device, characterized in that: The device comprises: An image acquisition module is used to acquire a target image including a target object and the type of the target object, wherein the acquisition includes: acquiring the type of the target object selected by a user; and acquiring the target image in response to an image acquisition instruction triggered by the user, wherein the target image is a plant or a landscape; An image sending module, configured to upload the target image to the target image recognition unit based on the type of the target object, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object; The data display module is used to determine a first display template according to the type of the target object if the name and description information of the target object fed back by the image recognition unit is received, and to display the name and description information of the target object according to the first display template.

9. A terminal, characterized in that: The terminal comprises a processor and a memory, wherein the memory is coupled to the processor and stores instructions, and when the instructions are executed by the processor, the terminal performs the following operations: Acquiring a target image including a target object and a type of the target object, wherein acquiring the target image including a target object and a type of the target object comprises: acquiring the type of the target object selected by a user; acquiring the target image in response to an image acquisition instruction triggered by the user, wherein the target image is a plant or a landscape; Based on the type of the target object, uploading the target image to the target image recognition unit, so that the target image recognition unit matches the target image with images contained in a preset target image information library to obtain the name and description information of the target object, wherein the target image information library stores a plurality of reference images and the name and description information of the object in each reference image, and the object contained in the reference image is of the same type as the target object; If the name and description information of the target object fed back by the image recognition unit is received, a first display template is determined according to the type of the target object, and the name and description information of the target object are displayed according to the first display template.

Images