Picture element identification and 3D model conversion method and terminal

Abstract

The invention discloses a picture element recognition and 3D model conversion method and a terminal, and the method comprises the steps: determining the distance between a contact and a picture in a display interface in an interaction process through recognizing the coordinate information of the contact, and screening out the minimum distance as the basis of picture recognition. After the picture elements are determined, the 3D model corresponding to the picture information is loaded to the display interface from the database according to the label information, so that a user can quickly convert the target picture into the 3D model in a touch mode in the using process, deep interaction with the display interface is achieved, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent recognition, and in particular to a method and a terminal for image element recognition and 3D model conversion. Background Art

[0002] With the rapid development of computer vision, virtual reality (VR) and augmented reality (AR) technologies, image recognition and 3D modeling technologies have been widely used in various industries, especially in the fields of digital display, education, advertising, games, museums, etc. However, traditional two-dimensional picture displays still have certain limitations in terms of interactivity, intuitiveness and immersion.

[0003] In traditional display methods, two-dimensional images are mainly displayed on screens, and users can only view images from a flat perspective, but cannot interact from different angles. This limitation not only reduces the display effect, but also limits user participation and immersion. Especially in some complex interactive displays, two-dimensional images cannot show stereoscopic and depth, nor can they display related 3D models in real time when users touch or operate, resulting in insufficient user experience. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a method and terminal for image element recognition and 3D model conversion to solve the problem of limitations in the display of two-dimensional images.

[0005] In order to solve the above technical problems, the technical solution adopted by the present invention is: A method for image element recognition and 3D model conversion, comprising the steps of: S1, identifying the coordinate information of the touch point in the display interface; S2. Calculate the distance between the touch point and the preset marked areas of all pictures in the display interface using the coordinate information, and filter out the minimum distance between each touch point and the corresponding picture; S3, identifying picture elements based on the minimum distance, and determining the picture elements related to the touch point; S4. Extracting the corresponding 3D model file from the database according to the label of the image element, and loading the 3D model into the display interface.

[0006] In order to solve the above technical problems, another technical solution adopted by the present invention is: A terminal for image element recognition and 3D model conversion includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the following steps are performed: S1, identifying the coordinate information of the touch point in the display interface; S2. Calculate the distance between the touch point and the preset marked areas of all pictures in the display interface using the coordinate information, and filter out the minimum distance between each touch point and the corresponding picture; S3, identifying picture elements based on the minimum distance, and determining the picture elements related to the touch point; S4. Extracting the corresponding 3D model file from the database according to the label of the image element, and loading the 3D model into the display interface.

[0007] The beneficial effects of the present invention are: providing a method and terminal for image element recognition and 3D model conversion, which identifies the coordinate information of the touch point, determines the distance between the touch point and the image in the display interface during the interaction process, and selects the minimum distance as the basis for image recognition. After determining the image element, the 3D model corresponding to the image information is loaded from the database to the display interface according to the label information, so that the user can quickly convert the target image into a 3D model by touch during use, realize deep interaction with the display interface, and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 A flowchart of a method for image element recognition and 3D model conversion in an embodiment of the present invention; Figure 2 A schematic diagram of a method for image element recognition and 3D model conversion in an embodiment of the present invention; Figure 3 A schematic diagram of a terminal for image element recognition and 3D model conversion in an embodiment of the present invention; Description of labels: 1. A terminal for image element recognition and 3D model conversion; 2. Memory; 3. Processor. DETAILED DESCRIPTION

[0009] In order to explain the technical content, achieved objectives and effects of the present invention in detail, the following is an explanation in combination with the implementation modes and the accompanying drawings.

[0010] Please refer to Figure 1 as well as Figure 2 , a method for image element recognition and 3D model conversion, comprising the steps of: S1, identifying the coordinate information of the touch point in the display interface; S2, using the coordinate information to calculate the distance between the touch point and the preset marked area of ​​all pictures in the display interface, and screening out the minimum distance between each touch point and the corresponding picture; S3, identifying picture elements based on the minimum distance, and determining the picture elements related to the touch point; S4. Extracting the corresponding 3D model file from the database according to the label of the image element, and loading the 3D model into the display interface.

[0011] As can be seen from the above description, the method implements the whole process from touch point recognition to 3D model loading. First, by obtaining the coordinate information of the touch point, the terminal can accurately capture the user's touch operation. Then, by calculating the minimum distance between the touch point and the preset marked area in the display interface, the image element corresponding to the touch point can be efficiently identified. Finally, the terminal extracts the corresponding 3D model file from the database according to the label of the image element and loads it into the display interface. This process simplifies the complexity of user interaction operations and improves recognition accuracy and response speed. In a specific implementation, the user only needs to touch a certain area of ​​the screen, and the terminal can quickly respond and display the corresponding 3D model. For example, in an interactive electronic display board, the user touches an icon, and the terminal instantly displays the 3D model corresponding to the icon, which enhances the interactive experience. This method is widely used in education, display, advertising and other fields, and can greatly improve the display effect and user experience of digital content. In some implementations, step S3 specifically includes the steps of: S31, comparing the minimum distance with a preset threshold, and if the minimum distance is less than the preset threshold, identifying local image information corresponding to the minimum distance; S32, counting the coordinate information of all the touch points and linking the coordinate information of the touch points to form a boundary area; S33, determining the overall picture information with the highest matching probability within a range according to the boundary area and all the local picture information, and obtaining picture elements of the overall picture information.

[0012] From the above description, it can be seen that it is proposed to judge the local image information by comparing the minimum distance and the preset threshold, and to form a boundary area by combining the coordinates of all touch points, so as to more accurately determine the overall image information. This method can effectively handle complex multi-touch scenarios, and accurately identify and match image elements by comprehensively analyzing the positions of multiple touch points. For example, on a multi-touch display screen, the user touches multiple parts of the screen, and the terminal determines whether they belong to the same image element by calculating the distance between each touch point and the image annotation area. By establishing a boundary area and analyzing the relationship between the boundary area and the local image information, the terminal can clearly determine whether these touch points belong to a large overall element, avoiding misidentification and unnecessary segmentation, improving recognition accuracy, and can enhance the user's operating experience and ensure the accurate display of content.

[0013] In some implementations, the step S33 further includes the steps of: If the overall picture information includes all the local picture information, obtaining picture elements of the overall picture information; If there is an overlapping area between the local picture information and the overlapping area is included in the overall picture information, obtaining the picture element of the overall picture information; If there is no overlap between the partial picture information and the partial picture information can constitute any one of the overall picture information, then the picture elements of the overall picture information are obtained.

[0014] From the above description, it can be seen that this method proposes three rules to determine whether local picture elements belong to the same overall picture element: inclusion rule, overlap rule and composition rule, to ensure that the terminal can make correct recognition decisions when processing complex touch operations. Specifically, if there is overlap between local elements and these overlapping parts are included in the overall element, the terminal will classify these local elements as an overall picture element; if the local elements do not overlap, but they are combined to form a complete picture element, the terminal will also merge them into a whole. Through these rules, the terminal can handle a variety of possible user interaction situations to ensure that the final recognized picture elements meet the user's actual intentions. In some optional applications, the user selects multiple parts through the touch screen to draw a picture, and the terminal can recognize that these parts belong to the same overall picture and display the corresponding 3D model.

[0015] Preferably, if the local image information satisfies multiple judgment rules and different overall image information is obtained, multiple image elements of the overall image information will be obtained. For example, if two overall image elements both meet the inclusion rules, or if three overall image elements meet one, two or three of the three rules respectively, the image elements of the multiple overall image information that meet the rules will be extracted. Since users have a need for comparative display, when selecting a touch point, they want to load 3D models corresponding to multiple image elements at the same time. Then, through the above solution, the terminal loads the 3D models of multiple image elements screened by the user from the data control at the same time, further improving the user experience.

[0016] In some embodiments, step S2 specifically includes the steps of: S21, obtaining preset marked areas of all pictures in the display interface and parsing to obtain coordinate information and area shape information in the preset marked areas; S22: Based on the coordinate information and area shape information of the preset marked area, calculate the distance between each touch point and all the pictures in the display interface, and filter out the minimum distance between each touch point and the corresponding picture.

[0017] From the above description, it can be seen that the steps of obtaining the preset annotated area of ​​all pictures on the display interface and parsing their coordinates and shape information are proposed. In this way, the distance between each touch point and the annotated area of ​​the picture can be calculated more accurately, and the minimum distance can be screened out, thereby improving the accuracy of matching the touch point with the picture element. Through detailed regional shape information, the terminal can more accurately determine the location of the touch point to ensure that the identified picture elements are highly consistent with the user's intention. For example, in an interactive display, the terminal not only relies on the coordinates of the touch point, but also combines the regional shape of the picture element to ensure that the area touched by the user accurately matches the picture element defined in the terminal, which can improve the recognition accuracy in the interface with complex layout, avoid false touches and false recognition, and is especially suitable for occasions such as smart advertising screens and display walls that require refined control and high response speed.

[0018] In some implementations, step S4 specifically includes the steps of: Set a unique label for each image element and establish a mapping relationship with the corresponding 3D model in the database; Searching for a file path of a corresponding 3D model from a database according to the acquired label of the image element; The 3D model is loaded into the display interface based on the file path.

[0019] From the above description, it can be seen that it is proposed to set a unique label for each image element and establish a mapping relationship with the 3D model in the database, so as to achieve accurate loading from the image element to the 3D model. By setting a label for each image element, the terminal can easily find and load the corresponding 3D model, reducing errors and delays in the recognition and loading process.

[0020] Please refer to Figure 3 A terminal 1 for image element recognition and 3D model conversion includes a memory 2, a processor 3, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps in the method for image element recognition and 3D model conversion are completed. That is, an execution carrier of the above method is provided.

[0021] Preferably, the terminal includes a multi-touch module, a picture element recognition module, a 3D model conversion module, a 3D model display module and a database management module, which are respectively used to implement the steps in the above method.

[0022] In summary, the present invention provides a method and terminal for image element recognition and 3D model conversion, which have the following beneficial effects: (1) By obtaining the coordinate information of the touch point and calculating the distance with the preset marked area, accurate image element recognition can be achieved. The terminal can efficiently filter out the minimum distance and the most relevant image element corresponding to each touch point, improving the accuracy of image recognition and avoiding misrecognition.

[0023] (2) Through the comprehensive analysis of multiple touch points and the design of the boundary area formed by the linked touch point coordinates, the relationship between the touch points and the image elements can be accurately identified, and based on the formed boundary area and image information, it can be judged whether the multiple touch points belong to the same image element or multiple overall image elements, ensuring that in the case of multi-touch, the terminal can correctly judge the user's intention.

[0024] (3) Inclusion rules, overlapping rules, and composition rules are introduced to ensure that the terminal can reasonably integrate local image elements according to different touch situations and user needs, and correctly identify and display the corresponding overall image elements. This method is particularly suitable for scenarios that require high-precision judgment and multi-image display. Refined touch area and image matching: (4) The present invention sets a unique tag for each image element and establishes a mapping relationship with the 3D model, so that the corresponding 3D model can be quickly and accurately loaded from the database. This process reduces loading errors and delays, improves user experience, and is particularly suitable for interactive display environments that require fast response and accurate display, such as digital museums, virtual stores, virtual reality and other fields.

[0025] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent transformations made using the contents of the present invention's specification and drawings, or directly or indirectly applied in related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for image element recognition and 3D model conversion, characterized by: Includes steps: S1, identifying the coordinate information of the touch point in the display interface; S2, using the coordinate information to calculate the distance between the touch point and the preset marked area of ​​all pictures in the display interface, and screening out the minimum distance between each touch point and the corresponding picture; S3, identifying picture elements based on the minimum distance, and determining the picture elements related to the touch point; S4. Extracting the corresponding 3D model file from the database according to the label of the image element, and loading the 3D model into the display interface.

2. The method for image element recognition and 3D model conversion according to claim 1, characterized in that: The step S3 specifically comprises the following steps: S31, comparing the minimum distance with a preset threshold, and if the minimum distance is less than the preset threshold, identifying local image information corresponding to the minimum distance; S32, counting the coordinate information of all the touch points and linking the coordinate information of the touch points to form a boundary area; S33, determining the overall picture information with the highest matching probability within a range according to the boundary area and all the local picture information, and obtaining picture elements of the overall picture information.

3. The method for image element recognition and 3D model conversion according to claim 2, characterized in that: The step S33 further comprises the steps of: If the overall picture information includes all the local picture information, obtaining picture elements of the overall picture information; If there is an overlapping area between the local picture information and the overlapping area is included in the overall picture information, obtaining the picture element of the overall picture information; If there is no overlap between the partial picture information and the partial picture information can constitute any one of the overall picture information, then the picture elements of the overall picture information are obtained.

4. The method for image element recognition and 3D model conversion according to claim 1, characterized in that: The step S2 specifically includes the following steps: S21, obtaining preset marked areas of all pictures in the display interface and parsing to obtain coordinate information and area shape information in the preset marked areas; S22: Based on the coordinate information and the area shape information of the preset marked area, calculate the distance between each of the touch points and all the pictures in the display interface, and filter out the minimum distance between each touch point and the corresponding picture.

5. The method for image element recognition and 3D model conversion according to claim 1, characterized in that: The step S4 specifically comprises the following steps: Set a unique label for each image element and establish a mapping relationship with the corresponding 3D model in the database; Searching for a file path of a corresponding 3D model from a database according to the acquired label of the image element; The 3D model is loaded into the display interface based on the file path.

6. A terminal for image element recognition and 3D model conversion, characterized by: The invention comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the following steps are performed: S1, identifying the coordinate information of the touch point in the display interface; S2, using the coordinate information to calculate the distance between the touch point and the preset marked area of ​​all pictures in the display interface, and screening out the minimum distance between each touch point and the corresponding picture; S3, identifying picture elements based on the minimum distance, and determining the picture elements related to the touch point; S4. Extracting the corresponding 3D model file from the database according to the label of the image element, and loading the 3D model into the display interface.

7. The terminal for image element recognition and 3D model conversion according to claim 6, characterized in that: The step S3 specifically comprises the following steps: S31, comparing the minimum distance with a preset threshold, and if the minimum distance is less than the preset threshold, identifying local image information corresponding to the minimum distance; S32, counting the coordinate information of all the touch points and linking the coordinate information of the touch points to form a boundary area; S33, determining the overall picture information with the highest matching probability within a range according to the boundary area and all the local picture information, and obtaining picture elements of the overall picture information.

8. The terminal for image element recognition and 3D model conversion according to claim 7, characterized in that: The step S33 further comprises the steps of: If the overall picture information includes all the local picture information, obtaining picture elements of the overall picture information; If there is an overlapping area between the local picture information and the overlapping area is included in the overall picture information, obtaining the picture element of the overall picture information; If there is no overlap between the partial picture information and the partial picture information can constitute any one of the overall picture information, then the picture elements of the overall picture information are obtained.

9. The terminal for image element recognition and 3D model conversion according to claim 6, characterized in that: The step S2 specifically includes the following steps: S21, obtaining preset marked areas of all pictures in the display interface and parsing to obtain coordinate information and area shape information in the preset marked areas; S22: Based on the coordinate information and the area shape information of the preset marked area, calculate the distance between each of the touch points and all the pictures in the display interface, and filter out the minimum distance between each touch point and the corresponding picture.

10. The terminal for image element recognition and 3D model conversion according to claim 6, characterized in that: The step S4 specifically comprises the following steps: Set a unique label for each image element and establish a mapping relationship with the corresponding 3D model in the database; Searching for a file path of a corresponding 3D model from a database according to the acquired label of the image element; The 3D model is loaded into the display interface based on the file path.

Images