AR flower information display method and system
Through the combination of cloud neural network model and virtual character model, the inaccurate identification and device compatibility of AR scanning flower blessing software has been solved, user experience and flower culture dissemination have been improved, and brand image and user satisfaction have been improved.
Patent Information
- Application Number
- CN202410904615.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-08
- Publication Date
- 2024-11-01
AI Technical Summary
The existing AR scan flower blessing software has inaccurate identification, device compatibility issues, data privacy and security risks, and user experience inconsistency, affecting the user experience and brand image.
The neural network model is built on the cloud to recognize flowers, combine virtual character models and flower blessing information to realize multi-level feature extraction and virtual element display of user terminals, and use cloud sharing and database storage to improve interactivity and data security.
It provides innovative user experience, enhances the value of flower culture, promotes the dissemination of flower culture, increases interactivity and sociality, and improves brand image and user satisfaction.
Smart Images

Figure CN118887367A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of AR fusion technology, and in particular to an AR flower information display method and system. Background Art
[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.
[0003] Existing technologies may be subject to certain limitations, such as the accuracy of image recognition technology, the stability and real-time performance of AR fusion technology, etc. These technical limitations may lead to deficiencies in software in identifying flowers, presenting virtual elements, and interacting with users, affecting user experience.
[0004] Technology maturity: Although AR technology has made great progress, the technical maturity of AR flower scanning blessing software may still be limited. In actual applications, problems such as inaccurate recognition and inaccurate positioning may occur, affecting the user experience.
[0005] Device compatibility: Existing AR flower scanning blessing software may rely on specific device performance, such as camera quality, processor speed, and memory capacity. If the device performance is insufficient, it may affect the running effect and response speed of the software and reduce the user experience. AR flower scanning blessing software may require specific device support, such as smartphones or tablets that support AR functions. If the user's device does not support it, the software cannot be used, which limits its popularity and application scope.
[0006] Data privacy and security: The software needs to process and transmit a large amount of data during operation, including flower images, user data, etc. If the data is not transmitted and processed properly, it may cause data loss, delay or error, affecting the stability and reliability of the software. In the process of collecting and processing user data, this software needs to ensure data privacy and security. If the software has security vulnerabilities or data leakage risks, it may cause losses to users and have a negative impact on the brand image.
[0007] Consistency of user experience: Different users may have different expectations and needs for the AR flower scanning blessing software. If the software has inconsistencies in user experience, such as interface design, operation process, etc., it may affect user satisfaction and loyalty.
[0008] Technology update and upgrade: With the continuous development and progress of technology, AR flower scanning blessing software needs to be constantly updated and upgraded to maintain its competitiveness and innovation. This requires a lot of human and material resources, increasing the cost of software development and maintenance. Summary of the invention
[0009] The technical problem to be solved by the present invention is to overcome the defects of the prior art. The present invention proposes an xx, AR flower information display method and system.
[0010] In order to solve the above technical problems, the technical solution adopted by the present invention is: an AR flower information display method, comprising the following steps:
[0011] S1. Build an image recognition model in the cloud, and use the model to recognize the flower image obtained by the user terminal, and synchronously obtain the flower information corresponding to the current flower image in the cloud big data;
[0012] S2. After the terminal receives the recognition result of the current flower, the user creates a corresponding virtual character model based on the terminal, and the terminal synchronously associates the constructed character model with the recognition result in S1 for display;
[0013] S3, establishing a database containing various flower blessing information on the user terminal for the user to choose or for the user to customize the blessing information;
[0014] S4. The user terminal displays the flower image, the character model and the flower blessing information in association with each other, and shares them in the cloud through the user's mobile terminal.
[0015] Furthermore, the specific identification steps in step S1 are as follows:
[0016] A neural network model is built in the cloud, and a variety of flower image samples are obtained from the cloud big data. The obtained image samples are screened and classified, and then input into the neural network model to train and obtain a model that can recognize flower images;
[0017] The user terminal obtains the flower image to be identified and uploads it to the cloud to be fed into the trained neural network model for identification;
[0018] After the cloud model outputs the recognition result, the corresponding flower information in the cloud big database is obtained synchronously, and the flower image recognition result and flower information are associated and sent to the user terminal in a unified format.
[0019] Furthermore, the neural network model includes, in sequence,
[0020] The extraction layer includes a multi-layer convolutional neural network, which uses a skip connection structure for upsampling and downsampling to achieve multi-level feature extraction of the input flower image;
[0021] The feature enhancement layer abstractly extracts local features at different levels in a bottom-up manner and fuses them with the features of the corresponding convolutional layer in the previous module to form multiple feature layers;
[0022] A pooling layer, used to fuse multiple feature layers in the feature enhancement layer;
[0023] The regression layer uses the pooling layer and the fully connected layer to predict the target category in the detection box, and regresses and locates the flower information, and associates it with the flower information of the current flower type in the cloud big database;
[0024] The mask module judges the pixel points of the flower image to be identified through the convolution layer and the fully connected layer, and predicts the flower image recognition result.
[0025] Furthermore, the steps of constructing the virtual character model in step S2 are as follows:
[0026] receiving a virtual image construction instruction and collecting a user image through a user terminal;
[0027] The user image is compressed in a preset format and sent to the cloud in the form of image data. The cloud receives and processes the currently collected user image data. The processing process includes restoring the image data to obtain floating point data.
[0028] 3D modeling is performed based on floating-point data to obtain the corresponding virtual character model for the user.
[0029] An AR flower information display system, comprising:
[0030] Graphic recognition module, which has a built-in trained neural network recognition model to recognize flower images uploaded by user terminals;
[0031] The virtual character creation module compresses and restores the user image uploaded by the user terminal into floating-point data, and constructs a virtual character model corresponding to the user image through 3D modeling, and simultaneously sends it to the mobile terminal for display;
[0032] The information editing module is stored in the cloud in the form of a database and is associated with the user terminal. The database contains blessing information corresponding to various flowers;
[0033] The association module is used to combine flower images, virtual character models and blessing information, and deploy and display them in the user terminal applet or APP.
[0034] An electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the AR flower information display method as described above are implemented.
[0035] A non-transitory computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, is used to implement the steps of the above-mentioned AR flower information display method.
[0036] Compared with the prior art, the beneficial effects of the present invention include:
[0037] 1. Innovative user experience: Through AR technology, users can scan flowers to obtain relevant information and blessings. This interactive method provides users with a novel, interesting and interactive experience, making the display of flowers more vivid and interesting.
[0038] 2. Enhance the cultural value of flowers: AR scanning flowers to send blessings can enhance the cultural value of flowers. By scanning flowers, users can understand the stories, meanings and blessings behind them, and thus have a deeper understanding and appreciation of flowers.
[0039] 3. Promote the spread of flower culture: AR scanning flowers to send blessings can be used as an effective means of communication to promote the spread of flower culture. In this way, more people can understand and appreciate the beauty and value of flowers, thereby enhancing their understanding and love of flower culture.
[0040] 4. Increase interactivity and sociality: AR scanning flowers to send blessings allows users to share their blessings with others, increasing interactivity and sociality. Users can share their blessings with friends, family or others on social media, thereby enhancing connections and interactions between each other.
[0041] 5. Enhance brand image: For merchants, AR scanning flowers to send blessings can be used as an effective marketing tool to enhance brand image. In this way, merchants can attract more customers, increase sales, and also enhance brand awareness and reputation. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] The disclosure of the present invention is described with reference to the accompanying drawings. It should be understood that the drawings are for illustrative purposes only and are not intended to limit the scope of protection of the present invention. In the accompanying drawings, the same reference numerals are used to refer to the same components. Among them:
[0043] Figure 1 The flowchart of the method proposed according to one embodiment of the present invention is schematically shown. DETAILED DESCRIPTION
[0044] It is easy to understand that according to the technical solution of the present invention, without changing the essential spirit of the present invention, a person skilled in the art can propose a variety of interchangeable structural modes and implementation modes. Therefore, the following specific implementation modes and drawings are only exemplary descriptions of the technical solution of the present invention, and should not be regarded as the whole of the present invention or as a limitation or restriction to the technical solution of the present invention.
[0045] According to one embodiment of the present invention, Figure 1 Shown.
[0046] An AR flower information display method comprises the following steps:
[0047] S1. Build an image recognition model in the cloud, and use the model to recognize the flower image obtained by the user terminal, and synchronously obtain the flower information corresponding to the current flower image in the cloud big data;
[0048] S2. After the terminal receives the recognition result of the current flower, the user creates a corresponding virtual character model based on the terminal, and the terminal synchronously associates the constructed character model with the recognition result in S1 for display;
[0049] S3, establishing a database containing various flower blessing information on the user terminal for the user to choose or for the user to customize the blessing information;
[0050] S4. The user terminal displays the flower image, the character model and the flower blessing information in association with each other, and shares them in the cloud through the user's mobile terminal.
[0051] Furthermore, the specific identification steps in step S1 are as follows:
[0052] A neural network model is built in the cloud, and a variety of flower image samples are obtained from the cloud big data. The obtained image samples are screened and classified, and then input into the neural network model to train and obtain a model that can recognize flower images;
[0053] The user terminal obtains the flower image to be identified and uploads it to the cloud to be fed into the trained neural network model for identification;
[0054] After the cloud model outputs the recognition result, the corresponding flower information in the cloud big database is obtained synchronously, and the flower image recognition result and flower information are associated and sent to the user terminal in a unified format.
[0055] Furthermore, the neural network model includes, in sequence,
[0056] The extraction layer includes a multi-layer convolutional neural network, which uses a skip connection structure for upsampling and downsampling to achieve multi-level feature extraction of the input flower image;
[0057] The feature enhancement layer abstractly extracts local features at different levels in a bottom-up manner and fuses them with the features of the corresponding convolutional layer in the previous module to form multiple feature layers;
[0058] A pooling layer, used to fuse multiple feature layers in the feature enhancement layer;
[0059] The regression layer uses the pooling layer and the fully connected layer to predict the target category in the detection box, and regresses and locates the flower information, and associates it with the flower information of the current flower type in the cloud big database;
[0060] The mask module judges the pixel points of the flower image to be identified through the convolution layer and the fully connected layer, and predicts the flower image recognition result.
[0061] Furthermore, the steps of constructing the virtual character model in step S2 are as follows:
[0062] receiving a virtual image construction instruction and collecting a user image through a user terminal;
[0063] The user image is compressed in a preset format and sent to the cloud in the form of image data. The cloud receives and processes the currently collected user image data. The processing process includes restoring the image data to obtain floating point data.
[0064] 3D modeling is performed based on floating-point data to obtain the corresponding virtual character model for the user.
[0065] The present invention relates to an AR flower information display method, which is based on the following:
[0066] (1) Flower recognition: Use graphic recognition technology to identify flower images scanned by users.
[0067] (2) 3D character selection: A virtual character model corresponding to the user’s face is constructed.
[0068] ① Character model design: a. Character design: Design a series of attractive and individual three-dimensional characters that can be related to flowers, such as flower fairies, flower elves, etc. b. Model making: Use 3D modeling software to create high-precision models of the characters, ensuring that the details and textures of the models are clear.
[0069] ② Character animation production: a. Animation design: design a set of basic animations for each character, such as walking, standing, waving, etc.; b. Animation production: use animation production software to apply these animations to the character model to ensure that the animation is smooth and natural.
[0070] ③Character interaction design: a. Interaction method: Design a way for users to select and operate three-dimensional characters, such as by clicking buttons or gestures on the screen; b. Interaction feedback: Provide appropriate feedback when users interact with the characters, such as the character's movements, expression changes, etc.
[0071] ④Character scene design: a. Scene background: Design a flower-related scene for each character, such as a garden, flower bed, etc.; b. Scene rendering: Use rendering technology to combine the scene with the character model to create a realistic virtual environment.
[0072] (3) Blessing database: Establish a database containing a variety of flower blessing information for users to choose from. Or allow users to customize the blessing content to add personalized elements. Design a set of blessings for each character. These blessings are related to flowers and have positive meanings.
[0073] (4) Social sharing: Allow users to share their blessings on social media to increase interactivity, or send blessings to designated people through apps or mini-programs.
[0074] In the actual project implementation process, you can refer to the following steps:
[0075] 1. Requirements analysis and planning: First, you need to clarify the goals and requirements of the software, such as what flower information to display, how to identify flowers, the effect and method of display, etc., and formulate a development plan and schedule based on the requirements;
[0076] 2. Image recognition algorithm development: In order to identify flowers, it is necessary to develop an image recognition algorithm. Machine learning algorithms can be used to train a large number of flower images to obtain a model that can accurately identify flowers;
[0077] 3.3D modeling and animation: To create realistic virtual scenes and objects, 3D modeling technology is needed. Professional 3D modeling software, such as Blender, Maya, etc., can be used to create 3D models of flowers and other objects in the virtual scene. At the same time, animation and special effects need to be produced to make the virtual scene more vivid and realistic.
[0078] 4. AR engine development: In order to match virtual information with the real world, an AR engine needs to be developed. The AR engine can include functions such as image recognition, tracking, and rendering, and can match virtual information with flowers in the real world and display relevant information around them;
[0079] 5. Speech recognition and synthesis: In order to make the AR flower information display more natural and humanized, speech recognition and synthesis technology is needed. You can use speech recognition libraries, such as the Google Speech Recognition library, to recognize the user's voice input. At the same time, you can use text-to-speech libraries, such as Amazon Polly, to convert text into speech output;
[0080] 6. AI and database technology: In order for the software to intelligently recommend relevant flower information and display methods, AI technology is required. Machine learning algorithms can be used to analyze user behavior and preferences to recommend relevant flower information and display methods. At the same time, database technology is required to store and manage large amounts of flower information and user data;
[0081] 7. Testing and optimization: During the development process, the software needs to be tested and optimized to ensure its normal operation and provide a smooth user experience. Volunteers or testers can be invited to test the functionality and performance of the software, collect feedback, and fix errors or problems;
[0082] 8. Release and maintenance: After testing and optimization, the software can be released to the app store or other platforms for users to download and use. At the same time, the software needs to be updated and maintained regularly to fix bugs, add new features, or optimize performance, etc.
[0083] Similarly, an AR flower information display system constructed according to the above display method is also within the protection scope of the present invention. The system is specifically constructed as follows, including:
[0084] Graphic recognition module, which has a built-in trained neural network recognition model to recognize flower images uploaded by user terminals;
[0085] The virtual character creation module compresses and restores the user image uploaded by the user terminal into floating-point data, and constructs a virtual character model corresponding to the user image through 3D modeling, and simultaneously sends it to the mobile terminal for display;
[0086] The information editing module is stored in the cloud in the form of a database and is associated with the user terminal. The database contains blessing information corresponding to various flowers;
[0087] The association module is used to combine flower images, virtual character models and blessing information, and deploy and display them in the user terminal applet or APP.
[0088] In addition, the above-mentioned method steps and system can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.
[0089] On the other hand, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it is implemented to execute the business performance analysis method based on the SaaS model CRM system provided by the above methods, the method comprising: obtaining a business performance analysis request; the business performance analysis request is used to request analysis of the reasons affecting business performance when multiple tenants access the software operation service SaaS model customer relationship management CRM system; the tenants are tenants with standard product functions, or tenants with standard product functions and business extension functions; based on the business performance analysis request and the log information of each of the tenants when executing at least one business logic, the reasons affecting business performance when each of the tenants accesses the SaaS model CRM system are analyzed to obtain the reasons affecting business performance; the log information includes tenant identification and execution time information. The device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. A person skilled in the art can understand and implement the present invention without any creative effort.
[0090] The technical scope of the present invention is not limited to the contents in the above description. Those skilled in the art can make various deformations and modifications to the above embodiments without departing from the technical idea of the present invention, and these deformations and modifications should all fall within the protection scope of the present invention.
Claims
1. An AR flower information display method, characterized in that: The steps include: S1. Build an image recognition model in the cloud, and use the model to recognize the flower image obtained by the user terminal, and synchronously obtain the flower information corresponding to the current flower image in the cloud big data; S2. After the terminal receives the recognition result of the current flower, the user creates a corresponding virtual character model based on the terminal, and the terminal synchronously associates the constructed character model with the recognition result in S1 for display; S3, establishing a database containing various flower blessing information on the user terminal for the user to choose or for the user to customize the blessing information; S4. The user terminal displays the flower image, the character model and the flower blessing information in association with each other, and shares them in the cloud through the user's mobile terminal.
2. The method for displaying AR flower information according to claim 1, characterized in that: The specific identification steps in step S1 are as follows: A neural network model is built in the cloud, and a variety of flower image samples are obtained from the cloud big data. The obtained image samples are screened and classified, and then input into the neural network model to train and obtain a model that can recognize flower images; The user terminal obtains the flower image to be identified and uploads it to the cloud to be fed into the trained neural network model for identification; After the cloud model outputs the recognition result, the corresponding flower information in the cloud big database is obtained synchronously, and the flower image recognition result and flower information are associated and sent to the user terminal in a unified format.
3. The method for displaying AR flower information according to claim 2, characterized in that: The neural network model includes, in sequence, The extraction layer includes a multi-layer convolutional neural network, which uses a skip connection structure for upsampling and downsampling to achieve multi-level feature extraction of the input flower image; The feature enhancement layer abstractly extracts local features at different levels in a bottom-up manner and fuses them with the features of the corresponding convolutional layer in the previous module to form multiple feature layers; A pooling layer, used to fuse multiple feature layers in the feature enhancement layer; The regression layer uses the pooling layer and the fully connected layer to predict the target category in the detection box, and regresses and locates the flower information, and associates it with the flower information of the current flower type in the cloud big database; The mask module judges the pixel points of the flower image to be identified through the convolution layer and the fully connected layer, and predicts the flower image recognition result.
4. The method for displaying AR flower information according to claim 1, characterized in that: The steps of constructing the virtual character model in step S2 are as follows: receiving a virtual image construction instruction and collecting a user image through a user terminal; The user image is compressed in a preset format and sent to the cloud in the form of image data. The cloud receives and processes the currently collected user image data. The processing process includes restoring the image data to obtain floating point data. 3D modeling is performed based on floating-point data to obtain the corresponding virtual character model for the user.
5. An AR flower information display system, characterized in that: include: Graphic recognition module, which has a built-in trained neural network recognition model to recognize flower images uploaded by user terminals; The virtual character creation module compresses and restores the user image uploaded by the user terminal into floating-point data, and constructs a virtual character model corresponding to the user image through 3D modeling, and simultaneously sends it to the mobile terminal for display; The information editing module is stored in the cloud in the form of a database and is associated with the user terminal. The database contains blessing information corresponding to various flowers; The association module is used to combine flower images, virtual character models and blessing information, and deploy and display them in the user terminal applet or APP.
6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that : When the processor executes the program, the steps of the AR flower information display method as described in any one of claims 1 to 4 are implemented.
7. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, it is used to implement the steps of the AR flower information display method described in any one of claims 1 to 4 above.
