Plant health status assessment method and device, and computer readable storage medium

Abstract

The present disclosure provides a plant health status assessment method. The method comprises: receiving a plant image; using a plant health assessment model to determine the rating of a plant under a plurality of dimensions on the basis of the plant image; determining a health status of the plant on the basis of the rating under the plurality of dimensions, wherein the health status comprises at least three grades, and the at least three grades comprise healthy, sub-healthy, and unhealthy; and displaying the health status. The present disclosure further relates to a plant health status assessment device and a computer readable storage medium.

Description

Plant health status assessment method, device and computer-readable storage medium Technical Field

[0001] The present disclosure relates to the field of plant maintenance technology, and in particular to a plant health status assessment method, device, and computer-readable storage medium. Background Art

[0002] As people prioritize environmental protection and healthy living, they're increasingly interested in plants. In cities, people are increasingly aware of the importance of plants for air purification and urban beautification, leading to an increase in the number of plants planted in parks, squares, and streets. An increasing number of people are also growing plants at home, beautifying their environment while also enjoying the joys of gardening.

[0003] Summary of the Invention

[0004] One of the objectives of one or more embodiments of the present disclosure is to provide a plant health status assessment method, device, and computer-readable storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a method for assessing the health status of a plant is provided, comprising: receiving a plant image; determining a rating of the plant in multiple dimensions based on the plant image using a plant health assessment model; determining the health status of the plant based on the ratings in the multiple dimensions, the health status including at least three levels, the at least three levels including healthy, sub-healthy and unhealthy; and displaying the health status.

[0006] In some embodiments, the plurality of dimensions includes multiple of leaf color, leaf size, leaf morphology, robustness, and leaf spotting.

[0007] In some embodiments, the multiple dimensions include multiple ones of light conditions, watering conditions, nutrition conditions and plant shape.

[0008] In some embodiments, the method further includes: determining disease information of the plant based on a plant disease diagnosis model; and determining a health status of the plant based on the ratings of the multiple dimensions and the disease information.

[0009] In some embodiments, determining the health status of the plant based on the ratings under the multiple dimensions includes: determining the value of the rating of each dimension and the weight corresponding to each dimension; and determining the health status of the plant based on the weighted result of the value of the rating of each dimension and the weight corresponding to each dimension.

[0010] In some embodiments, the ratings of the dimensions include at least normal and abnormal; determining the health status of the plant based on the ratings under the multiple dimensions includes: determining the importance of each dimension, the importance including important and unimportant; in response to the ratings of the dimensions with important importance being all normal, determining the health status of the plant to be healthy; and / or in response to the presence of one abnormality in the ratings of the dimensions with important importance, determining the health status of the plant to be sub-healthy or unhealthy.

[0011] In some embodiments, the plant health assessment model includes a plurality of sub-models, each sub-model being used to assess a rating of a plant in one of the plurality of dimensions.

[0012] In some embodiments, the method further includes outputting an overall status of the plant, wherein the overall status is determined based on the health status and a maintenance status, wherein the maintenance status includes a good maintenance and a poor maintenance.

[0013] In some embodiments, the maintenance status is determined based on one or more dimensions of light conditions, watering conditions, nutritional conditions, and plant shape.

[0014] In some embodiments, the method further includes: outputting information to guide the user to upload an overall image of the plant and a partial image of the plant; and determining a rating of the plant in multiple dimensions based on the overall image of the plant and the partial image of the plant.

[0015] In some embodiments, the method further includes: determining a description and / or maintenance suggestion for the rating of each dimension based on the rating of each dimension; and displaying the rating of each dimension, and the description and / or maintenance suggestion.

[0016] In some embodiments, the method further includes: in response to the health status of the plant being sub-healthy or unhealthy, determining a dimension with diagnostic significance among the multiple dimensions based on the ratings under the multiple dimensions; determining relevant questions based on the dimension with diagnostic significance, and generating an interactive questionnaire based on the relevant questions; and displaying the interactive questionnaire.

[0017] According to a second aspect of an embodiment of the present disclosure, a plant health status assessment device is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the method described in any one of the above embodiments based on instructions stored in the memory.

[0018] According to a third aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, comprising computer program instructions, wherein the computer program instructions implement the method described in any one of the above embodiments when executed by a processor.

[0019] According to a fourth aspect of an embodiment of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the method described in any one of the above embodiments is implemented.

[0020] The technical solution of the present disclosure is further described in detail below through the accompanying drawings and examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] FIG1 is a flow chart of a method for assessing plant health status according to some embodiments of the present disclosure.

[0023] 2 to 4 are schematic diagrams of pages for displaying the health status of a plant in a plant health status assessment method according to different embodiments of the present disclosure.

[0024] 5 and 6 are schematic diagrams of pages for displaying each dimension in a method for assessing the health status of a plant according to some embodiments of the present disclosure.

[0025] FIG7 is a schematic structural diagram of a plant health status assessment device according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0026] The following will clearly and completely describe the technical solutions in the embodiments of the present disclosure in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0027] Unless specifically stated otherwise, the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure.

[0028] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0029] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0030] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0031] It should be noted that like reference numerals and letters refer to like items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0032] When purchasing a new plant, users often want to know information such as the plant's health status before deciding whether to purchase it. When caring for plants, users also want to have a general understanding of the plant's health status. If users know that the plant's health is poor, they can take timely and targeted measures to better care for the plant and prevent it from becoming sick or even dying. Therefore, the inventors realized that providing users with a function to assess the plant's health status would be a great convenience.

[0033] Figure 1 is a schematic flow chart of a method for assessing plant health according to some embodiments of the present disclosure. Figures 2 through 4 are schematic diagrams of pages for displaying plant health status in a method for assessing plant health according to various embodiments of the present disclosure. The method shown in Figure 1 can be executed by an application installed on an electronic device, such as a computer or mobile phone, to provide users with the ability to assess plant health. The method may include steps S110, S120, S130, and S140 as described below.

[0034] In step S110, a plant image is received. The plant image may be provided by the user. For example, the plant image may be received from the user's mobile phone album. For another example, the plant image may be received by the user through the user's camera, taking a photo of the plant on site.

[0035] In step S120, a plant health assessment model is used to determine the rating of the plant in multiple dimensions based on the plant image. The multiple dimensions may include, for example, multiple of leaf color, leaf size, leaf morphology, plant robustness, and leaf spots. For another example, the multiple dimensions may include multiple of light conditions, watering conditions, nutritional conditions, and plant shape. For another example, the multiple dimensions may include, for example, multiple of leaf color, leaf size, leaf morphology, plant robustness, leaf spots, light conditions, watering conditions, nutritional conditions, and plant shape. The plant health assessment model can be trained using pre-labeled sample images. The labeling rules for sample images will be described below in conjunction with some embodiments.

[0036] In step S130, the health status of the plant is determined based on the ratings under multiple dimensions. Here, the health status may include at least three levels, and the at least three levels may include healthy, sub-healthy, and unhealthy. For example, the health status may include only the three levels of healthy, sub-healthy, and unhealthy, or may include the four levels of healthy, good, sub-healthy, and unhealthy (where good is a level between healthy and sub-healthy), or may include more and / or more detailed levels. More and more detailed levels may include, for example, lack of water, excessive water, lack of fertilizer, excessive fertilizer, and need for pruning, etc.

[0037] In step S140, the health status of the plant may be displayed as shown in Figures 2 to 4, which will be described later. In some embodiments, as shown in Figures 2 and 3, the health level of the plant may be displayed. In other embodiments, as shown in Figure 4, the score corresponding to the health status may be displayed.

[0038] In the above embodiment, the function of evaluating the health status of plants is provided to users, which is conducive to improving the user's maintenance level and helping users to discover health problems of plants in a timely manner, so as to take corresponding measures for protection and treatment, and fully meet the needs of users. On the one hand, the health status is graded in a more detailed manner, and the health status includes at least 3 levels, that is, in addition to healthy and unhealthy states, it also includes at least sub-healthy states, which enables users to discover problems with plants as early as possible (without having to wait until the plants are in an unhealthy state). On the other hand, the evaluated plants are first rated in multiple dimensions, and then the health status of the plants is comprehensively determined based on the ratings in multiple dimensions. Therefore, the health status of plants provided to users by this application is more accurate and comprehensive, which is conducive to helping users maintain plants better and more professionally.

[0039] Figures 2 to 4 are described below.

[0040] As shown in Figure 2, a page 200 for displaying a plant's health status may include a title 210, a plant's health level 220, auxiliary instructions 230, a label 240 for the plant's overall status, an illustration 250, and an Add Plant button 260. Title 210, for example, could be "Health Status." By displaying the title, the user can quickly understand the purpose of page 200 for displaying a plant's health status. The plant's health level 220 could be presented in a single sentence. For example, if the plant's health level is healthy, the plant's health level 220 could be displayed as "This plant appears healthy." The auxiliary instructions 230 could be an introduction to the Add Plant button 260, such as "You can add this plant to 'My Garden' to track its growth." "My Garden" here refers to another functional module included in the application program executing this application. It can be used to store information about one or more plants currently used by the user, as well as record the plant's status, growth process, and maintenance history. The auxiliary instructions 230 could also be an introduction to other content, such as a description of the plant's health status. The overall plant status label 240 can display the overall plant status, such as "Good." The following text will describe how to determine the overall plant status in conjunction with some embodiments. Illustrations 250 can be determined based on the overall plant status. For example, if a plant's overall status includes good, fair, and poor, there can be three illustrations, each corresponding to a different overall status. In response to the user clicking the Add Plant button 260, the plant can be added to "My Garden."

[0041] Figure 3 shows pages for displaying the health status of plants, corresponding to different health statuses. As shown in Figure 3, if the plant's health status is unhealthy, page 310 may be displayed to the user; if the plant's health status is sub-healthy, page 320 may be displayed to the user; if the plant's health status is good, page 330 may be displayed to the user; and if the plant's health status is healthy, page 340 may be displayed to the user. The distribution of display modules on pages 310, 320, 330, and 340 is relatively similar. For the sake of simplicity, page 310 will be used as an example for the following description. Page 310 may include a title 311, a plant's health status level 312, associated buttons 313, and a plant image 314. Title 311 may, for example, be "Plant Health." In some implementations, title 311 may also include icons or symbols to enhance the aesthetics of page 310 and improve the user's browsing experience. The plant's health status level 312 can be presented in the form of a sentence. For example, if the plant's health level is unhealthy, the plant's health status level 312 can be displayed as "This plant looks unhealthy!". The associated button 313 can provide an associated function in response to a user operation, and the associated function can be determined based on the health level. For example, if the plant's health level is unhealthy, the associated button 313 on the page 310 displayed to the user can provide a "Check Solutions" function to provide the user with advice on how to properly care for the plant. If the plant's health level is healthy, the associated button on the page 340 displayed to the user can provide a "Save to 'My Garden'" function so that the user can track the plant's growth in "My Garden."

[0042] As shown in FIG4 , a page 400 for displaying plant health status may include a title 410, a plant image 420, a plant health score 430, and ratings 440 across multiple dimensions. Title 410 may be, for example, "AI Detection." Plant image 420 may display the plant image received in step S110, or a representative image of the plant species corresponding to the plant image received in step S110. The plant name, such as "Star Cactus," may be labeled at the bottom of plant image 420. Plant health score 430 may display the plant's health status in numerical form, such as "Health Score: 78." Ratings 440 across multiple dimensions may include an image and text. The image may use a radar chart to display the plant's rating for each of the multiple dimensions. The text may read, for example, "Your star cactus appears generally healthy. Please note its health score and detailed descriptions for each dimension." A radar chart is a type of chart used to visualize multidimensional data. It represents data as a polygon, with each dimension corresponding to a vertex of the polygon. For example, the radar chart in FIG4 shows that the plant's ratings for each dimension of light, watering, nutrition, plant shape, and disease are 9.8, 9.7, 9.6, 9.2, and 8.5, respectively. Using a radar chart to present the plant's scores for each dimension helps make the display of multiple dimensions more intuitive, allowing users to more easily notice the relationships and differences between the multiple dimensions, and also improves the aesthetics of the page. In some embodiments, in response to a user's operation on a plant's health score 430 or a rating 440 for multiple dimensions, a page displaying each dimension, as shown in FIG5 and FIG6 to be described later, may be displayed to the user.

[0043] In some embodiments, the disease information of the plant can be determined based on a plant disease diagnosis model; the health status of the plant can be determined based on the ratings and disease information of multiple dimensions. For example, when the disease information of the plant indicates that the plant is diseased, the health status of the plant can be determined to be unhealthy. When the disease information of the plant indicates that the plant is not diseased, the health status of the plant can be comprehensively determined by combining the ratings and disease information of multiple dimensions. As some implementations, when the health status of the plant is displayed to the user, the ratings and disease information of each dimension can also be displayed together. Since disease information is crucial to the health status of the plant, comprehensively considering the disease information of the plant and the ratings of multiple dimensions is conducive to making the determined health status of the plant more accurate.

[0044] The following describes how to determine the health status of a plant based on ratings across multiple dimensions.

[0045] In some embodiments, determining the health status of a plant based on ratings in multiple dimensions includes: determining the value of the rating of each dimension and the weight corresponding to each dimension; and determining the health status of the plant based on a weighted result of the value of the rating of each dimension and the weight corresponding to each dimension.

[0046] For example, the multiple dimensions include leaf color, leaf size, and leaf morphology, with corresponding weights of 0.2, 0.5, and 0.3, respectively. Leaf color is rated as 1, leaf size as 2, and leaf morphology as 3. The default rule is that if the weighted result is greater than 2, the plant's health status is determined to be healthy. Calculation yields the weighted result of 0.2*1+0.5*2+0.3*3=2.1. Since 2.1>2, the plant's health status can be determined to be healthy.

[0047] In some embodiments, the ratings of the dimensions include at least normal and abnormal. In this case, determining the health status of the plant based on the ratings of the multiple dimensions includes: determining the importance of each dimension, where the importance levels include important and unimportant; in response to the ratings of the important dimensions being all normal, determining the health status of the plant as healthy; and / or in response to the rating of the important dimensions being abnormal, determining the health status of the plant as sub-healthy or unhealthy.

[0048] For example, multiple dimensions include leaf color, leaf size, and leaf morphology, with each dimension having an importance rating of important, important, and unimportant. Leaf color is rated normal, leaf size is rated normal, and leaf morphology is rated abnormal. A preset rule states that if all important dimensions have normal ratings, the plant's health status is determined to be healthy. Since all important dimensions have normal ratings, the plant's health status can be determined to be healthy. For another example, multiple dimensions include leaf color, leaf size, and leaf morphology, with each dimension having an importance rating of important, important, and unimportant. Leaf color is rated normal, leaf size is rated abnormal, and leaf morphology is rated abnormal. A preset rule states that if any one of the important dimension ratings is abnormal, the plant's health status is determined to be sub-healthy or unhealthy. Since the leaf size rating is abnormal, meaning that any one of the important dimension ratings is abnormal, the plant's health status can be determined to be sub-healthy or unhealthy. For another example, multiple dimensions include leaf color, leaf size, and leaf morphology, with each dimension having an importance rating of important, important, and unimportant. Leaf color is rated normal, leaf size is rated normal, and leaf morphology is rated abnormal. The default rule is that if all important dimensions are rated normal, and one unimportant dimension is rated abnormal, the plant's health is determined to be sub-healthy. Because leaf color and leaf size are rated normal, and leaf morphology is rated abnormal, the plant's health is determined to be sub-healthy.

[0049] In some embodiments, a plant health assessment model may include multiple sub-models, each of which is used to assess a plant's rating across multiple dimensions. For example, corresponding sub-models may be used to assess leaf color, leaf size, leaf morphology, plant health, leaf spotting, light exposure, watering, nutrition, and plant shape.

[0050] In some embodiments, each dimension of light exposure, watering conditions, nutritional status, and plant shape can be determined based on leaf color, leaf size, leaf morphology, plant firmness, and leaf spots. In some embodiments, light exposure can also be assisted by a photometer. In some embodiments, disease information can be determined based on leaf color, leaf size, leaf morphology, and plant firmness.

[0051] In some embodiments, as shown in FIG2 , the overall state of the plant can also be output (see the overall state label 240 of the plant in FIG2 ), and the overall state can be determined based on the health state and the maintenance state. The maintenance state can include, for example, good maintenance and poor maintenance. The overall state can include, for example, good, average, and poor. For example, when the maintenance state is well maintained and the health state is healthy, the overall state of the plant can be determined to be good. When the maintenance state is well maintained and the health state is sub-healthy or unhealthy, the overall state of the plant can be determined to be average. When the maintenance state is poorly maintained and the health state is sub-healthy or unhealthy, the overall state of the plant can be determined to be poor.

[0052] In the above embodiment, by outputting the overall status of the plant, the user can have a more comprehensive understanding of the plant, and can not only understand the health status of the plant, but also understand the maintenance status, which is conducive to improving user satisfaction.

[0053] In some embodiments, the maintenance status can be determined based on one or more dimensions of light conditions, watering conditions, nutrition conditions, and plant shape.

[0054] In some embodiments, information may be output to guide the user to upload an overall image of the plant and a partial image of the plant; and the plant's rating across multiple dimensions may be determined based on the overall image and the partial image of the plant. For example, before the user provides a plant image, a prompt message stating "Please provide an overall image and a partial image of the plant" may be displayed to the user to guide the user. For another example, after receiving the plant image provided by the user, the plant image provided by the user may be analyzed to determine whether the plant image provided by the user is an overall image or a partial image. If the plant image provided by the user only includes an overall image and not a partial image, the message "Please continue to provide a partial image of the plant" may be displayed to the user to guide the user. Alternatively, after receiving the partial image of the plant provided by the user, information may be output to guide the user to upload an overall image of the plant. When determining the plant's rating across multiple dimensions, for example, the plant's rating across multiple dimensions may be determined based on the overall image of the plant, and then based on the partial image of the plant, and the two determined ratings may be weighted to obtain the final rating.

[0055] In the above embodiment, the rating of the plant in multiple dimensions is determined based on the overall image and the local image of the plant, which helps to make the rating determination more accurate and comprehensive, thereby improving the accuracy of the plant health status.

[0056] In some embodiments, information may be output to guide the user to upload photos of the plant from multiple angles; and the ratings of the plant in multiple dimensions may be determined based on the photos of the plant from multiple angles.

[0057] The following describes the labeling rules for sample images used to train a plant health assessment model in conjunction with Table 1 and some embodiments. As described above, the plant health assessment model can include multiple sub-models, each of which outputs a rating for the plant to be assessed in the dimension corresponding to the sub-model. In this case, sample images for each dimension labeled according to the exemplary standard rules in Table 1 are used to train the corresponding sub-model. In other examples, the plant health assessment model can be an overall model that outputs ratings for the plant to be assessed in multiple dimensions. In this case, sample images for all dimensions labeled according to the exemplary standard rules in Table 1 are used to train the overall model.

[0058] Table 1 Labeling rules for sample images

[0059] As shown in Table 1, corresponding annotation rules can be set for the whole plant and the parts thereof, and the annotated samples can be used to train the plant health assessment model. For example, under the dimension of "leaf color", if the overall image of the plant meets the requirements of "old leaves are dark green, new leaves are light green, the color is uniform, there are no spots, reticular yellowing, etc., there are no yellow leaves or only 1-2 old leaves at the bottom of the branch are yellow", and the local image meets the requirements of "old leaves are dark green, new leaves are light green, the color is uniform, there are no spots, reticular yellowing, etc. There are no yellow leaves", then the leaf color rating can be determined to be normal (green leaves), and the annotation value can be "1". By setting annotation rules for the whole plant and the parts thereof separately, it is conducive to a more comprehensive and detailed assessment of the plant, and to improve the accuracy of the plant health status assessment results.

[0060] It should be understood that Table 1 is only an example of some rules; in reality, many different types and locations can be identified using different rules. By setting detailed and specific labeling rules, labelers can accurately label plants instead of simply relying on subjective judgment, making samples more accurate and improving the performance of the plant health assessment model.

[0061] Figures 5 and 6 are schematic diagrams of pages for displaying each dimension in a method for assessing the health status of a plant according to some embodiments of the present disclosure. The pages of Figures 5 and 6 can be displayed in response to an operation on any of Figures 2 to 4, so that the user can understand in detail the specific conditions of the plant in each dimension. These operations may include, for example, clicking or long pressing on modules 210, 220, 240, and 250 in page 200, on pages 310, 320, 330, and 340, and on modules 410, 420, 430, and 440 in page 400.

[0062] As shown in FIG5 , the schematic diagram 500 for displaying the page for each dimension may include an area 510 for displaying the light conditions and an area 520 for displaying the watering conditions. As shown in FIG6 , the schematic diagram 500 for displaying the page for each dimension may include an area 530 for displaying the nutritional conditions, an area 540 for displaying the disease conditions, and an area 550 for displaying the plant shape. As shown in FIG5 , the area 510 for displaying the light conditions may include a title 511, a rating icon 513, a rating overview 512, a description and maintenance suggestions for the rating 514, an associated button 515, and related knowledge 516. The title 511 may be, for example, "Light Conditions" or "Sunlight." The rating icon 513 may display the light conditions of the plant in a graphical manner, for example, by visually displaying the actual light conditions of the plant (for example, the percentage of the actual light received by the current plant relative to the standard / recommended light received by the plant) in the form of a progress bar. The rating overview 512 may be, for example, "Lack of Light." The description and maintenance suggestions for the rating are, for example, "Your succulents lack light. Please check whether the light time is not long enough or the light intensity is not enough. Try not to keep succulents indoors. You can use a photometer to measure the light intensity." The associated button 515 can be determined according to the content of each dimension. For example, in the area 510 used to display the light conditions, the associated button 515 can be used to turn on the photometer function; in the area 520 used to display the watering conditions, the associated button can be used to set a watering reminder. Related knowledge 516 can display knowledge related to the current dimension, and its content can be determined based on the rating of the plant under each dimension. For example, in the area 510 used to display the light conditions, in response to the user's operation on the related knowledge 516 area, knowledge related to "yellowing (excessive growth)" can be displayed to the user. In the area 520 used to display the watering conditions, in response to the user's operation on the related knowledge area, knowledge related to "rotten roots" can be displayed to the user. In the area 530 used to display nutritional conditions, the relevant knowledge may be related to nutrition; if the evaluated plant is rated as nutrient deficient under this dimension and the maintenance recommendations include treating flowering lateral buds, the content of the relevant knowledge may be "flowers". The area 540 used to display symptom conditions is similar. If the evaluated plant is rated as a disease under this dimension and the cause of the disease is a certain insect, the content of the relevant knowledge may be an introduction to the insect, including the identification, harm, and prevention and control measures of the insect. By displaying relevant knowledge, it is helpful to expand the user's knowledge and improve the user's maintenance ability. Since the area 520 used to display watering conditions, the area 530 used to display nutritional conditions, the area 540 used to display symptom conditions, and the area 550 used to display the shape of the plant are relatively similar to the area 510 used to display the light conditions described above, for the sake of brevity, only the differences will be introduced below, and the same parts will not be repeated.As shown in FIG6 , the area 540 for displaying the condition may also include a condition image 541 and a condition treatment pathway 542. Condition image 541 may be an image formed by selecting and marking areas representing the plant's condition based on the plant image received in step S110, or it may be a pre-stored standard example of an image of the plant's condition. Condition treatment pathway 542 may include treatment methods and / or treatment products. As shown in FIG5 , three different treatment products are displayed, each with a brief description below.

[0063] In some embodiments, as shown in Figures 5 and 6, a description and / or maintenance suggestion for each dimension's rating can be determined based on the rating of each dimension; and the rating of each dimension, along with the description and / or maintenance suggestion, can be displayed. By displaying descriptions and maintenance suggestions for the ratings, it is helpful to present and guide users in appropriate scenarios, allowing users to further understand maintenance knowledge and maintenance functions, and promoting the rational use of subsequent maintenance functions by users, thereby obtaining plants in a healthier and more beautiful state of maintenance, and improving user satisfaction with the maintenance functions.

[0064] In some embodiments, in response to the plant's health status being sub-healthy or unhealthy, or the plant's disease information indicating that the plant is sick, a dimension with diagnostic significance can be determined in multiple dimensions based on the ratings under multiple dimensions, and then relevant questions can be determined based on the dimension with diagnostic significance, and an interactive questionnaire is generated based on the relevant questions, and the interactive questionnaire is displayed to the user. The user's incorrect operations during the maintenance process are determined through the user's answers to the interactive questionnaire, and the user is helped to correct these errors. For example, if the plant's health status is unhealthy and the rating of the dimension of leaf color indicates that the leaves are withered and yellow, then the leaf color can be determined as a dimension with diagnostic significance. Since the withered and yellow leaves may be caused by lack of water, the relevant question may be to ask the user about the frequency and amount of watering. Subsequently, the user's answer to this question can be used to determine whether the user has made mistakes in the frequency and amount of watering. If there are mistakes, the appropriate frequency and amount of watering can be displayed to the user as a maintenance guide. As some implementations, the relevant questions corresponding to each dimension can be pre-stored in a database. By identifying dimensions with diagnostic significance and then generating interactive questionnaires, we can gain a more targeted understanding of users' maintenance situations, thereby better guiding users in maintenance and improving their satisfaction with maintenance functions.

[0065] In some embodiments, in response to the inability to accurately determine the rating of a certain dimension, information can be outputted requesting the user to provide pictures and / or information that are helpful for determining the rating of the current dimension, and then the rating of the dimension is determined based on the pictures and / or information provided by the user. For example, when determining the rating of a plant under multiple dimensions, the confidence level of each rating can be determined simultaneously. In response to the confidence level being less than a preset threshold, it can be determined that the rating of the dimension is inaccurate, that is, the rating of the dimension cannot be accurately determined. By judging the accuracy of the rating of the dimension, if the rating of the dimension is inaccurate, the user is required to provide more information to accurately determine the rating of the dimension, which helps to improve the accuracy of the plant health status assessment results.

[0066] Each embodiment in this specification is described in a progressive manner, with each embodiment focusing on its differences from the other embodiments. Reference can be made to the descriptions of the identical or similar parts between the various embodiments. For the device embodiments, since they are essentially identical to the method embodiments, their descriptions are relatively simple. For relevant parts, reference can be made to the descriptions of the method embodiments.

[0067] FIG7 is a schematic structural diagram of a plant health status assessment device according to some embodiments of the present disclosure.

[0068] As shown in FIG. 7 , a plant health status assessment device 700 includes a memory 710 and a processor 720 coupled to the memory 710 . The processor 720 is configured to execute the method of any one of the aforementioned embodiments based on instructions stored in the memory 710 .

[0069] The memory 710 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, application programs, a boot loader, and other programs.

[0070] The plant health status assessment device 700 may also include an input / output interface 730, a network interface 740, a storage interface 750, and the like. These interfaces 730, 740, and 750, as well as the memory 710 and the processor 720, may be connected via, for example, a bus 760. The input / output interface 730 provides a connection interface for input / output devices such as a display, mouse, keyboard, and touch screen. The network interface 740 provides a connection interface for various networked devices. The storage interface 750 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0071] An embodiment of the present disclosure further provides a computer-readable storage medium, comprising computer program instructions, which implement the method of any one of the above embodiments when executed by a processor.

[0072] An embodiment of the present disclosure further provides a computer program product, including a computer program, wherein when the computer program is executed by a processor, any one of the above methods is implemented.

[0073] Thus far, various embodiments of the present disclosure have been described in detail. To avoid obscuring the concept of the present disclosure, some details known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.

[0074] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0075] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0076] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0077] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0078] Although some specific embodiments of the present disclosure have been described in detail through examples, those skilled in the art will understand that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. Those skilled in the art will understand that the above embodiments may be modified or some technical features may be replaced with equivalents without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for assessing the health status of a plant, comprising: receiving a plant image; Determining a rating of the plant in multiple dimensions based on the plant image using a plant health assessment model; Determining a health status of the plant based on the ratings under the multiple dimensions, the health status comprising at least three levels, the at least three levels comprising healthy, sub-healthy, and unhealthy; and The health status is displayed.

2. The method according to claim 1, wherein: The multiple dimensions include multiple ones of leaf color, leaf size, leaf morphology, robustness and leaf spots.

3. The method according to claim 1 or 2, wherein: The multiple dimensions include multiple ones of light conditions, watering conditions, nutritional conditions and plant shape.

4. The method according to claim 1, further comprising: determining plant disease information based on a plant disease diagnosis model; as well as The health status of the plant is determined based on the ratings of the plurality of dimensions and the disease information.

5. The method according to claim 1, wherein: Determining the health status of the plant based on the ratings under the multiple dimensions includes: Determine the rating value of each dimension and the corresponding weight of each dimension; and The health status of the plant is determined based on the value of the rating of each dimension and the weighted result of the weight corresponding to each dimension.

6. The method according to claim 1, wherein: Ratings for the dimensions include at least normal and abnormal; Determining the health status of the plant based on the ratings under the multiple dimensions includes: Determine the importance of each dimension, including important and unimportant; In response to the ratings of the dimensions having important levels being all normal, determining the health state of the plant to be healthy; and / or In response to an abnormality in the rating of the dimension whose importance is important, the health state of the plant is determined to be sub-healthy or unhealthy.

7. The method according to claim 1, wherein: The plant health assessment model includes multiple sub-models, each of which is used to assess the plant's A rating on one of the multiple dimensions.

8. The method according to claim 1, further comprising: An overall state of the plant is output, wherein the overall state is determined based on the health state and a maintenance state, wherein the maintenance state includes a good maintenance and a non-good maintenance.

9. The method according to claim 8, wherein: The maintenance status is determined based on one or more dimensions of light conditions, watering conditions, nutritional conditions and plant shape.

10. The method according to claim 1, further comprising: Output information to guide the user to upload an overall image of the plant and a partial image of the plant; as well as A rating of the plant in multiple dimensions is determined based on the overall image of the plant and the partial image of the plant.

11. The method according to claim 1, further comprising: determining a description and / or maintenance recommendation for each dimension's rating based on the rating for each dimension; as well as The rating for each dimension is presented, along with a description and / or maintenance recommendations.

12. The method according to claim 1, further comprising: In response to the health status of the plant being sub-healthy or unhealthy, determining a dimension having diagnostic significance among the multiple dimensions based on the ratings under the multiple dimensions; Determine relevant questions based on the dimensions with diagnostic significance, and generate an interactive questionnaire based on the relevant questions; and The interactive questionnaire is displayed.

13. A plant health status assessment device, comprising: Memory; as well as A processor coupled to the memory, configured to execute the method according to any one of claims 1 to 12 based on instructions stored in the memory.

14. A computer-readable storage medium comprising computer program instructions, wherein: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 12 is implemented.

15. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images