Method and apparatus for object classification

Abstract

The application provides a method and device for object classification, and relates to the field of computers. A user of the application selects a first object indicated by first information and a classification to which the first object indicated by the first information belongs through a gesture. In the case that the classification to which the first object indicated by the first information belongs selected by the user is incorrect, a first device displays a correct classification to which the first object belongs, and the first user can learn the correct classification of the first object. In the case that the classification to which the first object indicated by the first information belongs selected by the first user is correct, the first device displays the correct classification to which the first object belongs, and the first user can consolidate the correct classification of the first object. This human-computer interaction learning mode in which the user selects the classification to which the first object belongs through a gesture makes the user more involved in the learning process of object classification. The existing single and boring learning process is avoided, the interest point of the user is better stimulated, and the learning efficiency of knowledge related to object classification is improved.

Description

Technical Field

[0001] This application belongs to the field of computer science, and in particular relates to methods and apparatus for object classification. Background Technology

[0002] Currently, knowledge about object classification, especially garbage classification, is mostly disseminated to the public through text or pictures. This method is rather monotonous and tedious, with low learning efficiency, and fails to attract people to actively learn. Summary of the Invention

[0003] This application provides a method and apparatus for object classification, which can improve users' learning efficiency.

[0004] To achieve the above objectives, in a first aspect, embodiments of this application provide a method for object classification, which is applied to a first device, and the method includes:

[0005] Obtain the first spatial data of the first user's first posture;

[0006] The first spatial data is converted into first plane coordinate data of the first posture on the first device. Based on the first plane coordinate data, the first information selected by the first user is displayed. The first information is used to indicate the first object.

[0007] Obtain the second spatial data of the second pose of the first user;

[0008] The second spatial data is converted into second plane coordinate data of the second pose on the first device. Based on the second plane coordinate data, the selection result of the first object indicated by the first information is displayed. The selection result is used to indicate the category to which the first object selected by the first user belongs.

[0009] Determine whether the category to which the first object selected by the first user, as indicated by the selection results, belongs is correct;

[0010] If the category to which the first object selected by the first user belongs is correct, as indicated by the selection result, display the first information and the selection result of the first object indicated by the first information;

[0011] If the selection result indicates that the first object selected by the first user belongs to an incorrect category, display the first information and the correct category to which the first object belongs.

[0012] In the above scheme, the first device of this application can acquire first spatial data of the first user's first posture; convert the first spatial data into first planar coordinate data of the first posture on the device; and display the first information selected by the first user based on the first planar coordinate data; acquire second spatial data of the first user's second posture; convert the second spatial data into second planar coordinate data of the second posture on the device; and display the selection result of the first object indicated by the first information based on the second planar coordinate data; determine whether the category to which the first object selected by the first user belongs, as indicated by the selection result, is correct; if correct, the first device displays the first information and the selection result of the first object indicated by the first information; if incorrect, the first device displays the first information and the correct category to which the first object belongs. That is, the first user can select the first object indicated by the first information and the category to which the first object belongs based on their own posture; if the category to which the first object indicated by the first information belongs is incorrect, the first device can display the correct category to which the first object belongs, and the first user can know the correct category of the first object; if the category to which the first object indicated by the first information belongs is correct, the first device displays the correct category to which the first object belongs, and the first user can solidify the correct category of the first object. This human-computer interaction learning method, where users choose the category of the first object based on their own posture, makes the learning process of object classification more engaging. Avoiding the existing monotonous and tedious learning process, this application's learning process is more likely to stimulate user interest and improve the efficiency of learning object classification-related knowledge.

[0013] Optionally, converting the first spatial data into first plane coordinate data of the first posture on the first device includes: if the first spatial data of the first posture is the same as the spatial data of the first preset posture, then converting the first spatial data into first plane coordinate data of the first posture on the first device.

[0014] Optionally, converting the second spatial data into second pose coordinate data of the second plane of the first device includes:

[0015] If the second spatial data of the second posture is the same as the spatial data of the second preset posture, then the second spatial data is converted into the second plane coordinate data of the second posture on the first device.

[0016] Optionally, determining whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct includes:

[0017] Determine the first piece of information from the N pieces of information included in the standard object classification library, where N is a positive integer;

[0018] If the category to which the first object belongs, as indicated by the first information in the standard object classification library, is the same as the category to which the first object belongs, as indicated by the selection result, then it is determined that the category to which the first object selected by the first user belongs, as indicated by the selection result, is correct.

[0019] If the category to which the first object belongs, as indicated by the first information in the standard object classification library, is different from the category to which the first object belongs, as indicated by the selection result, then it is determined that the category to which the first object selected by the first user belongs is incorrect.

[0020] Optionally, the selection result is used to indicate the waste category to which the first object selected by the first user belongs. The standard object classification library also includes N reason information and the waste disposal process of N objects. The N reason information is used to indicate the reason for the waste category to which the N objects belong, and the N information is used to indicate the N objects. The method also includes:

[0021] Determine the cause information of the first object from among N cause information, and output the cause information of the first object;

[0022] Determine the waste disposal process for the first object in the waste disposal process of N objects, and output the waste disposal process for the first object.

[0023] Optionally, the waste disposal process for the first object includes at least one step, outputting the waste disposal process for the first object, including:

[0024] Display the first process and the corresponding triggering action in at least one process;

[0025] Receive the trigger action corresponding to the first user's first process;

[0026] If the trigger action corresponding to the first user's first process is the same as the trigger action corresponding to the displayed first process, display the trigger action corresponding to the second process in at least one process and the second process.

[0027] The first process and the second process are two consecutive processes in at least one process, and the processing of the first process precedes the processing of the second process.

[0028] Optionally, the method further includes:

[0029] Acquire the first image of the object to be identified;

[0030] Based on the features of the first image, second information of the object to be identified is determined, and the second information is used to indicate that the object to be identified is a second object;

[0031] Displays the category to which the second object belongs.

[0032] Optionally, the method further includes:

[0033] Acquire the 3D data of the object to be identified;

[0034] Based on the three-dimensional data, the third information of the object to be identified is determined. The third information is used to indicate that the object to be identified is a third object.

[0035] Displays the category to which the third object belongs.

[0036] Optionally, the first device includes a display screen, and the method further includes:

[0037] The categories to which the first user-selected M objects belong are displayed in the first display area of ​​the screen;

[0038] The user information of the first user and the first mode corresponding to the category of the M objects selected by the first user are displayed in the second display area of ​​the display screen. The M objects include the first object.

[0039] The score of the first user is determined based on the number of categories of L objects correctly selected by the first user and the first pattern. The M objects include the L objects, where M and L are positive integers, and L is less than or equal to M.

[0040] The score of the first user is displayed in the second display area.

[0041] Optionally, after displaying the first user's score in the second display area, the method further includes:

[0042] The first display area of ​​the screen displays the categories to which the M objects selected by the second user belong;

[0043] The second display area of ​​the screen displays the user information of the second user and the second mode corresponding to the categories of the M objects selected by the second user;

[0044] The score of the second user is determined based on the number of categories of the P objects correctly selected by the second user and the second pattern. The M objects include the P objects, where P is a positive integer and P is less than or equal to M.

[0045] The second user's score is displayed in the second display area;

[0046] The scores of the first user and the second user are sorted, and the sorted scores of the first user and the second user are displayed in the third display area of ​​the screen.

[0047] Secondly, embodiments of this application provide an object classification device, which includes a method for performing the first aspect or any of the embodiments described above.

[0048] Optionally, the device includes:

[0049] The acquisition unit is used to acquire the first spatial data of the first user's first pose.

[0050] The processing unit is used to convert the first spatial data into first planar coordinate data of the first posture on the first device, and display the first information selected by the first user based on the first planar coordinate data. The first information is used to indicate the first object.

[0051] The acquisition unit is further configured to acquire second spatial data of the second posture of the first user;

[0052] The processing unit is further configured to convert the second spatial data into second planar coordinate data of the second posture on the first device, and display the selection result of the first object indicated by the first information based on the second planar coordinate data. The selection result is used to indicate the category to which the first object selected by the first user belongs.

[0053] The determining unit is used to determine whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct;

[0054] The display unit is used to display first information and the selection result of the first object indicated by the first information if it is determined that the category to which the first object selected by the first user belongs is correct.

[0055] The display unit is further configured to, if it is determined that the first object selected by the first user as indicated by the selection result belongs to an incorrect category, display first information and the correct category to which the first object belongs as indicated by the first information.

[0056] Thirdly, embodiments of this application provide an object classification device, the device including a processor coupled to a memory, the processor being configured to execute a computer program or instructions stored in the memory to implement the method described in the first aspect or any embodiment of the first aspect.

[0057] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the method described in the first aspect or any embodiment of the first aspect. Attached Figure Description

[0058] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0059] Figure 1 This is a flowchart of the object classification method provided in the embodiments of this application;

[0060] Figure 2 This is a schematic diagram of selecting an object indicated by a certain information, provided in an embodiment of this application;

[0061] Figure 3 This is a schematic diagram illustrating the selection of the category to which an object indicated by a certain information belongs, provided in an embodiment of this application.

[0062] Figure 4 This is a schematic diagram of a first user selecting first information according to an embodiment of this application;

[0063] Figure 5 This is a schematic diagram illustrating the selection result of the first object indicated by the first information selected by the first user, as provided in an embodiment of this application.

[0064] Figure 6 This is a schematic diagram showing the first device when the first object belongs to the correct category, as provided in the embodiments of this application.

[0065] Figure 7 This is a schematic diagram showing the first device when the first object is classified incorrectly, as provided in the embodiments of this application.

[0066] Figure 8 This is a schematic diagram illustrating the categories to which M objects selected by user A in simple mode according to an embodiment of this application;

[0067] Figure 9 This is a schematic diagram illustrating the categories and scores of M objects selected by user A in simple mode, as provided in an embodiment of this application.

[0068] Figure 10 This is a schematic diagram illustrating the categories and scores of the M objects selected by user B in hard mode, as provided in an embodiment of this application.

[0069] Figure 11 This is a schematic diagram showing the sorting of scores for user A and user B, provided in an embodiment of this application.

[0070] Figure 12 A schematic diagram showing the categories to which the M objects selected by user A and user B respectively belong, as provided in this application;

[0071] Figure 13 This is a schematic diagram illustrating how to identify the category to which an object to be identified belongs, provided in an embodiment of this application.

[0072] Figure 14 This is a schematic diagram illustrating another classification of an object to be identified, provided in an embodiment of this application.

[0073] Figure 15 This is a schematic diagram of the structure of the object classification device provided in the embodiments of this application;

[0074] Figure 16 This is a schematic diagram of the structure of the object classification system provided in the embodiments of this application. Detailed Implementation

[0075] The technical solutions in the embodiments of this application will be described in detail below with reference to the embodiments of this application.

[0076] It should be understood that the methods, situations, categories, and classifications of embodiments in this application are only for the convenience of description and do not constitute any limitation on this application. Various methods, categories, situations, and features in the embodiments can be combined with each other without contradiction.

[0077] It should also be understood that the terms "first," "second," ..., "tenth" in the embodiments of this application are merely for distinction and do not constitute any limitation on this application. It should also be understood that in the various embodiments of this application, the sequence number of each process does not imply the execution order of the steps; the execution order of the steps is determined by their internal logic and does not constitute any limitation on the execution process of the embodiments of this application.

[0078] Currently, knowledge about object classification, especially garbage classification, is mostly disseminated to users in text form. This method is rather monotonous and tedious, with low learning efficiency, and fails to attract people to actively learn, especially primary and secondary school students.

[0079] Based on the problems in related technologies, this application proposes a method and apparatus for object classification. The method includes: acquiring first spatial data of a first user's first posture; converting the first spatial data into first planar coordinate data of the first posture on a device; displaying first information selected by the first user based on the first planar coordinate data, the first information indicating a first object; acquiring second spatial data of the first user's second posture; converting the second spatial data into second planar coordinate data of the second posture on a device; displaying the selection result of the first object indicated by the first information based on the second planar coordinate data, the selection result indicating the category to which the first object selected by the first user belongs; determining whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct; if the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct, displaying the first information and the selection result of the first object indicated by the first information; if the category to which the first object selected by the first user, as indicated by the selection result, belongs is incorrect, displaying the first information and the correct category to which the first object belongs, as indicated by the first information. The first user can select the first object indicated by the first information and its category through their own posture. If the first user selects an incorrect category, the first device can display the correct category, allowing the user to understand the correct category. If the first user selects a correct category, the first device displays the correct category, reinforcing the user's understanding of the correct category. This human-computer interaction learning method, where the user selects the category of the first object through their own posture, makes the learning process of object classification more engaging. Avoiding the existing monotonous and tedious learning process, this application's learning process is more likely to stimulate user interest and improve the efficiency of learning object classification-related knowledge.

[0080] The technical solutions of this application will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0081] In the scheme of this application, the first user can select the first object indicated by the first information on the first device through a first posture, or select the selection result of the first object indicated by the first information through a second posture. Before the first user makes a selection through posture, the first device executes the following optional scheme.

[0082] Optionally, the first device reads the configuration file of the motion-sensing interaction device; the first device connects to the motion-sensing interaction device according to the configuration file; and the first device calibrates the motion-sensing interaction device.

[0083] Optionally, the motion-sensing interaction device is a camera device capable of capturing various postures of the user.

[0084] For example, the device could be a 3D motion-sensing camera.

[0085] In the above scheme, the first device can acquire spatial data of various user postures through the motion-sensing interaction device. After calibrating the motion-sensing interaction device, the first device can acquire the corrected posture through the motion-sensing interaction device.

[0086] Optionally, the first device inputs spatial data of the first preset posture through a motion-sensing interaction device and displays the first preset posture, which is the posture of selecting an object. In this way, when the user wants to select an object, he / she can make the first preset posture.

[0087] For example, the first preset posture is the gesture of making a heart shape with the hands or the gesture of making a peace sign with the hands.

[0088] Optionally, the first device inputs spatial data of the second preset posture through a motion-sensing interaction device and displays the second preset posture. The second preset posture is a posture for selecting a certain category to which an object belongs. In this way, when a user wants to select a certain category to which an object belongs, they can perform the second preset posture.

[0089] For example, the second preset posture is a posture with the palm open, or a posture with only the index finger extended while the other four fingers are clenched into a fist, or a posture with the hand clenched into a fist.

[0090] Optionally, the first device displays a first range, which is the spatial range for acquiring the posture of the first user.

[0091] In the above scheme, the first device displays a first range, allowing the user to know within what range the user can select the first object indicated by the first information by gesture and the selection result of the first object indicated by the first information.

[0092] Figure 1 This is a flowchart illustrating the object classification method provided in an embodiment of this application, as shown below. Figure 1 As shown, the method is applied to a first device, and the method includes the following steps:

[0093] S110, the first device acquires the first spatial data of the first user's first posture.

[0094] Optionally, the first device in S110 may be a terminal device.

[0095] Alternatively, the terminal device can be any of a mobile phone, computer, or tablet computer.

[0096] Optionally, the motion-sensing interaction device is a camera device capable of capturing various postures of the user.

[0097] For example, the device could be a 3D motion-sensing camera.

[0098] Optionally, before S110, when the first user needs to select the first object indicated by the first information on the first device, the first user can perform the same posture as the first preset posture at the spatial position corresponding to the first object indicated by the first information within the first range.

[0099] It should be understood that when the first user needs to select an object indicated by other information on the first device, the first user can make the same posture as the first preset posture by the spatial position corresponding to the other object indicated by other information within the first range.

[0100] For example, such as Figure 2 As shown, the first object indicated by the first information displayed on the first device is a banana, and the second object indicated by the second information is a battery. The first user can select the banana by making a heart shape with their hands at spatial position A corresponding to the banana; or, they can select the battery by making a heart shape with their hands at spatial position B corresponding to the battery.

[0101] Optionally, prior to S110, the motion-sensing interaction device acquires the first spatial data of the first user's first posture; the motion-sensing interaction device then sends the first spatial data of the first posture to the first device.

[0102] S120, the first device converts the first spatial data into first plane coordinate data of the first posture on the first device; the first device displays the first information selected by the first user based on the first plane coordinate data, the first information being used to indicate the first object.

[0103] Optionally, the first device converts the first spatial data into first orientation coordinate data of the first plane on the first device, including: the first device converts the first spatial data into first orientation coordinate data of the first plane on the first device according to the principle of similar triangles.

[0104] Optionally, the first device converts the first spatial data into first plane coordinate data of the first posture on the first device, including: if the first spatial data of the first posture is the same as the spatial data of the first preset posture, then the first device converts the first spatial data into first plane coordinate data of the first posture on the first device.

[0105] Optionally, if the first spatial data of the first posture is different from the spatial data of the first preset posture, the first device deletes the first spatial data of the first posture.

[0106] Optionally, the first device displays the first information selected by the first user based on the first planar coordinate data, including: if the first planar coordinate data is close to the coordinate data of the first object indicated by the first information on the first device, then the first device displays the first information selected by the first user.

[0107] For example, the first plane coordinate data is (4, 9), the coordinate data of the first object indicated by the first information on the first device is (3.9, 9.3), and the first threshold is 0.2. According to the formula for the distance between two points, the distance between (4, 9) and (3.9, 9.3) is calculated to be 0.1. Since 0.1 < 0.2, the first device displays the first object indicated by the first information.

[0108] S130, the first device acquires the second spatial data of the second posture of the first user.

[0109] For example, the second posture in S130 is the posture with the palm open.

[0110] It should be understood that this scheme does not limit the second posture, and the first posture can also be a posture in which only the index finger is extended and the other four fingers are clenched into a fist or a posture in which the hand is clenched into a fist.

[0111] Optionally, prior to S130, when the first user needs to select from multiple categories to which the first object belongs, as indicated by the first information on the first device, the first user can perform the same posture as the second preset posture at the spatial position corresponding to the category to which the selected first object belongs within the first range.

[0112] For example, such as Figure 3 As shown, the first information displayed on the first device indicates that the banana belongs to multiple categories, namely fruit, snack and vegetable. The first user can select the fruit category by making an open palm gesture at the spatial position C corresponding to fruit; or, the first user can select the snack category by making an open palm gesture at the spatial position D corresponding to snack; or, the first user can select the vegetable category by making an open palm gesture at the spatial position E corresponding to vegetable.

[0113] Optionally, prior to S110, the motion-sensing interaction device acquires the second spatial data of the second posture of the first user; the motion-sensing interaction device then sends the second spatial data of the second posture to the first device.

[0114] Optionally, the motion-sensing interaction device is a camera device capable of capturing various postures of the user.

[0115] For example, the device could be a 3D motion-sensing camera.

[0116] S140, the first device converts the second spatial data into second planar coordinate data of the second posture on the first device; the first device displays the selection result of the first object indicated by the first information according to the second planar coordinate data, and the selection result is used to indicate the category to which the first object selected by the first user belongs.

[0117] Optionally, the first device converts the second spatial data into second pose coordinate data of the second plane on the first device, including: the first device converts the second spatial data into second pose coordinate data of the second plane on the first device according to the principle of similar triangles.

[0118] Optionally, the first device converts the second spatial data into second planar coordinate data of the second posture on the first device, including: if the second spatial data of the second posture is the same as the spatial data of the second preset posture, then the first device converts the second spatial data into second planar coordinate data of the second posture on the first device.

[0119] Optionally, the second preset posture can be the same as the first preset posture.

[0120] Optionally, if the second spatial data of the second posture is different from the spatial data of the second preset posture, the first device deletes the second spatial data of the second posture.

[0121] Optionally, the first device displays the selection result of the first object indicated by the first information based on the second plane coordinate data, including: if the second plane coordinate data is close to the coordinate data of the selection result of the first object indicated by the first information on the first device, then the first device displays the selection result of the first object indicated by the first information.

[0122] For example, the second plane coordinate data is (6, 10), the coordinate data of the first object selection result indicated by the first information on the first device is (6, 10.2), and the second threshold is 0.2. According to the formula for the distance between two points, the distance between (6, 10) and (6, 10.2) is calculated to be 0.04. Since 0.04 < 0.2, the first device displays the selection result of the first object indicated by the first information.

[0123] To better understand the solution of this application, the following is an example description of the selection result of the first object indicated by the first information.

[0124] The first posture is making a heart shape with your hands, and the second posture is having your palms open. Figure 4 and Figure 5 Both provide schematic diagrams illustrating the interaction between the first device and the first user. Figure 4 and Figure 5 In the first information, the first object is a banana. The banana can be categorized as snack, fruit, or sports. The second information indicates a battery, which can be categorized as hazardous, kitchen waste, or recyclable.

[0125] exist Figure 4In the first information, the planar coordinate data of the banana indicated on the first device is (a1, a2), and the first threshold is l0. After the first device obtains the first spatial data of the first user's hand gesture of making a heart shape, it converts the first spatial data into the first planar coordinate data of the hand gesture of making a heart shape on the first device as (a3, a4); the first device determines that the distance between (a1, a2) and (a3, a4) is l1.

[0126] Based on a1=3, a2=4, l0=0.5, a3=3.2, and a4=4, we can deduce that l1 is 0.04. Since 0.04 is less than 0.5, the first device displays the first information selected by the first user as "banana," with the word "banana" in bold.

[0127] exist Figure 5 In the first information, the banana selection result is the planar coordinate data of the fruit on the first device as (b1, b2), and the second threshold is l2. After the first device obtains the second spatial data of the first user's open palm posture, it converts the second spatial data into the planar coordinate data of the open palm posture on the first device as (b3, b4); the first device determines the distance between (a1, a2) and (a3, a4) as l3.

[0128] Based on b1=6, b2=7, l2=0.4, a3=6.5, and a4=7.2, l3 is calculated to be 0.29. Since 0.29 is less than 0.4, the first device displays the banana selection result indicated by the first information as "Fruit," with the word "Fruit" in bold.

[0129] S150, the first device determines whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct.

[0130] Optionally, S150 includes: the first device determining first information from N pieces of information included in the standard object classification library; if the classification of the first object indicated by the first information in the standard object classification library is the same as the classification of the first object indicated by the selection result, then the first device determines that the classification of the first object selected by the first user indicated by the selection result is correct; if the classification of the first object indicated by the first information in the standard object classification library is different from the classification of the first object indicated by the selection result, then the first device determines that the classification of the first object selected by the first user indicated by the selection result is incorrect, where N is a positive integer.

[0131] Optionally, the standard object classification library can be stored in the first device, or the standard object classification library can be obtained by the first device from the server.

[0132] To better understand the technical solution of this application, Table 1 is a standard object classification library provided by this application. As shown in Table 1, N is 10. The specific content of the 10 objects indicated by the 10 pieces of information in Table 1 can be derived from the content in parentheses after the information. For example, for the first piece of information in the 10 pieces of information, the first object indicated by the first piece of information is glass, and the glass indicated by the first piece of information belongs to the recyclable category; for the chocolate indicated by the ninth piece of information in the 10 pieces of information, the chocolate indicated by the first piece of information belongs to the snack category.

[0133] Table 1

[0134] information To which category (or class) does it belong? First Information (Glass) Recyclable Second information (battery) harmful Third Information (Vegetables) kitchen waste Fourth Message (Banana) fruit Fifth piece of information (racket) sports Sixth Information (Paper) Stationery Seventh Message (Water) regeneration Eighth Message (Coat) apparel Ninth Message (Chocolate) snack 10th Item (Juicer) Electrical appliances

[0135] Example 1: When the first information indicates that the first object is a coat, and the selection result indicates that the coat selected by the first user belongs to the clothing category, the first information is determined from the 10 pieces of information included in Table 1. If the clothing category of the coat indicated by the first information in Table 1 is different from the clothing category of the coat selected by the first user as indicated in the selection result, then the first device determines that the category of the coat selected by the first user as indicated in the selection result is correct.

[0136] Example 2: When the first information indicates that the first object is a coat, and the selection result indicates that the coat selected by the first user belongs to the category of electrical appliances, the first information is determined from the 10 pieces of information included in Table 1. If the category of clothing to which the first information in Table 1 belongs is different from the category of electrical appliances to which the coat selected by the first user belongs as indicated in the selection result, then the first device has incorrectly determined the category to which the coat selected by the first user belongs as indicated in the selection result.

[0137] S160, if the category to which the first object selected by the first user belongs is correct, as indicated by the selection result, the first device displays the first information and the selection result of the first object indicated by the first information.

[0138] For example, if the selection result in Example 1 indicates that the first user's selected coat belongs to the correct clothing category, Figure 6 A schematic diagram is given of the first information displayed by the first device and the selection result of the coat indicated by the first information.

[0139] S170, if the selection result indicates that the first object selected by the first user belongs to an incorrect category, the first device displays first information and the correct category to which the first object belongs, as indicated by the first information.

[0140] The correct classification of the first object indicated by the first information refers to the classification of the first object indicated by the first information in the standard object classification library.

[0141] For example, in the case where the selection result in Example 2 indicates that the first user's selected coat belongs to an incorrect appliance category, Figure 7 A diagram is provided showing the first information displayed by the first device and the correct clothing category to which the coat belongs, as indicated by the first information.

[0142] Optionally, the selection result is used to indicate the waste classification to which the first object selected by the first user belongs. The standard object classification library also includes N reason information and N object waste treatment processes. The N reason information is used to indicate the reasons for the waste classification to which the N objects belong. The N information is used to indicate the N objects. The method further includes: the first device determining the reason information of the first object from the N reason information and outputting the reason information of the first object; the first device determining the waste treatment process of the first object in the waste treatment process of the N objects and outputting the waste treatment process of the first object.

[0143] Optionally, the first device determines the cause information of the first object from N cause information and outputs the cause information of the first object, including: the first device determines the cause information of the first object from N cause information; the first device displays the cause information of the first object, and / or the first device outputs the cause information of the first object verbally.

[0144] Optionally, the first device determines the waste disposal process of the first object during the waste disposal process of N objects, and outputs the waste disposal process of the first object, including: the first device determines the waste disposal process of the first object during the waste disposal process of N objects; the first device displays the waste disposal process of the first object, and / or, the first device outputs the waste disposal process of the first object via voice.

[0145] To better understand the technical solution of this application, Table 2 is the standard object classification library provided by this application. As shown in Table 2, N is 10. From the contents in parentheses after the 10 pieces of information in Table 2, we can derive the 10 objects indicated by the 10 pieces of information, the waste classification to which the 10 objects indicated by the 10 pieces of information belong, the 10 reason information, and the waste disposal process of the 10 objects indicated by the 10 pieces of information. For example, regarding the second piece of information in the 10 pieces of information; the second object indicated by the second piece of information is a battery; the waste classification to which the battery belongs is hazardous waste; the reason information for the battery belonging to the hazardous waste classification is that the battery contains heavy metals, which are harmful to water sources or air; the waste disposal process of the battery is collection-sorting and storage-harmless disposal.

[0146] Table 2

[0147]

[0148]

[0149] The first object indicated by the first information is vegetable leaves. The first device determines from 10 possible cause information that the vegetable leaves are waste generated after cooking, and that after processing, they can be used as fuel for power generation; the first device displays and verbally outputs the cause information for the vegetable leaves. The first device determines the waste processing process for the vegetable leaves from the waste processing of the 10 objects; the first device displays and verbally outputs the waste processing process for the vegetable leaves.

[0150] Optionally, the waste disposal process of the first object includes at least one process, and the first device outputs the waste disposal process of the first object, including: the first device displays a first process and a trigger action corresponding to the first process in at least one process; the first device receives the trigger action corresponding to the first process from the first user; if the trigger action corresponding to the first process from the first user is the same as the trigger action corresponding to the first process displayed, the first device displays a second process and a trigger action corresponding to the second process in at least one process; wherein the first process and the second process are two consecutive processes in at least one process, and the processing of the first process precedes the processing of the second process.

[0151] It should be understood that the first process and the first flow are any two consecutive processes in the waste disposal process of the first object.

[0152] Optionally, the first device outputs the waste disposal process of the first object, including: the first device displays at least one process, including a first process and a corresponding trigger action; the first device receives a trigger action corresponding to the first process from a first user; if the trigger action corresponding to the first process from the first user is the same as the trigger action corresponding to the displayed first process, the first device displays a second process and a trigger action corresponding to the second process; the first device receives a trigger action corresponding to the second process from the first user; if the trigger action corresponding to the second process from the first user is the same as the trigger action corresponding to the displayed second process, the first device displays a third process and a trigger action corresponding to the third process, and so on, until the first device displays the last process in at least one process.

[0153] Optionally, when the first device determines that the trigger action corresponding to the first user's first process is different from the trigger action corresponding to the displayed first process, the first device does not respond to the trigger action corresponding to the first user's first process. The first device only responds when the trigger action corresponding to the first process of the first user within a preset time is the same as the trigger action corresponding to the displayed first process. If the trigger action corresponding to the first process of the first user within the preset time is the same as the trigger action corresponding to the displayed first process, the first device exits the output process of the waste disposal process for the first object.

[0154] It should be understood that the solution implemented by the first device after determining that the trigger action corresponding to the first user's second process is different from the trigger action corresponding to the displayed second process is similar to the solution implemented by the first device after determining that the trigger action corresponding to the first user's first process is different from the trigger action corresponding to the displayed first process. Further details will not be elaborated here.

[0155] To better understand the technical solution of this application, the following is an example description of a first device displaying at least one process and the corresponding triggering action in a process.

[0156] The first object indicated by the first information is pesticide. The pesticide waste disposal process includes at least one step, specifically collection, sorting and storage, and harmless disposal. The first step is collection, the second step is sorting and storage, and the third step is harmless disposal. The triggering action for the first step is a two-footed jumping motion, and the triggering action for the second step is a rotating motion. The triggering action for the first user's collection step is a two-footed jumping motion, and the triggering action for the first user's sorting and storage step is a rotating motion.

[0157] The first device displays the collection process and the corresponding double-foot jumping motion in the pesticide waste treatment process. When the first device receives the double-foot jumping motion corresponding to the first user's collection process, it determines whether the motion is the same as the double-foot jumping motion corresponding to the displayed collection process. If they are the same, the first device displays the sorting and storage process and the corresponding rotation motion in the pesticide waste treatment process. When the first device receives the rotation motion corresponding to the first user's sorting and storage process, it determines whether the motion is the same as the rotation motion corresponding to the displayed sorting and storage process. If they are the same, the first device displays the harmless disposal process in the pesticide waste treatment process.

[0158] Optionally, the first device includes a display screen, and the method further includes: the first device displaying the categories to which the M objects selected by the first user belong in a first display area of ​​the display screen; the first device displaying the user information of the first user and a first mode corresponding to the categories to which the M objects selected by the first user belong in a second display area of ​​the display screen, wherein the M objects include the first object; the first device determining the score of the first user based on the number of categories of the L objects correctly selected by the first user and the first mode, wherein the M objects include the L objects, M and L are positive integers, and L is less than or equal to M; and the first device displaying the score of the first user in the second display area.

[0159] Optionally, the first mode is used to indicate to the first user how easy it is to select the correct category to which each of the M objects belongs.

[0160] Optionally, the difficulty of selecting the correct category to which an object belongs can be measured by a score or by the time given when selecting the category to which each of the M objects belongs.

[0161] Optionally, in the first mode, each object correctly selected by the first user has the same score for the category to which it belongs.

[0162] Optionally, the first mode is either easy mode or hard mode.

[0163] It should be understood that in the easy mode, it is easier for the first user to select the correct category for each of the M objects than in the hard mode. The score for each category correctly selected by the user in the easy mode is lower than the score for each category correctly selected by the user in the hard mode.

[0164] Optionally, the first device determines the first user's score based on the number of categories of the L objects correctly selected by the first user and the first mode, including: the first device multiplies the number of categories of the L objects correctly selected by the first user with the score of the category to which each object correctly selected by the first user belongs in the first mode to obtain the first user's score.

[0165] To better understand the technical solution of this application, Figure 8 This is a schematic diagram showing the category to which each of the M objects selected by the first user in simple mode belongs, as provided in this application.

[0166] M is 5, the first user's information is user A, and the first mode is simple mode. For example... Figure 8 As shown, the second display area displays the information of the first user, User A, and the first display mode is simple mode. In simple mode, the scores of each category to which User A correctly selects each object are the same, and the score of each category to which User A correctly selects each object is 4 points. The first display area displays the categories to which the five objects indicated by the five pieces of information belong. Among them, the scores of the objects with underlines are the scores of the objects selected by User A. The content of the right part of the first display area is the five objects indicated by the five pieces of information and the correct categories to which the five objects belong.

[0167] exist Figure 8In the first display area, the first device compares the clothing category of the coat selected by user A with the clothing category of the coat shown on the right. If the clothing category of the coat selected by user A matches the clothing category of the coat shown on the right, the number of categories of the correctly selected object is incremented by 1. This process is repeated until the correctness of the categories of the 5 objects selected by user A in the first display area is determined. The number of categories of objects correctly selected by user A is 3. Based on the product of the score of each correctly selected category and the number of correctly selected categories in simple mode (3 * 4), user A's score is 12. User A's score is then displayed as shown in the image. Figure 9 The second display area is shown.

[0168] The above scheme describes the categories to which the M objects selected by the first user belong. The following discussion addresses the scheme for categories to which the M objects selected by multiple users belong, considering different scenarios.

[0169] In scenario one, after displaying the categories of the M objects selected by the first user in the first display area, and then displaying the first user's score in the second display area, the categories of the M objects selected by the second user are displayed in the first display area. It should be understood that the categories of the M objects selected by the second user overlap with the categories of the M objects selected by the first user.

[0170] Optionally, after displaying the first user's score in the second display area, the method further includes: the first device displaying the categories to which the M objects selected by the second user belong in the first display area of ​​the display screen; the first device displaying the second user's user information and the second mode corresponding to the categories to which the M objects selected by the second user belong in the second display area of ​​the display screen; the first device determining the second user's score based on the number of categories of the P objects correctly selected by the second user and the second mode, where the M objects include P objects, P is a positive integer, and P is less than or equal to M; the first device displaying the second user's score in the second display area; and the first device sorting the scores of the first user and the second user, and displaying the sorted scores of the first user and the second user in the third display area of ​​the display screen.

[0171] In the above scheme, it is equivalent to displaying the categories of M objects selected by different users in the first display area at different times.

[0172] Optionally, the first device determines the second user's score based on the number of categories of the P objects correctly selected by the second user and the second mode, including: the first device multiplies the number of categories of the P objects correctly selected by the second user with the score of the category to which each object correctly selected by the second user belongs in the second mode to obtain the second user's score.

[0173] For example, the second user is user B, and the second mode is the hard mode. Figure 10 This diagram illustrates the categories to which the M objects selected by user B belong, and user B's score. M is 5, the number of categories correctly selected by user B is P, which is 3, and the score for each correctly selected object in the hard mode is 5 points. Based on the scores for each correctly selected object in the hard mode and the number of categories correctly selected by user B (P, i.e., 3*5), user B's score is 15.

[0174] Optionally, the first device sorts the scores of the first user and the second user, and displays the sorted scores of the first user and the second user in a third display area of ​​the display screen, including: the first device sorts the scores of the first user and the second user in descending order of scores, and displays the sorted scores of the first user and the second user in a third display area of ​​the display screen.

[0175] For example, the first user is user A, whose score is 12 points, and the second user is user B, whose score is 15 points. Figure 11 This is a schematic diagram showing the sorted scores of user A and user B in the third display area provided in this application. From... Figure 11 The data clearly shows that user B's score is higher than user A's score.

[0176] In scenario two, the first display area at the first moment displays the categories to which the M objects selected by the first user belong, and the fifth display area at the first moment displays the categories to which the M objects selected by the second user belong.

[0177] Optionally, the first device includes a display screen, and the method further includes: the first device displaying the categories to which the M objects selected by the second user belong in a fourth display area of ​​the display screen; the first device displaying the user information of the second user and a second mode corresponding to the categories to which the M objects selected by the second user belong in a fifth display area of ​​the display screen; the first device determining the score of the second user based on the number of categories of the P objects correctly selected by the second user and the second mode, wherein the M objects include P objects, P is a positive integer, and P is less than or equal to M; the first device displaying the score of the second user in the fifth display area; and the first device sorting the scores of the first user and the second user, and displaying the sorted scores of the first user and the second user in a third display area of ​​the display screen.

[0178] In the above scheme, it is equivalent to using the split-screen function of the first device to display the categories of M objects selected by different users in different display areas at the same time.

[0179] It should be understood that the display area of ​​the screen in the above scheme can also be a sixth display area and a seventh display area. The sixth display area can display the categories to which the M objects selected by the third user belong, the seventh display area can display the user information of the third user and the third mode corresponding to the categories to which the M objects selected by the third user belong, and the seventh display area can display the score of the third user.

[0180] For example, M is 5, the first user is user A, and user A selects the simple mode. In simple mode, user A scores 4 points for each category of the object correctly selected. Based on the categories of the 5 objects indicated by the 5 pieces of information selected by user A in the first display area, and the categories of the 5 objects indicated by the 5 pieces of information displayed in the right part of the second display area, the first device obtains that user A correctly selected 3 categories of objects. Based on the product of the number of categories of objects correctly selected by user A and the score of each category of the object correctly selected by user A in simple mode, user A's score is 12 points. The second user is user B, and user B selects the hard mode. In hard mode, user B scores 5 points for each category of the object correctly selected. Based on the categories of the 5 objects indicated by the 5 pieces of information selected by user B in the fourth display area, and the categories of the 5 objects indicated by the 5 pieces of information displayed in the right part of the fourth display area, the first device obtains that user B correctly selected 3 categories of objects. User B's score is 15 points, calculated by multiplying the number of object categories correctly selected by User B by the score of each category to which User B correctly selected each object in the hard mode. Figure 12 A schematic diagram showing the categories to which the five objects selected by User A and User B respectively belong, as provided in this application.

[0181] Optionally, the method further includes: a first device acquiring a first image of the object to be identified; the first device determining second information of the object to be identified based on features of the first image, the second information being used to indicate that the object to be identified is a second object; and the first device displaying the category to which the second object belongs.

[0182] Optionally, the first device determines the second information of the object to be identified based on the features of the first image, including: the first device comparing the features of the first image with the image features of the second object; if the features are the same as the image features of the second object, then the object to be identified is determined to be the second object.

[0183] Optionally, before the first device displays the category to which the second object belongs, the method further includes: the first device determining the category to which the second object belongs in a standard object classification library; and the first device displaying the category to which the second object belongs.

[0184] It should be understood that the above-mentioned scheme of acquiring an image of the object to be identified by the first device and extracting features from the image to identify the object is a parallel scheme to S110 to S170.

[0185] For example, Figure 13 A schematic diagram is given showing how the first device determines the classification of an object to be identified based on an image of the object. For example... Figure 13 As shown, the first device acquires a first image of the object to be identified, compares the features of the first image with the features of a pre-stored banana image, and determines that the object to be identified is a banana.

[0186] Optionally, the method further includes: a first device acquiring three-dimensional data of the object to be identified; the first device determining third information of the object to be identified based on the three-dimensional data, the third information being used to indicate that the object to be identified is a third object; and the first device displaying the category to which the third object belongs.

[0187] Alternatively, the 3D data can be 3D point cloud data.

[0188] Optionally, the first device determines the third information of the object to be identified based on the three-dimensional data, including: the first device comparing the three-dimensional data with the three-dimensional data of the third object; if the three-dimensional data is the same as the three-dimensional data of the third object, then the object to be identified is determined to be the third object.

[0189] Optionally, before the first device displays the category to which the third object belongs, the method further includes: the first device determining the category to which the third object belongs in a standard object classification library; and the first device displaying the category to which the third object belongs.

[0190] It should be understood that the above-mentioned scheme of the first device acquiring three-dimensional data of the object to be identified and identifying the object based on the three-dimensional data features of the object to be identified, and the scheme of the first device acquiring an image of the object to be identified and extracting features from the image to identify the object to be identified, and S110 to S170 are parallel schemes.

[0191] For example, Figure 14 A schematic diagram is provided showing how the first device determines the classification of an object based on its 3D data. For example... Figure 14 As shown, the first device acquires the three-dimensional data of the object to be identified, compares the three-dimensional data with the pre-stored three-dimensional data of a banana, and determines that the object to be identified is a banana.

[0192] Figure 15 This is a schematic diagram of the structure of an object classification device provided in an embodiment of this application. This device is used to implement the method in any of the embodiments described above. Figure 15 As shown, the device provided in this embodiment includes:

[0193] Acquisition unit 151 is used to acquire the first spatial data of the first user's first pose.

[0194] The processing unit 152 is used to convert the first spatial data into first planar coordinate data of the first posture on the first device, and display the first information selected by the first user based on the first planar coordinate data. The first information is used to indicate the first object.

[0195] The acquisition unit 151 is also used to acquire second spatial data of the second posture of the first user.

[0196] The processing unit 152 is further configured to convert the second spatial data into second planar coordinate data of the second posture on the first device, and display the selection result of the first object indicated by the first information based on the second planar coordinate data. The selection result is used to indicate the category to which the first object selected by the first user belongs.

[0197] The determining unit 153 is used to determine whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct.

[0198] The display unit 154 is also configured to display first information and the selection result of the first object indicated by the first information if the category to which the first object selected by the first user belongs is correct, as indicated by the selection result.

[0199] The display unit 154 is also configured to display first information and the correct category to which the first object belongs if the first object selected by the first user, as indicated by the selection result, belongs to an incorrect category.

[0200] The processing unit 152 is specifically used to convert the first spatial data into the first plane coordinate data of the first posture on the first device if the first spatial data of the first posture is the same as the spatial data of the first preset posture.

[0201] The processing unit 152 is further configured to convert the second spatial data into second planar coordinate data of the second posture on the first device if the second spatial data of the second posture is the same as the spatial data of the second preset posture.

[0202] Optionally, the determining unit 153 is specifically used to determine first information from N pieces of information included in the standard object classification library, where N is a positive integer; if the classification to which the first object indicated by the first information in the standard object classification library belongs is the same as the classification to which the first object indicated by the selection result belongs, then it is determined that the classification to which the first object selected by the first user indicated by the selection result belongs is correct; if the classification to which the first object indicated by the first information in the standard object classification library belongs is different from the classification to which the first object indicated by the selection result belongs, then it is determined that the classification to which the first object selected by the first user indicated by the selection result belongs is incorrect.

[0203] Optionally, the selection result is used to indicate the waste classification to which the first object selected by the first user belongs. The standard object classification library also includes N reason information and the waste treatment process of N objects. The N reason information is used to indicate the reason for the waste classification to which the N objects belong. The N information is used to indicate the N objects. The determining unit 153 is also used to determine the reason information of the first object from the N reason information.

[0204] Optionally, the device also includes an output unit 155 for outputting the waste disposal process of the first object.

[0205] Optionally, the waste disposal process of the first object includes at least one process. The output unit 155 is specifically used to display the first process and the trigger action corresponding to the first process in the at least one process; receive the trigger action corresponding to the first process of the first user; if the trigger action corresponding to the first process of the first user is the same as the trigger action corresponding to the first process displayed, display the trigger action corresponding to the second process in the at least one process; wherein, the first process and the second process are two consecutive processes in the at least one process, and the processing of the first process is before the processing of the second process.

[0206] Optionally, the acquisition unit 151 is further configured to acquire a first image of the object to be identified.

[0207] Optionally, the processing unit 152 is further configured to determine second information of the object to be identified based on the features of the first image, the second information being used to indicate that the object to be identified is a second object; and to display the category to which the second object belongs.

[0208] Optionally, the acquisition unit 151 is further configured to acquire three-dimensional data of the object to be identified;

[0209] Optionally, the processing unit 152 is further configured to determine third information of the object to be identified based on the three-dimensional data, the third information being used to indicate that the object to be identified is a third object; and to display the category to which the third object belongs.

[0210] Optionally, the first device includes a display screen, and the display unit 154 is further configured to display the categories to which the M objects selected by the first user belong in a first display area of ​​the display screen; and to display the user information of the first user and a first mode corresponding to the categories to which the M objects selected by the first user belong in a second display area of ​​the display screen, wherein the M objects include the first object.

[0211] Optionally, the determining unit 153 is further configured to determine the score of the first user based on the number of categories of the L objects correctly selected by the first user and the first pattern, wherein the M objects include the L objects, M and L are positive integers, and L is less than or equal to M.

[0212] Optionally, the display unit 154 is also configured to display the score of the first user in the second display area.

[0213] Optionally, after displaying the first user's score in the second display area, the display unit 134 is further configured to display the categories to which the M objects selected by the second user belong in the first display area of ​​the display screen; and to display the user information of the second user and the second mode corresponding to the categories to which the M objects selected by the second user belong in the second display area of ​​the display screen.

[0214] Optionally, the determining unit 153 is further configured to determine the score of the second user based on the number of categories of the P objects correctly selected by the second user and the second mode, wherein the M objects include the P objects, P is a positive integer, and P is less than or equal to M.

[0215] Optionally, the display unit 154 is also used to display the score of the second user in the second display area.

[0216] Optionally, the processing unit 152 is further configured to sort the scores of the first user and the second user, and display the sorted scores of the first user and the second user in a third display area of ​​the display screen.

[0217] Figure 16 A schematic diagram of the structure of the object classification system provided in the embodiments of this application is shown below. Figure 16 As shown, the system includes a motion-sensing interaction device 161 and, as shown, ... Figure 15 The object classification device 162 shown is connected to the motion-sensing interaction device 161. The motion-sensing interaction device 161 is used to acquire first spatial data of a first user's first posture and send the first spatial data of the first posture to the object classification device 162. The motion-sensing interaction device 161 is also used to acquire second spatial data of a second user's second posture and send the second spatial data of the second posture to the object classification device 162.

[0218] When the object classification device 162 is a computer and the motion-sensing interaction device 161 is a 3D motion-sensing camera, such as Figure 16 As shown, the 3D motion-sensing camera is used to acquire the first spatial data of the first user's first posture and send the first spatial data of the first posture to the computer; the 3D motion-sensing camera is also used to acquire the second spatial data of the first user's second state and send the second spatial data of the second state to the computer; the computer is used to execute S110 to S170 and optional schemes related to S110 to S170.

[0219] Optionally, the system also includes a speaker 163, which is used to output voice information about the cause of the first object and the waste disposal process of the first object, wherein the first object is selected by the first user through first spatial data of a first posture.

[0220] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0221] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the method of the first aspect or any embodiment of the first aspect described above.

[0222] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a device. Based on this understanding, all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer chip, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0223] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0224] In the embodiments provided in this application, it should be understood that the disclosed apparatus / devices and methods can be implemented in other ways. For example, the apparatus / device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0225] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0226] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0227] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for classifying objects, characterized in that, The method is applied to a first device, which reads the configuration file of the motion-sensing interaction device. The first device connects to the motion-sensing interaction device according to a configuration file, and the method includes: First spatial data of the first user's first posture is obtained through a motion-sensing interaction device; The first spatial data is converted into first planar coordinate data of the first posture on the first device. Based on the first planar coordinate data, the first information selected by the first user is displayed. The first information is used to indicate the first object. Second spatial data of the second posture of the first user are obtained through a motion-sensing interaction device; The second spatial data is converted into second planar coordinate data of the second pose in the first device. Based on the second planar coordinate data, the selection result of the first object indicated by the first information is displayed. The selection result is used to indicate the category to which the first object selected by the first user belongs. Determining whether the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct includes: determining the first information from N pieces of information included in the standard object classification library, where N is a positive integer; if the category to which the first object belongs, as indicated by the first information in the standard object classification library, is the same as the category to which the first object belongs, as indicated by the selection result, then the category to which the first object selected by the first user, as indicated by the selection result, belongs is correct; if the category to which the first object belongs, as indicated by the first information in the standard object classification library, is different from the category to which the first object belongs, then the category to which the first object selected by the first user, as indicated by the selection result, belongs is incorrect. If it is determined that the category to which the first object selected by the first user belongs is correct, as indicated by the selection result, the first information and the selection result of the first object indicated by the first information are displayed; If it is determined that the category to which the first object selected by the first user belongs is incorrect, as indicated by the selection result, the first information and the correct category to which the first object belongs, as indicated by the first information, are displayed. The standard object classification library also includes N reason information and the waste disposal process for N objects. The N reason information are used to indicate the reason for the waste classification to which the N objects belong. The N information are used to indicate the N objects. The method further includes: Determining the cause information of the first object from the N cause information and outputting the cause information of the first object includes: displaying a first process in at least one process and the trigger action corresponding to the first process; receiving the trigger action corresponding to the first process of the first user; if the trigger action corresponding to the first process of the first user is the same as the trigger action corresponding to the first process displayed, displaying a second process in the at least one process and the trigger action corresponding to the second process; wherein, the first process and the second process are two consecutive processes in the at least one process, and the processing of the first process precedes the processing of the second process; During the waste disposal process of the N objects, determine the waste disposal process of the first object and output the waste disposal process of the first object; Acquire the first image of the object to be identified; Based on the features of the first image, second information of the object to be identified is determined, and the second information is used to indicate that the object to be identified is a second object; This displays the category to which the second object belongs.

2. The method as described in claim 1, characterized in that, The step of converting the first spatial data into the first plane coordinate data of the first pose on the first device includes: If the first spatial data of the first posture is the same as the spatial data of the first preset posture, then the first spatial data is converted into the first plane coordinate data of the first posture in the first device; The conversion of the second spatial data into second plane coordinate data of the second pose in the first device includes: If the second spatial data of the second posture is the same as the spatial data of the second preset posture, then the second spatial data is converted into the second plane coordinate data of the second posture in the first device.

3. The method as described in claim 1 or 2, characterized in that, The method further includes: Acquire the first image of the object to be identified; Based on the features of the first image, second information of the object to be identified is determined, and the second information is used to indicate that the object to be identified is a second object; This displays the category to which the second object belongs.

4. The method as described in claim 1, characterized in that, The method further includes: Acquire the 3D data of the object to be identified; Based on the three-dimensional data, third information of the object to be identified is determined, and the third information is used to indicate that the object to be identified is a third object; This displays the category to which the third object belongs.

5. The method as described in claim 1, characterized in that, The first device includes a display screen, and the method further includes: The categories to which the M objects selected by the first user belong are displayed in the first display area of ​​the display screen; The user information of the first user and the first mode corresponding to the category to which the M objects selected by the first user belong are displayed in the second display area of ​​the display screen, wherein the M objects include the first object; The score of the first user is determined based on the number of categories of the L objects correctly selected by the first user and the first pattern. The M objects include the L objects, M and L are positive integers, and L is less than or equal to M. The score of the first user is displayed in the second display area.

6. The method according to claim 5, characterized in that, After displaying the first user's score in the second display area, the method further includes: The categories to which the M objects selected by the second user belong are displayed in the first display area of ​​the display screen; The second display area of ​​the display screen displays the user information of the second user and the second mode corresponding to the category to which the M objects selected by the second user belong; The score of the second user is determined based on the number of categories of the P objects correctly selected by the second user and the second pattern, wherein the M objects include the P objects, P is a positive integer, and P is less than or equal to M; The score of the second user is displayed in the second display area; The scores of the first user and the second user are sorted, and the sorted scores of the first user and the second user are displayed in the third display area of ​​the display screen.

7. A device for classifying objects, characterized in that, The device includes a processor coupled to a memory, the processor being configured to execute a computer program or instructions stored in the memory to implement the method as described in any one of claims 1-5.

Images