Tableware placement guidance method, device, storage medium and mobile terminal

Abstract

The embodiment of the present application discloses a tableware placement guidance method, device, storage medium and mobile terminal, which relates to the field of smart home. The method of the present application includes: determining the size information of each tableware among multiple tableware to be washed; determining the size information of the dishwashing rack; displaying a tableware placement guidance interface through a display unit; wherein the tableware placement guidance interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack; generating the position information of each tableware in the dishwashing rack according to a preset space planning rule; according to the position information, placing each tableware icon in the dishwashing rack schematic diagram to obtain an overall layout diagram, so as to effectively guide the tableware placement, improve the efficiency of tableware placement and improve the dishwashing effect of the dishwasher.

Description

Technical Field

[0001] The present application relates to the field of smart home, and in particular to a tableware placement guidance method, device, storage medium and mobile terminal. Background Art

[0002] With the improvement of living standards, more and more families are buying dishwashers. Users only need to place the dishes in the dishwasher's dishwashing rack and then click the start button to automatically complete the dishwashing operation, which greatly saves users' dishwashing time. Since the dishes to be washed vary in size, when users place the dishes in the dishwashing rack, there may be a situation where the dishes cannot be placed, which causes users to spend a lot of time adjusting the position of the dishes, or the dishes are not placed in a standardized position, which causes the dishwasher to not rinse thoroughly and the dishwashing effect is poor. Summary of the invention

[0003] The embodiments of the present application provide a tableware placement guidance method, device, storage medium and mobile terminal, which can solve the problem of low efficiency and irregular placement of tableware in a dishwashing rack. The technical solution is as follows:

[0004] Determine the size information of each tableware among the plurality of tableware to be cleaned;

[0005] Determine the size information of the dishwashing rack;

[0006] Displaying a tableware placement guide interface through a display unit; wherein the tableware placement guide interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack;

[0007] Generate the position information of each tableware in the dishwashing rack according to a preset space planning rule;

[0008] According to the position information, each tableware icon is placed in the dishwashing rack schematic diagram to obtain an overall layout diagram.

[0009] In a second aspect, an embodiment of the present application provides a tableware placement guidance device, the device comprising:

[0010] A determination unit, used to determine the size information of each tableware among the plurality of tableware to be washed;

[0011] The determining unit is further used to determine the size information of the dishwashing rack;

[0012] A guide unit, used to display a tableware placement guide interface through a display unit; wherein the tableware placement guide interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack;

[0013] A planning unit, configured to generate position information of each tableware in the dishwashing rack according to a preset space planning rule;

[0014] The layout unit is used to place each tableware icon in the dishwashing rack schematic diagram according to the position information to obtain an overall layout diagram.

[0015] In a third aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor and executing the above-mentioned method steps.

[0016] In a fourth aspect, an embodiment of the present application provides a mobile terminal, which may include: a processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the above-mentioned method steps.

[0017] The beneficial effects brought about by the technical solutions provided by some embodiments of the present application include at least:

[0018] A tableware placement guidance interface is generated through multiple tableware to be washed and a dishwashing rack, and then the tableware placement is simulated according to the size information of the tableware and the size information of the dishwashing rack to obtain the position information of the tableware. Finally, an overall layout diagram showing the tableware layout method is displayed on the tableware placement guidance interface, and the user can place the tableware according to the layout method shown in the overall layout diagram; it effectively solves the problem of repeated placement or irregular placement caused by users' unclear dishwasher space planning and misjudgment of the size of tableware, effectively guides the placement of tableware, improves the efficiency of tableware placement and enhances the dishwashing effect of the dishwasher. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0020] Figure 1 It is a flowchart of a tableware placement guidance method provided in an embodiment of the present application;

[0021] Figure 2 is a schematic diagram of a photo taking interface provided in an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of an upload interface provided in an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of a configuration interface provided in an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of a measurement interface provided in an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a preview interface provided in an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of a backup interface provided in an embodiment of the present application;

[0027] Figure 8 is a schematic diagram of a recommendation interface provided in an embodiment of the present application;

[0028] Fig. 9 is a schematic diagram of a tableware placement guidance interface provided in an embodiment of the present application;

[0029] Fig.10 is a schematic diagram of a layout interface provided in an embodiment of the present application;

[0030] Fig.11 It is a structural schematic diagram of a tableware placement guidance device provided by the present application;

[0031] Fig.12 It is a structural schematic diagram of a mobile terminal provided by this application. DETAILED DESCRIPTION

[0032] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0033] It should be noted that the tableware placement guidance method provided in the present application is generally executed by a mobile terminal, and correspondingly, the tableware placement guidance device is generally set in the mobile terminal.

[0034] Various communication client applications can be installed on the mobile terminal of the present application, such as: video recording applications, video playback applications, voice interaction applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0035] The mobile terminal may be hardware or software. When the mobile terminal is hardware, it may be various mobile terminals with display screens, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers. When the mobile terminal is software, it may be installed in the mobile terminals listed above. It may be implemented as multiple software or software modules (for example, to provide distributed services), or it may be implemented as a single software or software module, which is not specifically limited here.

[0036] When the mobile terminal is hardware, a display unit and a camera may be installed thereon. The display unit may be various devices capable of realizing display functions, and the camera is used to collect video streams; for example, the display unit may be a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink screen, a liquid crystal display (LCD), a plasma display panel (PDP), etc. The user may use the display unit on the mobile terminal to view displayed text, pictures, videos and other information.

[0037] The following will be combined with the attached Figure 1 , the tableware placement guidance method provided in the embodiment of the present application is described in detail. Among them, the tableware placement guidance device in the embodiment of the present application can be Figure 1 The mobile terminal shown.

[0038] See also Figure 1 , which is a flow chart of a tableware placement guidance method provided in an embodiment of the present application. Figure 1 As shown, the method of the embodiment of the present application may include the following steps:

[0039] S101, determining size information of each tableware among a plurality of tableware to be washed.

[0040] The types of the multiple tableware to be cleaned may be the same or different, and the tableware types include bowls, plates, cups, etc. In this embodiment, the tableware is regarded as a rectangular parallelepiped, and the size information of the tableware represents the length, height and width of the tableware. The mobile terminal pre-stores the size information of all the tableware owned by the user, and the mobile terminal can determine the size information of each tableware to be cleaned by image acquisition or interface interaction.

[0041] In a possible embodiment, a mobile terminal captures an image of tableware through a camera, and the tableware is one of all the tableware owned by a user. The mobile terminal stores template images of all the tableware of the user and size information associated with each template image, calculates the similarity between the captured image and all the template images, and determines the template image with the highest similarity, and uses the size information associated with the template image as the size information of the tableware.

[0042] For example, see Figure 2The schematic diagram of the photo interface shown in the figure, the photo interface is provided with a photo button and an add button, the mobile terminal collects images of tableware through the camera, and this embodiment can collect images of one or more tableware at the same time, when the number of tableware exceeds the quantity threshold, the user clicks the add button to trigger the continued collection of images of tableware. During the image collection process of the mobile terminal, the tableware is placed on a horizontal plane, and the mobile terminal ensures that the lens glass of its camera is always vertically parallel to the horizontal plane through the attitude sensor. The mobile terminal pre-stores a default vertical distance, measures the vertical distance between the tableware through the built-in distance sensor, and displays the value of the vertical distance in real time on the photo interface. When the measured vertical distance is equal to the default vertical distance, the mobile terminal displays a photo prompt information on the photo interface, for example: the value of the vertical distance is displayed in red, and the user clicks the photo button to trigger the collection of the image of the tableware, and the image is displayed in the preview area of ​​the photo interface. This embodiment ensures that the images collected each time have the same scale through the distance prompt, thereby improving the accuracy of the subsequent calculation process.

[0043] See also Figure 3 The schematic diagram of the upload interface shown in the figure is provided with an upload button. After the mobile terminal completes the collection of images of multiple tableware to be washed, the thumbnails of each tableware are displayed in the preview area. The user triggers the upload of each tableware image to the size information calculation service through the upload button. Then the mobile terminal runs the size information calculation service, and the pixel area where the tableware is located is detected in the image. The similarity between the pixel area and each template image is calculated according to the cosine similarity algorithm, the template image with the greatest similarity is determined, and the size information associated with the target image is used as the size information of the tableware.

[0044] In another possible embodiment, the mobile terminal displays a tableware set through a display unit, where the tableware set includes multiple tableware icons, each tableware icon corresponds to a tableware with the same size information, the tableware corresponding to the tableware set is all the tableware owned by the user, and the user selects multiple tableware icons in the tableware set through a selection instruction. The mobile terminal uses the tableware corresponding to the selected tableware icons as multiple tableware to be cleaned, and the mobile terminal determines the size information of the multiple tableware to be cleaned based on the pre-stored size information.

[0045] In one or more possible embodiments, before S101, the process further includes:

[0046] Capturing a first image of a reference object through a camera, and displaying the image of the reference object on a configuration interface through a display unit;

[0047] Measuring the first image by using a ruler on the configuration interface to obtain size information of the reference object;

[0048] Acquire a second image of the reference object and the tableware to be measured by a camera;

[0049] Calculating the size information of the tableware to be measured and saving the size information of the tableware to be measured according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object;

[0050] After completing the measurement of all the user's tableware, count the total number of tableware.

[0051] For example, Figure 4 The configuration interface shown in the figure is provided with a reference object setting button. After the user clicks the reference object setting button, the camera is called to collect the first image of the reference object. The reference object is generally tableware, which can be any tableware owned by the user. The mobile terminal Figure 5 The measurement interface shown displays the first captured image, and a ruler is provided in the configuration interface. The user measures the length, height and width of the reference area in the first image by moving the ruler, and then enters the measured length, height and width in the numeric box of the configuration interface. The mobile terminal obtains the size information of the reference object based on the values ​​entered by the user. Then, the mobile terminal measures the size information of all the tableware of the user. The measurement method is: the tableware to be measured and the above-mentioned reference object are placed on the same horizontal plane. The mobile terminal collects the second image of the reference object and the tableware to be measured through a camera. The mobile terminal ensures that the lens glass of its camera is always vertically parallel to the horizontal plane through a posture sensor. The mobile terminal pre-stores a default vertical distance, measures the vertical distance between the tableware through a built-in distance sensor, and displays the vertical distance value in real time on the photo interface. When the measured vertical distance is equal to the default vertical distance, the mobile terminal displays a photo prompt message on the photo interface. The photo prompt message is as follows: Figure 7 The red origin shown in the figure, the user clicks the photo button to capture the second image, and then Figure 6 The second image is displayed on the preview interface shown. Further, in order to improve the accuracy of the size information measurement, the mobile terminal can take a plurality of second images at different angles, for example: Figure 7 The backup interface shown in the figure shows three second images of the reference object and the tableware to be measured taken by the mobile terminal, for example, including a top view, a side view and a top view at a 45-degree angle. A backup button is set on the backup interface. After the user clicks the backup button, the mobile terminal determines the length pixel ratio, width similarity ratio and height similarity ratio of the reference object and the tableware in the second image. According to the above-mentioned measured size information, the pixel ratio and the size information of the reference object are multiplied to obtain the length, width and height of the tableware to be measured. According to the above measurement method, the size information of all the tableware of the user can be measured in advance. After the measurement is completed, the mobile terminal displays the number of all the tableware of the user as 13 on the backup interface.

[0052] Furthermore, after obtaining the size information of all the user's tableware, the mobile terminal recommends a tableware usage plan based on the number of family members input by the user. When the user selects multiple tableware to be washed, he or she can directly select an existing tableware usage plan, thereby improving user operation efficiency.

[0053] For example, see Figure 8 The recommendation interface shown includes tableware icons of all the tableware of the user. Each tableware icon is set with a quantity. After the user enters the number of family members in the numeric input box, the mobile terminal generates the corresponding quantity of each tableware in the area below.

[0054] S102, determining the size information of the dishwashing rack.

[0055] Among them, the dishwashing rack is a device for placing tableware inside the dishwasher. The method for the mobile terminal to determine the size information of the dishwashing rack includes: after consulting the instruction manual of the dishwasher, the user inputs the length, height and height of the dishwashing rack through the user interface of the mobile terminal, and the mobile terminal obtains the size information of the dishwashing rack according to the values ​​input by the user; or the mobile terminal pre-stores a mapping relationship between multiple dishwasher models and the size information of the dishwashing rack, the user obtains the model of the dishwasher through user input, and then queries the size information corresponding to the model according to the mapping relationship, thereby obtaining the size information of the dishwashing rack.

[0056] S103, displaying a tableware placement guidance interface via a display unit.

[0057] Among them, the tableware placement guidance interface includes tableware icons for each tableware and a dishwashing rack schematic diagram for the dishwashing rack. The size of the tableware icons is proportional to the size of the tableware, and the size of the dishwashing rack schematic diagram is positively correlated to the size of the dishwashing rack. The tableware icons and the dishwashing rack schematic diagram have the same scale, which can intuitively show the relative size relationship between the tableware and the dishwashing rack. Furthermore, the tableware icons and the dishwashing rack schematic diagram can be 3D images, which can more intuitively show the position of the tableware icons in the dishwashing rack schematic diagram, so as to better guide the user to place them.

[0058] For example, see Fig. 9 The tableware placement guidance interface shown is provided with a start placing bowls button and an overall layout diagram button, two tableware icons, the number of tableware corresponding to the tableware icons, and a diagram of the dishwashing rack.

[0059] S104: Generate location information of each tableware in the dishwashing rack according to a preset space planning rule.

[0060] Among them, the mobile terminal is pre-configured with space planning rules for planning the position of tableware in the dishwashing rack to maximize the space utilization of the dishwashing rack. The mobile terminal regards the tableware and the dishwashing rack as a rectangular parallelepiped according to the size information, and then places the tableware in the dishwashing rack in turn until all the tableware is placed. After placement, the position information of each tableware in the dishwashing rack is obtained, and the position information has a corresponding relationship with the position information of the tableware icon in the dishwashing rack schematic diagram.

[0061] In one or more possible embodiments, generating the position information of each tableware in the dishwashing rack according to a preset rule includes:

[0062] Calculate the volume of each tableware according to the size information; the volume of the tableware is calculated by multiplying the length, height and width to obtain the volume;

[0063] Arrange the plurality of dishes to be washed in ascending order according to volume;

[0064] For the sorted multiple tableware, one tableware to be placed is selected from the multiple tableware starting from the beginning; further, the tableware may be sorted in ascending order according to the volume, and then one tableware to be placed is selected from the end to the beginning.

[0065] Traversing the free spaces in the dishwashing rack that meet the space requirement for placing the tableware, wherein the number of the free spaces is one or more;

[0066] The tableware to be placed is placed in the smallest free space until all the tableware is placed; by placing the small tableware first, the space utilization of the dishwashing rack is maximized;

[0067] Obtain the coordinates of each tableware in the dishwashing rack to obtain the position information of each tableware.

[0068] S105: placing each tableware icon in the dishwashing rack schematic diagram according to the position information to obtain an overall layout diagram.

[0069] According to the position information of each tableware in the dishwashing rack calculated in S104, the tableware icons are placed in the dishwashing rack schematic diagram to generate an overall layout diagram.

[0070] For example, see Fig. 9 In the tableware placement guide interface, after the user clicks the start placing dishes button, the mobile terminal places two large plates and two large bowls of tableware icons in the dishwashing rack schematic diagram according to the location information, and the tableware icons placed in the dishwashing rack schematic diagram are highlighted, for example: the tableware icons are displayed in red. For further information, see Fig.10 In the layout interface shown, the user clicks Fig. 9After clicking the overall layout diagram button in the mobile terminal, the overall layout diagram with tableware icons placed on the layout interface is displayed in full screen mode, so that the user can place the tableware in the dishwashing rack of the dishwasher with reference to the overall layout diagram.

[0071] Before placing tableware, the embodiment of the present application generates a tableware placement guidance interface through multiple tableware to be washed and a dishwashing rack, then simulates the placement according to the size information of the tableware and the size information of the dishwashing rack to obtain the position information of the tableware, and finally displays an overall layout diagram showing the tableware layout method on the tableware placement guidance interface, and the user can place the tableware with reference to the tableware layout method shown in the overall layout diagram; it effectively solves the problem of users' unclear dishwasher space planning and repeated or irregular placement caused by misjudgment of the size of tableware, effectively guides the placement of tableware, improves the efficiency of tableware placement and enhances the dishwashing effect of the dishwasher.

[0072] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0073] See also Fig.11 , which shows a schematic diagram of the structure of a tableware placement guidance device provided by an exemplary embodiment of the present application, hereinafter referred to as device 11. The device 11 can be implemented as all or part of the mobile terminal through software, hardware or a combination of both. The device 11 includes: a determination unit 1101, a guidance unit 1102, a planning unit 1103, and a layout unit 1104.

[0074] A determination unit 1101 is used to determine the size information of each tableware among a plurality of tableware to be washed;

[0075] The determining unit 1101 is further used to determine the size information of the dishwashing rack;

[0076] The guidance unit 1102 is used to display a tableware placement guidance interface through a display unit; wherein the tableware placement guidance interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack;

[0077] A planning unit 1103, configured to generate position information of each tableware in the dishwashing rack according to a preset space planning rule;

[0078] The layout unit 1104 is used to place each tableware icon in the dishwashing rack schematic diagram according to the position information to obtain an overall layout diagram.

[0079] In one or more possible embodiments, determining the size information of each tableware in the plurality of tableware to be washed includes:

[0080] Collecting images including tableware through a camera;

[0081] Calculating the similarity between the collected image and a plurality of pre-stored template images;

[0082] Determine the template image with the greatest similarity;

[0083] The size information associated with the determined template image is used as the size information of the tableware.

[0084] In one or more possible embodiments, during the image acquisition process, the lens glass is controlled to be parallel to the horizontal plane by a posture sensor, and the vertical distance between the tableware is controlled to be maintained at a default vertical distance by a distance sensor.

[0085] In one or more possible embodiments, determining the size information of each tableware in the plurality of tableware to be washed includes:

[0086] Displaying a tableware set through a display unit; wherein the tableware set includes a plurality of tableware icons, each tableware icon corresponding to a tableware;

[0087] selecting a plurality of tableware icons in the tableware set based on a user's selection instruction;

[0088] Query the size information associated with the selected multiple tableware icons.

[0089] In one or more possible embodiments, it further includes:

[0090] A measuring unit, configured to capture a first image of a reference object through a camera, and to display the image of the reference object on a configuration interface through a display unit;

[0091] Measuring the first image by using a ruler on the configuration interface to obtain size information of the reference object;

[0092] Acquire a second image of the reference object and the tableware to be measured by a camera;

[0093] Calculating the size information of the tableware to be measured and saving the size information of the tableware to be measured according to the pixel ratio between the reference object and the tableware to be measured in the second image and the size information of the reference object;

[0094] After completing the measurement of all the user's tableware, count the total number of tableware.

[0095] In one or more possible embodiments, the captured first image is images captured from multiple different shooting angles.

[0096] In one or more possible embodiments, generating the position information of each tableware in the dishwashing rack according to a preset space planning rule includes:

[0097] Calculate the volume of each tableware according to the size information;

[0098] Arrange the plurality of dishes to be washed in ascending order according to volume;

[0099] For the sorted multiple tableware, select a tableware to be placed from the multiple tableware from the beginning;

[0100] Traversing the free spaces in the dishwashing rack that meet the space requirement for placing the tableware, wherein the number of the free spaces is one or more;

[0101] Place the tableware to be placed in the smallest free space until all the tableware has been placed;

[0102] Obtain the coordinates of each tableware in the dishwashing rack to obtain the position information of each tableware.

[0103] It should be noted that the device 11 provided in the above embodiment only uses the division of the above functional modules as an example when executing the tableware placement guidance method. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the above functions. In addition, the tableware placement guidance device provided in the above embodiment and the tableware placement guidance method embodiment belong to the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be repeated here.

[0104] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0105] The present application also provides a computer storage medium, which can store multiple instructions, and the instructions are suitable for being loaded and executed by a processor as described above. Figure 2 The method steps of the embodiment shown in the figure can be found in the specific implementation process. Figure 2 The specific description of the illustrated embodiment will not be repeated here.

[0106] The present application also provides a computer program product, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the tableware placement guidance method described in the above embodiments.

[0107] See also Fig.12 , which is a schematic diagram of the structure of a mobile terminal provided in an embodiment of the present application. Figure 5 As shown, the mobile terminal 1200 may include: at least one processor 1201 , at least one network interface 1204 , a user interface 1203 , a memory 1205 , and at least one communication bus 1202 .

[0108] The communication bus 1202 is used to realize the connection and communication between these components.

[0109] The user interface 1203 may include a display screen (Display) and a camera (Camera), and the optional user interface 1203 may also include a standard wired interface and a wireless interface.

[0110] The network interface 1204 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0111] Among them, the processor 1201 may include one or more processing cores. The processor 1201 uses various interfaces and lines to connect various parts in the entire mobile terminal 1200, and executes various functions and processes data of the mobile terminal 1200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1205, and calling data stored in the memory 1205. Optionally, the processor 1201 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1201 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1201, and it can be implemented separately through a chip.

[0112] Among them, the memory 1205 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1205 includes a non-transitory computer-readable storage medium. The memory 1205 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1205 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1205 may also be optionally at least one storage device located away from the aforementioned processor 1201. As Figure 5 As shown, the memory 1205 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program.

[0113] exist Figure 5 In the mobile terminal 1200 shown in the figure, the user interface 1203 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 1201 can be used to call the application stored in the memory 1205 and specifically execute the following Figure 1 The specific process can be referred to Figure 1 As shown, no further description is given here.

[0114] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0115] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A tableware placement guidance method, characterized in that: include: Capturing a first image of a reference object through a camera, and displaying the image of the reference object on a configuration interface through a display unit; Measuring the first image by using a ruler on the configuration interface to obtain size information of the reference object; The second image of the reference object and the tableware to be measured is collected by a camera; the size information of the tableware to be measured is calculated and saved according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object; after completing the measurement of all the tableware of the user, the total number of the tableware is counted; in the process of collecting the second image, the lens glass is controlled to be parallel to the horizontal plane by the attitude sensor, and the vertical distance between the lens glass and the tableware is controlled to be maintained at a default vertical distance by the distance sensor; Determine the size information of each tableware among the plurality of tableware to be cleaned; Determine the size information of the dishwashing rack; Displaying a tableware placement guide interface through a display unit; wherein the tableware placement guide interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack; Calculate the volume of each tableware according to the size information of each tableware; arrange the multiple tableware to be washed in ascending order according to the volume; for the multiple tableware after sorting, select a tableware to be placed from the multiple tableware from the beginning; traverse the free space that meets the space requirement of the tableware to be placed in the dishwashing rack; wherein the number of free spaces is one or more; place the tableware to be placed in the free space with the smallest volume until all the tableware is placed; obtain the coordinates of each tableware in the dishwashing rack to obtain the position information of each tableware; According to the position information, each tableware icon is placed in the dishwashing rack schematic diagram to obtain an overall layout diagram.

2. The method according to claim 1, characterized in that The step of determining the size information of each tableware among the plurality of tableware to be cleaned includes: Collecting images including tableware through a camera; Calculating the similarity between the collected image and a plurality of pre-stored template images; Determine the template image with the greatest similarity; The size information associated with the determined template image is used as the size information of the tableware.

3. The method according to claim 1, characterized in that The step of determining the size information of each tableware among the plurality of tableware to be cleaned includes: Displaying a tableware set through a display unit; wherein the tableware set includes a plurality of tableware icons, each tableware icon corresponding to a tableware; selecting a plurality of tableware icons in the tableware set based on a user's selection instruction; Query the size information associated with the selected multiple tableware icons.

4. The method according to claim 1, characterized in that: The first image captured is an image captured from multiple different shooting angles.

5. A tableware placement guidance device, characterized in that: include: A measuring unit, configured to capture a first image of a reference object through a camera, and to display the image of the reference object on a configuration interface through a display unit; Measuring the first image by using a ruler on the configuration interface to obtain size information of the reference object; Capturing a second image of the reference object and the tableware to be measured by a camera; calculating the size information of the tableware to be measured and saving the size information of the tableware to be measured according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object; After completing the measurement of all the user's tableware, count the total number of tableware; A determination unit, used to determine the size information of each tableware among the plurality of tableware to be washed; The determining unit is further used to determine the size information of the dishwashing rack; A guide unit, used to display a tableware placement guide interface through a display unit; wherein the tableware placement guide interface includes tableware icons of each tableware and a dishwashing rack schematic diagram of the dishwashing rack; The planning unit is used to calculate the volume of each tableware according to the size information of each tableware; arrange the multiple tableware to be washed in ascending order according to the volume; for the multiple tableware after sorting, select a tableware to be placed from the multiple tableware from the beginning; traverse the free space that meets the space requirement of the tableware to be placed in the dishwashing rack; wherein the number of free spaces is one or more; place the tableware to be placed in the free space with the smallest volume until all the tableware is placed; obtain the coordinates of each tableware in the dishwashing rack to obtain the position information of each tableware; The layout unit is used to place each tableware icon in the dishwashing rack schematic diagram according to the position information to obtain an overall layout diagram.

6. A computer storage medium, characterized in that: The computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps according to any one of claims 1 to 4.

7. A mobile terminal, characterized in that: include: A processor and a memory; wherein the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method steps as claimed in any one of claims 1 to 4.

Images