A method for obtaining function demonstration of smart home appliance

Through mobile terminals, the images of smart home appliances are collected and recognized by cloud servers are used to provide model and function selection, and the voice guidance and dynamic demonstration of smart home managers are realized, which solves the complex operation of smart home appliances, simplifies the user learning process, and improves usage efficiency.

CN112053647BActive Publication Date: 2024-11-22VATTI CORP LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
CN202010725117.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-24
Publication Date
2024-11-22
Estimated Expiration
2040-07-24

AI Technical Summary

Technical Problem

Smart home appliances have complex functions, heavy user instructions, and high learning costs. Traditional electronic instructions have failed to effectively simplify user operations, making it difficult to use smart home appliances in a convenient, easy and efficient manner.

Method used

The mobile terminal collects images of smart home appliances, uploads them to the cloud server to identify device category information, provides model and function selection interface, and starts the smart home manager for voice guidance and dynamic demonstration. Users can use different angles to collect images and perform three-dimensional synthesis after optimization and processing. Identify and obtain corresponding function demonstration.

Benefits of technology

It is easy to obtain smart home appliance function demonstrations without paper or electronic manuals, reducing user learning costs, improving usage efficiency, reducing misoperation, and quickly mastering equipment functions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112053647B_ABST
    Figure CN112053647B_ABST
Patent Text Reader

Abstract

The present invention proposes a method for obtaining a function demonstration of a smart home appliance, comprising the following steps: collecting an image of the smart home appliance through an image acquisition unit of a mobile terminal; uploading the collected image to a cloud server; the cloud server obtains device category information of the smart home appliance according to the collected image, and feeds back the category information of the smart home appliance to the mobile terminal; the mobile terminal provides an interface containing model information of the smart home appliance for the user to select, and starts a smart home butler when receiving a user's selection of a certain model information; the mobile terminal provides an interface containing function information of the smart home appliance for the user to select and view; according to the model of the smart home appliance selected by the user and the function information selected by the user, the smart home butler performs voice guidance and / or dynamic demonstration. It is convenient for users to obtain function demonstrations of various smart home appliances, without having to view the usage methods of various functions of smart home appliances through paper manuals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a method for obtaining function demonstration of smart home appliance equipment. Background Art

[0002] Smart home is developing rapidly, and with it comes more and more functions of smart home appliances. Each function key represents a different function, and different function keys combined with each other have another function. Therefore, the user manual is getting thicker and thicker, and the user's learning cost is getting higher and higher. For example, a dishwasher is a product that frees users' hands and can greatly reduce the user's housework work and time after meals. However, because the user did not place the tableware according to the instructions, the tableware was not washed clean, and the product that should have helped users reduce housework time and housework was not implemented. Although traditional paper instructions have gradually transitioned to electronic instructions, electronic instructions are just copying the paper content to the user's mobile phone, and no in-depth research has been done. How to make users use smart home appliances more conveniently, easily and efficiently is the subject of research in this field. Summary of the invention

[0003] The present invention aims to solve one of the problems existing in the existing related technologies to a certain extent. To this end, the purpose of the present invention is to propose a method for obtaining function demonstrations of smart home appliances, so as to facilitate users to obtain function demonstrations of various smart home appliances.

[0004] The above purpose is achieved through the following technical solutions:

[0005] A method for obtaining a function demonstration of a smart home appliance comprises the following steps:

[0006] Capturing images of smart home appliances through an image acquisition unit of a mobile terminal;

[0007] Upload the collected images to the cloud server;

[0008] The cloud server obtains device category information of the smart home appliance according to the collected images, and feeds back the category information of the smart home appliance to the mobile terminal;

[0009] The mobile terminal provides an interface containing model information of smart home appliances for the user to select, and starts the smart home manager when receiving the user's selection of a certain model information;

[0010] The mobile terminal provides an interface containing functional information of smart home appliances for users to select and view;

[0011] Based on the model of smart home appliance selected by the user and the functional information the user chooses to view, the smart home butler provides voice guidance and / or dynamic demonstration.

[0012] As a further improvement of the present invention, the step of acquiring images of smart home appliances through the image acquisition unit of the mobile terminal is specifically as follows: scanning the smart home appliances at different angles through the image acquisition unit of the mobile terminal; and acquiring images of the smart home appliances at different angles within the scanning time.

[0013] As a further improvement of the present invention, the steps of collecting images of smart home appliances at different angles within the scanning time are specifically as follows: scanning the current angle of the smart home appliance through the image acquisition unit of the mobile terminal to collect the current angle image of the home appliance; judging whether the similarity between the front and rear frames of the current angle image is greater than a preset value; if the similarity between the front and rear frames of the current angle image is greater than the preset value, the collection is successful, and the mobile terminal uploads the collected current angle image to the cloud server; if the similarity between the front and rear frames of the current angle image is less than the preset value, the collection is unsuccessful, and the smart home appliance is scanned again at different angles through the image acquisition unit of the mobile terminal.

[0014] As a further improvement of the present invention, the scanning time is 2-3 seconds.

[0015] As a further improvement of the present invention, the cloud server obtains the equipment category information of the smart home appliance device based on the collected image information, and feeds back the smart home appliance equipment category information to the mobile terminal in the following specific steps: optimizing the collected image; performing three-dimensional synthesis on the optimized image to restore the basic shape structure of the smart home appliance; judging through intelligent algorithm comparison whether the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance; if the basic shape structure pre-stored in the cloud server database does not match the basic shape structure of the smart home appliance, re-collecting the image of the smart home appliance device through the image acquisition unit of the mobile terminal; if the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance, obtaining the equipment category information of the corresponding pre-stored smart home appliance basic shape structure as the equipment category information of the corresponding smart home appliance, and feeding back the smart home appliance equipment category information to the mobile terminal.

[0016] As a further improvement of the present invention, the steps of optimizing the collected image information are specifically as follows: covering the smart home appliance part in the image with the foreground color and covering the remaining part of the image with the background color; repairing and denoising the smart home appliance part covered with the foreground color in the image, and then performing graphic cutting processing to obtain an optimized image.

[0017] As a further improvement of the present invention, the specific steps for the smart home butler to perform voice guidance and / or dynamic demonstration according to the model of the smart home appliance selected by the user and the function selected by the user to view are as follows: the mobile terminal transmits the model of the smart home appliance selected by the user and the function selected by the user to view to the cloud server; after the cloud server receives the model of the smart home appliance selected by the user and the function selected by the user, it retrieves the corresponding function voice guidance and / or dynamic demonstration information pre-stored in the cloud server database, and transmits the function voice guidance and / or dynamic demonstration information to the mobile terminal; after the user downloads the function voice guidance and / or dynamic demonstration information, the smart home butler performs voice guidance and / or dynamic demonstration.

[0018] As a further improvement of the present invention, before collecting image information of smart home appliances through the image acquisition unit of the mobile terminal, the following steps are also included: collecting basic shape structures, models, functions and voice guidance and / or dynamic demonstration information of the functions of various smart home appliances, and uploading them to the cloud server to form a database.

[0019] Compared with the prior art, the present invention has at least the following beneficial effects:

[0020] The present invention provides a method for obtaining function demonstrations of smart home appliances, which facilitates users to obtain function demonstrations of various smart home appliances without having to view usage methods of various functions of smart home appliances through paper manuals or electronic manuals. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A flowchart of a method for obtaining a function demonstration of a smart home appliance in Embodiment 1;

[0022] Figure 2 It is a schematic diagram of the process in the second embodiment;

[0023] Figure 3 This is a schematic diagram of the process in Example 3;

[0024] Figure 4 This is a schematic diagram of the process in Embodiment 4;

[0025] Figure 5 This is a schematic diagram of the process in Embodiment 5;

[0026] Figure 6 This is a schematic diagram of the process in Example 6;

[0027] Figure 7 This is a schematic diagram of the process in Example 7. DETAILED DESCRIPTION

[0028] The following examples illustrate the present invention, but the present invention is not limited to these examples. Modifications to the specific embodiments of the present invention or equivalent replacement of some technical features without departing from the spirit of the present invention should be included in the scope of the technical solution claimed by the present invention.

[0029] Embodiment 1:

[0030] like Figure 1 A method for obtaining a function demonstration of a smart home appliance device according to the present invention is shown, comprising the following steps:

[0031] Step S1, collecting images of smart home appliances through an image collection unit of a mobile terminal;

[0032] Step S2, uploading the collected image to the cloud server;

[0033] Step S3, the cloud server obtains device category information of the smart home appliance according to the collected image, and feeds back the category information of the smart home appliance to the mobile terminal;

[0034] Step S4, the mobile terminal provides an interface containing model information of smart home appliances for the user to select, and starts the smart home manager when receiving the user's selection of a certain model information;

[0035] Step S5, the mobile terminal provides an interface containing function information of the smart home appliance for the user to select and view;

[0036] Step S6: Based on the model of the smart home appliance selected by the user and the function information selected by the user to view, the smart home butler provides voice guidance and / or dynamic demonstration.

[0037] In step S4, after confirming the category information of the smart home appliance, since the differences between different smart home appliance models are not only in appearance, but more in the differences in built-in software functions, the mobile terminal provides an interface containing the model information of the smart home appliance for the user to choose.

[0038] The present invention proposes a method for obtaining a function demonstration of a smart home appliance. The user collects an image of the smart home appliance through a mobile terminal and uploads the image. After the cloud server identifies the category of the smart home, the user selects the model and corresponding function of the smart home appliance to be viewed. The smart home butler is aroused by the user's selection, and the smart home butler performs voice guidance and / or dynamic demonstration. It is convenient for users to obtain function demonstrations of various smart home appliances, without having to view the usage methods of various functions of smart home appliances through paper manuals or electronic manuals.

[0039] Embodiment 2:

[0040] The difference between this embodiment and the first embodiment is that Figure 2 Step S1, before the image acquisition unit of the mobile terminal acquires the image of the smart home appliance, the following steps are also included:

[0041] Step S0, collects the basic shape structure, model, function and voice guidance and / or dynamic demonstration information of various smart home appliances, and uploads them to the cloud server to form a database. It is convenient for the cloud server to identify the smart home appliances and convenient for users to use. In the process of user use, more basic shape structure, model, function and voice guidance and / or dynamic demonstration information of smart home appliances will be uploaded to the cloud server to update the cloud server to meet the user's use needs.

[0042] Embodiment three:

[0043] The difference between this embodiment and the first embodiment is that Figure 3 , wherein step S1, the step of collecting the image of the smart home appliance by the image collection unit of the mobile terminal is specifically as follows:

[0044] Step S11, scanning the smart home appliance at different angles through the image acquisition unit of the mobile terminal;

[0045] Step S12: collect images of the smart home appliance at different angles during the scanning time, and upload the collected images to the cloud server.

[0046] In this embodiment, the scanning time is 2-3 seconds. By scanning the smart home appliance at different angles, collecting images of the smart home appliance at different angles, and then uploading the images of the smart home appliance at different angles to the cloud server, the cloud server can more accurately identify the smart home appliance, avoiding the situation where the cloud server misidentifies the category of the smart home appliance after scanning the smart home appliance at a single angle and uploading the image to the cloud server.

[0047] Embodiment 4:

[0048] The difference between this embodiment and embodiment 3 is that Figure 4 , step S12, the method for collecting images of the smart home appliance at different angles within the scanning time is:

[0049] Step S121, scanning the current angle of the smart home appliance through the image acquisition unit of the mobile terminal to acquire the current angle image of the home appliance;

[0050] Step S122, determining whether the similarity between the previous and next frames of the current angle image is greater than a preset value;

[0051] If the similarity between the previous and next frames of the current angle image is greater than the preset value, step S123 indicates that the acquisition is successful, and the mobile terminal uploads the acquired current angle image to the cloud server;

[0052] If the similarity between the frames before and after the current angle image is less than the preset value, the acquisition is unsuccessful, and the process returns to step S11 to scan the smart home appliance at different angles through the image acquisition unit of the mobile terminal. Preferably, when the similarity between the frames before and after the current angle image is less than the preset value, the mobile terminal will remind the user, inform the user of the reason for the unsuccessful acquisition, and remind the user to pay attention, so as to improve the success rate of the user's image acquisition next time.

[0053] To scan smart home appliances, it is necessary to collect images of smart home appliances at different angles. Users need to move mobile terminals or smart home appliances to collect images of smart home appliances at different angles. In the process of collecting images, it is easy for the image to be unclear or blurred due to moving too fast. The similarity of the front and back frames of the current angle image is judged, and the image whose similarity of the front and back frames of the current angle image reaches a preset value is uploaded to the cloud server to avoid uploading unclear images to the cloud server, causing the cloud server to inaccurately identify the category of smart home appliances, and ultimately requiring users to rescan the smart home appliances. This avoids users from looping through the steps of collecting images, uploading images to the cloud server, and cloud server recognition errors, thereby avoiding wasting users' time.

[0054] Embodiment five:

[0055] The difference between this embodiment and the first embodiment is that Figure 5 In step S3, the cloud server obtains the category information of the smart home appliance according to the collected image information, and feeds back the category information of the smart home appliance to the mobile terminal as follows:

[0056] Step S31, optimizing the collected image;

[0057] Step S32, performing three-dimensional synthesis on the optimized image to restore the basic shape structure of the smart home appliance;

[0058] Step S33, through intelligent algorithm comparison, determine whether the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance;

[0059] If the basic shape structure pre-stored in the cloud server database does not match the basic shape structure of the smart home appliance, return to step S1 to capture an image of the smart home appliance through the image acquisition unit of the mobile terminal;

[0060] If the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance, step S34 obtains the device category information of the corresponding pre-stored smart home appliance basic shape structure as the device category information of the corresponding smart home appliance, and feeds back the smart home appliance device category information to the mobile terminal.

[0061] In step S33, the intelligent algorithm will continue to optimize after the user scans more smart home appliances.

[0062] Collect images of smart home appliances from different angles, optimize these images, and then perform three-dimensional synthesis to restore the basic shape structure of smart home appliances. The shape structures of smart home appliances of the same category are similar, but there must be differences in local structures between different brands and models of smart home appliances of the same type, and the shape structures of smart home appliances of different categories are quite different, such as dishwashers and refrigerators. If the shape structure information of smart home appliances of different brands and models of the same category is stored in the cloud server, the workload will be greatly increased. When various new smart home appliances are launched, the shape structure information of smart home appliances on the cloud server needs to be updated in real time to prevent the situation where they cannot be recognized after the user scans. By restoring the basic shape structure of smart home appliances, the cloud server only needs to recognize the basic shape structure, which greatly improves the accuracy of cloud server recognition and avoids the situation where the cloud server cannot recognize and the user cannot obtain its functional information due to the failure of the cloud server to update its shape structure in time when the smart home appliances are launched.

[0063] Embodiment six:

[0064] like Figure 6 The difference between this embodiment and the fifth embodiment is that, in step S31, the step of optimizing the collected image information is specifically as follows:

[0065] Step S311, covering the smart home appliance part in the image as the foreground color, and covering the rest of the image as the background color;

[0066] Step S312, repair and denoise the portion of the smart home appliance device covered by the foreground color in the image, and then perform graphic cutting processing to obtain an optimized image.

[0067] In this embodiment, the foreground color is black and the background color is white. The smart home appliance is covered as the foreground color, which effectively distinguishes the smart home appliance from irrelevant information in the image, and the complex image information in the image that is irrelevant to the smart home appliance is covered by the background color, and the cloud server does not need to identify the background color part, which greatly improves the recognition efficiency of the cloud server.

[0068] Embodiment seven:

[0069] like Figure 7 Step S6: According to the model of the smart home appliance selected by the user and the function selected by the user, the smart home butler performs voice guidance and / or dynamic demonstration. The specific steps are as follows:

[0070] Step S61, the mobile terminal transmits the model of the smart home appliance selected by the user and the function selected by the user to view to the cloud server;

[0071] Step S62, after receiving the model of the smart home appliance selected by the user and the function selected by the user, the cloud server retrieves the corresponding function voice guidance and / or dynamic demonstration information pre-stored in the cloud server database, and transmits the function voice guidance and / or dynamic demonstration information to the mobile terminal;

[0072] Step S63: After the user downloads the function voice guidance and / or dynamic demonstration information, the smart home butler performs voice guidance and / or dynamic demonstration.

[0073] In step S63, the user can download the function voice guidance and / or dynamic demonstration information in a wireless network environment or a traffic environment.

[0074] Through the integration of virtual and real life, users can intuitively experience the one-to-one smart home butler's voice guidance and / or dynamic demonstration of smart home appliances. This allows users to obtain usage information of smart home appliance functions more quickly and conveniently, helping users to quickly master the various functions of smart home appliances. Users can switch between dynamic demonstrations and / or voice guidance of different functions at any time. Even if they forget to use smart home appliances later, they can still scan the smart home appliances again to call up the smart home butler without having to read traditional paper instructions.

[0075] The above-mentioned preferred implementation modes should be regarded as illustrative examples of the implementation modes of the present application scheme. Any technical deductions, replacements, improvements, etc. that are identical or similar to the present application scheme or made based on this scheme should be regarded as within the scope of protection of this patent.

Claims

1. A method for obtaining a function demonstration of a smart home appliance, characterized in that: The steps include: Capturing images of smart home appliances through an image acquisition unit of a mobile terminal; Upload the collected images to the cloud server; The cloud server obtains device category information of the smart home appliance device based on the collected images, and feeds back the category information of the smart home appliance device to the mobile terminal; The mobile terminal provides an interface containing model information of smart home appliances for the user to select, and starts the smart home manager when receiving the user's selection of a certain model information; The mobile terminal provides an interface containing functional information of smart home appliances for users to select and view; According to the model of smart home appliance selected by the user and the function information selected by the user, the smart home butler provides voice guidance and / or dynamic demonstration; The cloud server obtains the device category information of the smart home appliance according to the collected image information, and feeds back the smart home appliance category information to the mobile terminal in the following specific steps: Optimize the collected images; Perform three-dimensional synthesis on the optimized images to restore the basic shape structure of smart home appliances; By comparing with intelligent algorithms, it is determined whether the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance; If the basic shape structure pre-stored in the cloud server database does not match the basic shape structure of the smart home appliance, the image of the smart home appliance is captured again by the image capture unit of the mobile terminal; If the basic shape structure pre-stored in the cloud server database matches the basic shape structure of the smart home appliance, the device category information of the corresponding pre-stored basic shape structure of the smart home appliance is obtained as the device category information of the corresponding smart home appliance, and the smart home appliance device category information is fed back to the mobile terminal; The specific steps of collecting images of smart home appliances by the image acquisition unit of the mobile terminal are as follows: Scan the smart home appliances at different angles through the image acquisition unit of the mobile terminal; Capture images of smart home appliances at different angles within the scanning time.

2. A method for obtaining a function demonstration of a smart home appliance according to claim 1, characterized in that: The specific steps for collecting images of smart home appliances at different angles within the scanning time are: Scanning the current angle of the smart home appliance through the image acquisition unit of the mobile terminal to acquire the current angle image of the home appliance; Determine whether the similarity between the previous and next frames of the current angle image is greater than a preset value; If the similarity between the previous and next frames of the current angle image is greater than a preset value, the acquisition is successful, and the mobile terminal uploads the acquired current angle image to the cloud server; If the similarity between the previous and next frames of the current angle image is less than a preset value, the acquisition is unsuccessful, and the smart home appliance device is scanned again at a different angle through the image acquisition unit of the mobile terminal.

3. The method for obtaining a function demonstration of a smart home appliance according to claim 1, characterized in that: The scanning time is 2-3 seconds.

4. The method for obtaining a function demonstration of a smart home appliance according to claim 1, characterized in that: The specific steps for optimizing the collected image information are as follows: Cover the smart home appliance part in the image as the foreground color and cover the rest of the image as the background color; The part of the smart home appliance covered by the foreground color in the image is repaired and denoised, and then a graphic cutting process is performed to obtain an optimized image.

5. The method for obtaining a function demonstration of a smart home appliance according to claim 1, characterized in that: According to the model of the smart home appliance selected by the user and the function selected by the user, the smart home butler provides voice guidance and / or dynamic demonstration in the following specific steps: The mobile terminal transmits the model of the smart home appliance selected by the user and the function selected by the user to view to the cloud server; After receiving the model of the smart home appliance selected by the user and the function selected by the user, the cloud server retrieves the corresponding function voice guidance and / or dynamic demonstration information pre-stored in the cloud server database, and transmits the function voice guidance and / or dynamic demonstration information to the mobile terminal; After the user downloads the function voice guidance and / or dynamic demonstration information, the smart home butler provides voice guidance and / or dynamic demonstration.

6. A method for obtaining a function demonstration of a smart home appliance according to any one of claims 1 to 5, characterized in that: Before the image information of the smart home appliance is collected by the image acquisition unit of the mobile terminal, the following steps are also included: The basic shape structure, model, function and voice guidance and / or dynamic demonstration information of various smart home appliances are collected and uploaded to the cloud server to form a database.

Citation Information

Patent Citations

  • Method for identifying and reading code image to check operation instruction of household appliance

    CN104598864A

  • Intelligent product specification management system based on Internet

    CN105868962A

  • Instruction demonstration method demonstration system, and intelligent device

    CN106303090A

  • Method and device for demonstrating functions of electronic equipment, and intelligent terminal

    CN106485956A

  • Production method and system for panorama picture

    CN107690049A