Device for prompting user based on image, method and device for prompting user operation

Abstract

The present application provides a device for prompting a user based on an image, a method for prompting a user to operate, and a device, wherein the method comprises: when it is detected that the distance between the target user and the socket is less than a preset threshold, obtaining multiple current image information of the target plug, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug and the socket match; and according to the current image information, prompting the target user to complete the operation of inserting the target plug into the socket of the socket. Through the present application, the problem of inaccurate alignment between the plug and the socket in the related art during the insertion process is solved.

Description

Technical Field

[0001] The present application relates to the field of electrical plugs and sockets, and in particular to a device for prompting a user based on an image, a method for prompting a user to operate, and a device. Background Art

[0002] Currently, the smart wall sockets on the market have some intelligent functions such as the socket being able to connect to an APP, but when users connect the socket to a plug, there is no socket that can solve the problem of accurately and easily aligning the plug and socket when using the socket.

[0003] Therefore, in the related art, there is a problem that the alignment between the plug and the socket is not precise enough during the insertion process. Summary of the invention

[0004] The present application provides a device for prompting a user based on an image, a method for prompting a user to operate, and a device, so as to at least solve the problem in the related art that the alignment between the plug and the socket is not accurate enough during the insertion process.

[0005] According to one aspect of an embodiment of the present application, there is provided a device for prompting a user based on an image, the device comprising: a camera, a body sensor, and a socket;

[0006] The camera is installed at a target position and is used to obtain image information of the socket;

[0007] The camera is connected to the somatosensory sensor, which senses the physical parameters of the target user's body movements. When it is monitored that the distance between the target user and the socket is less than a preset threshold, the camera is used to obtain the image information, and the image information is transmitted to the prompt device. The prompt device prompts the target user to complete the operation of inserting the plug into the socket of the socket according to the image information.

[0008] According to another aspect of an embodiment of the present application, a method for prompting a user to operate is also provided, the method comprising:

[0009] When it is detected that the distance between the target user and the socket is less than a preset threshold, multiple current image information of the target plug is obtained, wherein the current image information is used to represent the positional relationship between the target plug and the socket, and the target plug matches the socket;

[0010] According to the current image information, the target user is prompted to complete the operation of inserting the target plug into the socket of the outlet.

[0011] According to another aspect of the embodiments of the present application, there is also provided a device for prompting a user to operate, characterized in that the device comprises:

[0012] an acquisition unit, configured to acquire a plurality of current image information of the target plug when it is detected that the distance between the target user and the socket is less than a preset threshold, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug matches the socket;

[0013] A prompting unit is used to prompt the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information.

[0014] Optionally, the prompt unit includes:

[0015] A first obtaining module, used for combining the multiple current image information to obtain first image information;

[0016] A second obtaining module is used to perform an image deduplication operation on the first image information to obtain second image information;

[0017] The first prompting module is used to use the second image information to prompt the target user to complete the operation of inserting the target plug into the socket of the socket.

[0018] Optionally, the acquiring unit includes:

[0019] A first acquisition module is used to use the camera to acquire multiple current image information of the target plug when the camera is set at a position on the same side of the socket and not overlapping with the socket, wherein each current image information is a complete image of the process of the target user inserting the target plug into the socket of the socket, and the complete image contains the current image information of the socket and the current image information of the target plug.

[0020] Optionally, the acquiring unit includes:

[0021] The second acquisition module is used to obtain multiple current image information of the target plug using the camera in each socket when the camera is set in each socket included in the socket, wherein each current image information is the image information corresponding to the target plug during the process of the target plug being inserted into the socket, photographed from the angle of each socket.

[0022] Optionally, the prompt unit includes:

[0023] A display module, used to display the position of a preset reference mark, wherein the preset reference mark is used to indicate the position corresponding to when the target plug is fully inserted into the socket of the socket;

[0024] An acquisition module, configured to acquire the position of each target plug in the second image information according to a preset plug image;

[0025] A matching module, used for matching the position of each target plug with the preset benchmark;

[0026] The second prompting module is used to adjust the position of the target plug according to the matching result, and prompt the target user to complete the operation of inserting the target plug into the socket of the socket.

[0027] According to another aspect of the embodiments of the present application, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; wherein the memory is used to store a computer program; and the processor is used to execute the method steps in any of the above embodiments by running the computer program stored in the memory.

[0028] According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the method steps in any of the above embodiments when executed.

[0029] In an embodiment of the present application, an image-based user prompting method is adopted, through a camera, a somatosensory sensor and a socket. The camera is installed at a target position to obtain image information of the socket; the camera is connected to the somatosensory sensor, and the somatosensory sensor senses the physical parameters of the target user's body movements. When it is monitored that the distance between the target user and the socket is less than a preset threshold, the image information obtained by the camera is used, and the image information is transmitted to a prompting device. The prompting device prompts the target user to complete the operation of inserting the target plug into the socket hole of the socket according to the image information. When the target user tries to install the target plug of the electrical appliance on the socket, the camera presents an image of the contact between the target plug and the socket hole in real time. The target user inserts the plug according to the image information, so that the target user can observe in real time whether the target plug and the socket are aligned, making the process of inserting the target plug into the socket simpler and more convenient, and can be inserted accurately, thereby solving the problem of inaccurate alignment between the plug and the socket during the insertion process in the related art. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0031] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0032] Figure 1 is a flowchart of an optional method for prompting a user to operate according to an embodiment of the present application;

[0033] Figure 2 This is a schematic diagram of the overall process of an optional method for prompting a user to operate according to an embodiment of the present application;

[0034] Figure 3 is a structural block diagram of an optional device for prompting a user to operate according to an embodiment of the present application;

[0035] Figure 4 It is a structural block diagram of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0036] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0037] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0038] The smart wall sockets currently on the market have realized some smart functions such as the socket being able to connect to an APP, but some problems with the socket have not been solved. When a user needs to insert a plug into a socket, he needs to bend down and align the plug with the socket before he can insert it, and there are many cases where the plug cannot be inserted. In order to solve the above problems, an embodiment of the present application provides a device for prompting a user based on an image, the device comprising: a camera, a body sensor, and a socket;

[0039] The camera is installed at the target position to obtain image information of the socket;

[0040] The camera is connected to the somatosensory sensor, which senses the physical parameters of the target user's body movements. When it is detected that the distance between the target user and the socket is less than a preset threshold, the camera acquires image information and transmits the image information to the prompt device. The prompt device prompts the target user to complete the operation of inserting the plug into the socket according to the image information.

[0041] Optionally, the device for prompting a user based on an image provided in an embodiment of the present application includes a camera, a somatosensory sensor, and a socket. Among them, the camera can be installed at a target position, and the target position can be a position on the same side as the socket and not overlapping with the socket, such as a wall with a socket installed on the wall, and the camera is also installed on the wall, not overlapping with the position of the socket, so that the camera can capture the image of the socket, and can also capture the image of the process of the target user inserting the plug into the socket position. The target position can also be any raised position on the socket plate, and a camera is set at the raised position. Since the camera and the socket are not on the same plane, the image of the socket and the image of the process of the target user inserting the plug into the socket position can also be captured. The target position can also be the position of each socket contained in the socket, such as the socket is a three-hole socket, and cameras are installed in all three sockets.

[0042] In order to save the endless number of shots of the device based on image prompts to the user, the embodiment of the present application installs an integrated sensor in the device for image prompts to the user, and the camera is connected to the somatosensory sensor. Among them, the somatosensory sensor mainly includes an inertial sensor, such as a gravity sensor, a gyroscope, and a magnetic sensor to sense the physical parameters of the target user's body movements, and the various movements of the target user in space are obtained based on these physical parameters. When the target user's movements are sensed to be enough to turn on the camera in the device for shooting, the image information is acquired. For example, when it is monitored that the distance between the target user and the socket is less than a preset threshold, the image information acquired by the camera is used, which saves the number of camera shots and saves certain material resources.

[0043] The image information acquired by the camera is then transmitted to the prompting device, which prompts the target user to complete the operation of inserting the plug into the socket of the socket according to the image information. The prompting device can be any device set outside the device that prompts the user with the image, such as a mobile terminal or a fixed device installed at any location. In addition, the prompting method involved in the embodiments of the present application can be a voice prompt method, an image display method, etc.

[0044] In an embodiment of the present application, an image-based user prompting method is adopted, through a camera, a somatosensory sensor and a socket. The camera is installed at a target position to obtain image information of the socket; the camera is connected to the somatosensory sensor, and the somatosensory sensor senses the physical parameters of the target user's body movements. When it is monitored that the distance between the target user and the socket is less than a preset threshold, the image information obtained by the camera is used, and the image information is transmitted to a prompting device. The prompting device prompts the target user to complete the operation of inserting the plug into the socket hole of the socket according to the image information. When the target user tries to install the electrical plug on the socket, the camera presents an image of the contact between the plug and the socket hole in real time, and the target user inserts the plug according to the image information, so that the target user can observe in real time whether the plug and the socket are aligned, making the process of inserting the plug into the socket simpler and more convenient, and can be inserted accurately, thereby solving the problem of insufficient alignment of the plug and the socket during the insertion process in the related art.

[0045] As an optional embodiment, the prompting device includes: a display;

[0046] The prompting device is provided with a display, and the display is used to display the operation of the target user inserting the plug into the socket of the socket.

[0047] Optionally, when prompting the target user to complete the operation of inserting the plug into the socket of the socket by displaying an image, a display can be provided on the prompting device to transmit the image information acquired by the camera to the display for image display, that is, to display the image information captured by the camera on the display, wherein the display can be set at any position that is convenient for the target user to watch. In this way, the target user can be prompted to complete the operation of inserting the plug into the socket of the socket according to the displayed image information, that is, the target user can watch the image displayed on the display to check whether he has aligned the plug with the socket of the socket, and can make adjustments in time if he has not aligned, so that the target user does not need to bend down to check the insertion, so as to accurately and completely insert the plug into the socket of the socket.

[0048] According to another aspect of the embodiment of the present application, a method for prompting a user to operate is also provided, such as Figure 1 , the method comprising:

[0049] Step S101, when it is detected that the distance between the target user and the socket is less than a preset threshold, multiple current image information of the target plug is obtained, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug matches the socket.

[0050] Optionally, in an embodiment of the present application, a somatosensory sensor can be used to sense the physical parameters of the target user's body movements, and then when it is monitored that the distance between the target user and the socket is less than a preset threshold, it indicates that the target user has a tendency to use the socket to charge, and at this time, the camera can be used to obtain multiple current image information of the target plug; in addition, the embodiment of the present application can also set a preset time length, such as 5 minutes, and then the current image information of multiple target plugs can be obtained continuously or intermittently within the preset time length. At the same time, the target plug can be a plug held in the palm of the target user, or a plug held by other parts of the target user.

[0051] The preset threshold may be the minimum value of the target user's action to turn on the camera in the device for shooting. The positional relationship between the target plug and the socket may be obtained based on the current image information. The target plug here is an object that matches the socket, such as a set of plugs and sockets produced in a matching manner.

[0052] Step S102: prompting the target user to complete the operation of inserting the target plug into the socket of the outlet according to the current image information.

[0053] Optionally, the target user may flexibly change and adjust the position of the target plug based on the positional relationship between the target plug and the socket reflected by the current image information, so that the target user can complete the operation of inserting the target plug into the socket of the socket.

[0054] In an embodiment of the present application, by continuously acquiring multiple current image information of the target plug when the target user approaches the socket to a preset threshold, the positional relationship between the target plug and the socket is obtained, and then based on these image information, the target object completes the operation of inserting the target plug into the socket hole according to the processed image information. When the target user attempts to install the target plug of the electrical appliance on the socket, the camera presents the image of the contact between the target plug and the socket hole in real time, and the target user inserts the plug according to the prompts given, so that the target user can observe in real time whether the currently held target plug is aligned with the socket, and then the process of inserting the target plug into the socket is simpler, more convenient, and can be inserted accurately, thereby solving the problem of inaccurate alignment between the plug and the socket during the insertion process in the related art.

[0055] As an optional embodiment, prompting the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information includes:

[0056] Merging multiple current image information to obtain first image information;

[0057] Performing an image deduplication operation on the first image information to obtain second image information;

[0058] The target user is prompted to complete the operation of inserting the target plug into the socket of the outlet by using the second image information.

[0059] Optionally, since the camera continuously captures images of the target plug within a period of time, in order to display relatively concise image information on the display, the embodiment of the present application will merge the obtained multiple current image information to obtain merged first image information.

[0060] Since the camera in the embodiment of the present application is shooting continuously, there must be overlaps between the multiple current image information obtained, and the merged first image information will also show overlapping areas. At this time, in order to provide the target user with a better viewing experience, the embodiment of the present application will deduplicate the first image information to obtain the second image information.

[0061] Among them, the embodiment of the present application can display the obtained second image information on the display, and can remind the target user of the current positional relationship between the target plug and the socket by prompting, so that the target user can complete the operation of inserting the target plug into the socket of the socket.

[0062] It is understandable that the present application can also display on the display that the target user should perform a series of displacement operations such as "left", "right", "up", "down", etc.

[0063] The embodiment of the present application can also use the obtained second image information to remind the target user of the current positional relationship between the target plug and the socket in the form of voice prompts, so that the target user can complete the operation of inserting the target plug into the socket of the socket. For example, voice broadcasts "left", "right", "up", "down", etc. to perform a series of displacement operations.

[0064] As an optional embodiment, acquiring multiple current image information of the target plug includes:

[0065] When the camera is set at a position on the same side as the socket and not overlapping with the socket, the camera is used to obtain multiple current image information of the target plug, wherein each current image information is a complete image of the process of inserting the target plug into the socket hole of the socket, and the complete image contains the current image information of the socket and the current image information of the target plug.

[0066] Optionally, when it is determined that the position of the camera is at the same side as the socket and does not overlap with the socket, multiple complete images (or multiple complete images continuously acquired within a preset time period) of the target user inserting the target plug into the socket hole are acquired by the camera, wherein the complete image includes the current image information of the socket and the current image information of the target plug. Based on these complete images, the target user can determine whether he or she has aligned the socket hole with the target plug during the process of inserting the target plug into the socket.

[0067] As an optional embodiment, acquiring multiple current image information of the target plug includes:

[0068] In the case where the camera is set in each socket included in the socket, the camera in each socket is used to obtain multiple current image information of the target plug, wherein each current image information is the image information corresponding to the target plug during the process of the target plug being inserted into the socket, photographed from each socket angle.

[0069] Optionally, in an embodiment of the present application, the camera can be installed in each socket included in the socket. For example, if a socket includes three sockets, a camera is installed in each socket. The camera in each socket can be used to continuously obtain multiple current image information of the target plug within a preset time period, wherein these current image information come from cameras in different sockets. For example, socket 1 will continuously capture image information when the target plug is moved over, and socket 2 will also continuously capture image information when the target plug is moved over, etc. These current image information are all image information captured from the angles of each socket.

[0070] As an optional embodiment, using the second image information to prompt the target user to complete the operation of inserting the target plug into the socket of the socket includes:

[0071] Displaying the position of a preset reference mark, wherein the preset reference mark is used to indicate the position corresponding to when the target plug is fully inserted into the socket of the socket;

[0072] Acquire each target plug position in the second image information according to the preset plug image;

[0073] Positionally match each target plug position with a preset benchmark;

[0074] The target plug position is adjusted according to the matching result, and the target user is prompted to complete the operation of inserting the target plug into the socket of the outlet.

[0075] Optionally, the position of a preset mark may be displayed on the display, and the target plug may be completely inserted into the socket of the socket according to the preset mark, wherein the preset mark may be an "x" symbol or a "+" symbol, etc.

[0076] The embodiment of the present application sets a preset plug image of the plug in advance, and each target plug in the second image information can be located according to the preset plug image, that is, the position of each target plug in the second image information is found. At this time, the position of each target plug found is matched with the preset reference mark. If it is completely matched, it proves that the target user has completely inserted the target plug into the socket. If it is not completely matched, the target plug position is adjusted according to the matching result to prompt the target user how to complete the insertion of the target plug into the socket of the socket.

[0077] In the embodiment of the present application, the target plug position is adjusted by using a preset alignment mark, so as to achieve the purpose of quickly and accurately aligning the target plug with the socket.

[0078] As an optional embodiment, Figure 2 As shown, the specific steps are as follows:

[0079] Install cameras or other imaging devices on sockets or walls;

[0080] In the case where the user starts inserting the plug into the socket;

[0081] An imaging device on the plug or on the wall detects images of the plug and socket holes in real time;

[0082] Upload the acquired real-time image to the server;

[0083] The server sends the image to the visual interface of the user's mobile terminal;

[0084] The user inserts the plug into the socket through real-time images.

[0085] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0086] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM (Read-Only Memory) / RAM (Random Access Memory), a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0087] According to another aspect of an embodiment of the present application, a device for prompting a user to operate is also provided for implementing the above-mentioned method for prompting a user to operate. Figure 3 is a structural block diagram of an optional device for prompting a user to operate according to an embodiment of the present application, such as Figure 3 As shown, the device may include:

[0088] The acquisition unit 301 is used to acquire multiple current image information of the target plug when it is detected that the distance between the target user and the socket is less than a preset threshold, wherein the current image information is used to represent the positional relationship between the target plug and the socket, and the target plug matches the socket;

[0089] The prompting unit 302 is used to prompt the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information.

[0090] It should be noted that the acquisition unit 301 in this embodiment can be used to execute the above step S101, and the prompt unit 302 in this embodiment can be used to execute the above step S102.

[0091] Through the above module, when the target user attempts to install the target plug of the electrical appliance on the socket, the camera presents the image of the contact between the target plug and the socket hole in real time, and the target user inserts the plug according to the image information, so that the target user can observe in real time whether the target plug and the socket are aligned, making the process of inserting the target plug into the socket simpler and more convenient, and can be inserted accurately, thereby solving the problem of inaccurate alignment of the plug and the socket during the insertion process in the related art.

[0092] As an optional embodiment, the prompting unit 302 includes:

[0093] A first obtaining module, used for combining multiple current image information to obtain first image information;

[0094] A second obtaining module is used to perform an image deduplication operation on the first image information to obtain second image information;

[0095] The first prompting module is used to prompt the target user to complete the operation of inserting the target plug into the socket of the outlet by using the second image information.

[0096] As an optional embodiment, the acquiring unit 301 includes:

[0097] The first acquisition module is used to use the camera to acquire multiple current image information of the target plug when the camera is set at a position on the same side of the socket and not overlapping with the socket, wherein each current image information is a complete image of the process of the target user inserting the target plug into the socket of the socket, and the complete image includes the current image information of the socket and the current image information of the target plug.

[0098] As an optional embodiment, the acquiring unit 301 includes:

[0099] The second acquisition module is used to obtain multiple current image information of the target plug using the camera in each socket when the camera is set in each socket included in the socket, wherein each current image information is the image information corresponding to the target plug during the process of the target plug being inserted into the socket, photographed from each socket angle.

[0100] As an optional embodiment, the prompting unit 302 includes:

[0101] A display module, used to display the position of a preset reference mark, wherein the preset reference mark is used to indicate the position corresponding to when the target plug is fully inserted into the socket of the socket;

[0102] An acquisition module, used for acquiring each target plug position in the second image information according to a preset plug image;

[0103] A matching module, used for matching the position of each target plug with a preset reference;

[0104] The second prompting module is used to adjust the position of the target plug according to the matching result, and prompt the target user to complete the operation of inserting the target plug into the socket of the outlet.

[0105] It should be noted here that the examples and application scenarios implemented by the above modules and corresponding steps are the same, but are not limited to the contents disclosed in the above embodiments.

[0106] According to another aspect of an embodiment of the present application, an electronic device for implementing the above-mentioned method of prompting a user to operate is also provided. The electronic device may be a server, a terminal, or a combination thereof.

[0107] Figure 4 is a structural block diagram of an optional electronic device according to an embodiment of the present application, such as Figure 4 As shown, it includes a processor 401, a communication interface 402, a memory 403 and a communication bus 404, wherein the processor 401, the communication interface 402 and the memory 403 communicate with each other through the communication bus 404, wherein,

[0108] Memory 403, used for storing computer programs;

[0109] The processor 401 is used to implement the following steps when executing the computer program stored in the memory 403:

[0110] When it is detected that the distance between the target user and the socket is less than a preset threshold, multiple current image information of the target plug is obtained, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug matches the socket;

[0111] It is used to prompt the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information.

[0112] Optionally, in this embodiment, the communication bus may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0113] The communication interface is used for communication between the above electronic device and other devices.

[0114] The memory may include RAM, or may include non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0115] As an example, Figure 4 As shown, the memory 403 may include, but is not limited to, the acquisition unit 301, the first obtaining unit 302, the second obtaining unit 303, and the prompting unit 304 in the device for prompting the user to operate. In addition, other module units in the device for prompting the user to operate may also be included but are not limited to, which will not be repeated in this example.

[0116] The above-mentioned processor can be a general-purpose processor, which can include but not be limited to: CPU (Central Processing Unit), NP (Network Processor), etc.; it can also be DSP (Digital Signal Processing), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0117] In addition, the electronic device mentioned above further comprises: a display for displaying the result of prompting the user's operation.

[0118] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment will not be described in detail here.

[0119] It can be understood by those skilled in the art that Figure 4 The structure shown is for illustration only. The device for implementing the above method of prompting the user to operate may be a terminal device, which may be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (Mobile Internet Devices, MID), a PAD, and other terminal devices. Figure 4 It does not limit the structure of the above electronic device. For example, the terminal device may also include Figure 4 More or fewer components (such as network interfaces, display devices, etc.) shown in, or having Figure 4 Different configurations shown.

[0120] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a computer-readable storage medium, which can include: a flash drive, ROM, RAM, a magnetic disk or an optical disk, etc.

[0121] According to another aspect of the embodiment of the present application, a storage medium is also provided. Optionally, in this embodiment, the storage medium can be used to execute the program code of the method for prompting the user to operate.

[0122] Optionally, in this embodiment, the storage medium may be located on at least one network device among a plurality of network devices in the network shown in the above embodiment.

[0123] Optionally, in this embodiment, the storage medium is configured to store program codes for executing the following steps:

[0124] When it is detected that the distance between the target user and the socket is less than a preset threshold, multiple current image information of the target plug is obtained, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug matches the socket;

[0125] It is used to prompt the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information.

[0126] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, which will not be described in detail in this embodiment.

[0127] Optionally, in this embodiment, the storage medium may include, but is not limited to, various media that can store program codes, such as a USB flash drive, a ROM, a RAM, a mobile hard disk, a magnetic disk, or an optical disk.

[0128] According to another aspect of the embodiments of the present application, a computer program product or a computer program is also provided, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method steps of prompting a user to operate in any of the above embodiments.

[0129] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0130] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling one or more computer devices (which can be personal computers, servers or network devices, etc.) to execute all or part of the steps of the method for prompting the user to operate in each embodiment of the present application.

[0131] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0132] In the several embodiments provided in the present application, it should be understood that the disclosed client can be implemented in other ways. Among them, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0133] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution provided in this embodiment.

[0134] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0135] The above are only preferred implementations of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A device for prompting a user based on an image, characterized in that: The device comprises: a camera, a body sensor and a socket; The camera is installed at a target position and is used to obtain image information of the socket; The camera is connected to the body sensor, and the body sensor senses the physical parameters of the target user's body movements. When it is detected that the distance between the target user and the socket is less than a preset threshold, the image information obtained by the camera is used and transmitted to the prompt device. The image information is a real-time picture of the target user inserting the plug into the socket. The prompt device prompts the target user to complete the operation of inserting the plug into the socket according to the image information. The prompt device comprises: a display; the display is arranged on the prompt device, and the display is used to display the operation of the target user inserting the plug into the socket of the socket, so that the target user can observe through the prompt device whether the plug and the socket are aligned and complete the operation of inserting the plug into the socket of the socket; The prompt device is also used to display a displacement operation on a display, and the displacement operation is used to guide the target user to insert the plug into the socket of the socket, and / or the prompt device is also used to voice broadcast the displacement operation so that the target user completes the operation of inserting the plug into the socket of the socket.

2. The device according to claim 1, characterized in that The target position includes: a position on the same side as the socket and not overlapping with the socket or a position of each socket included in the socket.

3. A method for prompting a user to operate, applied to the device for prompting a user based on an image as claimed in any one of claims 1 to 2, characterized in that: The method comprises: When it is detected that the distance between the target user and the socket is less than a preset threshold, multiple current image information of the target plug is obtained, wherein the current image information is used to represent the positional relationship between the target plug and the socket, and the target plug matches the socket; According to the current image information, the target user is prompted to complete the operation of inserting the target plug into the socket of the outlet.

4. The method according to claim 3, characterized in that The prompting the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information includes: Merging a plurality of the current image information to obtain first image information; Performing an image deduplication operation on the first image information to obtain second image information; The target user is prompted to complete the operation of inserting the target plug into the socket of the outlet by using the second image information.

5. The method according to claim 3, characterized in that: The acquiring a plurality of current image information of the target plug comprises: When the camera is set at a position on the same side as the socket and not overlapping with the socket, the camera is used to obtain multiple current image information of the target plug, wherein each current image information is a complete image of the process of inserting the target plug into the socket hole of the socket, and the complete image contains the current image information of the socket and the current image information of the target plug.

6. The method according to claim 3, characterized in that The acquiring a plurality of current image information of the target plug comprises: In the case where a camera is arranged in each socket included in the socket, the camera in each socket is used to obtain multiple current image information of the target plug, wherein each current image information is image information corresponding to the target plug during the process of the target plug being inserted into the socket, photographed from the angle of each socket.

7. The method according to claim 4, characterized in that The using the second image information to prompt the target user to complete the operation of inserting the target plug into the socket of the socket includes: Displaying the position of a preset reference mark, wherein the preset reference mark is used to indicate the position corresponding to when the target plug is fully inserted into the socket of the socket; Acquire the position of each target plug in the second image information according to a preset plug image; Positionally matching each of the target plug positions with the preset benchmark; The target plug position is adjusted according to the matching result, and the target user is prompted to complete the operation of inserting the target plug into the socket of the socket.

8. A device for prompting a user to operate, applied to the device for prompting a user based on an image as claimed in any one of claims 1 to 2, characterized in that: The device comprises: an acquisition unit, configured to acquire a plurality of current image information of a target plug when it is detected that the distance between the target user and the socket is less than a preset threshold, wherein the current image information is used to characterize the positional relationship between the target plug and the socket, and the target plug matches the socket; A prompting unit is used to prompt the target user to complete the operation of inserting the target plug into the socket of the socket according to the current image information.

9. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein: The processor, the communication interface and the memory communicate with each other via the communication bus, wherein: The memory is used to store computer programs; The processor is configured to execute the method steps of any one of claims 3 to 7 by running the computer program stored in the memory.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, wherein the computer program is configured to execute the method steps described in any one of claims 3 to 7 when run.

Images