Display method, device, electronic device and storage medium

Abstract

The present application discloses a display method, device, electronic device and storage medium, belonging to the field of computer technology. The method comprises: determining the position of a plug in a first image currently captured by an electronic device; determining the relative position relationship between the plug and the at least one socket in the electronic device based on the position of the plug and the position of the at least one socket; displaying a second image, the second image indicating the relative position relationship, and the user determines whether the current plug has reached the position of the socket to be plugged in according to the second image, thereby improving the user's speed of finding the socket and the accuracy of aligning the plug with the socket, thereby improving the user's operating efficiency.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a display method, device, electronic device and storage medium. Background Art

[0002] With the development of electronic technology, electronic devices have become an indispensable part of people's lives. Some electronic devices also provide functions such as displaying external signals, wired network connection, and external sound output. If these electronic devices realize these functions, users need to insert the plug of the connecting cable into the socket on the back of the electronic device before they can be used normally. However, electronic devices are usually hung on the wall, or the electronic devices are backed by obstacles, which makes it impossible for users to align the plug with the socket on the back of the electronic device, affecting the operation efficiency. Summary of the invention

[0003] The embodiments of the present application provide a display method, device, electronic device and storage medium, wherein the electronic device displays a second image indicating the relative position relationship between a plug and at least one socket, and the user determines whether the current plug has reached the position of the socket to be plugged in based on the second image, thereby improving the user's speed of finding the socket and the accuracy of aligning the plug with the socket, thereby improving the user's operating efficiency. The technical solution is as follows:

[0004] According to one aspect of an embodiment of the present application, a display method is provided, the method comprising:

[0005] Determine the position of the plug in the first image currently captured by the electronic device;

[0006] Determining a relative position relationship between the plug and the at least one socket in the electronic device based on the position of the plug and the position of the at least one socket in the electronic device;

[0007] A second image is displayed, the second image indicating the relative positional relationship.

[0008] According to another aspect of an embodiment of the present application, a display device is provided, the device comprising:

[0009] A position determination module, used to determine the position of the plug in the first image currently captured by the electronic device;

[0010] a relationship determination module, configured to determine a relative position relationship between the plug and the at least one socket in the electronic device based on the position of the plug and the position of the at least one socket in the electronic device;

[0011] The display module is used to display a second image, where the second image indicates the relative position relationship.

[0012] According to another aspect of an embodiment of the present application, an electronic device is provided, comprising a processor, a memory and a display device; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the display method described in the above aspect.

[0013] According to another aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein the storage medium stores at least one program code, and the at least one program code is used to be executed by a processor to implement the display method as described in the above aspect.

[0014] According to another aspect of an embodiment of the present application, a computer program product is provided. The computer program product stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the display method described in the above aspect.

[0015] The display method, device, electronic device and storage medium provided in the embodiments of the present application can capture a first image including a plug, and also determine the relative position relationship between the plug and at least one socket of the electronic device. The electronic device displays a second image indicating the relative position relationship between the plug and at least one socket. The user determines whether the current plug has reached the position of the socket to be plugged in based on the second image, thereby improving the user's speed in finding the socket and the accuracy of aligning the plug with the socket, thereby improving the user's operating efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A flow chart of a display method provided by an exemplary embodiment of the present application is shown;

[0018] Figure 2 A flow chart of a display method provided by an exemplary embodiment of the present application is shown;

[0019] Figure 3 A flow chart of a display method provided by an exemplary embodiment of the present application is shown;

[0020] Figure 4 A flow chart of a display method provided by an exemplary embodiment of the present application is shown;

[0021] Figure 5A structural block diagram of a display device provided by an exemplary embodiment of the present application is shown;

[0022] Figure 6 A structural block diagram of a display device provided by an exemplary embodiment of the present application is shown;

[0023] Figure 7 A structural block diagram of an electronic device provided by an exemplary embodiment of the present application is shown; DETAILED DESCRIPTION

[0024] In order to make the objectives, technical solutions and advantages of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

[0025] The term "multiple" as used herein refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0026] An embodiment of the present application provides a display method, which is executed by an electronic device. The electronic device captures a current first image and displays a second image that can indicate the relative position relationship between the plug and at least one socket based on the position of the plug in the first image and the position of the socket in the electronic device.

[0027] In some embodiments, the electronic device is a terminal, for example, the terminal is a mobile phone, a desktop computer, a laptop computer, a tablet computer, a smart TV, a smart speaker, a car terminal, an intelligent robot, and other types of terminals.

[0028] The display method provided by the embodiment of the present application can be applied to the scene of installing electronic devices. For example, after the electronic device is installed on the wall, the user needs to insert the plug into the socket of the electronic device. At this time, the electronic device can capture the first image, identify the first image to determine the position of the plug in the first image, determine the relative position relationship between the plug and at least one socket in the electronic device according to the position of the plug and the position of at least one socket in the electronic device, and display a second image including the relative position relationship. Then, the user can move the plug to the corresponding socket position according to the relative position relationship of the second image, and insert the plug into the socket, thereby improving the accuracy of the user's alignment of the plug with the socket, thereby improving the user's operating efficiency.

[0029] Figure 1 A flow chart of a display method provided by an exemplary embodiment of the present application is shown. Figure 1 , the method is applied in an electronic device, the method comprising:

[0030] Step 101: Determine the position of a plug in a first image currently captured by an electronic device.

[0031] In an embodiment of the present application, after the electronic device is installed on the wall, in order to allow the user to intuitively view the position of at least one socket and a plug located behind the electronic device, the electronic device captures a first image, and then determines the relative position relationship between the plug and at least one socket in the electronic device based on the position of the plug in the captured first image, and then displays a second image that can indicate the relative position relationship.

[0032] For example, according to the type of plug, the plug may be an image transmission plug, a sound transmission plug, a network plug or other types of plugs. Alternatively, according to the function of the wire connected by the plug, the plug may be an HDMI (High Definition Multimedia Interface) line plug, a VGA (Video Graphics Array) line plug, an AV (Audio & Video) line plug, or a YPbPr (color difference component interface) line plug.

[0033] Step 102: Based on the position of the plug and the position of at least one socket in the electronic device, determine the relative position relationship between the plug and the at least one socket.

[0034] In an embodiment of the present application, the electronic device determines the position of the plug in the captured first image, and the electronic device can also determine the position of at least one socket included in itself. The electronic device can then determine the relative position relationship between the plug and the at least one socket based on the position of the plug and the position of the at least one socket in the electronic device.

[0035] Step 103: Display a second image, where the second image indicates the relative positional relationship.

[0036] In an embodiment of the present application, after the electronic device determines the relative position relationship between the plug and at least one socket, it can generate an image indicating the relative position relationship, and then display the second image. The user can determine the current position of the plug based on the displayed second image, and then move the plug according to the relative position relationship displayed by the second image, so as to move the plug to the position of the socket where it needs to be inserted, thereby inserting the plug into the socket.

[0037] In the display method provided in the embodiment of the present application, the electronic device can capture a first image including a plug, and also determine the relative position relationship between the plug and at least one socket of the electronic device. The electronic device displays a second image indicating the relative position relationship between the plug and at least one socket. The user determines whether the current plug has reached the position of the socket to be plugged in based on the second image, thereby improving the user's speed in finding the socket and the accuracy of aligning the plug with the socket, thereby improving the user's operating efficiency.

[0038] Figure 2 A flow chart of a display method provided by an exemplary embodiment of the present application is shown. Figure 2 , the method is applied in an electronic device, the method comprising:

[0039] Step 201: Determine the position of a plug in a first image currently captured by an electronic device.

[0040] In the embodiment of the present application, the electronic device recognizes the currently acquired first image to determine the position of the plug in the first image.

[0041] In some embodiments, the electronic device recognizes the first image using image recognition technology, or the electronic device recognizes the first image using other methods.

[0042] In some embodiments, the electronic device includes a camera, through which the first image is captured.

[0043] Optionally, the camera is located inside at least one socket included in the electronic device, and the shooting direction of the camera is consistent with the direction of the at least one socket. After the camera is turned on, it can capture images along the shooting direction. If the user holds the plug and moves it into the camera's capture range, the camera can capture images including the socket.

[0044] Optionally, the camera is located at the rear side of the electronic device, and the shooting direction of the camera is toward at least one socket of the electronic device, and the at least one socket belongs to the shooting range of the camera.

[0045] In some embodiments, the electronic device further includes a fill light, and the irradiation direction of the fill light is consistent with the shooting direction of the camera. The electronic device in the embodiment of the present application improves the brightness through the light of the fill light, thereby improving the clarity of the image collected by the camera.

[0046] Step 202: Determine a first relative position relationship between the position of the plug and the target position in the first image.

[0047] The target position is a specific position in the image captured by the electronic device, and it can also be understood that the target position is a reference position for the electronic device to determine the position of the plug.

[0048] In some embodiments, the target position is the center position of the first image, or the target position is the upper left corner position of the first image, or the target position is the center position of the edge of the first image, or the target position is other position in the first image.

[0049] In an embodiment of the present application, the plug is located in the first image, and the target position is a specific position in the image, so the electronic device can determine the first relative position relationship between the position of the plug and the target position based on the position of the plug in the first image and the target position in the first image.

[0050] Step 203: Determine the relative position relationship between the plug and at least one socket according to the first relative position relationship and the second relative position relationship, wherein the second relative position relationship is the relative position relationship between the target position and at least one socket.

[0051] In an embodiment of the present application, the first relative position relationship is the relationship between the plug and the target position, and the second relative position relationship is the relative position relationship between the target position and at least one socket. Since the plug and the at least one socket are both related to the target position, the target position is used as a reference position, and the relative position relationship between the plug and at least one socket is determined based on the first relative position relationship and the second relative position relationship.

[0052] In an embodiment of the present application, a first image is acquired by a camera of an electronic device, and positions of the camera and at least one socket in the electronic device are fixed. The shooting angle, shooting direction and shooting angle of the camera when acquiring the first image are fixed. Therefore, the relative position relationship between the target position in the first image acquired by the camera and the camera is fixed. By utilizing the relative position relationship between the camera and at least one socket, and the relative position relationship between the camera and the target position, the second relative position relationship between the target position and at least one socket can be converted and determined, and then the relative position relationship between the plug and at least one socket can be determined based on the first relative position relationship and the second relative position relationship.

[0053] It should be noted that the embodiment of the present application may not execute steps 202-203, and the relative position relationship between the plug and at least one socket may be determined by executing step 102.

[0054] Step 204: Determine a mapping position of at least one socket in the first image based on the position of the plug and the relative position relationship between the plug and at least one socket.

[0055] In an embodiment of the present application, the plug is located in the first image, and at least one socket is not in the first image. There is a relative position relationship between the plug and the at least one socket. Therefore, based on the relative position relationship between the plug and the at least one socket, the mapping position of the at least one socket in the first image can be determined.

[0056] Step 205: Add a socket image to at least one mapping position determined in the first image to obtain a second image, and display the second image.

[0057] In an embodiment of the present application, the electronic device has determined the mapping position of at least one socket in the first image, and then adds a socket image at each mapping position to obtain a second image, which can represent the relative position relationship between the plug and at least one socket in an actual environment. The electronic device displays the second image for the user to view.

[0058] In some embodiments, different sockets have different shapes. In order to distinguish the socket images added in the first image, different sockets are represented by different socket images. Therefore, after determining the mapping position of each socket of at least one socket in the first image, the socket image corresponding to the socket is added to each mapping position in the first image to obtain a second image, which includes different types of socket images.

[0059] In some embodiments, for each mapping position determined in the first image, a socket image is added at the mapping position, a socket name of the socket corresponding to the mapping position is added to the name display position corresponding to the mapping position, a second image is generated based on the first image and the socket image and socket name added in the first image, and the second image is displayed.

[0060] In an embodiment of the present application, the electronic device not only adds a socket image to the first image, but also adds the name information of each socket, so that the user can know the name of each socket and prevent the user from plugging the plug into the wrong socket.

[0061] After the electronic device determines the mapping position of at least one socket in the first image, each mapping position corresponds to a name display position. The electronic device adds a socket image to each mapping position determined in the first image, and each socket corresponding to the plug image has a name, so the socket name of the socket corresponding to each mapping position is added to the name display position corresponding to each mapping position. After adding the socket image to each mapping position and adding the socket name to the name display position, a second image is generated, and the electronic device displays the generated second image.

[0062] The name display position is above the mapping position, or the name display position is to the left of the mapping position, or the name display position is at other positions of the mapping position, which is not limited in the embodiments of the present application.

[0063] It should be noted that, in the embodiment of the present application, steps 204-205 may not be executed, and the second image may be displayed by executing step 103.

[0064] In the method provided by the embodiment of the present application, the first image captured by the electronic device includes the target position, and the electronic device can also determine a first relative position relationship between the position of the plug and the target position, and a second relative position relationship between the target position and at least one socket. Since the first relative position relationship and the second relative position relationship both include the target position, the relative position relationship between the plug and at least one socket can be determined with the target position as a reference position, and a second image indicating the relative position relationship is displayed. The user determines whether the current plug has reached the position of the socket to be plugged in based on the second image, thereby improving the user's speed in finding the socket and the accuracy of aligning the plug with the socket, thereby improving the user's operating efficiency.

[0065] Figure 1 The illustrated embodiment illustrates a process of determining a relative positional relationship between a plug and at least one socket in a captured image and displaying a second image indicating the relative positional relationship. Figure 3 In the embodiment shown, if the electronic device collects images to perform a subsequent process, it needs to be performed when the wiring auxiliary function is turned on. The process of the electronic device turning on the wiring auxiliary function to collect images is as follows: Figure 3 As shown, the method includes:

[0066] Step 301: When the wiring assistance function is turned on, a first image is acquired.

[0067] Among them, the wiring auxiliary function is used to display the relative position relationship between the plug and the socket based on the currently acquired image.

[0068] In an embodiment of the present application, the process of the electronic device capturing the first image to determine the relative position relationship between the plug and at least one socket needs to be performed when wiring is required, so the electronic device sets a wiring assistance function, and executes steps 301-304 when the wiring assistance function is turned on. If the electronic device does not turn on the wiring assistance function, the electronic device will not execute steps 301-304.

[0069] The wiring auxiliary function of the electronic device is enabled when a plug needs to be plugged into the socket of the electronic device. At this time, step 301 may be performed. The following describes how to enable the wiring auxiliary function.

[0070] In some embodiments, a distance sensor in the electronic device is used to detect a second distance between the distance sensor and the plug, and when the second distance is less than a second preset distance, the wiring auxiliary function is enabled.

[0071] In an embodiment of the present application, a distance sensor is installed in the electronic device, and the distance sensor can measure a second distance between the distance sensor and the plug. If the second distance is less than the second preset distance, it means that the distance between the distance sensor and the plug is close, and the plug needs to be inserted into the socket. Therefore, the electronic device turns on the wiring auxiliary function and executes subsequent steps 301-304.

[0072] The second preset distance is set by the electronic device, or by the developer, or in other ways. For example, the second preset distance is 10 centimeters, 20 centimeters, or other values.

[0073] Optionally, in order to improve the accuracy of starting the wiring auxiliary function, in the embodiment of the present application, when the electronic device detects that the second distance between the distance sensor and the plug is less than the second preset distance, it will continue to determine whether the duration of the measured second distance being less than the second preset distance is greater than the first preset duration. If the duration is greater than the first preset duration, it means that the plug has been near the distance sensor, which can also be understood as the user needs to insert the plug into the socket, so the wiring auxiliary function is turned on. If the duration is not greater than the first preset duration, it means that the plug has not been near the distance sensor, which can also be understood as the user does not need to insert the plug into the socket, so there is no need to turn on the wiring auxiliary function to perform steps 301-304.

[0074] It should be noted that the present embodiment of the application is only described by taking the second distance measured by the distance sensor to determine whether to turn on the wiring auxiliary function. In another embodiment, the electronic device also determines whether to turn on the wiring auxiliary function based on whether the auxiliary opening operation is detected.

[0075] In some embodiments, the electronic device includes a wiring function button, and when the electronic device detects an on operation of the wiring function button, it determines that an auxiliary on operation is detected to turn on the wiring auxiliary function. When the electronic device detects a off operation of the wiring function button, it determines that an auxiliary off operation is detected to turn off the wiring auxiliary function.

[0076] In other embodiments, the electronic device is installed with a wiring assistance program, and the display interface of the wiring assistance program includes a wiring function option. When the electronic device detects an on operation of the wiring function option on the display interface, it determines that an auxiliary on operation is detected to turn on the wiring assistance function. When the electronic device detects a off operation of the wiring function option on the display interface, it determines that an auxiliary off operation is detected to turn off the wiring assistance function.

[0077] Step 302: Determine the position of the plug in the first image currently captured by the electronic device.

[0078] Step 303: Based on the position of the plug and the position of at least one socket in the electronic device, determine the relative position relationship between the plug and the at least one socket.

[0079] Step 304: Display a second image, where the second image indicates the relative position relationship.

[0080] Among them, steps 302-304 are similar to the above steps 101-103 and will not be repeated here.

[0081] In the display method provided in the embodiment of the present application, the electronic device captures a first image when a wiring assistance function is turned on, and determines the relative position relationship between the plug and at least one socket based on the first image, and then displays a second image that can indicate the relative position relationship. The electronic device indicates the execution steps of subsequently displaying the second image through the wiring assistance function, thereby expanding the function of the electronic device and improving the accuracy of the electronic device in displaying the relative position relationship between the plug and at least one socket.

[0082] It should be noted that the embodiment of the present application is only described by taking the display of the second image when the wiring auxiliary function is turned on as an example. In another embodiment, the electronic device will also turn off the wiring auxiliary function so as not to display the second image.

[0083] In some embodiments, when the distance sensor in the electronic device cannot detect the distance between the distance sensor and the plug, the wiring assistance function is turned off.

[0084] In an embodiment of the present application, the distance sensor in the electronic device will continuously detect the distance to objects around the distance sensor. If the distance sensor cannot detect the distance to the plug, it means that the plug is no longer around the distance sensor. It can also be understood that the user no longer needs to insert the plug into the socket, so the electronic device will turn off the wiring assistance function.

[0085] Optionally, in order to improve the accuracy of turning off the wiring assistance function, in the embodiment of the present application, the electronic device will continue to determine whether the duration of the inability to detect the distance is greater than a second preset time when it cannot detect the distance between the distance sensor and the plug. If the duration is greater than the second preset time, it means that the plug has not been near the distance sensor. It can also be understood that the user does not need to insert the plug into the socket, so the wiring assistance function is turned off.

[0086] The embodiment of the present application determines whether to turn off the wiring auxiliary function according to the distance detected by the distance sensor. The distance sensor is used to realize automatic turning off of the wiring auxiliary function of the electronic device, thereby reducing the user's operation and improving the user's operation efficiency.

[0087] exist Figure 1 Based on the embodiment shown, the electronic device not only displays the second image according to the relative position relationship between the plug and at least one socket, but also displays prompt information that the plug is connected to the socket. The process of displaying the prompt information is as follows: Figure 4 As shown:

[0088] Step 401: when it is detected that the plug is connected to any socket, a first prompt message is displayed, and the first prompt message indicates that the plug is successfully inserted.

[0089] In an embodiment of the present application, the electronic device detects the connection relationship between the plug and any socket to determine whether the plug is connected to the socket. When it is determined that the plug is connected to any socket, a first prompt message is displayed to indicate that the plug has been successfully inserted.

[0090] In some embodiments, when a first distance between the plug and any socket is less than a first preset distance, it is determined that the plug and the socket are in a connected state.

[0091] The electronic device determines whether the plug is in a connected state with the socket by detecting a first distance between the plug and any socket. If the first distance between the plug and any socket is less than a first preset distance, it indicates that the plug is in a connected state with the socket. If the first distance between the socket and the socket is not less than the first preset distance, it indicates that the plug is not in a connected state with the socket.

[0092] In other embodiments, when any socket detects an electrical signal, it is determined that the plug is in a connected state with any socket.

[0093] It should be noted that the embodiment of the present application is only described by taking the display of prompt information when the plug is connected to any socket as an example. In another embodiment, the electronic device can also display a prompt information when the plug is not connected to the socket to prompt the plug to disconnect from the connected socket.

[0094] In an embodiment of the present application, after the user inserts the plug into the socket, the user may pull out the plug. In order to prompt the user that the plug is disconnected from the socket, the electronic device will continue to detect the connection status between the plug and any socket. If it is detected that the plug and any socket are switched from a connected state to an unconnected state, a second prompt message is displayed to prompt the user to disconnect the plug from the connected socket.

[0095] In the display method provided in the embodiment of the present application, the electronic device determines whether to display the first prompt information indicating that the plug is successfully inserted by detecting whether the plug is connected to the socket. The user determines whether the plug is successfully inserted based on whether the electronic device displays the first prompt information, thereby improving the efficiency of the user in inserting the plug.

[0096] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0097] Please refer to Figure 5 , which shows a structural block diagram of a display device provided by an exemplary embodiment of the present application. The display device is applied to an electronic device, and the display device includes:

[0098] A position determination module 501, configured to determine the position of the plug in the first image currently captured by the electronic device;

[0099] A relationship determination module 502, configured to determine a relative position relationship between the plug and at least one socket in the electronic device based on the position of the plug and the position of at least one socket in the electronic device;

[0100] The display module 503 is used to display a second image, where the second image indicates the relative position relationship.

[0101] In some embodiments, the relationship determination module 502 is configured to:

[0102] determining a first relative position relationship between the position of the plug and the target position in the first image;

[0103] The relative position relationship between the plug and at least one socket is determined according to the first relative position relationship and the second relative position relationship, wherein the second relative position relationship is the relative position relationship between the target position and at least one socket.

[0104] In some embodiments, see Figure 6 , the display module 503 includes:

[0105] A mapping determination unit 5031, configured to determine a mapping position of at least one socket in the first image based on a position of the plug and a relative position relationship between the plug and the at least one socket;

[0106] The display unit 5032 is used to add a socket image to at least one mapping position determined in the first image to obtain a second image, and display the second image.

[0107] In some embodiments, the display unit 5032 is used to:

[0108] For each mapping position determined in the first image, adding a socket image at the mapping position, and adding a socket name of the socket corresponding to the mapping position at a name display position corresponding to the mapping position;

[0109] Based on the first image and the socket image and the socket name added in the first image, a second image is generated and displayed.

[0110] In some embodiments, the display module 503 is used to display a first prompt message when it is detected that the plug is connected to any socket, and the first prompt message indicates that the plug is successfully inserted.

[0111] In some embodiments, see Figure 6 , the device further comprises:

[0112] The state determination module 504 is used to determine that the plug and the socket are in a connected state when a first distance between the plug and any socket is less than a first preset distance; or

[0113] The state determination module 504 is further configured to determine whether the plug is in a connection state with any socket when an electrical signal is detected at any socket.

[0114] In some embodiments, the display module 503 is used to display a second prompt message when it is detected that the plug and any socket are switched from a connected state to a disconnected state, and the second prompt message prompts that the plug is disconnected from the connected socket.

[0115] In some embodiments, see Figure 6 , the location determination module 501 comprises:

[0116] The acquisition unit 5011 is used to acquire a first image when the wiring auxiliary function is turned on;

[0117] The position determination unit 5012 is used to determine the position of the plug in the first captured image, and the wiring auxiliary function is used to display the relative position relationship between the plug and the socket based on the currently captured image.

[0118] In some embodiments, see Figure 6 , the device further comprises:

[0119] The distance detection module 505 is used to detect a second distance between the distance sensor and the plug through the distance sensor in the electronic device;

[0120] The enabling module 506 is used to enable the wiring auxiliary function when the second distance is less than the second preset distance.

[0121] In some embodiments, see Figure 6 , the device further comprises:

[0122] The closing module 507 is used to close the wiring auxiliary function when the distance sensor in the electronic device cannot detect the distance between the distance sensor and the plug.

[0123] It should be noted that the device provided in the above embodiment, when implementing its functions, only uses the division of the above functional modules as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the electronic device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0124] An embodiment of the present application provides an electronic device, which includes a processor, a memory and a display device; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the display method provided by the above-mentioned various method embodiments.

[0125] The memory also stores the position of at least one plug in the electronic device, and the processor is used to determine the position of the plug in the first image currently captured by the electronic device, and determine the relative position relationship between the plug and the at least one socket based on the position of the plug and the position of the at least one socket stored in the memory. The display device is used to display the second image, and the second image indicates the relative position relationship determined by the processor.

[0126] Please refer to Figure 7 , which shows a block diagram of an electronic device provided by an exemplary embodiment of the present application. The electronic device 700 in the present application includes at least one or more of the following components: a processor 710 , a memory 720 and a display device 730 .

[0127] In some embodiments, the processor 710 includes one or more processing cores. The processor 710 uses various interfaces and lines to connect various parts of the entire electronic device 700, and executes various functions and processes data of the electronic device 700 by running or executing program codes stored in the memory 720, and calling data stored in the memory 720. In some embodiments, the processor 710 is implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 710 can integrate one or more combinations of central processing unit (CPU), graphics processing unit (GPU), neural network processor (NPU) and modem. Among them, the CPU mainly processes the operating system, user interface and application program; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the NPU is used to implement artificial intelligence (AI) functions; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 710, but may be implemented by a separate chip.

[0128] In some embodiments, the memory 720 includes a random access memory (RAM), and in some embodiments, the memory 720 includes a read-only memory (ROM). In some embodiments, the memory 720 includes a non-transitory computer-readable storage medium. The memory 720 can be used to store program codes. The memory 720 may include a program storage area and a data storage area, wherein the program storage area may store program codes for implementing an operating system, program codes for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), program codes for implementing the following various method embodiments, etc.; the data storage area may store data (such as audio data, a phone book) created according to the use of the electronic device 700, etc.

[0129] In some embodiments, the electronic device 700 also includes a display device 730. The display device 730 is a display component for displaying a user interface. In some embodiments, the display device 730 is a display device with a touch function, through which a user can use any suitable object such as a finger or a touch pen to perform touch operations on the display device 730. In some embodiments, the display device 730 is generally arranged on the front panel of the electronic device 700. In some embodiments, the display device 730 is designed to be a full screen, a curved screen, a special-shaped screen, a double-sided screen or a folding screen. In some embodiments, the display device 730 is also designed to be a combination of a full screen and a curved screen, a combination of a special-shaped screen and a curved screen, etc., which is not limited in this embodiment.

[0130] In addition, those skilled in the art will appreciate that the structure of the electronic device 700 shown in the above figures does not limit the electronic device 700, and the electronic device 700 includes more or fewer components than shown, or combines certain components, or arranges components differently. For example, the electronic device 700 also includes components such as a microphone, a speaker, an input unit, a sensor, an audio circuit, a module, a power supply, and a Bluetooth module, which will not be described in detail here.

[0131] The present application also provides a computer-readable medium, which stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the display method shown in the above embodiments.

[0132] The present application also provides a computer program product, which stores at least one program code, and the at least one program code is loaded and executed by the processor to implement the display method shown in the above embodiments.

[0133] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0134] Those skilled in the art can understand that all or part of the steps in the display method of the above embodiment can be completed by hardware, or by a program to instruct the relevant hardware to complete the steps. The program can be stored in a computer-readable storage medium, and the storage medium mentioned above can be a read-only memory, a disk or an optical disk, etc. The above is only a preferred embodiment of the present application and is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A display method, characterized in that: The method comprises: Determine a position of a plug in a first image currently captured by an electronic device, wherein the electronic device is installed on a wall, and at least one socket on a rear side of the electronic device faces the wall; Determining a relative position relationship between the plug and the at least one socket in the electronic device based on the position of the plug and the position of the at least one socket in the electronic device; Determining a mapping position of the at least one socket in the first image based on the position of the plug and the relative position relationship between the plug and the at least one socket; A socket image is added to at least one mapping position determined in the first image to obtain a second image, and the second image is displayed, wherein the second image indicates the relative positional relationship.

2. The method according to claim 1, characterized in that The determining, based on the position of the plug and the position of at least one socket in the electronic device, a relative position relationship between the plug and the at least one socket includes: determining a first relative position relationship between a position of the plug and a target position in the first image; The relative position relationship between the plug and the at least one socket is determined according to the first relative position relationship and the second relative position relationship, wherein the second relative position relationship is the relative position relationship between the target position and the at least one socket.

3. The method according to claim 1, characterized in that The adding a socket image to at least one mapping position determined in the first image to obtain a second image, and displaying the second image comprises: For each mapping position determined in the first image, adding the socket image at the mapping position, and adding the socket name of the socket corresponding to the mapping position at the name display position corresponding to the mapping position; The second image is generated based on the first image and the socket image and socket name added to the first image, and the second image is displayed.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When it is detected that the plug is connected to any socket, a first prompt message is displayed, wherein the first prompt message prompts that the plug is successfully inserted.

5. The method according to claim 4, characterized in that The method further comprises: When a first distance between the plug and any socket is less than a first preset distance, determining that the plug and the socket are in a connected state; or, When any socket detects an electrical signal, it is determined that the plug is in a connected state with the any socket.

6. The method according to claim 4, characterized in that The method further comprises: When it is detected that the plug and any one of the sockets are switched from the connected state to the unconnected state, a second prompt message is displayed, wherein the second prompt message prompts that the plug is disconnected from the connected socket.

7. The method according to any one of claims 1 to 3, characterized in that: The determining the position of the plug in the first image currently captured by the electronic device includes: When the wiring auxiliary function is turned on, acquiring the first image; The position of the plug in the first captured image is determined, and the wiring auxiliary function is used to display the relative position relationship between the plug and the socket based on the currently captured image.

8. The method according to claim 7, characterized in that The method further comprises: Detecting a second distance between the distance sensor and the plug by means of a distance sensor in the electronic device; When the second distance is less than a second preset distance, the wiring auxiliary function is enabled.

9. The method according to claim 7, characterized in that: The method further comprises: When the distance sensor in the electronic device cannot detect the distance between the distance sensor and the plug, the wiring auxiliary function is turned off.

10. A display device, characterized in that: The device comprises: a position determination module, configured to determine a position of a plug in a first image currently captured by an electronic device, wherein the electronic device is mounted on a wall, and at least one socket on a rear side of the electronic device faces the wall; a relationship determination module, configured to determine a relative position relationship between the plug and the at least one socket in the electronic device based on the position of the plug and the position of the at least one socket in the electronic device; A display module is used to determine the mapping position of the at least one socket in the first image based on the position of the plug and the relative position relationship between the plug and the at least one socket; add a socket image to at least one mapping position determined in the first image to obtain a second image, and display the second image, wherein the second image indicates the relative position relationship.

11. An electronic device, characterized in that: The electronic device includes a processor, a memory and a display device; the memory stores at least one program code, and the at least one program code is used to be executed by the processor to implement the display method as described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The storage medium stores at least one program code, and the at least one program code is used to be executed by a processor to implement the display method according to any one of claims 1 to 9.

Images