Interface display method and electronic device

Abstract

This application belongs to the field of human-computer interaction, and provides an interface display method and an electronic device. The method displays a control interface on the screen of the electronic device. The control interface includes a control area, which includes remote control controls. The remote control controls are initially displayed within the control area and are used to control the self-moving device. In response to user operations on the control area, the display position of the remote control controls on the control interface is updated. This method enables dynamic changes in the position of the remote control controls on the control interface, facilitating user control of the remote control controls.

Description

Technical Field

[0001] This application belongs to the field of human-computer interaction, and in particular relates to an interface display method and an electronic device. Background Technology

[0002] Self-moving devices can move and operate automatically, providing convenience for various fields such as home life and industrial manufacturing. In home life, examples include robotic lawnmowers and robotic cleaning robots. To facilitate remote control by users, self-moving devices are usually equipped with a remote control terminal, such as a mobile phone. The control terminal can display the working status of the self-moving device to the user, and the user can also operate the control terminal to change the working status of the self-moving device.

[0003] Currently, in some scenarios, users can remotely control a mobile device to move in the desired direction via a remote control terminal. For example, when a lawnmower is creating a boundary map of the lawn area, the user can remotely control the robot to move along the outer boundary of the lawn. Similarly, in manual mode, a cleaning robot can be remotely guided to a target location in the home before automatically starting cleaning. The remote control terminal displays a directional control, which the user can manipulate to control the movement of the mobile device. However, this directional control is usually located in a fixed position on the remote control interface, limiting user operation to that specific location. When the directional control is obstructed by an object, the user cannot easily trigger it, resulting in inconvenience and a poor user experience. Summary of the Invention

[0004] This application provides an interface display method to solve the technical problem that users can only operate from a fixed position on the remote control interface.

[0005] The first aspect of this application provides an interface display method and an electronic device, applied to an electronic device that communicates with a self-moving device. The electronic device includes a display screen. The method includes: displaying a control interface on the display screen, the control interface including a control area, the control area including a remote control and displaying the remote control at an initial position within the control area, the remote control being used to control the self-moving device; and updating the display position of the remote control on the control interface in response to a user operation on the control area.

[0006] According to an embodiment of this application, updating the display position of the remote control on the control interface includes: if the starting position of the user operation is outside the initial position, updating the display position of the remote control on the control interface according to the starting position.

[0007] According to an embodiment of this application, updating the display position of the remote control in the control area based on the starting position includes: using the starting position as the center position of the remote control, and updating the display position of the remote control in the control interface.

[0008] According to an embodiment of this application, the user operation is a sliding operation, the sliding operation includes the starting position and the ending position, and the method further includes: responding to the sliding operation on the remote control when the starting position is outside the initial position, and determining movement control information for the self-moving device based on the starting position and the ending position of the sliding operation, the movement control information including the movement direction.

[0009] According to an embodiment of this application, the method further includes: in response to the end of the sliding operation, the remote control is restored to the initial position.

[0010] According to an embodiment of this application, after updating the display position of the remote control on the control interface, the method further includes: responding to a preset operation on the control area and controlling the remote control to return to the initial display position.

[0011] According to an embodiment of this application, updating the display position of the remote control on the control interface further includes: if the position of the user operation is located at the initial position, updating the position of the control area on the control interface.

[0012] According to an embodiment of this application, the method further includes: responding to a pressing operation on the remote control, and if the duration of the pressing operation is longer than a preset duration, updating the display position of the control area on the control interface.

[0013] According to an embodiment of this application, the control interface further includes a display area for displaying the movement trajectory of the self-moving device under the control of the remote control. Updating the display position of the control area on the control interface includes swapping the display position of the control area with the display position of the display area.

[0014] A second aspect of this application provides an interface display device operating on an electronic device connected to a self-moving device. The electronic device includes a display screen, and the device includes: a display unit for displaying a control interface on the display screen, the control interface including a control area, the control area including remote control controls and displaying the remote control controls at an initial position within the control area, the remote control controls being used to control the self-moving device; and an update unit for responding to user operations on the control area and updating the display position of the remote control controls on the control interface.

[0015] A third aspect of this application provides an electronic device, the electronic device comprising: a memory for storing computer-readable instructions; and a processor for executing the computer-readable instructions stored in the memory to implement the interface display method.

[0016] A fourth aspect of this application provides a computer-readable storage medium storing computer-readable instructions, which are executed by a processor in an electronic device to implement the interface display method.

[0017] In several embodiments of this application, the display position of the remote control on the control interface can be updated by user operation of the control area, thereby realizing the dynamic change of the position of the remote control on the control interface and facilitating user operation of the remote control. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of a remote control interface.

[0019] Figure 2 This is an application scenario diagram of the interface display method provided in the embodiments of this application.

[0020] Figure 3 This is a flowchart of the interface display method provided in the embodiments of this application.

[0021] Figure 4 This is a schematic diagram of the control interface provided in the embodiments of this application.

[0022] Figure 5 This is a schematic diagram of the remote control provided in the embodiments of this application.

[0023] Figure 6A This is a schematic diagram illustrating the process of updating the display position of the remote control according to an embodiment of this application.

[0024] Figure 6B This is a schematic diagram illustrating the process of updating the display position of the remote control according to another embodiment of this application.

[0025] Figure 7 This is a schematic diagram of another process for updating the display position of the remote control provided in an embodiment of this application.

[0026] Figure 8 This is a schematic diagram of another process for updating the display position of the remote control provided in an embodiment of this application.

[0027] Figure 9 This is a flowchart of another interface display method provided in the embodiments of this application.

[0028] Figure 10This is a schematic diagram of another process for updating the display position of the remote control provided in an embodiment of this application.

[0029] Figure 11 This is a functional block diagram of the interface display device provided in the embodiments of this application.

[0030] Figure 12 This is a schematic diagram of the overall structure of the self-moving device provided in the embodiments of this application. Detailed Implementation

[0031] To make the objectives, technical solutions, and advantages of this application clearer, the application will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0032] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects, not to describe a specific order or sequence.

[0033] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner. Unless otherwise specified, the following embodiments and features described herein can be combined with each other.

[0034] To facilitate remote control by users, self-moving devices are typically equipped with a remote control terminal, such as a mobile phone. The control terminal can display the working status of the self-moving device to the user, and the user can also operate the control terminal to change the working status of the self-moving device. Currently, in some scenarios, the remote control interface of the control terminal displays directional controls, which the user can operate to control the movement of the self-moving device.

[0035] like Figure 1The interface shown includes a directional control that allows for 360-degree adjustment of the mobile device's direction of movement. However, this control is located in a fixed position on the remote control interface, limiting user operation to that location. If the control is obstructed by an object, the user cannot easily activate it, or if the user's hand position makes it difficult to reach the control in that fixed position. All of these factors significantly impact the user experience.

[0036] To address the aforementioned problems, this application provides an interface display method that displays a control interface on the screen of an electronic device. The control interface includes a control area that displays remote control controls. In response to user operations on the control area, the display position of the remote control controls on the control interface is updated. This achieves dynamic changes in the position of the remote control controls, facilitating user operation.

[0037] like Figure 2 The diagram shown is an application scenario diagram of the interface display method provided in the embodiments of this application.

[0038] The interface display method provided in this application embodiment can be applied to an electronic device 10, which can communicate with a self-moving device 20. A remote control can be displayed on the screen of the electronic device 10, which can be used to control the self-moving device, for example, the movement of the self-moving device can be controlled by the remote control.

[0039] In this application embodiment, the electronic device 10 can be any electronic product capable of human-computer interaction with the user. For example, the electronic device 10 can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, as well as cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, in-vehicle device, smart home device and / or smart city device. This application embodiment does not impose any special restrictions on the specific type of electronic device 10.

[0040] In this embodiment, the self-moving device 20 can be a lawnmower, cleaning robot, de-icing robot, or cruise robot.

[0041] In this embodiment, the self-mobile device 20 and the electronic device 10 can communicate directly or indirectly through one or more networks. This network can be a wired network or a wireless network; for example, the wireless network can be a mobile cellular network or a Wireless-Fidelity (WIFI) network, and of course, it can be other possible networks. This embodiment does not limit this. It should be noted that... Figure 2 The examples shown are merely illustrative; in reality, the number of self-moving devices and electronic devices is unlimited and is not specifically limited in the embodiments of this application.

[0042] The interface display method provided in the embodiments of this application will be described below with reference to the accompanying drawings and the application scenarios described above. It should be noted that the application scenarios described above are only shown to facilitate understanding of the spirit and principle of the embodiments of this application, and the embodiments of this application are not limited in any way in this respect.

[0043] like Figure 3 The diagram shown is a flowchart of an interface display method provided in an embodiment of this application. The interface display method is applied to electronic devices, such as... Figure 1 The illustrated electronic device 10 is connected to a self-moving device and includes a display screen. The order of steps in this flowchart can be changed, and some steps can be omitted, depending on different requirements. The interface display method provided in this application embodiment includes the following steps.

[0044] S401 displays a control interface on the display screen. The control interface includes a control area, which includes remote control controls and displays the remote control controls at an initial position within the control area.

[0045] In at least one embodiment of this application, a user enters the control interface by triggering a button on the parent control interface, thereby displaying the control interface on the screen.

[0046] In another embodiment, the user issues a map creation command to the electronic device via voice, and the electronic device recognizes the map creation command using voice recognition. In response to the map creation command, the electronic device displays a control interface on its screen.

[0047] In another embodiment, the user can manually open the application corresponding to the self-moving device on the electronic device. In response to the launch of the application, the electronic device can display the control interface on the screen.

[0048] In at least one embodiment of this application, the control interface is a mapping control interface, through which a user can control the self-moving device to walk along a desired boundary to create a boundary map representing the working area of ​​the self-moving device 20. The mapping control interface also includes a display area, which displays the walking trajectory of the self-moving device.

[0049] In another embodiment, the control interface is a real-time video remote control interface. The interface also displays real-time footage captured by the mobile device. Users can control the mobile device to move to their desired location using the remote control controls on the interface, while simultaneously viewing the real-time environment. The real-time video remote control interface also includes a display area that shows the real-time footage captured by the mobile device.

[0050] In another embodiment, the control interface includes only the aforementioned control area for simple control of the self-moving device. In other embodiments, the control interface may be of other types, including other modules in addition to the control area, which will not be listed here. Control interfaces including the aforementioned control area all fall within the protection scope of this application.

[0051] In at least one embodiment of this application, the control interface includes a control area, and the outer boundary of the control area is not displayed in the control interface. The shape of the control area can be circular, elliptical, square, etc., and the area of ​​the control area can cover part or the entire control interface. A remote control is displayed at an initial position within the control area, and the shape of the remote control can be circular, elliptical, square, etc. The initial position is the default position of the remote control in the control area at the initial moment when the control interface is displayed on the screen. The initial position can be set and adjusted according to actual needs; for example, the remote control can be located in the center of the control area. For example, if the shape of the control area is circular, the shape of the remote control is circular, and the remote control is located in the center of the control area (i.e., the center of the remote control overlaps with the center of the control area), it is convenient for both left and right hands to operate the remote control in the control area. If the initial position is on the right side of the control area, it is beneficial for right-handed users. The subsequent changes in the position of the center (position) of the remote control will be used to characterize the position change of the remote control.

[0052] The control area also includes the control unit, which is the portion of the control area excluding the area occupied by the remote control. That is, the area of ​​the control area is larger than the area of ​​the remote control, but the remote control only occupies a portion of the control area. The control area is not equal to the remote control, as follows: Figure 4 As stated above.

[0053] See Figure 4 As shown, Figure 4 This is a schematic diagram of the control interface provided in an embodiment of this application. Figure 5As shown, the control interface includes a control area 50. For ease of illustration, the control area 50 is shown below. Figure 5 The outer boundary of the control area 50 is represented by a dashed line. In actual scenarios, the outer boundary of the control area 50 is not displayed in the control interface. The remote control 52 is displayed at the initial position of the control area 50, and the control unit 51 is displayed in other positions. The center of the control area 50 and the center of the remote control 52 are both located at the center of the initial position. The outer boundary of the remote control 52 is displayed in the control interface. The outer boundaries of the control unit 51 and the control area 50 may not be displayed in the control interface, meaning the user cannot see the outer boundaries of the control unit 51 and the control area 50 on the control interface. In other embodiments, one or both may be highlighted so that the user can clearly observe the operable range.

[0054] In at least one embodiment of this application, a remote control is used to control a self-moving device. Specifically, the remote control receives an external trigger signal to control the self-moving device to move in any direction within a 360-degree range. For example, a user can operate the remote control to control the self-moving device to move along the boundary of a work area.

[0055] In at least one embodiment of this application, see Figure 5 The diagram illustrates a remote control provided in this embodiment. As shown, the remote control 52 is a virtual joystick control, comprising a virtual joystick 521 and a first movement operation area 522. The virtual joystick control has an initial state, in which the center of the virtual joystick 521 is the origin, i.e., the initial position of the virtual joystick 521. A circular area with radius r centered on the origin is defined as the first movement operation area 522. The virtual joystick 521 in its initial position rests at the center of the first movement operation area 522. The user can trigger the virtual joystick 521 and slide it outwards from the origin, allowing for a 360-degree slide, moving within the first movement operation area 522 without exceeding it, or at least partially within it.

[0056] Correspondingly, the electronic device detects whether there is a sliding operation on the virtual joystick 521 located at the initial position, starting from the origin. If so, the virtual joystick 521 shifts outward from the origin with the sliding operation. That is, the electronic device moves the display position of the virtual joystick 521 according to the detected sliding operation, so that the virtual joystick 521 moves with the user's finger on the display interface.

[0057] In addition, the boundaries of the first mobile operation area 522 are displayed and can be viewed by the user.

[0058] The electronic device detects the sliding operation and controls the movement of the self-moving device based on it. Specifically, in one embodiment, when the virtual joystick 521 deflects outward, the real-time position of its midpoint is the offset point. Based on the vector from the origin to the offset point, the electronic device calculates movement control information and sends it to the self-moving device to control its movement. Alternatively, the electronic device transmits the vector to the self-moving device, which calculates the movement control information using the vector and ultimately controls its own movement. In other embodiments, a physical quantity other than the aforementioned vector can be used to represent the sliding operation, and the electronic device uses this physical quantity to control the movement of the self-moving device; this will not be elaborated upon here.

[0059] The movement control information includes the movement direction of the self-moving device. The movement direction can be determined based on the direction from the origin to the offset point, or it can be determined by the sliding direction of a sliding operation. In other embodiments, the movement control information may also include, but is not limited to, the angular velocity of the self-moving device and the linear velocity of the self-moving device. The angular velocity can be determined based on the sliding angular velocity of a sliding operation, and the linear velocity can be determined based on the sliding linear velocity of a sliding operation.

[0060] In other embodiments, the remote control 52 is a set of independent up, down, left and right buttons, or other forms. Similarly, it can receive external operations to control the movement of the self-moving device. It will not be elaborated here, and all of them fall within the scope of protection.

[0061] S402 responds to user operations on the control area and updates the display position of the remote control on the control interface.

[0062] In at least one embodiment of this application, the user operation can be a swipe operation, and the user operation can also be other operations, such as a press operation, a double-click operation, etc.

[0063] In at least one embodiment of this application, if the starting position of the user's operation is outside the initial position, i.e., the starting position is located within the aforementioned control unit, the electronic device updates the display position of the remote control on the control interface based on the starting position. Specifically, the electronic device uses the starting position as the center position of the remote control and updates the display position of the remote control on the control interface accordingly. In this embodiment, when the starting position of the user's operation is outside the initial position, the position of the control area on the control interface remains unchanged; only the display position of the remote control changes. This allows the user to flexibly adjust the remote control to a suitable position, facilitating subsequent operation of the remote control and improving the user experience.

[0064] See Figure 6A As shown, Figure 6A This is a schematic diagram illustrating the process of updating the display position of the remote control according to an embodiment of this application. Figure 6AAs shown, when the user touches the P0 position in the control interface, the P0 position is the starting position of the user's operation and the P0 position is outside the initial position, the center position of the remote control 52 is updated from the center of the initial position to the P0 position. At this time, the position of the control area does not change.

[0065] In another embodiment, if the user's starting position is outside the initial position (i.e., the starting position is located at the aforementioned control unit), the electronic device updates the position of the control area on the control interface based on the starting position, thereby updating the position of the remote control within the control area on the control interface. Specifically, the electronic device uses the starting position as the center position of the control area and updates the position of the control area on the control interface; correspondingly, the position of the remote control moves to the starting position. This embodiment synchronously adjusts the display positions of the control area and the remote control when the user's starting position is outside the initial position, allowing the user to flexibly adjust the remote control to a suitable position, facilitating subsequent operation of the remote control and improving the user experience.

[0066] See Figure 6B As shown, Figure 6B This is a schematic diagram illustrating the process of updating the display position of a remote control according to another embodiment of this application. Figure 6B As shown, when the user touches the P0 position in the control interface (the P0 position is outside the initial position), the center position of the remote control is updated from the center of the initial position to the P0 position. At this time, the center position of the control area is updated from the center of the initial position to the P0 position.

[0067] Therefore, if the user's starting position is outside the initial position, the electronic device updates the display position of the remote control on the control interface according to the starting position. This allows the remote control to be flexibly moved by triggering other positions on the control interface when the remote control is obscured or not obscured but difficult for the user to operate. This ensures that the remote control can be operated effectively and improves the user experience.

[0068] In at least one embodiment of this application, in response to a user operation on the control area, if the user operation is a swipe operation and the starting position of the swipe operation is outside the initial position, the electronic device further determines movement control information for the self-moving device based on the starting and ending positions of the swipe operation. The movement control information includes the movement direction of the self-moving device. The movement direction can be determined based on the direction from the starting position to the ending position, and can also be determined based on the swipe direction of the swipe operation. The movement control information may also include, but is not limited to, the angular velocity of the self-moving device and the linear velocity of the self-moving device. The angular velocity can be determined based on the angular velocity of the swipe operation, and the linear velocity can be determined based on the linear velocity of the swipe operation. The electronic device can also display the movement control information of the self-moving device on the control interface.

[0069] Specifically, in this embodiment, the remote control is a slide-triggered control, such as the aforementioned 360-degree swiping virtual joystick control. In response to the user's slide operation on the control unit, the electronic device first updates the display position of the remote control on the control interface based on the starting position of the slide operation. Then, the electronic device determines the movement control information for the self-moving device based on the starting and ending positions of the slide operation. This movement control information is the same as described above and will not be repeated here. Correspondingly, the electronic device moves the display position of the virtual joystick 521 according to the detected slide operation, as described above. This embodiment utilizes a single user operation to simultaneously update the position of the remote control and remotely control the self-moving device, which is convenient, efficient, and improves the user experience. The same type of user operation provides the possibility of integrating two functions, allowing the user's first step of moving the remote control and the second step of controlling the self-moving device via the remote control to be integrated into a single user operation.

[0070] When the swipe operation ends, i.e. when the finger leaves the control interface, the electronic device restores the remote control to its initial position, and the same control area also returns to the first preset position.

[0071] In another embodiment, if the user's starting position is outside the initial position (i.e., the starting position is located on the aforementioned control unit), and the user's operation is a sliding operation, the electronic device updates the display position of the remote control on the control interface based on the starting and ending positions of the sliding operation. Specifically, when the user touches and slides the aforementioned control unit, the electronic device updates the display position of the remote control on the control interface with the starting position as the center of the remote control; furthermore, when the user slides the remote control to the ending position, the electronic device updates the display position of the remote control on the control interface with the ending position as the center of the remote control. This also allows the user to flexibly adjust the remote control to a suitable position, facilitating subsequent operation of the remote control and improving the user experience.

[0072] In at least one embodiment of this application, the user slides from a starting position to an ending position. If the user's finger leaves the ending position, the sliding operation is determined to have ended. In response to the end of the sliding operation, the electronic device controls the remote control to return to its initial position.

[0073] See Figure 7 As shown, Figure 7 This is a schematic diagram illustrating another process for updating the display position of the remote control provided in an embodiment of this application. For example... Figure 7As shown, when the user touches position P0 in the control interface (where P0 is outside the initial position), the center position of the remote control 52 updates from the center of the initial position to position P0, while the position of the control area remains unchanged. Then, when the user slides from position P0 to position P1, the display state of the remote control 52 (virtual joystick control) changes from its initial state, and the virtual joystick 521 of the remote control 52 updates from position P0 to position P1. Based on the positional relationship between positions P0 and P1, the electronic device determines the movement control information for the self-moving device and displays this information, such as the direction and speed of movement. Finally, when the user's finger leaves position P1, the electronic device controls the remote control to return to its initial position.

[0074] In at least one embodiment of this application, the control interface further includes a display area for displaying the movement trajectory of the self-moving device under the control of the remote control. The display area also displays the location of the self-moving device and the charging station.

[0075] In at least one embodiment of this application, if the user's operation position is at the initial position, that is, the starting position of the user's operation is located on the aforementioned control unit, then the electronic device updates the position of the control area on the control interface and updates the display position of the remote control on the control interface.

[0076] Specifically, when the user operation is a press operation, if the duration of the user's press operation on the remote control exceeds a preset duration, the electronic device updates the display position of the control area on the control interface to a second preset position. The control area is initially in the first preset position on the control interface; the aforementioned user operation moves it from the first preset position to the second preset position. Correspondingly, the position of the remote control on the control interface also changes along with the control area. The preset duration can be set according to actual needs.

[0077] More specifically, in this embodiment, the remote control is the aforementioned virtual joystick control. If the duration of the user pressing and operating the virtual joystick 521 or the first moving operation area 522 exceeds a preset duration, the display position of the control area will be updated to the second preset position.

[0078] Specifically, as exemplified by the mapping control interface and the real-time screen remote control interface described above, the control interface also includes a display area. Under the user's operation, the electronic device can swap the display position of the control area with the display position of the display area. The remote control controls move along with the control area. This embodiment, by swapping the display positions of the control area and the display area, can meet the operating habits of different users and improve the user experience.

[0079] See Figure 8 As shown, Figure 8This is a schematic diagram illustrating another process for updating the display position of the remote control provided in an embodiment of this application. For example... Figure 8 As shown, the display area is located in the left-hand operating area of ​​the control interface, and the control area is located in the right-hand operating area. When the user presses the remote control, the electronic device determines the duration of the press. If the duration exceeds a preset duration, the control area switches from the right-hand operating area to the left-hand operating area, and the remote control also switches simultaneously from the right-hand operating area to the left-hand operating area. The display area then switches from the left-hand operating area to the right-hand operating area.

[0080] In another embodiment, the control interface displays a switching control. In response to an operation on the switching control, the display position of the control area and the display area are swapped.

[0081] In several embodiments of this application, the display position of the remote control on the control interface can be updated by user operation of the control area, so as to realize the dynamic change of the position of the remote control on the control interface, which facilitates the user's operation of the remote control.

[0082] like Figure 9 The diagram shown is a flowchart of another interface display method provided in an embodiment of this application. The interface display method is applied to electronic devices, such as... Figure 3 The illustrated electronic device 10 is connected to a self-moving device and includes a display screen. The order of steps in this flowchart can be changed, and some steps can be omitted, depending on different requirements. The interface display method provided in this application embodiment includes the following steps.

[0083] S901 displays a control interface on the display screen. The control interface includes a control area, which includes remote control controls and displays the remote control controls at an initial position within the control area.

[0084] S902 responds to user operations on the control area and updates the display position of the remote control on the control interface.

[0085] For details of steps S901-S902, please refer to the above text. Figure 4 The detailed description of steps S401-S402 is provided in the previous section and will not be repeated here.

[0086] S903 responds to preset operations on the control area and restores the remote control to its initial display position.

[0087] In at least one embodiment of this application, the preset operation may include a double-click operation, etc. See also... Figure 10 As shown, Figure 10 This is a schematic diagram illustrating another process for updating the display position of the remote control provided in an embodiment of this application. For example... Figure 10As shown, when the user double-clicks position P0, position P0 is outside the initial position, and the center of the control area and the center of the remote control both move to position P0. Then, the user slides the remote control from position P0 to position P1, and the electronic device determines and displays the movement control information based on the positional relationship between P0 and P1. Next, the user double-clicks the initial position, and the electronic device restores the remote control to its initial position.

[0088] In several embodiments of this application, user operations on the control area can update the display position of the remote control on the control interface, enabling dynamic changes in the position of the remote control on the control interface. Simultaneously, preset operations on the control area can restore the remote control to its initial display position, facilitating user control of the remote control.

[0089] like Figure 11 The diagram shown is a functional block diagram of the interface display device provided in an embodiment of this application. The interface display device 1 operates on an electronic device, which is connected to a self-moving device. The electronic device includes a display screen, and the interface display device 1 includes a display unit 1101, an update unit 1102, and a determination unit 1103. The module / unit referred to in this application refers to a series of computer-readable instruction segments that can be acquired by the processor 110 and perform a fixed function, and which are stored in the memory 121.

[0090] In one embodiment, the display unit 1101 is used to display a control interface on the display screen. The control interface includes a control area, which includes remote control controls and displays the remote control controls at an initial position within the control area. The remote control controls are used to control the self-moving device. The update unit 1102 is used to update the display position of the remote control controls on the control interface in response to user operations on the control area.

[0091] In one embodiment, the update unit 1102 is specifically used to: if the starting position of the user operation is outside the initial position, update the display position of the remote control on the control interface according to the starting position.

[0092] In one embodiment, the updating unit 1102 is further configured to: update the display position of the remote control on the control interface with the starting position as the center position of the remote control.

[0093] In one embodiment, the user operation is a sliding operation, which includes a starting position and an ending position. The determining unit 1103 is used to respond to a sliding operation where the starting position of the remote control is outside the initial position, and to determine the movement control information of the self-moving device based on the starting position and the ending position of the sliding operation. The movement control information includes the movement direction.

[0094] In one embodiment, the display unit 1101 is further configured to control the remote control to return to its initial position in response to the end of the sliding operation.

[0095] In one embodiment, after updating the display position of the remote control on the control interface, the display unit 1101 is further configured to respond to a preset operation on the control area and control the remote control to return to its initial display position.

[0096] In one embodiment, the update unit 1102 is further configured to: update the position of the control area on the control interface if the user's operation position is at the initial position.

[0097] In one embodiment, the updating unit 1102 is also configured to respond to a pressing operation on the remote control control, and if the duration of the pressing operation is longer than a preset duration, update the display position of the control area on the control interface.

[0098] In one embodiment, the control interface further includes a display area for displaying the movement trajectory of the self-moving device under the control of the remote control. The update unit 1102 is further used to: swap the display position of the control area with the display position of the display area.

[0099] In several embodiments of this application, the display position of the remote control on the control interface can be updated by user operation of the control area, so as to realize the dynamic change of the position of the remote control on the control interface, which facilitates the user's operation of the remote control.

[0100] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the methods described in the above embodiments.

[0101] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the methods in the above-described method embodiments.

[0102] In this embodiment, the terminal device, computer storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0103] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0104] like Figure 12 The diagram shown is a schematic diagram of the overall structure of the self-moving device provided in the embodiment of this application.

[0105] In this embodiment, the self-moving device 20 can be a lawn mowing device, which can be an automatic lawn mowing robot or a semi-automatic lawn mowing robot. This application does not limit the specific type of lawn mowing device.

[0106] In this embodiment, the lawn mowing device 20 includes a housing 201, a walking module 202 (e.g., drive wheels) for supporting the movement of the housing 201, a cutting module (not shown) disposed at the bottom of the housing 201, a control module (not shown) disposed within the housing 201 for controlling the automatic operation of the walking module 202 and the automatic operation of the cutting module, and an energy module (not shown) for supplying power to the lawn mowing device 20. The lawn mowing device 20 also includes a lidar 203 for detecting obstacles and the external environment.

[0107] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and other division methods may be used in actual implementation.

[0108] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0109] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional modules.

[0110] Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of this application is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be embraced within this application. No appended diagram markings in the claims should be construed as limiting the scope of the claims.

[0111] Furthermore, it is clear that the word "including" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices can also be implemented by a single unit or device through software or hardware. Terms such as "first," "second," etc., are used to indicate names and do not indicate any specific order.

[0112] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it. Although this application has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of this application without departing from the spirit and scope of the technical solutions of this application.

Claims

1. An interface display method applied to an electronic device, characterized by, The electronic device communicates with a self-moving device, the electronic device includes a display screen, and the method includes: A control interface is displayed on the display screen. The control interface includes a control area, which includes remote control controls and displays the remote control controls at an initial position within the control area. The remote control controls are used to control the self-moving device. In response to user operations on the control area, update the display position of the remote control on the control interface.

2. The interface display method according to claim 1, characterized in that, Updating the display position of the remote control on the control interface includes: If the starting position of the user operation is outside the initial position, the display position of the remote control on the control interface is updated according to the starting position.

3. The interface display method according to claim 2, characterized in that, The step of updating the display position of the remote control in the control area according to the starting position includes: The starting point position is used as the center position of the remote control, and the display position of the remote control on the control interface is updated.

4. The interface display method according to claim 3, characterized in that, The user operation is a swipe operation, which includes the start position and the end position. The method further includes: In response to a sliding operation where the starting position of the remote control is outside the initial position, movement control information for the self-moving device is determined based on the starting position and the ending position of the sliding operation, the movement control information including the movement direction.

5. The interface display method according to claim 4, characterized in that, The method further includes: In response to the end of the sliding operation, the remote control is restored to its initial display position.

6. The interface display method according to claim 1, characterized in that, After updating the display position of the remote control on the control interface, the method further includes: In response to a preset operation on the control area, the remote control is restored to its initial display position.

7. The interface display method according to claim 2, characterized in that, Updating the display position of the remote control on the control interface further includes: If the user's operation is located at the initial position, update the position of the control area on the control interface.

8. The interface display method according to claim 7, characterized in that, The method further includes: In response to a press operation on the remote control, if the duration of the press operation is longer than a preset duration, the display position of the control area on the control interface is updated.

9. The interface display method according to claim 7 or 8, characterized in that, The control interface also includes a display area for displaying the movement trajectory of the self-moving device under the control of the remote control. Updating the display position of the control area on the control interface includes: The display positions of the control area and the display area are swapped.

10. An electronic device, characterized in that, include: Memory, which stores computer-readable instructions; and The processor executes computer-readable instructions stored in the memory to implement the interface display method as described in any one of claims 1 to 9.

Images