Self-moving device control method, electronic device, and storage medium

Abstract

Embodiments of the present application provide a self-moving device control method, an electronic device and a storage medium, and relate to the technical field of artificial intelligence. The method comprises: displaying a target scene map, a custom area creation icon and a task triggering panel in a task control interface, the target scene map being used to reflect a target scene in which a target self-moving device works; in response to a triggering operation of the custom area creation icon by a user, creating a custom area on the target scene map; in response to a selection operation of the custom area and a target area in the target scene map by the user, displaying a working area of the target self-moving device in the target scene map, the working area being a mixed area of the custom area and the target area; and controlling the target self-moving device to execute a target task in the working area according to the target task triggered by the user through the task triggering panel. The present application has high work efficiency, can meet the individual needs of users and has good user experience.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, and in particular to a self-moving device control method, electronic device, and storage medium. Background Technology

[0002] With the development of smart home and artificial intelligence technologies, robotic vacuum cleaners, due to their diversified functions and more intelligent performance, are gradually entering people's daily lives, bringing great convenience to people's daily lives.

[0003] However, in related technologies, robotic vacuum cleaners only support cleaning a single custom area, a single room, or a single furniture area. If users need to clean both the custom area and the room simultaneously, they need to control the robotic vacuum cleaner to clean the custom area first, and then control it to clean the room. This is inefficient, cannot meet the user's personalized needs, and results in a poor user experience. Summary of the Invention

[0004] This application provides a self-moving device control method, electronic device, and storage medium that are highly efficient, can meet users' personalized needs, and provide a better user experience.

[0005] This application provides a self-moving device control method, including: displaying a target scene map, a custom area creation icon, and a task trigger panel in a task control interface, wherein the target scene map reflects the target scene in which the target self-moving device works; in response to a user's trigger operation on the custom area creation icon, creating a custom area on the target scene map; in response to a user's selection operation on the custom area and a target area in the target scene map, displaying the working area of ​​the target self-moving device in the target scene map, wherein the working area is a mixed area of ​​the custom area and the target area; and controlling the target self-moving device to execute the target task in the working area according to the target task triggered by the user through the task trigger panel.

[0006] In an optional embodiment, the task control interface displays a work area selection panel, and the target area is determined by multiple area options included in the work area selection panel; the method further includes adding the custom area to the work area selection panel.

[0007] In an optional embodiment, the task triggering panel includes a first task configuration mode and a second task configuration mode. The first task configuration mode is used to perform unified task configuration for the custom area and the target area, and the second task configuration mode is used to perform differentiated task configuration for the custom area and the target area.

[0008] In an optional embodiment, controlling the target self-moving device to execute the target task within the work area based on the target task triggered by the user through the task triggering panel includes: displaying a corresponding target task selection panel in response to the user's selection of the target task configuration mode, the target task selection panel including multiple tasks determined according to the device type of the target self-moving device; the target task configuration mode being either the first task configuration mode or the second task configuration mode; and controlling the target self-moving device to execute the target task within the work area based on the target task set by the user for the work area in the target task selection panel.

[0009] In an optional embodiment, controlling the target mobile device to execute the target task in the work area according to the target task set by the user in the target task selection panel includes: if the number of target tasks set by the user in the target task selection panel is at least two, then displaying the execution order setting item corresponding to the at least two target tasks in the target task selection panel; and controlling the mobile device to sequentially execute the at least two target tasks in the work area according to the user's execution order setting result for the at least two target tasks.

[0010] In an optional embodiment, before displaying the target scene map in the task control interface, the method further includes: displaying in the device management interface the identifiers of multiple self-moving devices associated with the target scene and mapping instruction information corresponding to each of the multiple self-moving devices, the mapping instruction information being used to indicate whether a map of the target scene has been created, the target self-moving device being included among the multiple self-moving devices; in response to the user's selection of the target self-moving device, if the target self-moving device has already created the target scene map, then displaying the task control interface corresponding to the target self-moving device.

[0011] In an optional embodiment, the method further includes: in response to a user's selection of the target self-mobile device, if the target self-mobile device has not created the target scene map, displaying a mapping management interface corresponding to the target self-mobile device; wherein the mapping management interface includes a created scene map corresponding to the target scene for another self-mobile device among the plurality of self-mobile devices, and a first map creation method option associated with the created scene map; the first map creation method option indicates learning the created scene map to complete map creation; in response to the user's selection of the first map creation method option, sending the created scene map to the target self-mobile device, so that the target self-mobile device determines the target scene map corresponding to the target self-mobile device by learning the created scene map; displaying a first map creation interface corresponding to the first map creation method option, so as to display the learned target scene map in the first map creation interface.

[0012] In an optional embodiment, the mapping management interface further includes a second map creation method option, which indicates that the target scene map is created independently; the method further includes: in response to the user's selection of the second map creation method option, displaying a corresponding second map creation interface to display the target scene map created by the target mobile device in the second map creation interface.

[0013] This application also provides an electronic device, the electronic device comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the above-described self-moving device control method.

[0014] This application also provides a computer-readable storage medium storing a computer program, which, when executed by one or more processors, causes the one or more processors to perform at least the following actions: displaying a target scene map, a custom area creation icon, and a task trigger panel in a task control interface, wherein the target scene map reflects the target scene in which the target self-moving device works; creating a custom area on the target scene map in response to a user's trigger operation on the custom area creation icon; displaying the working area of ​​the target self-moving device in the target scene map in response to a user's selection operation on the custom area and a target area in the target scene map, wherein the working area is a mixed area of ​​the custom area and the target area; and controlling the target self-moving device to execute the target task in the working area according to the target task triggered by the user through the task trigger panel.

[0015] In this embodiment, displaying a target scene map in the task control interface allows users to intuitively understand the environmental information of the target scene. Displaying a custom area creation icon in the task control interface enables the creation of custom areas. Displaying a task trigger panel in the task control interface facilitates the user's selection of the target task to be performed by the target mobile device. Responding to the user's trigger operation on the custom area creation icon, a custom area is created on the target scene map. Responding to the user's selection operation between the custom area and the target area in the target scene map, the target mobile device's working area in the target scene map is displayed. This allows for free combination of areas, making the determination of the working area more flexible and adaptable. Subsequently, the target mobile device can be controlled to perform the target task within the working area simply by following the target task triggered by the user through the task trigger panel. This method is highly efficient, meets the user's personalized needs, and provides a good user experience. Attached Figure Description

[0016] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0017] Figure 1 A flowchart illustrating a self-moving device control method provided in an exemplary embodiment of this application;

[0018] Figure 2 Specific example diagrams of a task control interface provided for an exemplary embodiment of this application;

[0019] Figure 3 Example diagram of the interface for creating a custom area provided in an exemplary embodiment of this application;

[0020] Figure 4 An example diagram of a mobile custom area provided as an exemplary embodiment of this application;

[0021] Figure 5 Example diagram of the interface for confirming a custom area provided in an exemplary embodiment of this application;

[0022] Figure 6 Example diagram of a work area selection interface provided for an exemplary embodiment of this application;

[0023] Figure 7 Example diagram of a working status information display interface provided for an exemplary embodiment of this application;

[0024] Figure 8 An example diagram of the interface for a first task configuration mode provided in an exemplary embodiment of this application;

[0025] Figure 9 An example diagram of the interface for a second task configuration mode provided in an exemplary embodiment of this application;

[0026] Figure 10 Example diagram of a personalized mode interface provided for an exemplary embodiment of this application;

[0027] Figure 11 Example diagram of the execution order setting item interface provided for an exemplary embodiment of this application;

[0028] Figure 12 Flowchart of a target scene map creation method provided for an exemplary embodiment of this application;

[0029] Figure 13 Example diagram of a device management interface provided for an exemplary embodiment of this application;

[0030] Figure 14 Example diagram of the user interface of a first self-moving device provided as an exemplary embodiment of this application;

[0031] Figure 15 Example diagram of the user interface of a second self-moving device provided as an exemplary embodiment of this application;

[0032] Figure 16 Example diagram of a mapping management interface provided for an exemplary embodiment of this application;

[0033] Figure 17 Example diagram of a learning interface provided for an exemplary embodiment of this application;

[0034] Figure 18 Example diagram of learning status display provided for an exemplary embodiment of this application;

[0035] Figure 19 Example diagram of a successful drawing completion notification interface provided for an exemplary embodiment of this application;

[0036] Figure 20 Example diagram of a drawing failure prompt interface provided for an exemplary embodiment of this application;

[0037] Figure 21 Example diagram of a drawing interface provided for an exemplary embodiment of this application;

[0038] Figure 22 Example diagram of the target scene map obtained after successful mapping, provided as an exemplary embodiment of this application;

[0039] Figure 23 A structural block diagram of an electronic device provided for an exemplary embodiment of this application. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0041] With the development of smart home and artificial intelligence technologies, robotic vacuum cleaners, due to their diversified functions and more intelligent performance, are gradually entering people's daily lives, bringing great convenience. However, currently, robotic vacuum cleaners only support cleaning a single custom area, a single room, or a single piece of furniture. If users need to clean both the custom area and the room simultaneously, they must first control the robotic vacuum cleaner to clean the custom area, and then control it to clean the room. This is inefficient, cannot meet users' personalized needs, and results in a poor user experience.

[0042] Therefore, embodiments of this application provide a self-moving device control method, such as... Figure 1 As shown, the method includes:

[0043] Step 101: Display the target scene map, custom area creation icon, and task trigger panel in the task control interface. The target scene map is used to reflect the target scene in which the target self-moving device works.

[0044] Step 102: In response to the user's triggering action of creating a custom area icon, create a custom area on the target scene map.

[0045] Step 103: In response to the user's selection operation of the custom area and the target area in the target scene map, display the working area of ​​the target self-moving device in the target scene map. The working area is a mixed area of ​​the custom area and the target area.

[0046] Step 104: Based on the target task triggered by the user through the task triggering panel, control the target self-moving device to execute the target task within the working area.

[0047] In this embodiment, the task control interface can be the interface of an application running on a terminal device. The terminal device can include: a mobile phone, a personal computer (PC), a tablet computer, a laptop computer, a wearable device, etc. The target self-moving device can be any mechanical device capable of autonomously moving within its environment, such as a robot, an air purifier, or a self-driving car. Robots can include robotic vacuum cleaners, window cleaning robots, home companion robots, welcoming robots, autonomous service robots, etc. The target scene map can be a scene map of any environment in which the self-moving device can move. For example, it can be a room scene map, a factory scene map, a shopping mall scene map, etc., and so on. The target scene map can be a 3D map.

[0048] For ease of understanding, this application will be described below with reference to the accompanying drawings:

[0049] In practical applications, after the app successfully connects to the target mobile device and establishes a target scene map, the target scene map, a custom area creation icon, and a task trigger panel will be displayed in the task control interface. See [link to relevant documentation] for details. Figure 2 Among them, the target scene map refers to... Figure 2 The map of the entire room shown can be found here; the custom area creation icon can be found in [link / reference]. Figure 2 The icon in the bottom right corner with the "Custom" label can be found in the task trigger panel. Figure 2 The task trigger panel is marked in the middle.

[0050] When a user wants to create a custom area on the target scene map, the app will trigger an action by clicking the custom area creation icon (i.e., clicking the icon with the "Custom" label, see...). Figure 2 The app responds to the user's action of clicking the custom area creation icon, creating a custom area on the target scene map. Specifically, for example, clicking the custom area creation icon creates a custom area at a default location on the target scene map. This default location can be a user-defined location or a location set by the app developers during development. The specific structure of this custom area can be found in [link to relevant documentation]. Figure 3 , Figure 3 The bathroom area with a toilet icon above the custom area creation icon is the default custom area.

[0051] As an example, such as Figure 3As shown, this custom area has a custom area editing panel. For example, this panel can have four "circle buttons" and one "trash can button." By dragging the four "circle buttons," the shape and size of the custom area can be adjusted from multiple angles. Among the four "circle buttons" is a button with a "confirm placement" function. Clicking this button confirms the location of the custom area. Clicking the "trash can button" allows you to delete the custom area.

[0052] After the custom area is created, if the user wants to change its position, one option is to drag and drop the custom area until it reaches the desired location. Let's assume... Figure 3 The custom region location in the settings is the initial default location when creating a custom region. Figure 4 This indicates the target location reached by the custom area after it has been moved.

[0053] After moving the custom area to the target location, click the button with the "Confirm Placement" function to confirm its placement. At this point, the custom area editing panel will be hidden, specifically the four "circle buttons" and one "trash can button," and the name of the custom area will be displayed. See [link to documentation] for details. Figure 5 , Figure 5 This is a schematic diagram of the interface after the custom area has been confirmed. Figure 5 The name of the custom area displayed is "Custom Area 1".

[0054] In practical applications, users sometimes need to control a target self-moving device to work only in a custom area and a specific area on the target scene map. In this case, the user can select the custom area and the target area on the target scene map within the app. The app, in response to the user's selection, displays the target self-moving device's working area on the target scene map. Specifically, suppose the user wants to control the target self-moving device to only work in... Figure 5 If you can work in a restaurant within a custom area and a target scene map, then you can... Figure 5 Click on the area where the "Restaurant" is located. A confirmation option will then pop up on the restaurant. Simply click "Confirm" to be redirected to... Figure 6 The interface shown is in Figure 6In the image, "Custom Area 1" and "Restaurant" represent the target mobile device's working area on the target scene map. The user can then control the target mobile device to perform the target task within its working area simply by triggering the target task through the task trigger panel. It should be noted that the above is only a specific example; for more detailed information, the actual implementation may vary. Figure 6 For the home scene map, you can not only select custom areas and rooms at the same time, but also select custom areas, rooms and furniture, or room and furniture, etc. The specific selection method is not limited.

[0055] For example, assuming the target self-moving device is a robot vacuum cleaner, its corresponding task trigger panel can be found here. Figure 6 Below, it features "Sweep" and "Mop" function options, as well as a "Custom Cleaning Start" button at the very bottom. After determining the work area, the user simply selects "Sweep" and / or "Mop," then clicks the "Custom Cleaning Start" button to send control commands to the robot vacuum, instructing it to perform "Sweep" and / or "Mop" within the work area. At this point, the interface will change from... Figure 6 Jump to Figure 7 .exist Figure 7 In the task control interface, the robot vacuum cleaner's working status information will be displayed, i.e. Figure 7 The text mentions "Cleaning in progress...". To allow users to control the robot vacuum's status in real-time, control buttons can be placed next to the status information, such as... Figure 7 The two buttons following "Cleaning in progress..." are, from left to right, "Pause" and "Return to Base Station." When the user presses the "Pause" button, the robot vacuum will pause in place. When the user presses the "Return to Base Station" button, the robot vacuum will return directly to the base station, ending the cleaning process. These two buttons are provided as examples only; in actual applications, other function buttons can be assigned here, and are not limited to these.

[0056] The self-moving device control method provided in this application embodiment allows users to intuitively understand the environmental information of the target scene by displaying a target scene map in the task control interface. It also enables the creation of custom areas by displaying a custom area creation icon in the task control interface and facilitates user selection of the target task to be performed by the target self-moving device by displaying a task trigger panel. Responding to the user's trigger operation on the custom area creation icon, a custom area is created on the target scene map. Responding to the user's selection operation between the custom area and the target area in the target scene map, the working area of ​​the target self-moving device in the target scene map is displayed. This allows for free combination of areas, making the determination of the working area more flexible and adaptable. Subsequently, the target self-moving device can be controlled to perform the target task within the working area simply by following the target task triggered by the user through the task trigger panel. This method is highly efficient, meets the user's personalized needs, and provides a good user experience.

[0057] In this embodiment, the task control interface displays a work area selection panel, and the target area is determined by multiple area options included in the work area selection panel. The work area selection panel can be found in [reference needed]. Figure 2 upper right, in Figure 2 The work area selection panel contains three icons, from top to bottom: "Whole House," "Rooms," and "Furniture." Clicking different icons switches between different areas. For example, clicking the "Whole House" icon selects the entire house as the work area. Clicking the "Rooms" icon allows you to select some or all of the rooms in the house as the work area. Clicking the "Furniture" icon allows you to select some or all of the furniture in each room as the work area. "Rooms" and "Furniture" can be combined. For example, to select the "Dining Room" in a room and the "Sofa" in the living room as the work area, you can first click the "Rooms" icon, select the "Dining Room" in the target scene map, and then click the "Furniture" icon, select the "Sofa" in the living room in the target scene map, thus completing the combined selection of rooms and furniture.

[0058] Furthermore, to facilitate users in selecting frequently used custom areas, improve the convenience of custom area selection, and enhance user experience, the method also includes adding custom areas to the work area selection panel.

[0059] In practice, a "Custom" icon can be added below "Whole House," "Room," and "Furniture" as described above. The target scene map corresponding to this "Custom" icon stores the user's frequently used custom areas. When a user needs to select multiple areas, and these areas include the user's frequently used custom areas, they can simply click the "Custom" icon, which is convenient and quick.

[0060] In this embodiment, the task trigger panel includes a first task configuration mode and a second task configuration mode. The first task configuration mode is used for unified task configuration of the custom area and the target area, while the second task configuration mode is used for differentiated task configuration of the custom area and the target area. By setting the first task configuration mode in the task trigger panel, unified task configuration can be performed for the custom area and the target area, improving task issuance speed and work efficiency. By setting the second task configuration mode in the task trigger panel, differentiated task configuration can be performed for the custom area and the target area, meeting users' personalized needs and improving user experience.

[0061] Furthermore, based on the target task triggered by the user through the task triggering panel for the target self-moving device, the system controls the target self-moving device to execute the target task within the working area, including: in response to the user's selection of the target task configuration mode, displaying a corresponding target task selection panel, which includes multiple tasks determined according to the device type of the target self-moving device; the target task configuration mode being either a first task configuration mode or a second task configuration mode; and controlling the target self-moving device to execute the target task within the working area based on the target task set by the user for the working area in the target task selection panel.

[0062] For easier understanding, please refer to the first task configuration mode. Figure 8 The "General" section of the task trigger panel, corresponding to the first task configuration mode (i.e., "General" mode), includes "Sweeping and Mopping" tasks in the target task selection panel. The second task configuration mode can be found here. Figure 9 The "Personalization" section of the task trigger panel, corresponding to the second task configuration mode (i.e., "Personalization mode"), includes a "Sweeping" task for the "Restaurant" setting. It's important to note that different parameters can be selected for each task configuration. For example, if the task configuration corresponding to the first task configuration mode is "Sweeping and Mopping," the adjustable parameters include: cleaning speed, water volume, and noise level. Each parameter has a corresponding function icon in the task trigger panel; see [link to relevant documentation] for details. Figure 8The "Parameter Adjustment" section in the task trigger panel. However, if it's the second task configuration mode, and the corresponding task configuration is "Sweeping," then there's no need to adjust the drainage volume. In this case, the function icon for drainage volume will be unselectable. See [link to relevant documentation] for details. Figure 9 Once the target task and its corresponding parameters are determined, the target self-moving device can be controlled to execute the target task within the working area.

[0063] In one alternative implementation, the self-moving device is controlled to execute the target task within the working area based on the target task triggered by the user through the task triggering panel. This includes: displaying a first task selection interface in response to the user's selection of a first task configuration mode, the first task selection interface including multiple tasks determined according to the device type of the self-moving device; and controlling the self-moving device to execute the first target task within the working area based on the first target task selected by the user in the first task selection interface.

[0064] In practical implementation, for example, assuming the first task configuration mode is general mode, then in response to the user's selection of general mode (i.e., clicking "general", see...), Figure 8 The first task selection interface is displayed, which includes multiple tasks determined by the device type of the self-moving device. For example, if the device type is cleaning, the multiple tasks displayed in the first task selection interface may include sweeping, mopping, etc. At this time, the "General" font in the task trigger panel will be highlighted, and the "Sweep" and "Mop" function option icons will be automatically checked. See details in [link to documentation]. Figure 8 .

[0065] In another optional implementation, based on the target task triggered by the user through the task triggering panel, the self-moving device is controlled to execute the target task within the working area, including: in response to the user's selection of a second task configuration mode, displaying a second task selection interface, which includes multiple tasks determined according to the device type of the self-moving device; determining the second target task selected by the user for a custom area and the third target task selected for a target area in the second task selection interface; and controlling the self-moving device to execute the second target task within the custom area and the third target task within the target area.

[0066] In practical implementation, for example, assuming the second task configuration mode is personalized mode, then in response to the user's selection of personalized mode, a second task selection interface is displayed. This interface includes multiple tasks determined by the device type of the self-device. Assuming the device type is cleaning, the multiple tasks displayed in the first task selection interface could include sweeping, mopping, etc. The system determines the second target task (e.g., sweeping) selected by the user for a custom area and the third target task (e.g., sweeping and mopping) selected for the target area in the second task selection interface. It then controls the self-device to perform the sweeping task within the custom area and the mopping task within the target area. At this time, the "Personalized" text in the task trigger panel will be highlighted, and the "Sweep" and "Mop" function option icons will both be checked. In practical implementation, such as... Figure 10 As shown, you can first click the "Restaurant" icon to select the target task for the restaurant, which is sweeping and mopping. Then, click "Custom Zone 1" to select the target task for "Custom Zone 1". By switching from general mode to personalized mode, the same set of working modes and parameter settings will be applied to all selected work locations. Alternatively, you can switch to personalized working modes and parameter settings for each individual work location, greatly improving the user experience.

[0067] Furthermore, when the user sets at least two target tasks in the target task selection panel, determining the execution order of these two target tasks is crucial to ensure their successful execution. In this embodiment, controlling the target mobile device to execute target tasks within the work area based on the target tasks set by the user in the target task selection panel includes: if the user sets at least two target tasks in the target task selection panel, displaying execution order settings corresponding to the at least two target tasks in the target task selection panel; and controlling the mobile device to sequentially execute the at least two target tasks within the work area based on the user's execution order settings.

[0068] For easier understanding, please refer to Figure 11 ,exist Figure 11 In the process, the user selected a mixed area of ​​three zones: "Dining Room (Room)," "Single Bed (Furniture)," and "Custom Area" as the work area. When controlling the robot vacuum to work in the work area, at least two target tasks are displayed in the target task selection panel. Figure 11 For the execution order settings for sweeping and mopping, please refer to [link / reference]. Figure 11 The "execution order" in Figure 11In this example, "sweeping" is set as the first task to be executed, and "mopping" is set as the second task to be executed. In practice, for instance, the execution order of multiple target tasks can be changed by dragging the icons of the target tasks. Alternatively, the execution order of multiple target tasks can be determined by clicking them sequentially; for example, the first target task clicked becomes the first task to be executed, and the second target task clicked becomes the second task to be executed. No specific limitations are imposed here.

[0069] In this embodiment of the application, before displaying the target scene map in the task control interface, such as Figure 12 As shown, the method also includes:

[0070] Step 1201: Display the identifiers of multiple self-moving devices associated with the target scene and the mapping instruction information corresponding to each of the multiple self-moving devices in the device management interface. The mapping instruction information is used to indicate whether a map of the target scene has been created. The target self-moving device is included in multiple self-moving devices.

[0071] Step 1202: In response to the user's selection of the target mobile device, if the target mobile device has already created the target scene map, the task control interface corresponding to the target mobile device is displayed.

[0072] In practical applications, after opening the app connected to the self-device, the app will enter the device management interface, which displays the identifiers of multiple self-devices associated with the target scene, as well as the mapping instructions for each self-device. For ease of understanding, the identifiers of the multiple self-devices can be found in [link to relevant documentation]. Figure 13 The text refers to "Robot 1" and "Robot 2", while the mapping instructions can be found in [reference needed]. Figure 13 The information corresponding to the right side of "Robot 1" and "Robot 2" shows that Robot 1 does not have the "mapping" label but has the "location robot" label, indicating that it has already created a map of the target scene or is in the process of creating a map of the target scene. Robot 2, on the other hand, has the "mapping" label, therefore, it has not created a map of the target scene.

[0073] In response to the user's selection of the target mobile device, if the target mobile device has already created a target scene map, the corresponding task control interface for the target mobile device will be displayed. For example, if the user selects "Robot 1" as the target mobile device mentioned above, and it has already created a target scene map, then the user will be redirected to... Figure 2 The example task control interface allows for subsequent self-moving device control operations.

[0074] In this embodiment, by displaying the identifiers of multiple self-moving devices associated with the target scene and their respective mapping instructions in the device management interface, users can easily understand the number of self-moving devices connected to the APP and their respective mapping instructions, and determine whether each device has created a map of the target scene. In response to the user's selection of a target self-moving device, if the target self-moving device has already created a map of the target scene, the corresponding task control interface for the target self-moving device is displayed, facilitating subsequent self-moving device control.

[0075] As an example of operation, based on Figure 13 As shown in the interface, if the user clicks "Robot 1", the app will redirect to the operation interface corresponding to Robot 1 (see...). Figure 14 ),Depend on Figure 14 As can be seen, Robot 1 is creating a target scene map. The upper part displays Robot 1's working status information (mapping). To the right of this status information are function buttons for changing Robot 1's working status: from left to right, "Pause" and "Return to Base Station." When the user triggers the "Pause" button, the self-moving device is paused in place. When the user triggers the "Return to Base Station" button, the self-moving device returns directly to the base station, ending the mapping work. These two buttons are only examples; other function buttons can be set here in actual applications, and are not limited to these. The middle part displays the area where the target scene map is being created (i.e., the "no map" area), and the lower part displays the mapping instruction information for Robot 1. The "Mapping" icon in this instruction information is unselectable, indicating that Robot 1 is currently mapping.

[0076] As another operational example, based on Figure 13 As shown in the interface, if the user clicks "Robot 2", the app will redirect to the corresponding operation interface for Robot 2 (see...). Figure 15 ),exist Figure 15 The text displays the area where the target scene map is created (i.e., the "no map" area), as well as the mapping instructions for robot 2.

[0077] Furthermore, the method also includes: in response to the user's selection of the target self-mobile device, if the target self-mobile device has not created a target scene map, displaying a mapping management interface corresponding to the target self-mobile device; wherein the mapping management interface includes a created scene map corresponding to the target scene for another self-mobile device among multiple self-mobile devices, and a first map creation method option associated with the created scene map; the first map creation method option indicates learning the created scene map to complete map creation; in response to the user's selection of the first map creation method option, sending the created scene map to the target self-mobile device, so that the target self-mobile device can determine the target scene map corresponding to the target self-mobile device by learning the created scene map; displaying a first map creation interface corresponding to the first map creation method option, so as to display the learned target scene map in the first map creation interface.

[0078] For ease of understanding, based on the above Figure 15 For example, in response to the user's selection of Robot 2, Robot 2 did not create a target scene map after clicking. Figure 15 After clicking the "Map Creation" button, the map creation management interface corresponding to the target mobile device will be displayed (see [link]). Figure 16 The mapping management interface includes a created scene map corresponding to another self-mobile device among multiple self-mobile devices and the target scene, as well as the first map creation method option associated with the created scene map (i.e., Figure 16 (Referring to the "Add to this map layer" option). In response to the user's selection of "Add to this map layer", the created scene map is sent to the target mobile device, allowing the target mobile device to determine its target scene map by learning from the created scene map; the first map creation interface corresponding to the first map creation method option is displayed (see [link]). Figure 17 ),exist Figure 17 The text displays relevant learning information, such as the learning time, learning map area, and learning process of the target mobile device. Clicking the back button will then redirect to the homepage (see [link]). Figure 18 ), Figure 18 The system displays the existing target scene map that is being learned, as well as the working status information of Robot 2.

[0079] After the learning process is completed, if successful, you will be redirected to a success message screen (see [link]). Figure 19 ), Figure 19 The system displays the target scene map that has been successfully learned, along with a message indicating that the map has been successfully learned. This message includes editing options, allowing users to either edit the learned map by clicking the "Map Edit" option or by clicking the "Ignore for now" option to directly jump to the task control interface.

[0080] If the learning fails, you will be redirected to the failure message screen (see [link]). Figure 20 ), Figure 20 The system displays the target scene map being learned, along with a message indicating map learning failure. This message includes a failure suggestion option; clicking the "Reselect" option will redirect to... Figure 16 In the interface, you can reselect "Add to this layer of map" or "Create a new map," or you can click the "Try again" option in the failure message to jump to... Figure 17 The interface needs to be relearned.

[0081] Furthermore, the mapping management interface also includes a second map creation method option, which indicates the creation of a map of the target scene independently. The method further includes: in response to the user's selection of the second map creation method option, displaying the corresponding second map creation interface to show the target scene map created by the target mobile device.

[0082] For a clearer understanding of the specific implementation, please refer to the options for creating the second map. Figure 16 The "Create New Map" function responds to user requests. Figure 16 The "Create New Map" selection option displays the corresponding second map creation interface (see [link]). Figure 21 Interface), to display the target scene map created from the target mobile device in the second map creation interface (see Figure 22 Interface). Figure 21 The text displays the mapping process of Robot 2, as well as relevant information such as the mapping process interview and time, allowing users to view it in real time.

[0083] The following scenario examples illustrate this application.

[0084] Scenario Example 1:

[0085] Assuming the terminal device is a mobile phone, the self-moving device is a robot vacuum cleaner, and the target scenario is a home.

[0086] First, open the app corresponding to the robot vacuum cleaner on your phone and establish a communication connection between the robot vacuum cleaner and the app via Wi-Fi, Bluetooth, or other communication methods. At this point, the app will display a device management interface. This interface shows the identifiers of multiple self-moving devices associated with the target scene, as well as the mapping instructions for each of these self-moving devices. The identifiers of the multiple self-moving devices can be found in [link to relevant documentation]. Figure 13 The text refers to "Robot 1" and "Robot 2", while the mapping instructions can be found in [reference needed]. Figure 13The information corresponding to the right side of "Robot 1" and "Robot 2" is shown below. Robot 1's information does not contain the "mapping" identifier but has the "localization robot" identifier, indicating that it has already created a map of the target scene or is in the process of creating one. Robot 2's information contains the "mapping" identifier, therefore, it has not created a map of the target scene.

[0087] When the user clicks "Robot 1", the app will... Figure 13 The interface jumps to Figure 14 The interface displays the working status information of "Robot 1" and the function buttons for changing the working status of Robot 1. From left to right, they are "Pause Button" and "Return to Base Station Button". When the user triggers the "Pause Button", the self-moving device can be controlled to pause in place. When the user triggers the "Return to Base Station Button", the self-moving device can be controlled to return directly to the base station and end the mapping work.

[0088] If the map is successfully created, the app will redirect to... Figure 19 On the interface shown, the user clicks Figure 19 The app will redirect to the "Temporarily ignore" option in the message. Figure 22 The interface displays the created family housing map. The user then clicks on the family housing map, and the app redirects to the task control interface, which displays the target scene map, a custom area creation icon, and a task trigger panel. See [link to relevant documentation] for details. Figure 2 .

[0089] exist Figure 2 In the app, when a user clicks the "Create Custom Area" icon, the created custom area frame will be displayed in the default area of ​​the home map. The user can then drag and drop this custom area frame to the target location. (See [link to app]). Figure 4 At this point, the user confirms the placement of the custom area box at the target location, and the name of the custom area (Custom Area 1) is displayed. See below. Figure 5 .

[0090] The user then selected the dining room and Custom Zone 1 on the family housing map, see below. Figure 6 At this point, the user selects the general mode (i.e., the first task configuration mode) in the task trigger panel and clicks the "Custom Cleaning Start" button in the task trigger panel to control the robot vacuum to execute the work task corresponding to the general mode. The app then redirects to... Figure 7 The interface shown displays the working status information of robot 1, as well as function icons for controlling the robot to change its working status. From left to right, these are the "pause icon" and the "return to base station icon" (meaning the app will now redirect to...). Figure 7 Interface), in Figure 7 The app's status information shows that the robot vacuum is currently "cleaning." If the user wants to pause the cleaning process, they can simply click the "pause icon" on the right. Upon receiving the command from the app, the robot vacuum will stop working and enter a paused state. To resume cleaning, the user simply clicks the "pause icon" again. Conversely, if the user wants to end the cleaning process, they can click the "return to base station icon" on the far right. Upon receiving the command from the app, the robot vacuum will end the cleaning process and return to the base station.

[0091] Scenario Example 2:

[0092] Assuming the terminal device is a mobile phone, the self-moving device is a robot vacuum cleaner, and the target scenario is a home.

[0093] First, open the app corresponding to the robot vacuum cleaner on your phone and establish a communication connection between the robot vacuum cleaner and the app via Wi-Fi, Bluetooth, or other communication methods. At this point, the app will display a device management interface. This interface shows the identifiers of multiple self-moving devices associated with the target scene, as well as the mapping instructions for each of these self-moving devices. The identifiers of the multiple self-moving devices can be found in [link to relevant documentation]. Figure 13 The text refers to "Robot 1" and "Robot 2", while the mapping instructions can be found in [reference needed]. Figure 13 The information corresponding to the right side of "Robot 1" and "Robot 2" is shown below. Robot 1's information does not contain the "mapping" identifier but has the "localization robot" identifier, indicating that it has already created a map of the target scene or is in the process of creating one. Robot 2's information contains the "mapping" identifier, therefore, it has not created a map of the target scene.

[0094] When the user clicks "Robot 2", the app will... Figure 13 The interface redirects to the "Robot 2" operation interface, i.e. Figure 15 Interface. When the user clicks the "Map Building" icon in the "Robot 2" operation interface, the app redirects to the mapping management interface (see...). Figure 16 At this point, when the user clicks "Add to this layer of map" (the first map creation method option) in the mapping management interface, the app redirects to the machine learning interface. See [link / reference]. Figure 17 ,exist Figure 17 The text displays relevant learning information, such as the target mobile device's learning time, learning map area, and learning process. Clicking the back button then redirects the app to the homepage (see...). Figure 18 ), Figure 18 The system displays the existing target scene map that is being learned, as well as the learning status information of Robot 2.

[0095] If the learning fails, you will be redirected to the failure message screen (see [link]). Figure 20 ), Figure 20 The system displays the target scene map being learned, along with a message indicating map learning failure. This message includes a failure suggestion option; clicking the "Reselect" option will redirect to... Figure 16 In the interface, you can reselect "Add to this layer of map" or "Create a new map," or you can click the "Try again" option in the failure message to jump to the next screen. Figure 17 The interface is relearned until the map is successfully created, at which point the app redirects to... Figure 19 On the interface shown, the user clicks Figure 19 The app will redirect to the "Temporarily ignore" option in the message. Figure 22 The interface displays the created family housing map. The user then clicks on the family housing map, and the app redirects to the task control interface.

[0096] The task control interface displays the target scene map, custom area creation icons, and a task trigger panel. See details in [link to relevant documentation]. Figure 2 .exist Figure 2 In the app, when a user clicks the "Create Custom Area" icon, the created custom area frame will be displayed in the default area of ​​the home map. The user can then drag and drop this custom area frame to the target location. (See [link to app]). Figure 4 At this point, the user confirms the placement of the custom area box at the target location, and the name of the custom area (Custom Area 1) is displayed. See below. Figure 5 .

[0097] The user then selected the dining room and Custom Zone 1 on the family housing map, see below. Figure 6 At this point, the user selects the general mode (i.e., the first task configuration mode) in the task trigger panel and clicks the "Custom Cleaning Start" button in the task trigger panel to control the robot vacuum to execute the work task corresponding to the general mode. The app then redirects to... Figure 7 The interface shown displays the working status information of robot 1, as well as function icons for controlling the robot to change its working status. From left to right, these are the "pause icon" and the "return to base station icon" (meaning the app will now redirect to...). Figure 7 (interface), in Figure 7The app's status information shows that the robot vacuum is currently "cleaning." If the user wants to pause the cleaning process, they can simply click the "pause icon" on the right. Upon receiving the command from the app, the robot vacuum will stop working and enter a paused state. To resume cleaning, the user simply clicks the "pause icon" again. Conversely, if the user wants to end the cleaning process, they can click the "return to base station icon" on the far right. Upon receiving the command from the app, the robot vacuum will end the cleaning process and return to the base station.

[0098] Scenario Example 3:

[0099] Assuming the terminal device is a mobile phone, the self-moving device is a robot vacuum cleaner, and the target scenario is a home.

[0100] First, open the app corresponding to the robot vacuum cleaner on your phone and establish a communication connection between the robot vacuum cleaner and the app via Wi-Fi, Bluetooth, or other communication methods. At this point, the app will display a device management interface. This interface shows the identifiers of multiple self-moving devices associated with the target scene, as well as the mapping instructions for each of these self-moving devices. The identifiers of the multiple self-moving devices can be found in [link to relevant documentation]. Figure 13 The text refers to "Robot 1" and "Robot 2", while the mapping instructions can be found in [reference needed]. Figure 13 The information corresponding to the right side of "Robot 1" and "Robot 2" is shown below. Robot 1's information does not contain the "mapping" identifier but has the "localization robot" identifier, indicating that it has already created a map of the target scene or is in the process of creating one. Robot 2's information contains the "mapping" identifier, therefore, it has not created a map of the target scene.

[0101] When the user clicks "Robot 2", the app will... Figure 13 The interface redirects to the "Robot 2" operation interface, i.e. Figure 15 Interface. When the user clicks the "Map Building" icon in the "Robot 2" operation interface, the app redirects to the mapping management interface (see...). Figure 16 At this point, when the user clicks "Add to this layer of map" (the first map creation method option) in the mapping management interface, the app redirects to the machine learning interface. See [link / reference]. Figure 17 ,exist Figure 17 The text displays relevant learning information, such as the target mobile device's learning time, learning map area, and learning process. Clicking the back button then redirects the app to the homepage (see...). Figure 18 ), Figure 18 The system displays the existing target scene map that is being learned, as well as the learning status information of Robot 2.

[0102] If the learning is successful, you will be redirected to a success message screen (see [link]). Figure 19 ), Figure 19 The system displays the target scene map that has been successfully learned, along with a message indicating that the map has been successfully learned. This message includes editing options, allowing users to either edit the learned map by clicking the "Map Edit" option or by clicking the "Ignore for now" option to directly jump to the task control interface.

[0103] The task control interface displays the target scene map, custom area creation icons, and a task trigger panel. See details in [link to relevant documentation]. Figure 2 .exist Figure 2 In the app, when a user clicks the "Create Custom Area" icon, the created custom area frame will be displayed in the default area of ​​the home map. The user can then drag and drop this custom area frame to the target location. (See [link to app]). Figure 4 At this point, the user confirms the placement of the custom area box at the target location, and the name of the custom area (Custom Area 1) is displayed. See below. Figure 5 .

[0104] The user then selected the dining room and Custom Zone 1 on the family housing map, see below. Figure 6 At this point, the user selects the personalized mode (i.e., the second task configuration mode) in the task trigger panel to control the robot vacuum to execute the work task corresponding to the personalized mode. The app then redirects to... Figure 9 The interface shown (the robot vacuum only performs cleaning operations in the restaurant area) allows the user to click the "Start Custom Cleaning" button in the task trigger panel, at which point the app will redirect to... Figure 7 The interface shown displays the working status information of robot 1, as well as function icons for controlling the robot to change its working status. From left to right, these are the "pause icon" and the "return to base station icon" (meaning the app will now redirect to...). Figure 7 (interface), in Figure 7 The app's status information shows that the robot vacuum is currently "cleaning." If the user wants to pause the cleaning process, they can simply click the "pause icon" on the right. Upon receiving the command from the app, the robot vacuum will stop working and enter a paused state. To resume cleaning, the user simply clicks the "pause icon" again. Conversely, if the user wants to end the cleaning process, they can click the "return to base station icon" on the far right. Upon receiving the command from the app, the robot vacuum will end the cleaning process and return to the base station.

[0105] In summary, this application allows users to intuitively understand the environmental information of the target scene by displaying a target scene map in the task control interface. Displaying a custom area creation icon in the task control interface enables the creation of custom areas. Displaying a task trigger panel in the task control interface facilitates the user's selection of the target task to be performed by the target mobile device. By responding to the user's trigger operation on the custom area creation icon, a custom area is created on the target scene map. Responding to the user's selection of the custom area and the target area in the target scene map, the working area of ​​the target mobile device in the target scene map is displayed. This allows for free combination of areas, making the determination of the working area more flexible and adaptable. Subsequently, the target mobile device can be controlled to perform the target task within the working area simply by following the target task triggered by the user through the task trigger panel. This approach is highly efficient, meets the user's personalized needs, and provides a good user experience.

[0106] Furthermore, in this application, newly added self-moving devices to the APP can be directly reused or integrated into existing target scene maps without affecting the use of any other self-moving devices. Once the new self-moving device is successfully network-connected, the user is guided to directly build a map. If a map already exists in the target scene, and the new self-moving device is on the same layer and map as previously owned self-moving devices, it can be guided to merge the maps. After successful merging, multiple self-moving devices can use the same map in the future, accurately recreating the target scene on the APP and helping users quickly find and use the corresponding robot within the target scene. The process of building and learning to merge the target scene map is presented in real-time as a 3D map, enabling rapid map reuse, improving work efficiency, and achieving a simpler and more efficient human-computer interaction experience.

[0107] Figure 23 This is a block diagram illustrating an electronic device according to an exemplary embodiment. The electronic device 2300 can be an electronic device used by a user. The electronic device 2300 can be, for example, a smartphone, smartwatch, desktop computer, laptop and laptop electronic device, desktop electronic device, or other names.

[0108] Typically, electronic device 2300 includes a processor 2301 and a memory 2302.

[0109] The processor 2301 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 2301 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 2301 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 2301 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 2301 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0110] The memory 2302 may include one or more storage media, which may be non-transitory. The memory 2302 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash storage devices.

[0111] In some embodiments, the electronic device 2300 may optionally include a peripheral device interface 2303 and at least one peripheral device. The processor 2301, memory 2302, and peripheral device interface 2303 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 2303 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 2304, a display screen 2305, a camera assembly 2306, an audio circuit 2307, a positioning assembly 2308, and a power supply 2309.

[0112] Peripheral interface 2303 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 2301 and memory 2302. In some embodiments, processor 2301, memory 2302 and peripheral interface 2303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 2301, memory 2302 and peripheral interface 2303 can be implemented on separate chips or circuit boards, and this embodiment is not limited thereto.

[0113] The radio frequency (RF) circuit 2304 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 2304 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 2304 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 2304 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 2304 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: metropolitan area networks (MANs), various generations of mobile communication networks (2G, 3G, 4G, and 23G), wireless local area networks (WLANs), and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 2304 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0114] Display screen 2305 is used to display a UI (User Interface). This UI may include images, text, icons, videos, and any combination thereof. When display screen 2305 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 2301 for processing. In this case, display screen 2305 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 2305, which serves as the front panel of electronic device 2300; in other embodiments, there may be at least two display screens 2305, respectively disposed on different surfaces of electronic device 2300 or in a folded design; in still other embodiments, display screen 2305 may be a flexible display screen, disposed on a curved or folded surface of electronic device 2300. Furthermore, display screen 2305 may also be configured as a non-rectangular, irregular image, i.e., a non-rectangular screen. The display screen 2305 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0115] The camera assembly 2306 is used to acquire images or videos. Optionally, the camera assembly 2306 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 2306 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0116] The audio circuit 2307 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting them into electrical signals that are input to the processor 2301 for processing, or to the radio frequency circuit 2304 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located in a different part of the electronic device 2300. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 2301 or the radio frequency circuit 2304 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 2307 may also include a headphone jack.

[0117] Positioning component 2308 is used to locate the current geographic location of electronic device 2300 in order to enable navigation or LBS (Location Based Service). Positioning component 2308 can be a positioning component based on the US GPS (Global Positioning System), China's BeiDou system, Russia's Granas system, or the European Union's Galileo system.

[0118] Power supply 2309 is used to supply power to the various components in electronic device 2300. Power supply 2309 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 2309 includes a rechargeable battery, the rechargeable battery can support wired or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0119] In some embodiments, the electronic device 2300 further includes one or more sensors 2310. The one or more sensors 2310 include, but are not limited to: an accelerometer 2311, a gyroscope 2312, a pressure sensor 2313, a fingerprint sensor 2314, an optical sensor 2315, and a proximity sensor 2316.

[0120] Accelerometer 2311 can detect the magnitude of acceleration along the three coordinate axes of a coordinate system established by electronic device 2300. For example, accelerometer 2311 can be used to detect the components of gravitational acceleration along the three coordinate axes. Processor 2301 can control display screen 2305 to display the user interface in either a landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 2311. Accelerometer 2311 can also be used for games or for acquiring user motion data.

[0121] The gyroscope sensor 2312 can detect the orientation and rotation angle of the electronic device 2300. The gyroscope sensor 2312 can work in conjunction with the accelerometer sensor 2311 to collect 3D motion data from the user on the electronic device 2300. Based on the data collected by the gyroscope sensor 2312, the processor 2301 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0122] The pressure sensor 2313 can be disposed on the side bezel of the electronic device 2300 and / or on the lower layer of the display screen 2305. When the pressure sensor 2313 is disposed on the side bezel of the electronic device 2300, it can detect the user's grip signal on the electronic device 2300, and the processor 2301 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 2313. When the pressure sensor 2313 is disposed on the lower layer of the display screen 2305, the processor 2301 can control the operable controls on the UI interface based on the user's pressure operation on the display screen 2305. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0123] The fingerprint sensor 2314 is used to collect a user's fingerprint. The processor 2301 identifies the user based on the fingerprint collected by the fingerprint sensor 2314, or vice versa. When the user's identity is recognized as trusted, the processor 2301 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 2314 can be located on the front, back, or side of the electronic device 2300. When the electronic device 2300 has physical buttons or a manufacturer's logo, the fingerprint sensor 2314 can be integrated with the physical buttons or manufacturer's logo.

[0124] The optical sensor 2315 is used to collect ambient light intensity. In one embodiment, the processor 2301 can control the display brightness of the display screen 2305 based on the ambient light intensity collected by the optical sensor 2315. Specifically, when the ambient light intensity is high, the display brightness of the display screen 2305 is increased; when the ambient light intensity is low, the display brightness of the display screen 2305 is decreased. In another embodiment, the processor 2301 can also dynamically adjust the shooting parameters of the camera assembly 2306 based on the ambient light intensity collected by the optical sensor 2315.

[0125] The proximity sensor 2316, also known as a distance sensor, is typically located on the front panel of the electronic device 2300. The proximity sensor 2316 is used to detect the distance between the user and the front of the electronic device 2300. In one embodiment, when the proximity sensor 2316 detects that the distance between the user and the front of the electronic device 2300 is gradually decreasing, the processor 2301 controls the display screen 2305 to switch from a screen-on state to a screen-off state; when the proximity sensor 2316 detects that the distance between the user and the front of the electronic device 2300 is gradually increasing, the processor 2301 controls the display screen 2305 to switch from a screen-off state to a screen-on state.

[0126] This application embodiment also provides a self-moving device, which includes: a device body, the device body having one or more processors and one or more memories storing a computer program; the one or more processors are used to execute the computer program for: receiving a movement operation command sent by a user; moving to a target location in a target scene map according to the movement operation command; and performing a target work task at the target location according to a target work task execution command sent by the user.

[0127] This application also provides a computer-readable storage medium storing a computer program, which, when executed by one or more processors, causes the one or more processors to perform at least the following actions: displaying a target scene map, a custom area creation icon, and a task trigger panel in a task control interface, wherein the target scene map reflects the target scene in which the target self-moving device works; creating a custom area on the target scene map in response to a user's trigger operation on the custom area creation icon; displaying the working area of ​​the target self-moving device in the target scene map in response to a user's selection operation on the custom area and the target area in the target scene map, wherein the working area is a mixed area of ​​the custom area and the target area; and controlling the target self-moving device to execute the target task within the working area according to the target task triggered by the user through the task trigger panel.

[0128] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0129] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0130] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0131] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0132] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0133] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0134] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0135] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0136] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A method for controlling a self-moving device, characterized in that, include: The task control interface displays a target scene map, a custom area creation icon, and a task trigger panel. The target scene map is used to reflect the target scene in which the target self-moving device works. In response to the user's triggering operation of creating an icon for the custom area, a custom area is created on the target scene map; In response to the user's selection operation of the custom area and the target area in the target scene map, the working area of ​​the target mobile device in the target scene map is displayed, and the working area is a mixed area of ​​the custom area and the target area; Based on the target task triggered by the user through the task triggering panel, the target self-device is controlled to execute the target task within the working area; the task triggering panel includes a first task configuration mode and a second task configuration mode, the first task configuration mode is used to perform unified task configuration for the custom area and the target area, and the second task configuration mode is used to perform differentiated task configuration for the custom area and the target area.

2. The method according to claim 1, characterized in that, The task control interface displays a work area selection panel, and the target area is determined by multiple area options included in the work area selection panel; The method further includes: Add the custom area to the work area selection panel.

3. The method according to claim 1, characterized in that, The step of controlling the target self-device to execute the target task within the work area based on the target task triggered by the user through the task triggering panel includes: In response to the user's selection of the target task configuration mode, a corresponding target task selection panel is displayed, which includes multiple tasks determined according to the device type of the target self-moving device; the target task configuration mode is either the first task configuration mode or the second task configuration mode. Based on the target task set by the user for the work area in the target task selection panel, control the target self-moving device to execute the target task in the work area.

4. The method according to claim 3, characterized in that, The step of controlling the target mobile device to execute the target task within the work area based on the target task set by the user in the target task selection panel for the work area includes: If the user sets at least two target tasks in the target task selection panel, then the execution order setting items corresponding to the at least two target tasks are displayed in the target task selection panel; Based on the user's setting of the execution order of the at least two target tasks, the self-moving device is controlled to sequentially execute the at least two target tasks within the working area.

5. The method according to claim 1, characterized in that, Before displaying the target scene map in the task control interface, the method further includes: The device management interface displays the identifiers of multiple self-moving devices associated with the target scene and the mapping instruction information corresponding to each of the multiple self-moving devices. The mapping instruction information is used to indicate whether a map of the target scene has been created. The target self-moving device is included in the multiple self-moving devices. In response to the user's selection of the target self-moving device, if the target self-moving device has already created the target scene map, the task control interface corresponding to the target self-moving device is displayed.

6. The method according to claim 5, characterized in that, The method further includes: In response to the user's selection of the target mobile device, if the target mobile device has not created a map of the target scene, a mapping management interface corresponding to the target mobile device is displayed; wherein, the mapping management interface includes a created scene map of another mobile device among the plurality of mobile devices corresponding to the target scene, and a first map creation method option associated with the created scene map; the first map creation method option indicates learning the created scene map to complete map creation; In response to the user's selection of the first map creation method option, the created scene map is sent to the target self-mobile device, so that the target self-mobile device can determine the target scene map corresponding to the target self-mobile device by learning the created scene map; Display the first map creation interface corresponding to the first map creation method option, so as to display the learned target scene map in the first map creation interface.

7. The method according to claim 6, characterized in that, The mapping management interface also includes a second map creation method option, which indicates that the target scene can be created independently. The method further includes: In response to the user's selection of the second map creation method option, the corresponding second map creation interface is displayed to show the target scene map created by the target mobile device.

8. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the self-moving device control method as described in any one of claims 1 to 7.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by one or more processors, it causes the one or more processors to perform at least the following actions: The task control interface displays a target scene map, a custom area creation icon, and a task trigger panel. The target scene map is used to reflect the target scene in which the target self-moving device works. In response to the user's triggering operation of creating an icon for the custom area, a custom area is created on the target scene map; In response to the user's selection operation of the custom area and the target area in the target scene map, the working area of ​​the target mobile device in the target scene map is displayed, and the working area is a mixed area of ​​the custom area and the target area; Based on the target task triggered by the user through the task triggering panel, the target self-device is controlled to execute the target task within the working area; the task triggering panel includes a first task configuration mode and a second task configuration mode, the first task configuration mode is used to perform unified task configuration for the custom area and the target area, and the second task configuration mode is used to perform differentiated task configuration for the custom area and the target area.

Images