Management and control method and electronic equipment
By automating the processing of user management needs through electronic devices, the problem of cumbersome management settings in existing technologies has been solved, enabling the generation and updating of management solutions in a simple and efficient manner.
Patent Information
- Application Number
- CN202410987876.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-22
- Publication Date
- 2026-01-23
AI Technical Summary
Existing electronic device control and setup schemes are cumbersome, time-consuming, difficult, and inefficient. Furthermore, different settings may have interrelationships, increasing complexity.
The electronic device receives user control requirements and commands, automatically selects, configures, and displays settings, provides an interface for user confirmation, supports unified updates and deletions of multiple control types, and generates accurate control plans using the server.
It simplifies the control setup process, reduces operational difficulty, improves setup efficiency, and ensures the accuracy and flexibility of the control plan.
Smart Images

Figure CN121387449A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic equipment technology, and more particularly to a control method and an electronic device. Background Technology
[0002] Currently, control settings in electronic devices typically employ a categorized and hierarchical approach. This means that control settings are divided by category and level, requiring users to manually plan and configure each setting individually. This method is cumbersome, time-consuming, and therefore difficult and inefficient. Summary of the Invention
[0003] This application provides a control method and electronic device to reduce the difficulty of control and improve the efficiency of control.
[0004] In a first aspect, embodiments of this application provide a control method applied to an electronic device. The method includes: receiving first information, the first information being used to characterize a first control requirement, the first control requirement being used to control applications in the electronic device; responding to the first information, displaying a first interface; wherein the first interface includes first content, the first content being used to indicate a first configuration for controlling applications in the electronic device; and controlling applications in the electronic device based on the first configuration.
[0005] In this method, the electronic device can display the first configuration used to implement the received control request in the form of an interface, allowing the user to intuitively see the configuration information, thus achieving good control setting results. In this method, the user only needs to submit a control request, and the electronic device can automatically present the corresponding control plan (i.e., the first configuration) to the user, and application control can be performed based on this control plan. Therefore, the process is very simple, time-saving, and has low setup difficulty and high efficiency. Thus, this method can reduce the difficulty of control and improve its efficiency.
[0006] In one possible design, the first control requirement is also used to perform a first control; the first control includes any one of time control, content control, and remote control, or the first control includes a combination of multiple of application control, time control, content control, and remote control; the method further includes: displaying a second interface in response to the first information; wherein the second interface includes second content, the second content being used to indicate a second configuration for performing the first control, the second configuration being different from the first configuration; and performing the first control based on the second configuration.
[0007] Based on this method, electronic devices can simultaneously present and apply different types of control plans based on a received control request. This method can greatly reduce the difficulty of control setup and significantly improve the efficiency of control setup, making it highly practical.
[0008] In one possible design, the method further includes: updating the first content to third content in response to a received first operation; wherein the third content indicates a third configuration for managing applications in the electronic device; controlling the applications in the electronic device based on the third configuration; or, stopping the display of the first interface and stopping control of the applications in the electronic device based on the first configuration in response to a received second operation. Optionally, the second operation is a swipe operation performed on the first interface.
[0009] Based on this method, electronic devices can update or delete the control settings (i.e., the first configuration) based on received user operations. This allows for a simple and quick update or deletion of control settings, offering high flexibility and usability.
[0010] In one possible design, the first configuration includes: disabling the use of at least one application in the electronic device; the first operation is used to indicate: allowing the use of one or more applications among the at least one application, and / or disabling the use of one or more applications among at least one candidate application; wherein the at least one candidate application includes applications in the electronic device other than the at least one application.
[0011] Based on this method, electronic devices can update the list of prohibited applications based on user actions. This process is very simple and quick, helping to improve management efficiency.
[0012] In one possible design, after displaying a first interface in response to the first information, the method further includes: receiving second information, the second information being used to characterize a second control requirement, the second control requirement being used to perform at least one of application control, time control, content control, and remote control; updating the first content to a fourth content in response to the second information, and / or displaying a third interface; wherein the fourth content is used to indicate a fourth configuration for controlling applications in the electronic device; the third interface includes fifth content, the fifth content being used to indicate a fifth configuration for performing the second control, the second control including any one of time control, content control, and remote control, or the second control including a combination of multiple of application control, time control, content control, and remote control.
[0013] In this method, electronic devices can uniformly update the control settings corresponding to the previously received control requests based on the received control requirements. During this process, the user only needs to submit a new control request, and the electronic device can automatically update the control settings corresponding to the previously received control request using the new control settings, presenting this information intuitively to the user and enabling application control based on the new settings. Therefore, this process is very simple, quick, and has low setup difficulty and high efficiency. Thus, this method reduces the difficulty and improves the efficiency of control settings.
[0014] In one possible design, before displaying the first interface in response to the first information, the method further includes: sending the first information, first setting information, and first device usage information to a server; wherein the first setting information is used to indicate multiple settings of the electronic device and characteristic information of each of the multiple settings; the first device usage information includes information about applications in the electronic device; receiving first control information from the server; wherein the first control information includes application control information corresponding to an application control type, the application control information being used to indicate the first configuration; and generating the first interface based on the application control information.
[0015] In this method, the electronic device can provide the server with as much comprehensive reference information as possible. Based on this information, the server can accurately identify the user intent corresponding to the control request received by the electronic device and accurately generate the control settings to respond to or implement that user intent. This ensures that the electronic device, when performing application control based on the server-generated control settings, can meet the user's needs as much as possible. Therefore, this method can improve the accuracy of control.
[0016] Optionally, the first control information further includes control information corresponding to the type of the first control, the control information corresponding to the type of the first control being used to indicate a second configuration for performing the first control; before displaying the second interface in response to the first information, the method further includes: generating the second interface according to the control information corresponding to the type of the first control.
[0017] In the above method, the first control information sent by the server to the electronic device is categorized according to different control types. The electronic device can directly generate an interface to display the corresponding control settings based on the control information of each category, thus clearly, intuitively, and efficiently displaying different types of control schemes. This method makes it easier for users to view control schemes, resulting in better display effects and higher practicality.
[0018] In one possible design, before updating the first content to the fourth content in response to the second information, and / or displaying the third interface, the method further includes: sending the second information, second setting information, and second device usage information to a server; wherein the second setting information is used to indicate a plurality of settings of the electronic device and characteristic information of each of the plurality of settings; the second device usage information includes information about applications in the electronic device; receiving second control information from the server; wherein the second control information includes control information corresponding to an application control type and / or control information corresponding to a second control type, the control information corresponding to the application control type being used to indicate the fourth configuration, and the control information corresponding to the second control type being used to indicate the fifth configuration; determining the fourth content for updating the first content based on the control information corresponding to the application control type; and / or generating the third interface based on the control information corresponding to the second control type.
[0019] Based on this method, when electronic devices update the control settings corresponding to the previously received control requirements based on new control needs, they can update each type of control setting separately, and can also add new types of control settings. Therefore, it can maintain good display quality and high efficiency during the control scheme update process.
[0020] Secondly, embodiments of this application provide a control method applied to a server. The method includes: receiving first information, first setting information, and first device usage information from an electronic device; wherein the first information is used to characterize a first control requirement, the first control requirement being used to control applications in the electronic device; the first setting information is used to indicate multiple settings of the electronic device and characteristic information of each setting; the first device usage information includes information about applications in the electronic device; generating first control information based on the first information, the first setting information, and the first device usage information; wherein the first control information includes application control information corresponding to an application control type, the application control information being used to indicate a first configuration, the first configuration being used to control applications in the electronic device; and sending the first control information to the electronic device.
[0021] In this method, the server can plan a control scheme based on the information reported by electronic devices, especially their control requirements, and then instruct the electronic devices to implement the planned control scheme. This allows the electronic devices to perform control based on the server's provided scheme. Based on this method, the server can assist electronic devices in achieving the effect of "users only need to issue control requirements to achieve application control," making the control process simpler and faster, reducing the difficulty of control on electronic devices, and improving the efficiency of control on the electronic device side.
[0022] In one possible design, the first control requirement is also used to perform a first control; the first control includes any one of time control, content control, and remote control, or the first control includes a combination of multiple of application control, time control, content control, and remote control; the first control information also includes control information corresponding to the type of the first control, the control information corresponding to the type of the first control is used to indicate a second configuration for performing the first control, the second configuration being different from the first configuration.
[0023] Based on this method, the server can simultaneously generate different types of control plans based on a single control requirement from an electronic device and provide them to the electronic device. This method significantly reduces the difficulty of control setup and greatly improves the efficiency of control setup, making it highly practical.
[0024] In one possible design, generating the first control information based on the first information, the first setting information, and the first device usage information includes: using a first setting model to determine a first user intent based on the first information; and using a second setting model to generate the first control information based on the first user intent, the first setting information, and the first device usage information.
[0025] Based on this method, the server can utilize a large model to generate a control plan, i.e., the first control information, to respond to or implement the control requirements based on control needs and other reference information, with high accuracy.
[0026] In one possible design, determining the first user intent based on the first information using the first setting model includes: selecting the first intent information with the highest similarity to the first information from a set of multiple intent information; wherein each intent information in the multiple intent information includes a user intent, a setting item corresponding to the user intent, and a target setting for the setting item; different intent information in the multiple intent information includes different user intents; generating first prompt information based on the first information and the first intent information; wherein the first prompt information is used to indicate the user intent corresponding to the first information by referring to the first intent information; and determining the first user intent corresponding to the first information based on the first prompt information using the first setting model.
[0027] Based on this method, the server can quickly and accurately identify the user intent corresponding to the control requirements, making it highly practical.
[0028] In one possible design, generating the first control information based on the first user intent, the first setting item information, and the first device usage information using the second setting model includes: generating second prompt information based on the first user intent, the first setting item information, and the first device usage information; wherein the second prompt information is used to indicate: determining the setting item corresponding to the first user intent and the configuration for the setting item corresponding to the first user intent by referring to the first setting item information and the first device usage information; and generating the first control information based on the second prompt information using the second setting model.
[0029] Based on this method, the server can quickly and accurately generate corresponding control schemes based on the identified user intent, making it highly practical.
[0030] In one possible design, after sending the first control information to the electronic device, the method further includes: receiving second information, second setting information, and second device usage information from the electronic device; wherein the second information is used to characterize a second control requirement, the second control requirement being used for at least one of application control, time control, content control, and remote control; the second setting information is used to indicate multiple settings of the electronic device and characteristic information of each setting; the second device usage information includes information about applications in the electronic device; generating second control information based on the second information, the second setting information, the second device usage information, and the first user intent, the second control information including control information corresponding to the application control type and control information corresponding to the second control; wherein the control information corresponding to the application control type is used to indicate a third configuration for updating the first configuration, the third configuration being used to control applications in the electronic device; the second control includes any one of time control, content control, and remote control, or the second control includes a combination of multiple of application control, time control, content control, and remote control, the control information corresponding to the type of the second control is used to indicate a fourth configuration for performing the second control; and sending the second control information to the electronic device.
[0031] In this method, the server can generate a new control scheme based on newly received control requirements. The new control scheme can then be used to uniformly update the control scheme corresponding to the previously received control requirements. Therefore, this method supports updating control schemes on the electronic device side based on new control requirements issued by the user, thereby improving the ease of operation in the control process, reducing operation time and setup difficulty, and ultimately improving setup efficiency. Thus, this method helps to reduce the difficulty of control setup and improve its efficiency.
[0032] In one possible design, determining the second control information based on the second information, the second setting information, the second device usage information, and the first user intent includes: using a first setting model to determine a second user intent based on the second information; determining a third user intent based on the first user intent and the second user intent; and using a second setting model to generate the second control information based on the third user intent, the second setting information, and the second device usage information.
[0033] In this method, the server can plan and determine the control scheme corresponding to the control request received this time based on the user intent corresponding to the control request received in the previous one. On the one hand, this can improve the accuracy of planning the control scheme this time, and on the other hand, it can realize the planning of control schemes in multiple rounds.
[0034] Thirdly, this application provides a control system, which includes the electronic device described in the first aspect and the server described in the second aspect.
[0035] Fourthly, this application provides an electronic device, the electronic device including a memory and one or more processors; wherein the memory is used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed by the one or more processors, the electronic device causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0036] Fifthly, this application provides a computer-readable storage medium storing a computer program that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0037] Sixthly, this application provides a computer program product comprising a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method described in the second aspect or any possible design of the second aspect.
[0038] Seventhly, this application provides a chip system including a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, they implement the methods described in the first aspect or any possible design of the first aspect, or implement the methods described in the second aspect or any possible design of the second aspect. The chip system may be composed of chips or may include chips and other discrete devices.
[0039] The beneficial effects of the third to seventh aspects mentioned above can be found in the beneficial effects of the first to second aspects mentioned above, and will not be repeated here. Attached Figure Description
[0040] Figure 1 A schematic diagram illustrating the classification and hierarchy of a control setting item;
[0041] Figure 2 A schematic diagram of the hardware architecture of an electronic device provided in an embodiment of this application;
[0042] Figure 3 A schematic diagram of the software architecture of an electronic device provided in an embodiment of this application;
[0043] Figure 4a A schematic diagram of a possible system architecture provided for an embodiment of this application;
[0044] Figure 4b A schematic diagram of a possible system architecture provided for an embodiment of this application;
[0045] Figure 5 A schematic diagram illustrating a possible control method provided in an embodiment of this application;
[0046] Figure 6 A schematic diagram of an instruction receiving interface provided in an embodiment of this application;
[0047] Figure 7 A schematic diagram of control settings information and corresponding cards provided in an embodiment of this application;
[0048] Figure 8 A schematic diagram of a card interface provided in an embodiment of this application;
[0049] Figure 9 A schematic diagram of a card editing process provided in an embodiment of this application;
[0050] Figure 10 A schematic diagram of a card interface provided in an embodiment of this application;
[0051] Figure 11 A schematic diagram illustrating a control setting planning process provided in an embodiment of this application;
[0052] Figure 12 A schematic diagram illustrating a possible control method provided in an embodiment of this application;
[0053] Figure 13 A schematic diagram of an instruction receiving interface provided in an embodiment of this application;
[0054] Figure 14 A schematic diagram of a card interface provided in an embodiment of this application;
[0055] Figure 15 A schematic diagram illustrating a control setting planning process provided in an embodiment of this application;
[0056] Figure 16 A schematic diagram illustrating a control method provided in an embodiment of this application;
[0057] Figure 17 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0058] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.
[0059] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.
[0060] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0061] The control functions provided by electronic devices can be used to manage and control how users use those devices. For example, the control functions provided by parental controls can help parents manage and control how their children use electronic devices, thereby preventing children from overusing or misusing them. Currently, control settings in electronic devices typically adopt a classification and hierarchical approach. Figure 1 This is a diagram illustrating the classification and hierarchy of a control setting. For example... Figure 1 As shown, electronic devices contain numerous control settings, making it difficult for users to master them all. When configuring control settings, users need to plan the various settings they want to control and manually configure them one by one, categorized by type and level. This method is cumbersome, time-consuming, and therefore inefficient. Furthermore, some control settings may be interconnected and influence each other, further increasing the complexity of the configuration process. In summary, current methods for configuring control settings suffer from both difficulty and inefficiency.
[0062] To address the above issues and reduce the difficulty of management while improving efficiency, this application provides a management method and electronic device. In this method, the electronic device can automatically select and configure management settings based on user-issued instructions indicating the user's management needs, displaying the settings to the user in an interface and performing corresponding management. During this process, the user only needs to issue the required instructions; the selection, configuration, display, and application of management settings can be automatically completed by the electronic device, thus reducing management difficulty and improving efficiency.
[0063] The methods provided in this application can be executed by any electronic device with display and processing capabilities. In some embodiments of this application, the electronic device may be a portable terminal device (e.g., mobile phone, tablet computer, laptop computer, ultra-mobile personal computer (UMPC), netbook, etc.), a wearable device with wireless communication capabilities (e.g., watch, etc.), an in-vehicle terminal device, an augmented reality (AR) / virtual reality (VR) device, a personal digital assistant (PDA), a smart home device (e.g., smart TV, etc.), a smart robot, workshop equipment, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, or a wireless terminal in a smart home, or a flying device (e.g., a smart robot, drone, airplane), etc. Exemplary embodiments of the portable terminal device include, but are not limited to, devices equipped with... Alternatively, it can be a portable terminal device with another operating system. The aforementioned portable terminal devices can also be other portable terminal devices, such as laptops with touch-sensitive surfaces (e.g., touch panels). Wearable devices are portable devices that users can wear directly on their bodies or integrate into their clothing or accessories.
[0064] See below. Figure 2 The structure of the electronic device to which the method provided in the embodiments of this application is applicable will be described.
[0065] like Figure 2As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a USB interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a SIM card interface 195, etc.
[0066] The sensor module 180 may include a gyroscope sensor, an accelerometer, a proximity sensor, a fingerprint sensor, a touch sensor, a temperature sensor, a pressure sensor, a distance sensor, a magnetic sensor, an ambient light sensor, a barometric pressure sensor, a bone conduction sensor, etc.
[0067] Understandable Figure 2 The electronic device 100 shown is merely an example and does not constitute a limitation on the electronic device. The electronic device may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. Figure 2 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0068] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0069] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0070] The execution of the control method provided in this application embodiment can be controlled by the processor 110 to control or call other components. For example, it can call the processing program of this application embodiment stored in the internal memory 121, or call the processing program of this application embodiment stored in a third-party device through the external memory interface 120 to control the wireless communication module 160 to perform data communication with other devices, thereby improving the intelligence and convenience of the electronic device 100 and enhancing the user experience. The processor 110 may include different devices. For example, when integrating a CPU and a GPU, the CPU and GPU can cooperate to execute the control method provided in this application embodiment. For example, some algorithms in the control method are executed by the CPU, and other algorithms are executed by the GPU to obtain faster processing efficiency.
[0071] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1. Display screen 194 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces (GUIs). For example, display screen 194 can display photos, videos, web pages, or documents, etc.
[0072] In this embodiment of the application, the display screen 194 can be a single flexible display screen, or it can be a splicing display screen composed of two rigid screens and a flexible screen located between the two rigid screens.
[0073] Camera 193 (a front-facing camera or a rear-facing camera, or a single camera that can function as both) is used to capture still images or videos. Typically, camera 193 may include a photosensitive element such as a lens assembly and an image sensor. The lens assembly includes multiple lenses (convex or concave lenses) for collecting light signals reflected from the object being photographed and transmitting these signals to the image sensor. The image sensor generates a raw image of the object being photographed based on the light signals.
[0074] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. The program storage area can store the operating system, application program code (such as the functions corresponding to the scheme in this application), etc. The data storage area can store data created during the use of the electronic device 100.
[0075] The internal memory 121 may also store one or more computer programs corresponding to the algorithm of this application. The one or more computer programs are stored in the internal memory 121 and configured to be executed by one or more processors 110. The one or more computer programs include instructions that can be used to perform the various steps in the following embodiments.
[0076] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0077] Of course, the algorithm code of the embodiment of this application can also be stored in external memory. In this case, the processor 110 can run the algorithm code of the embodiment of this application stored in external memory through the external memory interface 120.
[0078] A touch sensor, also known as a "touch panel," can be located on the display screen 194. The touch sensor and display screen 194 together form a touch display screen, also called a "touch screen." The touch sensor detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor may also be located on the surface of the electronic device 100, in a different position than the display screen 194.
[0079] For example, the display screen 194 of the electronic device 100 can display a main interface, which includes icons for multiple applications (such as a camera application, a fitness and health application, etc.). For instance, a user can tap the camera application icon on the main interface using a touch sensor, triggering the processor 110 to launch the camera application and open the camera 193. The display screen 194 then displays the camera application's interface, such as the viewfinder.
[0080] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0081] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0082] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device. In this embodiment, the mobile communication module 150 can also be used for information interaction with other devices.
[0083] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0084] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (WiFi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2. In this embodiment, the wireless communication module 160 can be used to establish connections with other electronic devices for data interaction. Alternatively, the wireless communication module 160 can be used to access access point devices, send control commands to other electronic devices, or receive data from other electronic devices.
[0085] In addition, the electronic device 100 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor, such as music playback and recording. The electronic device 100 can receive input from buttons 190, generating key signal inputs related to user settings and function control. The electronic device 100 can use a motor 191 to generate vibration alerts (such as vibration alerts for incoming calls). The indicator 192 in the electronic device 100 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. The SIM card interface 195 in the electronic device 100 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
[0086] It should be understood that, in practical applications, electronic device 100 may include more than Figure 2 The number of more or fewer components shown is not limited in the embodiments of this application. The illustrated electronic device 100 is merely an example, and the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0087] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. A layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. For example, ... Figure 3 As shown, the software architecture can be divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the (Linux) kernel layer.
[0088] The application layer is the top layer of the operating system and includes native operating system applications such as camera, gallery, calendar, Bluetooth, music, and video, as well as third-party applications. In this application embodiment, the application is referred to as an application (APP), which is a software program capable of performing one or more specific functions. Typically, multiple applications can be installed on an electronic device, such as camera applications and email applications. The applications mentioned below can be system applications pre-installed at the factory or third-party applications downloaded from the network or obtained from other electronic devices by the user during use. In this application embodiment, the application layer may also include applications for interaction related to user control settings (e.g., ...). Figure 3 (e.g., the parental assistant application shown). Optionally, the application can be used to perform some or all of the methods executed by the electronic device in the methods provided in the embodiments of this application. For example, the application can be used to display user instructions, cards, etc., and can also be used to interact with a server (e.g., report information to the server and receive information from the server).
[0089] Of course, for developers, they can write applications and install them into this layer. In one possible implementation, the application can be developed using the Java language, by calling the application programming interface (API) provided by the application framework layer. Developers can then interact with the underlying operating system (such as the kernel layer) through the application framework to develop their own applications.
[0090] The application framework layer provides the API and programming framework for the application layer. It can include predefined functions. The application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0091] The window manager is used to manage window programs. The window manager can obtain the screen size, determine if a status bar is present, lock the screen (or display), and capture the screen, among other things.
[0092] Content providers are used to store and retrieve data, and make that data accessible to applications. This data may include files (e.g., documents, videos, images, audio), text, and other information.
[0093] A view system includes visual controls, such as controls that display text, images, documents, and other content. View systems can be used to build applications. An interface in a display window can consist of one or more views. For example, a display interface including a text message notification icon could include a view that displays text and a view that displays images.
[0094] The phone manager provides communication functionality for electronic devices. The notification manager allows applications to display notification information in the status bar; it can be used to convey informative messages and can disappear automatically after a short pause without user interaction.
[0095] The runtime includes the core libraries and the virtual machine. The runtime is responsible for system scheduling and management.
[0096] The system's core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part is the system's core library. The application layer and application framework layer run in a virtual machine. Taking Java as an example, the virtual machine executes the Java files in the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0097] The system library can include multiple functional modules. Examples include: a surface manager, a media library, a 3D graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), and an image processing library. The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.564, MP3, AAC, AMR, JPG, and PNG. The 3D graphics processing library implements 3D graphics drawing, image rendering, compositing, and layer processing. The 2D graphics engine is the drawing engine for 2D graphics.
[0098] The kernel layer provides core system services for the operating system, such as security, memory management, process management, network protocol stack, and driver models, all of which are implemented based on the kernel layer. The kernel layer also serves as an abstraction layer between the hardware and software stacks. This layer contains many drivers related to electronic devices, including: display drivers; keyboard drivers as input devices; Flash drivers for memory-based devices; camera drivers; audio drivers; Bluetooth drivers; and WiFi drivers.
[0099] It is important to understand that the functional services described above are just an example. In practical applications, electronic devices may be divided into more or fewer functional services based on other factors, or the functions of each service may be divided in other ways, or they may not be divided into functional services but work as a whole.
[0100] Example 1
[0101] Figure 4aA schematic diagram illustrating a possible system architecture applicable to the solutions provided in the embodiments of this application. (Refer to...) Figure 4a In one possible scenario, the solution provided in this application embodiment can be applied to a system architecture including a user, a first device, and a server. For example, the server can be a cloud server.
[0102] In one possible approach, the first device can act as both a control terminal (or management terminal) and a controlled terminal. In another possible approach, the first device can act as a control terminal, and other devices can act as controlled terminals. For example, the system architecture described above can also include a second device. In this scenario, the first device can act as a control terminal, and the second device can act as a controlled terminal. The second device is bound to or associated with the first device, or the user account logged into the second device is bound to or associated with the user account logged into the first device.
[0103] For ease of description, in the following embodiments, the device acting as the control end will be referred to as an electronic device, and the device acting as the controlled end will be referred to as a controlled device.
[0104] The implementation process of the solution provided in this application embodiment may include the following four stages:
[0105] Phase 1: Users can issue control instructions to electronic devices via voice or text input to indicate control needs.
[0106] This control requirement can be used to manage electronic devices using any one of the following methods, or a combination of multiple methods: application control, time control, content control, and remote control. This control requirement can be the desired effect achieved after the electronic device is controlled (or it can be understood as a control objective or control demand).
[0107] Phase 2: Upon receiving a control instruction, electronic devices may report at least one of the following pieces of information to the server:
[0108] 1) Control instructions.
[0109] The control instructions can be used to determine the user's control needs, i.e., the user's control intentions, so as to plan and configure settings to meet the user's control needs in accordance with the user's control intentions, thereby achieving the user's needs. In this embodiment, the user's control intentions can be simply referred to as user intentions or intentions.
[0110] Optionally, when the control instruction received by the electronic device is in voice format, the electronic device can convert the control instruction into text format before uploading it to the server. When the control instruction received by the electronic device is in text format, the electronic device can directly report the control instruction to the server.
[0111] 2) Setting information used to indicate the settings and their characteristics supported (or included) by the electronic device.
[0112] The settings information can be used to determine the settings supported by the electronic device and their configuration methods, so as to make reasonable plans and configurations for the settings to meet the user's management needs, thereby improving the accuracy and success rate of management.
[0113] For example, the feature information of the settings supported by the electronic device may include at least one of the following: setting type, setting method, setting parameter range type, setting parameter range, and calling interface (e.g., API). Other information may also be included, but will not be listed in detail in this embodiment.
[0114] It should be noted that in the embodiments of this application, the setting item may also be called a control item, control setting item, control item or management control item, etc. The name of the setting item is not limited in the embodiments of this application.
[0115] 3) Equipment usage information used to indicate the usage status of the controlled equipment and / or the applications used in the controlled equipment.
[0116] Optionally, device usage information can be used to indicate information about applications on the controlled device (e.g., application identifier, application category, application usage records, etc., which are not specifically limited in this embodiment). This device usage information can be used to determine the detailed usage of the controlled device, so as to plan and configure settings to meet user management needs based on the usage of the controlled device, thereby improving the accuracy of management. When the controlled device is another device, the electronic device can obtain device usage information from that other device.
[0117] Optionally, the usage of the controlled device and / or the application in the controlled device may include the usage of the controlled device and / or the application in the controlled device over any period of time in the past, present, or future (e.g., usage duration, usage period, usage date, etc.).
[0118] In one example, device usage information may include schedule information and application information. Schedule information may include information related to schedules or plans recorded on the controlled device, such as study schedules or plans. Schedule information can reflect the usage of the controlled device within a certain period. Application information can be used to indicate the applications included on the controlled device, and can also be used to indicate application characteristics such as the category of the applications on the controlled device. For example, application information may include a list of various types of applications on the controlled device, such as educational, gaming, children's, news, audio-visual entertainment, social communication, photography and beautification, system, and other categories. Of course, device usage information may also include other usage-related information, which will not be listed and described in detail in this embodiment.
[0119] Phase 3: The server can respond to the control instructions reported by the electronic device, determine control setting information based on control reference information, and instruct the electronic device to do so. This control setting information can also be called control information or control configuration information. The control setting information can be used to indicate at least one control setting method, where each control setting method can be used to realize a certain user intent, and each control setting method can be used to determine how to configure at least one setting item of the electronic device. Optionally, the control setting information may also include information indicating the user intent corresponding to the control instruction. The control reference information may include information reported by the electronic device (e.g., the aforementioned control instructions, setting item information, device usage information, etc.), and may also include preset auxiliary information for identifying user intent and / or for indicating planning techniques for setting items. The preset auxiliary information may be information pre-configured by the user in the server. In some embodiments of this application, the preset auxiliary information may include a preset correspondence between different user intents and different control setting methods, where any user intent and its corresponding control setting method can constitute a piece of auxiliary information. Optionally, the server can vectorize the preset auxiliary information and store it in a database (i.e., each piece of auxiliary information can be a vectorized data) for subsequent retrieval.
[0120] In some embodiments of this application, the server can utilize a trained large language model (LLM) to understand user intent based on control instructions (or control instructions and auxiliary information) in the control reference information, and determine control settings information for implementing the user intent based on the user intent, setting information and device usage information (or setting information, device usage information and auxiliary information) in the control reference information. Here, the LLM is a model obtained after training on a large amount of text data. LLM can be used to perform a wide range of tasks, such as text summarization, translation, intent recognition, task planning, etc.
[0121] Phase 4: After receiving control setting information from the server, the electronic device can generate and display at least one interface based on the control setting information. The at least one interface includes an interface corresponding to each of the at least one control setting method described above. Each interface corresponding to a control setting method includes at least information indicating that control setting method.
[0122] The display format or form of the interface used to display the control settings can be in the form of cards, etc., and no specific limitation is made in this embodiment. For ease of description and to better demonstrate the effect of the solution of this application, the following embodiments of this application use the display of the interface for displaying the control settings in card form as an example for illustration.
[0123] The card described in this embodiment can be a component that carries information and / or functional controls. The card can contain various elements such as titles, text, images, buttons, or links; no limitations are imposed in this embodiment.
[0124] In some embodiments of this application, after displaying at least one card, the electronic device can also edit the card or its content based on user actions (e.g., delete or modify). Optionally, each card displayed by the electronic device may also include elements such as controls for editing the card or its content, so that the user can use the controls to edit the card or its content.
[0125] In some embodiments of this application, such as Figure 4a As shown, the electronic device may include a multimodal interaction module and a card generation module. The server may include an LLM processing module and a plug-in management module. Based on this architecture, as... Figure 4b As shown, the multimodal interaction module can be used for multimodal interaction with the user (e.g., interaction in multiple modes such as voice and text). For example, the multimodal interaction module can receive control instructions from the user via voice or text input. When the control instruction is in voice format, the multimodal interaction module can use automatic speech recognition (ASR) technology to convert the control instruction into text format and report it to the LLM processing module. When the control instruction is in text format, the multimodal interaction module can directly report the control instruction to the LLM processing module. For example, the multimodal interaction module in an electronic device can be an application for interacting with the user regarding control settings, such as a parental control assistant application. Optionally, such as... Figure 4a As shown, the electronic device may also include a reference information acquisition module. This module can acquire the aforementioned setting information and device usage information, and then report the acquired information to the server.
[0126] The plug-in management module can be used to integrate and manage setting information and device usage information reported by terminal devices, as well as preset auxiliary information. The information managed by the plug-in management module can serve as part of the input information for the task planning module. For example, ... Figure 4b As shown, the plug-in management module can be used to manage plug-in knowledge such as whole control mode usage skills, electronic device usage records, and terminal API options, and use plug-in knowledge as additional input information for the task planning module to improve the reliability and accuracy of control planning.
[0127] The LLM processing module can be used to determine control settings information based on control reference information using LLM. Optionally, such as... Figure 4a or Figure 4b As shown, the LLM processing module may further include an intent recognition module, a task planning module, and a memory module. The intent recognition module can be used to understand user intents based on control instructions (or control instructions and auxiliary information) in the control reference information, thereby determining the user intent and inputting it into the task planning module. The intent recognition module can also send the determined user intent to the memory module for storage. The task planning module can be used to determine the control settings information used to implement the user intent based on the user intent, setting information and device usage information (or setting information, device usage information and auxiliary information) in the control reference information. The memory module can be used to store user intents. The user intents stored in the memory module may include user intents determined by the server during the current interaction, and may also include user intents determined by the server during one or more previous interactions. The user intents stored in the memory module can serve as part of the input information for the task planning module.
[0128] The card generation module can be used to generate and display at least one card based on the aforementioned control settings information from the server. The card generation module can also be used to edit the displayed card based on user actions. For example... Figure 4b As shown, the control modes of electronic devices can be divided into four categories: application control, time control, content control, and remote control. The card generation module can be used to call the APIs corresponding to the four control modes, thereby generating cards and performing subsequent processing based on the called APIs.
[0129] In this embodiment, the electronic device can interact with the user once or multiple times consecutively. The first interaction in a single interaction or multiple consecutive interactions can refer to the processes described in stages 1-4 above. In subsequent interactions within multiple consecutive interactions, the interaction between the electronic device and the user, and the processing method on the electronic device side, can refer to the corresponding processes or methods described in stages 1-4. The difference between the server-side processing method and the server-side processing method described in stages 1-4 is that the information used by the server to determine the control settings information, in addition to the aforementioned control reference information, may also include the user intent determined by the server in the previous one or more interactions. Specifically, the server can determine the latest user intent based on the user intent determined in the previous one or more interactions and the control instructions in the current interaction, and then determine the latest control settings information based on the latest user intent. In subsequent interactions within multiple consecutive interactions, the electronic device can display cards by updating (i.e., replacing) the previously displayed card using the card determined this time.
[0130] In the above method, users only need to issue commands related to control requirements to the electronic device, making the operation very simple and low-complexity. The electronic device can report user commands and other relevant information to the server. The server can utilize the intent recognition and task planning capabilities of LLM to plan target settings based on the information reported by the electronic device and instruct the electronic device on the planned settings. The electronic device can then divide the settings into cards and display them to the user, allowing the user to intuitively see the settings and easily edit them, thus achieving high efficiency in control settings. In summary, the above method can reduce the difficulty of control settings and improve their efficiency.
[0131] The methods provided in the above embodiments will be illustrated below with reference to specific scenarios.
[0132] Example 2
[0133] Based on the above embodiments, referring to Figure 5 The process of one possible control method provided in this application may include:
[0134] S501: The electronic device receives a first control instruction issued by the user; wherein the first control instruction is used to indicate a first control requirement.
[0135] The explanation of the first control instruction can be found in the first embodiment of the above description of the control instruction, and the explanation of the first control requirement can be found in the first embodiment of the above description of the control requirement. They will not be described in detail here.
[0136] Optionally, when the first control instruction is in voice format, the electronic device may display the corresponding text of the first control instruction after receiving it, so that the user can view the control instruction issued via voice. Optionally, the electronic device may display a corresponding prompt interface in response to a received operation to trigger the control function, or in response to a received voice wake-up command, to prompt the user to issue a control instruction. Optionally, after displaying the prompt interface, the electronic device may begin receiving the first control instruction issued by the user via voice. Alternatively, the electronic device may begin receiving the first control instruction in response to an operation performed by the user on the prompt interface (such as inputting a control instruction).
[0137] Example 1: In one example, taking a mobile phone as the electronic device and voice format as the first control instruction, the electronic device can display the following after receiving the first control instruction: Figure 6The interface shown includes the text corresponding to the first control instruction, namely, "Let the child watch cartoons for a while, but don't let him play games freely." In one example, in this scenario, the controlled device can be a device logged into the child's account, and the child's account can be linked to the user account logged into the electronic device.
[0138] S502: The electronic device responds to the first control instruction and sends the first control instruction to the server.
[0139] The method for the electronic device to send the first control instruction to the server can be implemented by referring to the method for the electronic device to report the control instruction to the server in stage 1 of the aforementioned embodiment, and will not be described in detail here.
[0140] The specific methods for steps S501 to S502 can be implemented by referring to the methods described in stages 1 and 2 of the aforementioned embodiment, and will not be described in detail here.
[0141] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, steps S501 to S502 can be performed by... Figure 4a or Figure 4b The multimodal interaction module shown is executed. Optionally, the multimodal interaction module can send the first control instruction to the intent recognition module in the LLM processing module.
[0142] S503: The electronic device sends first setting information and first device usage information to the server; wherein, the first setting information is used to indicate the settings and their characteristic information supported by the current electronic device, and the first device usage information is used to indicate the usage status of the current controlled device and / or the applications in the controlled device.
[0143] The first setting information refers to the latest setting information currently obtained by the electronic device, and the first device usage information refers to the latest device usage information currently obtained by the electronic device. For details regarding the setting information and device usage information, please refer to the corresponding descriptions in the aforementioned Embodiment 1; they will not be elaborated upon here.
[0144] The specific method of step S503 can be implemented by referring to the method described in stage 2 of the aforementioned embodiment, and will not be described in detail here.
[0145] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, step S503 can be performed by... Figure 4a or Figure 4bThe reference information acquisition module shown is executed. Optionally, the reference information acquisition module can send the first setting information and the first device usage information to the plug-in management module.
[0146] Example 2: Based on Example 1 above, in one example, the first setting item information may include setting item information in the electronic device, the setting parameter range type of each setting item, and the setting parameter range. The setting parameter range type and setting parameter range of each setting item can serve as characteristic information of that setting item. For example, the first setting item information may specifically include the following eight pieces of information:
[0147] 1) Application usage permissions - toggle options - [On, Off]
[0148] 2) Application usage duration - Duration range - [0 hours - 24 hours]
[0149] 3) Application usage time - Time range - [00:00-24:00]
[0150] 4) App installation license level - fixed options - [Kids app, Teen app, Adult app]
[0151] 5) Video Rating - Fixed Options - [Children's Content, Teen Content, Adult Content]
[0152] 6) Eye Protection Mode - Switch Options - [On, Off]
[0153] 7) Eye Protection Mode Single Use Duration - Fixed Options - [15 minutes, 20 minutes, 30 minutes, 45 minutes, 60 minutes]
[0154] 8) Eye Protection Mode Single Rest Duration - Fixed Options - [5min, 10min, 15min, 20min, 30min]
[0155] The first device information item can include information for eight settings, such as application usage permissions and application usage duration. Taking the application usage permission setting item corresponding to item 1) as an example, the characteristic information of this setting item can include the setting parameter range type and the setting parameter range. The setting parameter range type of this setting item is a switch option. The setting parameter range of this setting item is [On, Off], meaning the value of the setting parameter range includes "On" and "Off," and the setting parameter of this setting item can be either "On" or "Off." Taking the application usage duration setting item corresponding to item 2) as an example, the characteristic information of this setting item can include the setting parameter range type and the setting parameter range. The setting parameter range type of this setting item is a duration range, meaning the setting parameter range of this setting item is a duration range. The setting parameter range of this setting item is [0 hours - 24 hours], meaning the value of the setting parameter range of this setting item is [0 hours - 24 hours], and the setting parameter of this setting item must be greater than or equal to 0 hours and less than or equal to 24 hours. The characteristics of other settings are similar and will not be described in detail here.
[0156] In one example, the first device usage information may include schedule information and application information. For example, schedule information may include the following two pieces of information:
[0157] 1) February 13, 2024, 18:30-19:30: Do homework
[0158] 2) February 14, 2024, 18:30-19:30: Do homework
[0159] Application information can include the following 10 items:
[0160] 1) Education Category - Application 1, Application 2, Application 3
[0161] 2) Children's Category - App 4, App 5
[0162] 3) News Apps - App 6, App 7
[0163] 4) Audio-visual entertainment apps - Apps 8, 9, 10, and 11
[0164] 5) Games - Apps 12, 13, 14, 15, and 16
[0165] 6) Social Communication Apps - Apps 17, 18, 19, and 20
[0166] 7) Sports and Health Apps - 21
[0167] 8) Photography enhancement apps - App 22, App 23
[0168] 9) System and Tools - Applications 24, 25, 26, 27, and 28
[0169] 10) Other categories - Application 29, Application 30
[0170] S504: The server determines the first control setting information based on the first control instruction, the first setting item information, the first device usage information sent by the electronic device, and the preset auxiliary information; wherein, the first control setting information is used to indicate at least one control setting method corresponding to the first control instruction.
[0171] In this embodiment, any control setting method can be a method of setting at least one setting item of the electronic device. Optionally, different control setting information in the first control setting information can be used to indicate different control setting methods, and different control setting methods can correspond to different control types. Any control type can include any one or a combination of multiple of application control, time control, content control, and remote control. Optionally, application control can refer to the type of control over applications in the controlled device. For example, it can be the control over the usage permissions of applications in the controlled device, etc., and no specific limitation is made in this embodiment. Time control can refer to the type of control over time-related items. For example, it can be the control over various time characteristics such as usage time, start time, end time, and rest time of the controlled device or applications in the controlled device, etc., and no specific limitation is made in this embodiment. Content control can refer to the type of control over the content in the controlled device. For example, it can be the control over the type of content displayed or output by the controlled device, etc., and no specific limitation is made in this embodiment. Remote control can refer to the type of control over the remote interaction of the controlled device.
[0172] The first control setting information may include content indicating at least one control setting method corresponding to the first control instruction. Optionally, the first control setting information may further include content indicating a first user intent corresponding to the first control instruction.
[0173] Regarding the preset auxiliary information, please refer to the corresponding description in the aforementioned Embodiment 1, which will not be elaborated here.
[0174] Example 3: Based on Example 2 above, in one example, such as Figure 7 As shown, the first control setting information determined by the server based on the first control instruction described in Example 1, the first setting item information described in Example 2, and the first device usage information may include the following three pieces of information:
[0175] 1) Restrict children to watch only cartoons and other children's content: Video rating - Children's content.
[0176] 2) Restrict children's gaming: Disable game apps.
[0177] 3) A study plan was detected between 18:30 and 19:30: Non-educational applications are prohibited during the time period [18:30-19:30], and eye protection mode is turned on.
[0178] Among them, item 1) belongs to the content control type, item 2) belongs to the application control type, and item 3) belongs to the combination of application control and time control. "Restrict children to watch only cartoons and other children's content," "Restrict children from playing games," and "A study plan was detected between 18:30 and 19:30" can be used as content to indicate the first user's intent. "Video rating - children's content," "Disable game applications," and "Prohibit the use of non-educational applications during the time period [18:30-19:30] and turn on eye protection mode" can be used as content to indicate at least one control setting method corresponding to the first control instruction. In this scenario, the first control instruction corresponds to three control settings: setting the "video rating" to "children's content"; disabling game applications; and prohibiting the use of non-educational applications during the time period [18:30-19:30] and turning on eye protection mode.
[0179] S505: The server sends the first control settings information to the electronic device.
[0180] The specific methods for steps S504 to S505 can be implemented by referring to the method described in stage 3 of the aforementioned embodiment, and will not be described in detail here.
[0181] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, steps S504 to S505 can be performed by... Figure 4a or Figure 4bThe LLM processing module and plug-in management module shown collaborate in execution. Optionally, the intent recognition module in the LLM processing module can identify the corresponding first user intent based on the first control instruction from the multimodal interaction module, and send the identified first user intent to the task planning module in the LLM processing module. The plug-in management module can send the first setting item information and the first device usage information from the reference information acquisition module, as well as the preset auxiliary information, to the task planning module in the LLM processing module. The task planning module in the LLM processing module can determine the first control setting information based on the received information. Optionally, the task planning module can send the first control setting information to the card generation module. Alternatively, the task planning module can send the first control setting information to the plug-in management module, which can convert the first control setting information into a set format (e.g., a lightweight data exchange format (e.g., JavaScript Object Notation (JSON) format, etc.)) and send the converted first control setting information to the card generation module.
[0182] S506: The electronic device generates at least one card corresponding to the first control instruction based on the first control setting information from the server; wherein, the at least one card includes a card corresponding to each of the at least one control setting methods corresponding to the first control instruction, and the card corresponding to each control setting method is used to indicate the control setting method.
[0183] Regarding at least one card, please refer to the explanation in the aforementioned Embodiment 1, which will not be elaborated here.
[0184] Optionally, the electronic device can generate a card corresponding to each control type based on the information corresponding to each control type in the first control setting information. For example, the electronic device can generate a card corresponding to an application control type based on the control setting information of the application control type in the first control setting information (e.g., as follows). Figure 8 Card 2 shown in the diagram). For example, an electronic device can generate a card corresponding to a content control type (e.g., the following) based on the content control type control settings information in the first control settings information. Figure 8 Card 1 shown.
[0185] S507: The electronic device displays at least one card corresponding to the first control instruction.
[0186] The specific methods for steps S506 to S507 can be implemented by referring to the method described in stage 4 of the aforementioned embodiment, and will not be described in detail here.
[0187] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, steps S506 to S507 can be performed by... Figure 4a or Figure 4b The card generation module shown is executed.
[0188] Example 4: Based on Example 3 above, in one example, the card corresponding to setting the "Video Rating" option to "Children's Content" in the control settings can be... Figure 7 Card 1 shown, the card corresponding to the control settings for disabling game applications can be... Figure 7 Card 2 shown, which prohibits the use of non-educational applications during the time period [18:30-19:30] and enables eye protection mode, can be the corresponding card. Figure 7 Card 3 is shown in the image. After generating cards 1 through 3 respectively, the electronic device can display them as shown in the image. Figure 8 The interface shown includes cards 1 through 3. That is, the electronic device can display... Figure 6 The interface shown has switched to display. Figure 8 The interface shown. Furthermore, electronic devices can configure relevant settings and manage the controlled devices according to the control settings corresponding to each card.
[0189] Example 5: Based on Example 4 above, in one example, the electronic device can modify the card and its corresponding control settings in response to a user's action on the card. For example, Figure 8 The card 1 shown may include a control 1 for triggering the setting to edit video levels. The electronic device can respond to user actions on the control 1 (e.g., a click) from the display. Figure 8 The interface shown has switched to display. Figure 9 The interface is shown in diagram (a). This interface may include a range of settings for the video rating setting, namely three options: "Children's Content," "Teenagers' Content," and "Adults' Content." The electronic device can update the video rating setting parameters to match the parameters of the selected target option in response to the user's selection of the target option. For example, when the user selects a target option through... Figure 9 After selecting the "Teen Content" option on the interface shown in diagram (a), the electronic device can respond to this operation by displaying... Figure 9 The interface shown in diagram (a) is switched to display. Figure 9 The interface shown in diagram (b) is similar to the interface shown in the diagram. Figure 8Compared to the interface shown, the setting parameter for the "Video Rating" setting has been changed to "Teen Content". Correspondingly, the control setting method for this card has been updated from setting the "Video Rating" setting to "Child Content" to setting it to "Teen Content". Electronic devices can then manage the controlled device according to the updated control setting method. It should be understood that the operation used to trigger the editing of the control setting method in this embodiment is not limited to the operation in the example above, and can also be other operations (such as long-press operations). This embodiment does not limit the specific operation method.
[0190] Example 6: Based on Example 4 above, in one example, the electronic device can respond to a user's action on a card by deleting the card and its corresponding control settings. For example, the electronic device displays... Figure 8 After the interface shown, it can respond to the user's action of instructing the deletion of card 2, from the display Figure 8 The interface shown has switched to display. Figure 10 The interface shown (which no longer includes card 2) eliminates the need to manage the controlled device using the method of setting the "Video Rating" to "Children's Content". The user's action to indicate the deletion of card 2 could be, for example, swiping left on card 2, or any other action; this embodiment does not limit the specific operation method.
[0191] The following is a detailed description of the specific implementation process of the server determining the first control setting information based on the first control instruction, the first setting item information, the first device usage information sent by the electronic device, and the preset auxiliary information in step S504 above.
[0192] In some embodiments of this application, the server may first determine the first user intent corresponding to the first control instruction based on the first control instruction and preset auxiliary information, and then determine the first control setting information based on the first user intent, the first setting item information and the first device usage information.
[0193] The process by which the server determines the first user intent corresponding to the first control instruction based on the first control instruction and preset auxiliary information may include the following steps A1 to A4:
[0194] A1: The server performs semantic segmentation on the first control instruction, dividing the first control instruction into at least one instruction message.
[0195] In this context, each instruction in at least one instruction can be a sentence in the text corresponding to the first control instruction.
[0196] By performing semantic segmentation on the first control instruction, in scenarios where the first control instruction is relatively complex, it can be broken down into simpler instruction information so that intent recognition can be performed on each instruction information separately.
[0197] Example 7: Based on Example 6 above, such as Figure 11 As shown, when the text corresponding to the first control instruction is "Let the child watch cartoons for a while, but don't let him play games casually", the server can obtain at least one instruction information by semantically segmenting the text corresponding to the first control instruction, which may include "Let the child watch cartoons for a while" and "Don't let him play games casually".
[0198] A2: The server retrieves at least one piece of auxiliary information from a database used to store auxiliary information based on at least one instruction; wherein, the at least one piece of auxiliary information includes auxiliary information corresponding to each of the at least one instruction, and the auxiliary information corresponding to each instruction is the auxiliary information in the database with the highest similarity to the instruction; each piece of auxiliary information in the database includes a preset user intent and a preset control setting method corresponding to the user intent, and different pieces of auxiliary information in the database contain different user intents.
[0199] Among these, the auxiliary information corresponding to each instruction has the highest similarity to the instruction itself. Therefore, the user intent contained in the auxiliary information corresponding to each instruction is highly likely to be the same as the user intent corresponding to the instruction. Thus, the auxiliary information corresponding to each instruction can be used as reference information for the server to determine the user intent corresponding to that instruction, helping to improve the accuracy of the server's user intent recognition.
[0200] Example 8: Based on Example 7 above, in one example, such as Figure 11 As shown, the auxiliary information may include the following auxiliary information 1 and auxiliary information 2:
[0201] Supporting information 1: "Only cartoons can be watched - videos are restricted to children's content".
[0202] Among them, "Only watch cartoons" is a preset user intent, and "Restrict video content to children's content" is the control setting corresponding to the user intent "Only watch cartoons".
[0203] Auxiliary information 2: "Prohibit children from playing games - restrict the use of game applications."
[0204] Among them, "prohibit children from playing games" is a preset user intent, and "restrict the use of game applications" is the control setting method corresponding to the user intent "prohibit children from playing games".
[0205] The server can vectorize auxiliary information 1 and auxiliary information 2 respectively and store them in the database.
[0206] As an optional implementation, the server can vectorize at least one instruction information obtained according to the first control instruction, and perform a similarity search in the database based on the vectorized instruction information to retrieve the auxiliary information with the highest similarity to each instruction information. For example... Figure 11 As shown, the search results may include: the auxiliary information with the highest similarity to the instruction "Let the child watch cartoons for a while" is auxiliary information 1, and the auxiliary information with the highest similarity to the instruction "Don't let him play games casually" is auxiliary information 2.
[0207] A3: The server generates a first prompt message based on a first control instruction, at least one instruction message, and at least one auxiliary message; wherein the first prompt message includes prompt message for indicating the user intent corresponding to the first control instruction and prompt message corresponding to each of the at least one instruction message, and the prompt message corresponding to each instruction message is used to indicate that the user intent corresponding to the instruction message is the user intent contained in the auxiliary message corresponding to the instruction message.
[0208] Example 9: Based on Example 8 above, in one example, such as Figure 11 As shown, the first prompt message may include the following three items:
[0209] 1) 'usr': Recognizes user intent in the dialogue {'usr':'Only watch cartoons'}
[0210] The user's intent was: "Restrict the video rating to children's content."
[0211] 2) 'usr': Identify user intent in the dialogue {'usr':'Prevent children from playing games'}
[0212] The user's intent was: "Restrict permissions for game applications."
[0213] 3) User intent identification: Recognize user intent in dialogues such as "Let the child watch cartoons for a while", "Don't let him play games casually"}
[0214] Items 1) and 2) are the prompts corresponding to the two instruction messages obtained from the breakdown of the first control instruction, and item 3) is the prompt message used to indicate the user's intent corresponding to the first control instruction. usr represents the user.
[0215] A4: The server uses the first set model to determine the first user intent corresponding to the first control instruction based on the first prompt information.
[0216] The server can input the first prompt information into the first setting model to obtain the first user intent corresponding to the first control instruction output by the first setting model. After determining the first user intent, the server can save the first user intent. For example, the first setting model can be an LLM pre-configured by the user on the server.
[0217] Example 10: Based on Example 9 above, in one example, such as Figure 11 As shown, the first user intent set by the model output can include: "Restrict video rating to children's content" and "Restrict access to game applications".
[0218] Optional, when applied to Figure 4a or Figure 4b In the system architecture shown, steps A1 to A4 can be performed by... Figure 4a or Figure 4b The intent recognition module shown is executed. After determining the first user intent, the intent recognition module can store the first user intent in the memory module.
[0219] The process by which the server determines the first control setting information based on the first user intent, the first setting item information, and the first device usage information may include the following steps B1 to B2:
[0220] B1: The server generates a second prompt message based on the first user intent, the first setting information, and the first device usage information; wherein the second prompt message is used to indicate: to plan a control setting scheme based on the first user intent and with reference to the first setting information and the first device usage information.
[0221] B2: The server uses the second setting model to determine the first control setting information corresponding to the first control instruction based on the second prompt information.
[0222] The server can input the second prompt information into the second setting model to obtain the first control setting information corresponding to the first control instruction output by the second setting model. For example, the second setting model can be an LLM pre-configured by the user on the server.
[0223] Example 11: Based on Example 10 above, in one example, such as Figure 11 As shown, the second prompt may include: Please plan your control measures according to the intent of [restricting video content to children's rating and restricting the use of game applications], while also considering a study plan for homework from 18:30 to 19:30. Reference settings include: application usage permissions, application usage time, application installation license level, video rating, eye protection mode, single use duration of eye protection mode, and single rest duration of eye protection mode. The server is based on... Figure 11The second prompt information shown can obtain the first control settings information described in Example 3 above.
[0224] Optional, when applied to Figure 4a or Figure 4b In the system architecture shown, steps B1 to B2 can be performed by... Figure 4a or Figure 4b The task planning module shown is executed.
[0225] In some embodiments of this application, after determining the first control setting information, the server can further check the first control setting information. Specifically, the server can generate a third prompt message based on the first control setting information and the first setting item information, and use a third setting model to determine whether the setting item corresponding to the control setting method indicated by the first control setting information exceeds the range of setting items supported by the electronic device. When the server determines that the setting item corresponding to the control setting method indicated by the first control setting information does not exceed the range of setting items supported by the electronic device, the server can indicate the first control setting information to the electronic device. When the server determines that the setting item corresponding to the control setting method indicated by the first control setting information exceeds the range of setting items supported by the electronic device, the server can generate a fourth prompt message to indicate that the setting item corresponding to the control setting method indicated by the first control setting information exceeds the range of setting items supported by the electronic device, and use a second setting model to re-determine the first control setting information corresponding to the first control instruction based on the second prompt message and the fourth prompt message.
[0226] Example 3
[0227] In some embodiments of this application, after an electronic device displays at least one card indicating the control settings method in response to a control instruction issued by a user, it can also update the displayed at least one card based on a subsequent control instruction issued by the user. Based on this method, refer to... Figure 12 Following step S507 in the above embodiment two, the following process may also be included:
[0228] S1201: The electronic device receives a second control instruction issued by the user; wherein the second control instruction is used to indicate a second control requirement.
[0229] The explanation of the second control instruction can be found in the first embodiment of the above-mentioned explanation of the control instruction, and the explanation of the second control requirement can be found in the first embodiment of the above-mentioned explanation of the control requirement, which will not be elaborated here.
[0230] Example 12: Based on Example 11 above, in one example, taking the format of the second control instruction as voice, the electronic device can display the following after receiving the second control instruction: Figure 13 The interface shown includes the text corresponding to the second control instruction, namely, "Let him watch cartoons for only half an hour, but he can play application 14."
[0231] S1202: The electronic device responds to the second control instruction by sending the second control instruction to the server.
[0232] The specific methods for steps S1201 to S1202 can be implemented by referring to the methods described in stages 1 and 2 of the aforementioned embodiment, or by referring to the methods described in steps S501 to S502, and will not be described in detail here.
[0233] S1203: The electronic device sends second setting information and second device usage information to the server; wherein, the second setting information is used to indicate the settings and their characteristic information supported by the current electronic device, and the second device usage information is used to indicate the usage status of the current controlled device and / or the applications in the controlled device.
[0234] The second setting information can be the same as or different from the first setting information, depending on the specific circumstances. For example, during the time period between the electronic device receiving the first control instruction and the second control instruction, if the setting information acquired by the electronic device does not change, then the second setting information is the same as the first setting information; if the setting information acquired by the electronic device changes, then the second setting information is different from the first setting information. Similarly, the second device usage information can be the same as or different from the first device usage information, depending on the specific circumstances.
[0235] The specific method of step S1203 can be implemented by referring to the method described in stage 2 of the aforementioned embodiment, or by referring to the method described in step S503, and will not be described in detail here.
[0236] S1204: The server obtains the first user intent corresponding to the first control instruction.
[0237] Example 13: Based on Example 12 above, the first user intent may include "restricting video content to children's content" and "restricting the use of game applications".
[0238] S1205: The server determines the second control setting information based on the second control instruction, the second setting item information, the second device usage information, the first user intent, and the preset auxiliary information sent by the electronic device; wherein, the second control setting information is used to indicate at least one control setting method corresponding to the second control instruction and the first control instruction.
[0239] The second control setting information may include content indicating at least one control setting method corresponding to the second control instruction and the first control instruction. Optionally, the second control setting information may also include content indicating a second user intent corresponding to the second control instruction and the first control instruction. The classification of information types included in the second control setting information can be referenced to the aforementioned classification of information types included in the first control setting information, and will not be detailed here.
[0240] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, steps S1204 to S1205 can be performed by... Figure 4a or Figure 4b The LLM processing module, memory module, and plug-in management module shown in the diagram work collaboratively. Optionally, the memory module in the LLM processing module can send the first user intent corresponding to the first control instruction to the intent recognition module. The intent recognition module can recognize the second control instruction and the second user intent corresponding to the first control instruction based on the second control instruction from the multimodal interaction module and the first user intent from the memory module, and send the recognized second user intent to the task planning module in the LLM processing module. The plug-in management module can send the second setting item information and the second device usage information from the reference information acquisition module, as well as the preset auxiliary information, to the task planning module in the LLM processing module. The task planning module in the LLM processing module can determine the second control setting information based on the received information. Optionally, the task planning module can send the second control setting information to the card generation module. Alternatively, the task planning module can send the second control setting information to the plug-in management module, which can convert the second control setting information into a set format and send the converted second control setting information to the card generation module.
[0241] Example 14: Based on Example 13 above, in one example, taking a scenario where the second setting information is the same as the first setting information described in Example 2, and the second device usage information is the same as the first device usage information described in Example 2, the second control setting information determined by the server based on the second control instruction described in Example 12, the first user intent described in Example 13, and the second setting information (the same as the first setting information described in Example 2) and the second device usage information (the same as the first device usage information described in Example 2) may include the following four pieces of information:
[0242] 1) Restrict children to watch only cartoons and other children's content: Video rating - Children's content.
[0243] 2) Restrict children from playing games: Disable game apps, but exclude app 14.
[0244] 3) A study plan was detected between 18:30 and 19:30: Non-educational applications are prohibited during the time period [18:30-19:30], and eye protection mode is turned on.
[0245] 4) Limit video viewing time to 30 minutes: Video applications - usage time - 30 minutes.
[0246] In this scenario, the second user intent corresponds to four control settings: setting the "video level" setting to "children's content"; disabling game apps but excluding app 14 (i.e., allowing the use of app 14, which is a game app, but prohibiting the use of other game apps besides app 14); prohibiting the use of non-educational apps during the time period [18:30-19:30] and turning on eye protection mode; and controlling the usage time of video apps to no more than 30 minutes.
[0247] S1206: The server sends second control settings information to electronic devices.
[0248] S1207: The electronic device updates at least one card corresponding to the first control instruction that has been displayed based on the second control setting information from the server, and displays the updated card; wherein, the updated card includes a card corresponding to each of the at least one control setting methods corresponding to the second control instruction, and the card corresponding to each control setting method is used to indicate the control setting method.
[0249] Regarding the method by which electronic devices generate updated cards based on the second control setting information, the method described above for generating cards before the update based on the first control setting information can be referred to, and will not be elaborated here.
[0250] Optional, Figure 5 The method shown is applied to Figure 4a or Figure 4b In the system architecture shown, step S1207 can be performed by... Figure 4a or Figure 4b The card generation module shown is executed.
[0251] Example 15: Based on Example 14 above, after receiving the second control setting information, the electronic device can, according to the second control setting information, set... Figure 13 The interface shown has been updated to Figure 14 The interface shown is shown. The control settings for "Video Rating - Children's Content" in the second control settings information are unchanged from the first control settings information. Figure 14 Card 1 shown is Figure 13 The card shown is the same as card 1. Figure 14The same applies to card 3 shown. The control setting method of "Disable game applications" in the first control setting information is updated to "Disable game applications, but exclude application 14" in the second control setting information. Therefore, Figure 14 Card 2 shown is opposite Figure 13 Card 2 shown has deleted application 14. The second control settings information, compared to the first control settings information, adds a control setting method of "video applications - usage time - 30 minutes". Therefore, Figure 14 The interface shown is relatively Figure 13 The interface shown has added card 4 corresponding to this device control method. The electronic device displays... Figure 13 The interface shown has switched to display. Figure 14 After the interface shown, the electronic device can follow... Figure 14 The control settings for each card shown allow for the configuration of relevant settings and the management of the controlled device.
[0252] Electronic devices respond to user actions, Figure 14 The method for modifying or deleting the cards shown is similar to the method described in Example 5 or Example 6 above, and will not be described in detail here.
[0253] The following is a detailed description of the specific implementation process of the server determining the second control setting information based on the second control instruction, second setting item information, second device usage information, and first user intent sent by the electronic device, as well as the preset auxiliary information, as described in step S1205 above.
[0254] In some embodiments of this application, the server may first determine the second control instruction and the second user intent corresponding to the first control instruction based on the second control instruction, the first user intent and the preset auxiliary information, and then determine the second control setting information based on the second user intent, the second setting item information and the second device usage information.
[0255] The process by which the server determines the second user intent corresponding to the second control instruction based on the second control instruction, the first user intent, and preset auxiliary information may include the following steps C1 to C4:
[0256] C1: The server performs semantic segmentation on the second control instruction, dividing the second control instruction into at least one instruction message.
[0257] In this context, each instruction in at least one instruction can be a sentence in the text corresponding to the second control instruction.
[0258] C2: The server retrieves at least one piece of auxiliary information from a database used to store auxiliary information based on at least one instruction; wherein, the at least one piece of auxiliary information includes auxiliary information corresponding to each instruction in the at least one instruction, and the auxiliary information corresponding to each instruction is the auxiliary information in the database with the highest similarity to the instruction; each piece of auxiliary information in the database includes a preset user intent and a preset control setting method corresponding to the user intent, and different pieces of auxiliary information in the database contain different user intents.
[0259] C3: The server generates a fifth prompt message based on the second control instruction, at least one instruction message, and at least one auxiliary message; wherein the fifth prompt message includes a prompt message for indicating the user intent corresponding to the second control instruction and a prompt message corresponding to each of the at least one instruction message, and the prompt message corresponding to each instruction message is used to indicate that the user intent corresponding to the instruction message is the user intent contained in the auxiliary message corresponding to the instruction message.
[0260] C4: The server uses the first set model to determine the third user intent corresponding to the second control instruction based on the second prompt information.
[0261] The implementation methods of steps C1 to C4 are similar to those of steps A1 to A4 mentioned above, and will not be described in detail here.
[0262] Example 16: Based on Example 15 above, such as Figure 15 As shown, when the text corresponding to the second control instruction is "Let him watch cartoons for half an hour, but he can play app 14", the server can obtain at least one instruction information by semantically segmenting the text corresponding to the second control instruction, which may include "Let him watch cartoons for half an hour" and "He can play app 14". In one example, as... Figure 15 As shown, the third user intent corresponding to the second control instruction determined by the server based on the above method may include: "Restrict video viewing time [30min]" and "Open application usage permission [application 14]".
[0263] C5: The server determines the second control instruction and the second user intent corresponding to the first control instruction based on the third user intent corresponding to the second control instruction and the first user intent corresponding to the first control instruction.
[0264] Optionally, the second user intent can be a combination of the third user intent and the first user intent.
[0265] Example 17: Based on Example 16 above, such as Figure 15As shown, the second user intent may include: "Restrict video rating to children's content", "Restrict game app usage permissions", "Restrict video viewing time [30 min]", and "Enable app usage permissions [app 14]".
[0266] The process by which the server determines the second control setting information based on the second user intent, the second setting item information, and the second device usage information may include the following steps D1 to D2:
[0267] D1: The server generates a sixth prompt message based on the second user intent, the second setting information, and the second device usage information; the sixth prompt message is used to indicate: plan a control setting scheme based on the second user intent and with reference to the second setting information and the second device usage information.
[0268] D2: The server uses the second setting model to determine the second control setting information corresponding to the second control instruction and the first control instruction based on the sixth prompt information.
[0269] The implementation methods of steps D1 to D2 are similar to those of steps B1 to B2 mentioned above, and will not be described in detail here.
[0270] Example 18, based on Example 17 above, such as Figure 15 As shown, the sixth prompt may include: Please plan your control measures based on your intentions regarding [restricting video content to children's rating, restricting game app permissions, limiting video viewing time [30 minutes], and granting app access permissions [App 14]], while also considering a study plan for homework from 18:30 to 19:30. Reference settings include: app access permissions, app usage duration, app usage time, app installation license level, video rating, eye protection mode, single use duration in eye protection mode, and single rest duration in eye protection mode. The server is based on... Figure 15 The sixth prompt shown can provide the second control settings information described in Example 14 above.
[0271] In some embodiments of this application, the method by which the server further checks the second control instruction information after determining the second control setting information can be implemented with reference to the method described above for the server to further check the first control setting information, and will not be described in detail here.
[0272] It should be noted that the processes provided in the above embodiments are merely illustrative examples of the applicable method processes in the embodiments of this application. The execution order of each step can be adjusted according to actual needs, and other steps can be added, some steps can be reduced, or some steps can be modified.
[0273] Based on the above embodiments and the same technical concept, this application also provides a control method, such as... Figure 16 As shown, the method may include:
[0274] S1601: The electronic device receives first information, which is used to characterize a first control requirement, and the first control requirement is used to control the applications in the electronic device.
[0275] Optionally, regarding the electronic device, refer to the electronic device described in Embodiments 1 to 3 above, which will not be detailed here. Regarding the first information, refer to the first control instruction in the foregoing embodiments, which will not be detailed here.
[0276] S1602: The electronic device responds to the first information and displays a first interface; wherein the first interface includes first content, the first content being used to indicate a first configuration for controlling applications in the electronic device.
[0277] Optionally, the first interface can be a first card. The first configuration may include: disabling at least one application on the electronic device.
[0278] In one example, the first interface can be card 2 as described in Example 4 above, the first content includes the content shown in card 2, and the at least one application indicated by the first configuration can include application 12 to application 16 shown in card 2. The method for displaying the first interface on the electronic device can also refer to the method for displaying card 2 on the electronic device described in Embodiment 2 above, and will not be detailed here.
[0279] In some embodiments of this application, after step S1601 and before step S1602, the following steps E1 to E4 may also be included:
[0280] E1: The electronic device sends first information, first setting information, and first device usage information to the server; wherein, the first setting information is used to indicate multiple settings of the electronic device and the characteristic information of each setting among the multiple settings; the first device usage information includes information about the applications in the electronic device.
[0281] For example, the relevant descriptions of the server in Embodiments 1 to 3 above can be referred to, and will not be described in detail here.
[0282] Optionally, the information regarding the first setting item can be referred to the information regarding the first setting item described in the foregoing embodiments (e.g., Embodiment 2), and the information regarding the first device usage can be referred to the information regarding the first device usage shown in the foregoing embodiments (e.g., Embodiment 2), which will not be described in detail here.
[0283] E2: The server generates first control information based on the first information, the first setting information, and the first device usage information; wherein, the first control information includes application control information corresponding to the application control type, the application control information is used to indicate the first configuration, and the first configuration is used to control the applications in the electronic device.
[0284] In some embodiments of this application, as an optional implementation, the server may utilize a first setting model to determine a first user intent based on first information; and may utilize a second setting model to generate first control information based on the first user intent, first setting item information, and first device usage information. The first and second setting models may be derived based on an LLM (Local Management Model).
[0285] In the above process, when determining the first user intent, the server can first select the first intent information with the highest similarity to the first information from a set of multiple intent information; wherein, each intent information in the multiple intent information includes a user intent, a setting item corresponding to the user intent, and a target setting for the setting item; different intent information in the multiple intent information includes different user intents. Then, based on the first information and the first intent information, a first prompt information is generated; wherein, the first prompt information is used to indicate the user intent corresponding to the first information by referring to the first intent information; using the first setting model, the first user intent corresponding to the first information is determined based on the first prompt information.
[0286] Specifically, the multiple intent information can refer to the information in the database described in the methods corresponding to steps A1 to A4 above; the first intent information can refer to at least one auxiliary information described in the methods corresponding to steps A1 to A4 above; and the first prompt information can refer to the first prompt information described in the methods corresponding to steps A1 to A4 above. These details will not be elaborated here. The method by which the server determines the first user intent based on the first information can be implemented using the methods corresponding to steps A1 to A4 above. These details will not be elaborated here.
[0287] In one example, the first information is Figure 11 When the first control instruction is given as shown, the first intent information may include... Figure 11 The search results shown in the first illustration can be: Figure 11 The first prompt message shown can indicate that the first user intent is... Figure 11 The first user intent shown.
[0288] In the above process, when generating the first control information, the server can first generate a second prompt message based on the first user intent, the first setting item information, and the first device usage information. The second prompt message indicates that, referring to the first setting item information and the first device usage information, the setting item corresponding to the first user intent and the configuration for that setting item should be determined. Then, using the second setting model, the first control information is generated based on the second prompt message. The specific implementation method of this process can refer to the methods corresponding to steps B1 to B2 above, and will not be detailed here.
[0289] In one example, the first user intent is Figure 11 When the first user intent is shown, the second prompt information can be... Figure 11 The second prompt information shown can be the first control information. Figure 11 The first control settings information shown.
[0290] Optionally, the specific implementation process of step E2 can be implemented with reference to the method related to step S504 provided in the foregoing embodiments, and will not be repeated here.
[0291] E3: The server sends the first control information to the electronic device.
[0292] E4: The electronic device generates the first interface based on the application control information included in the first control information.
[0293] Optionally, the specific implementation process of step E4 can be implemented with reference to the method related to step S506 provided in the foregoing embodiments, and will not be repeated here.
[0294] S1603: The electronic device controls the application in the electronic device based on the first configuration.
[0295] For example, when the first configuration includes disabling the use of at least one application in the electronic device, the electronic device may not respond to the user's operation when the user opens the application (or may display a prompt message indicating that the application is disabled, etc.), that is, it may prevent the user from using the at least one electronic device, thereby achieving the effect of controlling the application in the electronic device based on the first configuration.
[0296] In one possible implementation, after displaying the first interface, the electronic device may, in response to a received first operation, update the first content in the first interface to third content; wherein the third content is used to indicate a third configuration for controlling applications in the electronic device; control the applications in the electronic device based on the third configuration; or, in response to a received second operation, stop displaying the first interface and stop controlling the applications in the electronic device based on the first configuration.
[0297] Optionally, when the first configuration includes disabling at least one application in the electronic device, the first operation may be used to indicate: allowing the use of one or more applications among the at least one application, and / or disabling the use of one or more applications among at least one candidate application; wherein the at least one candidate application includes applications in the electronic device other than the at least one application.
[0298] In another possible solution, the first control requirement described in step S1601 above can also be used for first control. The first control can include any one of time control, content control, and remote control, or the first control can include a combination of multiple of application control, time control, content control, and remote control. Based on this, in step E2 above, the first control information generated by the server can also include control information corresponding to the type of the first control. The control information corresponding to the type of the first control is used to indicate the second configuration used for the first control. In this scenario, after receiving the first control information from the server, in addition to generating and displaying the first interface, the electronic device can also generate and display a second interface based on the control information corresponding to the type of the first control contained in the first control information. The second interface includes second content, which is used to indicate the second configuration used for the first control. The second configuration is different from the first configuration. Optionally, the electronic device can also perform the first control based on the second configuration.
[0299] Optionally, the second interface can be a second card.
[0300] In one example, the second configuration may include restricting the video rating to children's content, the second interface may be card 1 as described in Example 4 above, and the second content may include the content shown in card 1. The method for displaying the second interface on the electronic device can also refer to the method for displaying card 2 on the electronic device described in Embodiment 2 above, and will not be detailed here.
[0301] In another possible solution, after displaying the first interface, the electronic device can continue to receive second information and update the interface based on the second information, referring to the method described in Embodiment 3 above. The second information can characterize a second control requirement, which can be used for at least one of application control, time control, content control, and remote control. In response to the second information, the electronic device can update the first content in the already displayed first card to a fourth content, and / or add a third interface. The fourth content indicates a fourth configuration for controlling applications in the electronic device; the third interface includes fifth content, which indicates a fifth configuration for performing the second control. The second control includes any one of time control, content control, and remote control, or a combination of multiple of application control, time control, content control, and remote control.
[0302] Optionally, the second information can be referred to the second control instruction described in the aforementioned embodiment three, which will not be detailed here.
[0303] In one example, the first card displayed by the electronic device in step S1602 is card 2 as described in example 4 (i.e. Figure 7 Taking the scenario of card 2 shown as an example, after the electronic device updates the first content in the first card to the fourth content, the first card can be... Figure 14 Card 2 is shown in the image.
[0304] Optionally, the third interface can be a third card.
[0305] In one example, the fourth configuration could include limiting video viewing time to 30 minutes, and the third interface could be... Figure 14 Card 4 is shown in the figure. The method for displaying a third interface on an electronic device can also refer to the method for displaying card 4 on an electronic device described in Embodiment 3 above, and will not be detailed here.
[0306] Optionally, in the above method, after the electronic device receives the second information, and before the electronic device updates the first content in the already displayed first card to the fourth content in response to the second information, and / or adds the display of the third interface, the following steps F1 to F4 may also be included:
[0307] F1: The electronic device sends second information, second setting information, and second device usage information to the server; wherein, the second setting information is used to indicate multiple settings of the electronic device and characteristic information of each of the multiple settings; the second device usage information includes information about the applications in the electronic device.
[0308] Optionally, step F1 can be implemented by referring to the aforementioned step E1, which will not be described in detail here.
[0309] F2: The server generates second control information based on the second information, the second setting information, the second device usage information, and the first user intent. The second control information includes control information corresponding to the application control type and control information corresponding to the second control. The control information corresponding to the application control type is used to indicate the third configuration for updating the first configuration. The third configuration is used to control the applications in the electronic device. The second control includes any one of time control, content control, and remote control, or the second control includes a combination of multiple of application control, time control, content control, and remote control. The control information corresponding to the type of the second control is used to indicate the fourth configuration for performing the second control.
[0310] Optionally, step F2 can be implemented by referring to the aforementioned step E2, which will not be described in detail here.
[0311] In one example, when the second information is Figure 15 When the second control instruction is shown, the first user intent can be Figure 15 The first user intent shown, and the second control information can be... Figure 15 The second control settings information is shown.
[0312] F3: The server sends the second control information to the electronic device.
[0313] F4: The electronic device determines the fourth content for updating the first content based on the control information corresponding to the application control type included in the second control information; and / or generates a third interface based on the control information corresponding to the type of the second control included in the second control information.
[0314] Optionally, step F4 can be implemented by referring to the aforementioned step E4, which will not be described in detail here.
[0315] The specific steps performed by the electronic device or server in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.
[0316] It should be noted that the application scenarios provided in the above embodiments are merely illustrative examples of the applicable scenarios of the embodiments of this application, and do not limit the applicable scenarios of the solutions of this application. Some methods or the same technical concepts provided in any of the above embodiments can also be applied in other embodiments or other scenarios, or can be combined with the methods provided in other embodiments. Specifically, they can be applied in combination with specific embodiments or specific scenarios, and will not be listed and described one by one in this application.
[0317] Based on the above embodiments and the same technical concept, this application also provides an electronic device for implementing the control method provided in this application. Figure 17 As shown, electronic device 1700 may include: memory 1701, one or more processors 1702, and one or more computer programs (not shown). These devices may be coupled via one or more communication buses 1703. Optionally, electronic device 1700 may also include a display screen 1704.
[0318] The memory 1701 stores one or more computer programs (code), and the one or more computer programs include computer instructions; one or more processors 1702 call the computer instructions stored in the memory 1701, causing the electronic device 1700 to execute the control method provided in the above-described embodiments of this application.
[0319] In a specific implementation, memory 1701 may include high-speed random access memory, and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1701 may store an operating system (hereinafter referred to as the system), such as embedded operating systems like Android, iOS, Windows, or Linux. Memory 1701 can be used to store implementation programs of the embodiments of this application. Memory 1701 may also store network communication programs, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices.
[0320] One or more processors 1702 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs according to the present application.
[0321] Display screen 1704 is used to display application interfaces and other related user interfaces.
[0322] It should be noted that, Figure 17 This is merely one implementation of the electronic device 1700 provided in this application embodiment. In practical applications, the electronic device 1700 may include more or fewer components, as detailed in the following references. Figure 2 The specific structure and description shown are not limited here.
[0323] Based on the above embodiments and the same technical concept, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method provided in the above embodiments.
[0324] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments.
[0325] The methods provided in this application can be implemented, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented, in whole or in part, in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. A computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that integrates one or more available media. Available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs), or semiconductor media (e.g., SSDs), etc.
[0326] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A control method applied to electronic devices, characterized in that, include: Receive first information, the first information being used to characterize a first control requirement, the first control requirement being used to control the applications in the electronic device; In response to the first information, a first interface is displayed; wherein the first interface includes first content, the first content being used to indicate a first configuration for controlling applications in the electronic device; The applications in the electronic device are controlled based on the first configuration.
2. The method as described in claim 1, characterized in that, The first control requirement is also used to perform first control; the first control includes any one of time control, content control, and remote control, or the first control includes a combination of multiple of application control, time control, content control, and remote control; the method further includes: In response to the first information, a second interface is displayed; wherein the second interface includes second content, the second content being used to indicate a second configuration for performing the first control, the second configuration being different from the first configuration; The first control is performed based on the second configuration.
3. The method as described in claim 1 or 2, characterized in that, The method further includes: In response to the received first operation, the first content is updated to third content; wherein the third content indicates a third configuration for managing applications in the electronic device; and applications in the electronic device are controlled based on the third configuration; or In response to the received second operation, the first interface is stopped being displayed, and the control of applications in the electronic device based on the first configuration is stopped.
4. The method as described in claim 3, characterized in that, The first configuration includes: disabling the use of at least one application in the electronic device; The first operation is used to indicate: allowing the use of one or more applications in the at least one application, and / or prohibiting the use of one or more applications in at least one candidate application; wherein the at least one candidate application includes applications in the electronic device other than the at least one application.
5. The method according to any one of claims 1 to 4, characterized in that, After displaying the first interface in response to the first information, the method further includes: Receive second information, the second information being used to characterize a second control requirement, the second control requirement being used to perform at least one of application control, time control, content control, and remote control; In response to the second information, the first content is updated to a fourth content, and / or a third interface is displayed; wherein the fourth content is used to indicate a fourth configuration for controlling applications in the electronic device; the third interface includes a fifth content, which is used to indicate a fifth configuration for performing a second control, the second control including any one of time control, content control, and remote control, or the second control including a combination of multiple of application control, time control, content control, and remote control.
6. The method according to any one of claims 1 to 5, characterized in that, Before displaying the first interface in response to the first information, the method further includes: The system sends the first information, the first setting information, and the first device usage information to the server; wherein, the first setting information is used to indicate multiple settings of the electronic device and feature information of each of the multiple settings; the first device usage information includes information about the applications in the electronic device; Receive first management information from the server; wherein, the first management information includes application management information corresponding to the application management type, and the application management information is used to indicate the first configuration; The first interface is generated based on the application management information.
7. The method as described in claim 5, characterized in that, Before updating the first content to the fourth content in response to the second information, and / or displaying the third interface, the method further includes: The system sends the second information, the second setting information, and the second device usage information to the server; wherein the second setting information is used to indicate multiple settings of the electronic device and feature information of each of the multiple settings; the second device usage information includes information about the applications in the electronic device. Receive second control information from the server; wherein, the second control information includes control information corresponding to the application control type and / or control information corresponding to the type of the second control, the control information corresponding to the application control type is used to indicate the fourth configuration, and the control information corresponding to the type of the second control is used to indicate the fifth configuration; Based on the control information corresponding to the application control type, determine the fourth content used to update the first content; and / or, based on the control information corresponding to the second control type, generate the third interface.
8. A control method applied to a server, characterized in that, include: The system receives first information, first setting information, and first device usage information from an electronic device; wherein the first information is used to characterize a first control requirement, which is used to control applications in the electronic device; the first setting information is used to indicate multiple settings of the electronic device and characteristic information of each setting; and the first device usage information includes information about applications in the electronic device. Based on the first information, the first setting information, and the first device usage information, first control information is generated; wherein, the first control information includes application control information corresponding to the application control type, the application control information is used to indicate a first configuration, and the first configuration is used to control the applications in the electronic device; The first control information is sent to the electronic device.
9. The method as described in claim 8, characterized in that, The first control requirement is also used to perform the first control; the first control includes any one of time control, content control, and remote control, or the first control includes a combination of multiple of application control, time control, content control, and remote control; The first control information also includes control information corresponding to the type of the first control. The control information corresponding to the type of the first control is used to indicate a second configuration for performing the first control, and the second configuration is different from the first configuration.
10. The method as described in claim 8 or 9, characterized in that, The step of generating first control information based on the first information, the first setting information, and the first device usage information includes: Using the first established model, determine the first user intent based on the first information; Using the second setting model, the first control information is generated based on the first user intent, the first setting item information, and the first device usage information.
11. The method as described in claim 10, characterized in that, The step of determining the first user intent based on the first information using the first set model includes: Select the first intent information that has the highest similarity to the first information from the set multiple intent information; wherein, each intent information in the multiple intent information includes a user intent, a setting item corresponding to the user intent, and a target setting for the setting item; different intent information in the multiple intent information includes different user intents; Based on the first information and the first intent information, a first prompt information is generated; wherein, the first prompt information is used to indicate the user intent corresponding to the first information by referring to the first intent information; Using the first set model, the first user intent corresponding to the first information is determined based on the first prompt information.
12. The method as described in claim 10 or 11, characterized in that, The step of generating the first control information using the second setting model based on the first user intent, the first setting item information, and the first device usage information includes: A second prompt message is generated based on the first user intent, the first setting item information, and the first device usage information; wherein, the second prompt message is used to indicate: by referring to the first setting item information and the first device usage information, the setting item corresponding to the first user intent and the configuration of the setting item corresponding to the first user intent are determined; Using the second setting model, the first control information is generated based on the second prompt information.
13. The method according to any one of claims 10 to 12, characterized in that, After sending the first control information to the electronic device, the method further includes: The system receives second information, second setting information, and second device usage information from the electronic device; wherein the second information is used to characterize a second control requirement, which is used to perform at least one of application control, time control, content control, and remote control; the second setting information is used to indicate multiple settings of the electronic device and characteristic information of each setting; and the second device usage information includes information about applications in the electronic device. Based on the second information, the second setting information, the second device usage information, and the first user intent, second control information is generated. The second control information includes control information corresponding to the application control type and control information corresponding to the second control. The control information corresponding to the application control type is used to indicate a third configuration for updating the first configuration, and the third configuration is used to control applications in the electronic device. The second control includes any one of time control, content control, and remote control, or the second control includes a combination of multiple of application control, time control, content control, and remote control. The control information corresponding to the type of the second control is used to indicate a fourth configuration for performing the second control. The second control information is sent to the electronic device.
14. The method as described in claim 13, characterized in that, The step of determining the second control information based on the second information, the second setting information, the second device usage information, and the first user intent includes: Using the first established model, the second user intent is determined based on the second information; Based on the first user intent and the second user intent, a third user intent is determined; The second control information is generated using the second setting model based on the third user intent, the second setting information, and the second device usage information.
15. An electronic device, characterized in that, The electronic device includes a memory and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device performs the method as described in any one of claims 1 to 7, or performs the method as described in any one of claims 8 to 14.
16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 7, or the method as described in any one of claims 8 to 14.
17. A computer program product, characterized in that, The computer program product includes a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 7, or to perform the method as described in any one of claims 8 to 14.