Method, apparatus and electronic device for data processing

Abstract

The application provides a data processing method, device and electronic equipment. The method comprises the following steps: displaying a first interface, wherein the first interface comprises a first control, and the first control is used for authorizing the electronic equipment to memorize user data of a first application; detecting that a user authorizes the electronic equipment to memorize the user data of the first application through the first control; obtaining first structured data by memorizing the first user data of the first application; and obtaining a first memory item according to the first structured data in response to a first instruction of the user, wherein the first instruction is used for indicating that the user confirms that the first structured data is accurate. The data processing method, device and electronic equipment provided by the application can efficiently generate memory under the premise that the user is not aware, and improve the use experience of the user. In addition, the user can further confirm whether the structured data generated by the electronic equipment is accurate, so as to ensure the accuracy of the memory.

Description

[0001] This application is a divisional application. The parent application has application number 202411096268.X and an application date of August 9, 2024. The parent application claims priority to the earlier application 202410808057.8, with a priority date of June 20, 2024. The entire contents of the parent application and the earlier application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic devices, and more specifically, particularly to a method, apparatus, and electronic device for data processing. Background Technology

[0003] With the development of science and technology, electronic devices offer increasingly more functions and contain richer data and information. To improve the user experience, electronic devices can memorize key information such as identity information, address information, schedules, orders, and events. When users need this key information, they can directly access the memorized information for convenient use.

[0004] Current electronic devices can support the generation of memories based on user instructions, but the process of generating such memories is rather cumbersome and affects the user experience.

[0005] Therefore, how to efficiently generate memories without the user's awareness and improve the user experience is an urgent problem to be solved. Summary of the Invention

[0006] This application provides a data processing method, apparatus, and electronic device. The method efficiently generates memories without the user's awareness, improving the user experience.

[0007] In a first aspect, a data processing method is provided, the method comprising: displaying a first interface, the first interface including a first control for authorizing an electronic device to memorize user data of a first application; detecting that a user authorizes the electronic device to memorize user data of the first application through the first control; obtaining first structured data by memorizing the first user data of the first application; and, in response to a first instruction from a user, obtaining a first memory entry based on the first structured data, the first instruction being used to instruct the user to confirm that the first structured data is accurate.

[0008] For example, the first interface could be a source management interface, which includes authorization controls for multiple applications, such as authorization controls for a gallery application, a messaging application, a transportation application, a social networking application, and a memo application. When a user opens the authorization control for an application, it means that the electronic device can automatically obtain the user data of that application and automatically generate a memory based on that user data.

[0009] For example, in response to a user opening the authorization control of a gallery application, an electronic device can automatically obtain data such as videos and images stored in the gallery application, and memorize the video and image data to obtain structured data.

[0010] It is understood that users may open the application's authorization control in ways including but not limited to manual clicking, voice control, etc., and this application embodiment does not limit this.

[0011] It should be noted that, after obtaining user authorization, the process by which the electronic device acquires user data from the first application is imperceptible to the user. The electronic device memorizes the acquired user data from the first application; this can be understood as the electronic device performing data transformation on the user data from the first application.

[0012] Based on the above scheme, after obtaining user authorization, the electronic device can acquire user data from the application and process this data to obtain structured data. The entire process is seamless for the user, improving both the efficiency of data generation and the user experience. Furthermore, the user can further verify the accuracy of the structured data generated by the electronic device to ensure its accuracy.

[0013] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: obtaining second structured data by memorizing second user data of the first application; displaying a second interface in response to a second instruction from the user, the second interface being an editing interface for the second structured data; modifying the second structured data into third structured data in response to the user's operation on the second interface; and obtaining a second memory entry based on the third structured data.

[0014] Based on the above solution, if users believe that the structured data is inaccurate, or do not want their electronic devices to store certain private data, they can be reminded to edit the structured data before storing it on their electronic devices.

[0015] In conjunction with the first aspect, in some implementations of the first aspect, a third interface is displayed under a preset scenario. The third interface includes a first prompt message, which is used to prompt the user to confirm the first structured data. The preset scenario is related to the usage status of the electronic device and / or the status of the structured data.

[0016] It should be noted that the usage state of an electronic device can be understood as the state of the electronic device itself (e.g., whether the electronic device is unlocked or locked), or the state of interaction between the user and the electronic device (e.g., whether the user responds to prompts issued by the electronic device). The state of structured data can be understood as the usage state of the structured data (e.g., scenarios where memory is used, where the electronic device accesses memory entries), or the amount of structured data to be verified.

[0017] Based on the above solution, in order to avoid frequently prompting users to edit or confirm structured data, electronic devices can also preset certain trigger scenarios. Under the trigger scenarios, the electronic devices can remind users to edit or confirm structured data.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, when the preset scenario is related to the usage state of the electronic device, the preset scenario includes at least one of the following: when the electronic device is unlocked for the first time each day, or after a first period of time when the electronic device does not detect the user's feedback operation on the first prompt information; when the preset scenario is related to the state of the structured data, the preset scenario includes at least one of the following: when the electronic device calls the memory entry, or when the number of structured data to be confirmed reaches a preset threshold.

[0019] For example, Scenario 1: When unlocking the electronic device for the first time each day. For instance, after 6 AM each day, when the electronic device is unlocked for the first time, the user is prompted to edit or confirm. Scenario 2: After the electronic device has not detected any user feedback on the initial prompt for a certain period of time. For instance, if the user does not open the confirmation interface for three consecutive days, the electronic device will default to not prompting again for seven days, and will remind the user to confirm again after seven days. Scenario 3: When the electronic device accesses a memory entry. For instance, when the user accesses a memory entry (or memory information) by waking up a voice assistant or opening the memory homepage (e.g., the memory application interface or prompt box), the electronic device prompts the user to edit or confirm. Scenario 4: When the number of structured data items to be confirmed reaches a preset threshold. For instance, when the cumulative number of structured memory data items to be confirmed reaches 20, the electronic device prompts the user to edit or confirm.

[0020] It should be noted that the specific methods by which electronic devices prompt users to edit or confirm structured data may include voice prompts, pop-up prompts, prompt boxes, or push notifications, etc. The embodiments of this application do not limit the specific methods of prompting.

[0021] In conjunction with the first aspect, in some implementations of the first aspect, the memorization of the first user data is performed during the charging process of the electronic device and / or when the electronic device is connected to a wireless network (WiFi).

[0022] Based on the above solutions, the process of electronic devices memorizing user data requires significant power consumption. Therefore, user data processing can be performed while the electronic device is charging, or while charging and the screen is off. Furthermore, sometimes it is necessary to memorize user data through a server; therefore, user data can be memorized when the electronic device is connected to WiFi.

[0023] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: displaying a fourth interface in response to a third instruction from the user, the fourth interface including a second prompt message for prompting the user to authorize the electronic device to memorize user data of a second application, the third instruction being used to invoke a third memory entry associated with the second application.

[0024] For example, if the user has not enabled the authorization switch of the second application beforehand, the third instruction can be an instruction for the user to request the retrieval of memory entries in the context of using memory, or it can be understood as an instruction for the user to request the retrieval of at least some fields in the structured data in the context of using memory.

[0025] In conjunction with the first aspect, in some implementations of the first aspect, the first memory entry includes indication information for indicating that the memory information originates from the first application.

[0026] It should be noted that in scenarios where users use memory, tags can be used to distinguish the source of memory information.

[0027] In conjunction with the first aspect, in some implementations of the first aspect, the memory entry is displayed in any of the following ways: card, control, label, option, bullet screen, pop-up window, dialog box, or floating window.

[0028] In conjunction with the first aspect, in some implementations of the first aspect, the first structured data includes M fields. Obtaining the first structured data by memorizing the first user data of the first application includes: obtaining N fields from the M fields by memorizing the first user data of the first application, where M is greater than N and N is a positive integer greater than or equal to 1; the method further includes: obtaining third user data of the first application, which is associated with the first user data; obtaining L fields by memorizing the third user data of the first application, where the L fields include at least a portion of the fields other than the N fields from the M fields, and L is a positive integer greater than or equal to 1.

[0029] It should be noted that when memorizing the first user data and the third user data, the memory identifiers of the structured data obtained are the same, but the field contents may be different.

[0030] For example, by memorizing the first user data, the structured data obtained is user A's ID number; by memorizing the third user data, the structured data obtained is user A's ID card validity period. The memorized identifiers of user A's ID number and user A's ID card validity period are the same, but the fields are different (one is the ID number, and the other is the ID card validity period).

[0031] For example, an electronic device first generates memory A based on a photo of the back of user A's ID card. Memory A includes information such as user A's name, date of birth, and ID number. When the electronic device subsequently obtains a photo of the front of user A's ID card, it can update memory A to include the validity period of user A's ID document.

[0032] For example, a driver's license consists of two images. The electronic device retrieves the first image of the driver's license through a photo library application, obtaining fields containing information such as name, address, and date of birth. The electronic device then retrieves the second image of the driver's license through the same photo library application, obtaining fields containing information about the probationary period.

[0033] Based on the above scheme, for partially identical structured data with the same memory identifier but different fields, the existing memory can be refreshed to obtain new structured data. The new structured data includes the fields (N fields) in the original memory and the fields (L fields) in the current memory.

[0034] In conjunction with the first aspect, in some implementations of the first aspect, the user data of the first application belongs to any one of the following: structured data, image and audio data, and unstructured data.

[0035] It should be noted that user data may be of different types in different applications.

[0036] For example, user data for a photo gallery application can be image and video data, user data for a transportation application can be structured data, and data for a text messaging application can be unstructured data.

[0037] In conjunction with the first aspect, in some implementations of the first aspect, the method includes: acquiring user data of the first application through an active or passive means, the active means including sandbox data subscription and system capability data subscription, and the passive means including intent framework donation.

[0038] For example, when the user data of the first application is structured data, it can be obtained through intent framework donation; when the user data of the first application is audio-visual image data, it can be obtained through sandbox data subscription; when the user data of the first application is unstructured data, it can be obtained through system capability data subscription.

[0039] In a second aspect, a data processing apparatus is provided, comprising: a display unit for displaying a first interface, the first interface including a first control, the first control being used to authorize the apparatus to memorize user data of a first application; further configured to detect that a user authorizes the apparatus to memorize user data of the first application through the first control; a processing unit for obtaining first structured data by memorizing the first user data of the first application; further configured to, in response to a first instruction from a user, obtain a first memory entry based on the first structured data, the first instruction being used to instruct the user to confirm that the first structured data is accurate.

[0040] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is further configured to obtain second structured data by memorizing second user data of the first application; the display unit is further configured to display a second interface in response to a second instruction from the user, the second interface being an editing interface for the second structured data; the processing unit is further configured to modify the second structured data into third structured data in response to the user's operation on the second interface; and is further configured to obtain a second memory entry based on the third structured data.

[0041] In conjunction with the second aspect, in some implementations of the second aspect, the display unit is also used to display a third interface in a preset scenario. The third interface includes a first prompt message, which prompts the user to confirm the first structured data. The preset scenario is related to the usage status of the device and / or the status of the structured data.

[0042] In conjunction with the second aspect, in some implementations of the second aspect, when the preset scenario is related to the usage state of the device, the preset scenario includes at least one of the following: when the device is unlocked for the first time each day, or after a first period of time when the device does not detect the user's feedback operation on the first prompt information; when the preset scenario is related to the state of the structured data, the preset scenario includes at least one of the following: when the device calls the memory entry, or when the number of structured data to be confirmed reaches a preset threshold.

[0043] In conjunction with the second aspect, in some implementations of the second aspect, the memorization of the first user data is performed during the charging process of the device and / or when the device is connected to a wireless network (WiFi).

[0044] In conjunction with the second aspect, in some implementations of the second aspect, the display unit is further configured to display a fourth interface in response to a third instruction from the user. The fourth interface includes a second prompt message that prompts the user to authorize the device to memorize user data of the second application. The third instruction is configured to invoke a third memory entry that is associated with the second application.

[0045] In conjunction with the second aspect, in some implementations of the second aspect, the first memory entry includes indication information for indicating that the memory information originates from the first application.

[0046] In conjunction with the second aspect, in some implementations of the second aspect, the memory entry is displayed in any of the following ways: card, control, label, option, bullet screen, pop-up window, dialog box, or floating window.

[0047] In conjunction with the second aspect, in some implementations of the second aspect, the first structured data includes M fields. The processing unit is specifically configured to obtain N fields from the M fields by memorizing the first user data of the first application, where M is greater than N and N is a positive integer greater than or equal to 1. The processing unit is also configured to obtain third user data of the first application, which is associated with the first user data. It is also configured to obtain L fields by memorizing the third user data of the first application, where L fields include at least a portion of the fields other than the N fields from the M fields, and L is a positive integer greater than or equal to 1.

[0048] In conjunction with the second aspect, in some implementations of the second aspect, the user data of the first application belongs to any of the following: structured data, image and audio data, and unstructured data.

[0049] In conjunction with the second aspect, in some implementations of the second aspect, the processing unit is specifically used to acquire user data of the first application through an active or passive means. The active means include sandbox data subscription and system capability data subscription, and the passive means include intent framework donation.

[0050] Thirdly, an electronic device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the electronic device to perform the methods described in the first aspect and any possible implementation thereof.

[0051] Fourthly, a data processing apparatus is provided, comprising: a processor coupled to a memory for storing a computer program, the processor for running the computer program such that the data processing apparatus performs the methods described in the first aspect and any possible implementation thereof.

[0052] In conjunction with the fourth aspect, some implementations of the fourth aspect also include one or more of the memory and the transceiver, the transceiver being used to receive and / or transmit signals.

[0053] Fifthly, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a computer, causes the computer to implement the methods described in the first aspect and any possible implementation thereof.

[0054] In a sixth aspect, a computer program product containing instructions is provided, which, when run on a computer, causes the computer to perform the methods described in the first aspect and any possible implementation thereof.

[0055] In a seventh aspect, a chip is provided, the chip including a processor and a data interface, the processor reading instructions stored in a memory through the data interface to execute the methods described in the first aspect and any possible implementation thereof.

[0056] In conjunction with the seventh aspect, in one possible implementation, the processor is coupled to the memory via an interface.

[0057] In conjunction with the seventh aspect, in one possible implementation, the chip system further includes a memory in which computer programs or computer instructions are stored. Attached Figure Description

[0058] Figure 1 This is a schematic diagram of the structure of an electronic device.

[0059] Figure 2This is a software structure block diagram of the electronic device provided in the embodiments of this application.

[0060] Figure 3 This is a schematic diagram of a data processing method provided in an embodiment of this application.

[0061] Figure 4 This is an exemplary flowchart of a data processing method provided in an embodiment of this application.

[0062] Figure 5 This is an exemplary flowchart of a data processing method provided in an embodiment of this application.

[0063] Figure 6 This is a set of GUIs provided in the embodiments of this application.

[0064] Figure 7 This is a set of GUIs provided in the embodiments of this application.

[0065] Figure 8 This is an exemplary flowchart of a data processing method provided in an embodiment of this application. Detailed Implementation

[0066] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0067] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.

[0068] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0069] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or music player, such as a mobile phone, tablet computer, wearable electronic device with wireless communication capabilities (such as a smartwatch), etc. Exemplary embodiments of the portable electronic device include, but are not limited to, carrying... Alternatively, it can be a portable electronic device with another operating system. The aforementioned portable electronic device can also be other portable electronic devices, such as laptops. It should also be understood that in some other embodiments, the aforementioned electronic device may not be a portable electronic device, but rather a desktop computer. In some other embodiments, the electronic device can be a measurement instrument, such as an oscilloscope.

[0070] For example, Figure 1A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0071] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0072] The processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), etc.

[0073] The processor 110 may also include a memory for storing instructions and data.

[0074] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0075] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on electronic devices 100.

[0076] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0077] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0078] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc.

[0079] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0080] Camera 193 is used to capture still images or videos. An object passes through the lens to generate an optical image that is projected onto a photosensitive element.

[0081] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0082] Video codecs are used to compress or decompress digital video.

[0083] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.

[0084] Internal memory 121 can be used to store computer executable program code, which includes instructions.

[0085] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0086] The audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal.

[0087] The loudspeaker 170A, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals.

[0088] The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals.

[0089] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0090] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity greater than or equal to a first pressure threshold is applied to the alarm clock application icon, a command to create a new alarm is executed.

[0091] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0092] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194.

[0093] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0094] like Figure 2 As shown, the application layer can include camera, settings, skin modules, user interface (UI), third-party applications, etc. Third-party applications can include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, etc.

[0095] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer may include some predefined functions.

[0096] like Figure 2 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0097] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0098] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views.

[0099] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0100] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0101] The notification manager allows applications to display notifications in the status bar. These notifications can be used to convey informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0102] The Android runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the calls and management of the Android system.

[0103] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0104] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0105] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0106] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0107] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0108] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0109] A 2D graphics engine is a graphics engine for 2D drawing.

[0110] In addition, the system library may also include status monitoring service modules, such as a physical status recognition module for analyzing and recognizing user gestures; and a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0111] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0112] The hardware layer can include various types of sensors, such as Figure 1 The various sensors introduced in the text.

[0113] In summary Figure 1 and Figure 2 In the embodiments of this application, the electronic device described can be a device with a display screen, such as a mobile terminal or a tablet computer, or a device without a display screen, such as network attached storage (NAS).

[0114] With the development of science and technology, electronic devices offer increasingly more functions and contain richer data and information. To further facilitate user experience, electronic devices support the creation and memorization of certain key information. This memorized information can be directly accessed during user interactions, greatly enhancing the user experience.

[0115] For example, electronic devices can store ID card information. When a user buys train tickets through an application, the user can directly access the ID card information using their input method, without having to manually fill in their name, ID number, etc. Another example is electronic devices storing information from a screenshot of a user's movie ticket. The user can then use a voice assistant to access their schedule and be informed of their movie viewing plans.

[0116] Currently, there are several ways for electronic devices to generate memories. One approach involves a third-party application, with user authorization, acquiring information from the electronic device's screen and automatically recognizing screen content, browser browsing history, etc. This application can generate a timeline from the acquired data and display key user actions, helping users recall previously viewed content. However, this method only collects data, performs simple processing, and presents it directly to the user; it cannot process the acquired data to obtain structured data for user convenience, and the amount of data acquired is limited. Another approach involves the electronic device displaying key information. On the interface displaying this key information, memories are generated based on user instructions. This memory generation process is perceptible to the user; each memory entry requires the electronic device to generate according to user instructions, and the electronic device cannot automatically generate memories.

[0117] Therefore, this application provides a data processing method, apparatus, and electronic device. With user authorization, the electronic device can proactively acquire user data and process it to generate memories. This process can be seamless for the user, greatly enhancing the user experience. The data processing method, apparatus, and electronic device provided in this application will now be described in detail with reference to the accompanying drawings.

[0118] like Figure 3 The diagram illustrates a data processing method according to an embodiment of this application. This method mainly includes three steps: data acquisition, data conversion, and data deduplication, and can be applied to electronic devices. The method will be described in detail below using a mobile phone terminal with a screen as an example.

[0119] Step 1: Data Acquisition.

[0120] It should be noted that the data acquisition process can be understood as the process by which electronic devices automatically acquire user data. This user data can be user data from system applications or user data from third-party applications.

[0121] For example, an electronic device may carry system applications (e.g., gallery, SMS, and calling applications) and third-party applications (e.g., transportation applications). The transportation application carries user data such as information about a user's purchased train or plane tickets; the gallery application carries user data such as images of a user's ID card, videos, screenshots of purchased movie tickets, etc.; the SMS application carries user data such as notification SMS text messages; and the calling application carries user data such as voice recordings during calls.

[0122] It should be noted that user data carried by different applications can be obtained in different ways. In this embodiment, the methods for obtaining user data will be described using intent framework donation, sandbox data collection, and system capability data subscription as examples. It is understood that this embodiment does not limit the specific method of data collection.

[0123] It should be noted that data acquisition methods include active acquisition and passive acquisition.

[0124] Active data acquisition includes sandbox data subscription and system capability data subscription. Sandbox data subscription can be used to acquire user data from applications such as calendar, gallery, and memo. When these applications connect, they can declare a data paradigm according to the specifications. When application data changes and is written to disk, the corresponding data is automatically provided to the data acquisition module in a specific format according to the specific data paradigm. System capability data subscription can be used to acquire user data from applications such as SMS and call. System capability data subscription is an open system capability. Taking SMS content as an example, after requesting the corresponding permissions, the relevant system interface can be called, and when a user receives an SMS, the SMS content is automatically provided to the data acquisition module.

[0125] Passive acquisition includes intent kit donation. Intent kit donation is an intent standard system that helps developers intelligently distribute business functions within an application / metaservice to various system entry points. Once an application connects to the intent kit, with user authorization, the data received by the intent kit can be synchronized to the memory. The memory then receives the intent kit data, performs data transformation, and becomes part of the memory itself.

[0126] It should be noted that the acquired data can be divided into three categories: structured data, audio-visual image data, and unstructured data. In this embodiment, the type of data is not limited. Structured data has a fixed format and predefined schema. It is typically stored through a database management system (such as a relational database). Unstructured data does not have a fixed format or schema; it is usually free-form text.

[0127] For example, user data acquired by a transportation application through intent-based donations is structured data, such as a user's flight ticket information, including the traveler's name (xxx), flight number (ZH123), and travel date (ZZZZ year XX month XX day). User data acquired by a gallery application through sandbox data subscriptions is audio-visual and image data, such as images of the user's ID card, order screenshots, ticket screenshots, driver's license images, and vehicle registration certificates. User data acquired by SMS and call applications through system capability data subscriptions is unstructured data, such as notification SMS messages without a fixed format.

[0128] In one implementation, to ensure user privacy, electronic devices need to obtain user authorization before acquiring data. This can be achieved by setting authorization switches for various applications on the electronic device; the device will only acquire user data for a particular application when the user turns on that switch.

[0129] For example, a device can only access audio and video data from a gallery application when the user turns on the authorization switch. If the user does not turn on the authorization switch for a messaging application, the device will not be able to access unstructured data from the messaging application.

[0130] It should be noted that Step 1 can be performed by the data acquisition module in the electronic device. After the data acquisition module completes the data acquisition, it can save the data to a disk for later use. Under certain circumstances (e.g., charging and screen off), the electronic device will further process the acquired data.

[0131] It is understandable that, with the user's authorization, the process of electronic devices acquiring user data can be done without the user's awareness.

[0132] Step 2: Data transformation.

[0133] It should be noted that the data transformation process can be understood as the process by which electronic devices transform structured data, audio-visual image data, and unstructured data to obtain structured memory data to be confirmed.

[0134] For example, the three types of data obtained in Step 1 can be transformed in different ways.

[0135] Structured data can include data obtained through intent-based donations or sandbox data subscriptions. This type of data is generally well-defined, and usually only requires simple data mapping based on the data paradigm (shema) to obtain structured data. If the structured data in the shema paradigm cannot meet the memory requirements, a major model transformation is necessary.

[0136] For audio-visual and image data, if the data is video, keyframes can be extracted first, and these keyframes can be used as an image set. Optical character recognition (OCR) technology is then used to extract text from the images as unstructured data, which is then processed by a large model. Similarly, for image data, OCR technology is used to extract text as unstructured data, which is then processed by a large model. For audio data, automatic speech recognition (ASR) technology is used to obtain unstructured data, which is then processed by a large model. Therefore, the conversion of audio-visual and image data ultimately requires processing by a large model.

[0137] For unstructured data, it is usually rewritten according to the prompt, and the rewritten data is then provided to a large model for processing.

[0138] It should be noted that the data obtained after large model data transformation is structured memory data.

[0139] The following are examples of structured memory data:

[0140] Example 1: ID card information

[0141] Subject: xxx

[0142] Card number: 110xxxxxxxxxxxxxxx

[0143] Example 2: Ticketing Information

[0144] Passenger: xxx

[0145] Fight number: ZH123

[0146] DepartureDate: xxxx-xx-xx xx:xx:xx

[0147] It's important to note that the accuracy of large-scale model data transformation is limited. For example, consider a notification SMS received through a text messaging application. This SMS informs the user of travel information, such as "I will be taking train 123 at station A in two days." Processing this unstructured text using a large-scale model cannot accurately determine the specific time "in two days." This data will require user editing or confirmation. Another example is an SMS stating "I will be taking train 123 at station A tomorrow." While processing this unstructured text with a large-scale model cannot accurately determine the specific time "tomorrow," the current date can be obtained during post-processing to calculate the exact time. This inaccurate data can be corrected by the electronic device itself.

[0148] In one implementation, the structured data obtained after transforming large model data can be verified; that is, the memory data obtained after data transformation is memory data to be verified.

[0149] For example, the aforementioned large model includes a cloud-side large model and a device-side large model. In the data processing method provided in this application embodiment, the device-side large model is mainly used as an example for description. The data conversion task performed on the electronic device side consumes a significant amount of device power. Therefore, this process can be performed when the electronic device is charging and the screen is off; power failure or screen on status may interrupt this process.

[0150] It should be noted that Step 2 can be performed by the data conversion module in the electronic device. After the data conversion module completes the data conversion, it can save the data to disk for later use. In certain scenarios, the electronic device will further process the acquired data.

[0151] Step 3: Data deduplication.

[0152] It should be noted that the process of data deduplication can be understood as the process by which an electronic device identifies the structured memory data to be confirmed as the official memory data.

[0153] Optionally, as mentioned in Step 2 above, the structured data after large model transformation may not be accurate. Therefore, data verification can be performed on the structured data after large model transformation.

[0154] Understandably, ideally, if the structured data after the transformation of a large model is accurate, then data validation is unnecessary.

[0155] It should be noted that data validation is used to determine whether the converted structured data is accurate. Alternatively, simpler data corrections can be performed by electronic devices themselves.

[0156] It should be noted that formal memory data includes refreshing existing memory data as well as creating new memory data.

[0157] Understandably, before generating formal memory data, the current structured memory data needs to be compared with previously generated memories by the electronic device. If the current structured memory data is exactly the same as the previously generated memory, it will not be stored as a new memory in the electronic device to avoid duplication. If the current structured memory data is partially the same as or completely different from the previously generated memory, the former can refresh the existing memory data and store it in the electronic device; the latter can create new memory data and store it in the electronic device.

[0158] In response, the data processing method provided in this application proposes a memory key, which is determined according to the content of the structured memory data. For example, the memory keys for user A's ID card information and user B's ID card information are different; however, the validity period of user A's ID card and user A's ID card number both belong to user A's ID card information, therefore, the memory keys for user A's ID card validity period and user A's ID card number are the same.

[0159] It should be noted that the current structure memory data can be determined to be the same as the previously generated memory based on the memory identifier and field content.

[0160] For example, if the memory identifiers and field contents are the same, it means that the current structured memory data is the same as the previously generated memory, and to avoid duplication, there is no need to generate a new memory. If the memory identifiers are the same but the field contents are different, it means that the current structured memory data is the same as the previously generated memory, and the existing memory data needs to be refreshed. If both the memory identifiers and field contents are different, it means that the current structured memory data is completely different from the previously generated memory, and the memory data needs to be created.

[0161] For example, if a user takes multiple photos of their ID card using an electronic device, all with identical content except for the shooting angle, the structured memory data generated by the electronic device based on these photos will be completely identical. As another example, the electronic device might generate memory A based on user A's ID card information and memory B based on user B's identity information; memory A and memory B will be completely different. Yet another example: the electronic device might first generate memory A based on a photo of the back of user A's ID card, including user A's name, date of birth, and ID number. When the electronic device subsequently obtains a photo of the front of user A's ID card, it can update memory A, adding the validity period of user A's ID document to memory A.

[0162] In one implementation, the process of refreshing existing memory data or creating new memory data may also involve the user editing or confirming the memory data.

[0163] It should be noted that the accuracy of the memory data can be improved through user editing or confirmation before the official memory data is generated. Furthermore, the official memory data is the data that will be stored on the electronic device; some data involving user privacy can be deleted through user editing or confirmation before the official memory data is generated.

[0164] It is understandable that, in addition to electronic devices with screens performing the above steps, devices without screens, such as NAS, can also acquire data and process it to obtain stored data.

[0165] For example, a NAS can acquire user data from multiple electronic devices with the same account, transform and deduplicate the user data, and finally obtain the official memory data. Because a NAS can store a large amount of user data and can connect to multiple electronic devices, it can generate a large amount of memory data and enable cross-device sharing of memory data.

[0166] Based on the above scheme, electronic devices can automatically acquire user data from various applications and process the data according to different types to obtain formal memory data. This process can be implemented without the user's awareness, improving the user experience.

[0167] It should be noted that, as described in Step 3 above, in order to improve the accuracy of the stored data or to protect user privacy, electronic devices can prompt users to edit or confirm the stored data. However, when prompting users, electronic devices need to consider the scenario to prevent frequent prompts from disturbing users and affecting user experience.

[0168] Based on this Figure 4 This illustration shows an exemplary flowchart of a data processing method provided in an embodiment of this application, supplementing the scenario where an electronic device prompts the user to edit or confirm stored data, thereby further optimizing the data processing method provided in this application. The method is described in detail below.

[0169] S401, Data Acquisition.

[0170] For example, structured data, audio-visual image data, and unstructured data can be acquired.

[0171] It should be noted that for certain structured data, if the structured data in the schema paradigm can be generated into structured memory data according to memory requirements through data mapping, the data conversion is quick and consumes little power. After acquiring this type of structured data, electronic devices can directly convert the data through data mapping.

[0172] S402, Data Conversion.

[0173] It should be noted that, apart from certain structured data described in step S401 above, which can be converted immediately after acquisition via data mapping, other user data is typically converted while the electronic device is charging and the screen is off. This is because, for example, audio-visual image data and unstructured data require conversion through a large model, a process that is time-consuming and power-intensive, making it suitable for conversion while the electronic device is charging and the screen is off.

[0174] S403, data deduplication.

[0175] Understandably, the data deduplication process can also be performed while the electronic device is charging and the screen is off.

[0176] For example, when an electronic device is charging and the screen is off, user data needs to be processed item by item. When the electronic device's screen turns on or the power is off, the current task can be stopped. When the electronic device is charging again and the screen is off, the unfinished task will continue to be executed without affecting the normal use of other functions of the electronic device.

[0177] S404, responding to a triggered scenario, prompts the user to edit or confirm.

[0178] Understandably, after completing steps S401 to S403, structured memory data awaiting confirmation is generated. To avoid frequent prompts to the user, electronic devices can pre-set certain trigger scenarios.

[0179] For example, Scenario 1: When an electronic device is unlocked for the first time after 6 AM each day, the user is prompted to edit or confirm. Scenario 2: If the user does not open the memory confirmation interface for three consecutive days, the electronic device will default to not prompting again for seven days. Scenario 3: When the user wakes up the voice assistant or opens the memory homepage (e.g., the memory application interface or prompt box), the electronic device prompts the user to edit or confirm. Scenario 4: When the accumulated structured memory data to be confirmed reaches a certain threshold, the electronic device prompts the user to edit or confirm. Scenario 5: When electronic devices such as NAS, in-vehicle terminals, and smart screens are connected in the near field (e.g., connected to the same Wi-Fi network), the electronic device prompts the user to edit or confirm. Scenario 6: When the management page of electronic devices such as NAS, in-vehicle terminals, and smart screens is opened, the electronic device prompts the user to edit or confirm.

[0180] It should be noted that the specific methods by which electronic devices prompt users to edit or confirm structured memory data may include voice prompts, pop-up prompts, prompt boxes, or push notifications, etc. The embodiments of this application do not limit the specific methods of prompting.

[0181] Based on the above solution, in appropriate scenarios, electronic devices can prompt users to edit or confirm structured memory data, thereby improving the accuracy of the memory data without disturbing the user as much as possible.

[0182] As described above, to ensure user privacy, electronic devices need to obtain user authorization before accessing user data. Authorization switches can be set for various applications on the electronic device. The device will only access user data for an application when the user turns on that switch. If the electronic device has not obtained user authorization, it can prompt the user to turn on the authorization switch when using the memory function.

[0183] Based on this Figure 5 This illustration shows an exemplary flowchart of a data processing method provided in an embodiment of this application. It supplements the method by allowing the electronic device to prompt the user for authorization when the user uses the memory function without prior user authorization, thereby optimizing the data processing method provided in this application. The method is described in detail below.

[0184] S501, Data Acquisition.

[0185] Similar to step S401 above, to avoid redundancy, it will not be described again here.

[0186] S502, Has user authorization been obtained?

[0187] It's important to note that authorization switches can be set for individual applications on electronic devices. When a user turns on the authorization switch for an application, it means that the application has been authorized by the user, and the electronic device can automatically obtain the user's data for that application. If the user does not turn on the authorization switch for an application, it means that the application has not been authorized by the user, and the electronic device cannot automatically obtain the user's data for that application.

[0188] In one implementation, if the application obtains user authorization, the electronic device can perform the following step S503.

[0189] In another implementation, if the application does not have user authorization, the electronic device maliciously executes the following step S506.

[0190] S503, data conversion.

[0191] Similar to step S402 above, to avoid redundancy, it will not be described again here.

[0192] S504, data deduplication.

[0193] Similar to step S403 above, to avoid redundancy, it will not be described again here.

[0194] S505, in response to a triggered scenario, prompts the user to edit or confirm.

[0195] Similar to step S404 above, to avoid redundancy, it will not be described again here. Steps S503 and S504 can also be executed when the electronic device is charging and the screen is off.

[0196] S506, responding to a remembered scenario, prompts the user for authorization.

[0197] It should be noted that the memory scenario refers to the scenario in which a user manages or uses memories.

[0198] For example, memory scenarios may include scenarios such as a voice assistant prompting a user's schedule or a user directly entering their identity information through an input method when filling out a form.

[0199] Understandably, if an application does not have user authorization, it can prompt the user to turn on the authorization switch in the memory scenario so that the electronic device can automatically obtain user data in the future.

[0200] For example, when a user asks a voice assistant about their schedule, the assistant provides the schedule and then asks the user if they allow the user's data from a memo or calendar app to be stored in their memory. If the user agrees, the electronic device will automatically retrieve the user's data from the memo app later. Similarly, when a user fills in their ID information, a pop-up window prompts them if they want to allow the photo gallery app to store their data in its memory. If the user agrees, the electronic device will automatically retrieve the user's data from the photo gallery app.

[0201] It should be noted that the specific method of prompting the user for authorization can be a voice prompt, a pop-up prompt, a prompt box prompt, or a notification bar push notification prompt, etc. This application embodiment does not limit the specific method of prompting.

[0202] Based on the above solution, in memory scenarios, users can be prompted to authorize applications to facilitate electronic devices to automatically obtain user data, making the memory generation process more efficient.

[0203] For ease of understanding, such as Figure 6 As shown, a set of graphical user interfaces (GUIs) are illustrated. Taking a mobile phone terminal as an example, this application describes a data processing method provided by an embodiment.

[0204] like Figure 6 As shown in (a), the mobile terminal displays a source management interface. The source management interface includes authorization controls for multiple applications, such as authorization controls for the gallery application, the SMS application, the transportation application, the social application, and the memo application. For example, the authorization control 601 for the gallery application indicates that the gallery application has obtained user authorization, and the electronic device can automatically obtain user data from the gallery application; the authorization control 602 for the memo application indicates that the memo application has not obtained user authorization, and the electronic device will not be able to automatically obtain user data from the memo application.

[0205] like Figure 6 As shown in (b), the mobile terminal displays a memory confirmation window 603. Within the memory confirmation window, the user can edit or confirm the memory. The memory confirmation window may display the memory source, for example, displaying "Synced via Gallery," indicating that the following memory was obtained and generated by the electronic device from the Gallery application. The memory confirmation window includes multiple memory windows, including Memory 1 window 604 and Memory 2 window. Each memory window displays the main data of that memory; for example, Memory 1 window 604 displays "My ID Card Information," including the specific ID number "110xxxxxxxxxxxxxxx." Each memory window also includes an editing control to prompt the user to edit it. For example, the editing control 605 in Memory 1 window 604. The memory confirmation window 603 also includes a confirmation control 606; when the user clicks the confirmation control 606, it indicates that the user confirms multiple memories within the memory confirmation window 603. In response to the user's operation on the editing control 605, the mobile terminal may display as follows: Figure 6 The GUI shown in (c) is shown in the image.

[0206] like Figure 6 As shown in (c), in response to the user's operation on the editing control 605, the mobile terminal displays a memory editing window 607. The user can edit the specific content of the memory data in the memory editing window. From the memory editing window 607, it can be seen that the memory was generated from the user's ID card image in the gallery application, and the specific content includes the associated person being user A and the ID number "110xxxxxxxxxxxxxxx". The specific content of the memory data can be understood as fields, including the associated person field, the ID number field, the ID card effective date field, and the ID card expiration date field.

[0207] Based on the above scheme, after obtaining user authorization, electronic devices can automatically obtain user data within the application and generate memories based on the user data. To ensure the accuracy of the memories, users can also edit or confirm the generated structured data.

[0208] like Figure 7 As shown, a set of GUIs is illustrated. Taking a mobile phone terminal as an example, this paper introduces a data processing method provided by an embodiment of the present application.

[0209] like Figure 7 As shown in (a), the main interface of the mobile terminal is displayed. The main interface displays icons for various applications, including calendar, gallery, memo, and settings. In response to the user's operation on the settings application icon 701, the mobile terminal can display as follows: Figure 7 The GUI shown in (b) is shown in the image.

[0210] like Figure 7 As shown in (b), in response to the user's operation on the settings application icon 701, the mobile terminal displays the main interface of the settings application. The main interface of the settings application displays various settings options, including Bluetooth settings, mobile network settings, HyperTerminal settings, and memory settings. Each settings option corresponds to different specific settings. In response to the user's operation on the memory option 702, the mobile terminal can display as follows: Figure 7 The GUI shown in (c) is shown in the image.

[0211] like Figure 7 As shown in (c), in response to the user's operation on memory option 702, the mobile terminal displays an interface with memory options. In the memory options interface, parameters related to the memory function can be set. The memory options interface displays multiple setting options, including source management options, memory editing options, and more settings options. The user can select to set the memory source or edit memories in the memory options interface. In response to the user's operation on source management option 703, the mobile terminal can display as shown in (c). Figure 7 The GUI shown in (d) is shown in the image.

[0212] like Figure 7As shown in (d), in response to the operation of source management option 703, the mobile terminal displays a source management interface. The source management interface includes authorization controls for multiple applications, such as authorization controls for the gallery application, SMS application, transportation application, social application, and memo application. For example, the authorization control 704 for the gallery application indicates that the gallery application has obtained user authorization, and the electronic device can automatically obtain user data from the gallery application; the authorization control 705 for the memo application indicates that the memo application has not obtained user authorization, and the electronic device will not be able to automatically obtain user data from the memo application. Therefore, as... Figure 7 In the source management interface shown in (d), the gallery, SMS, transportation, and social applications have obtained user authorization, while the memo application has not.

[0213] For example, with user authorization, a photo gallery application can automatically obtain user data such as a photo of the user's ID card or screenshots of movie ticket purchases. With user authorization, a messaging application can automatically obtain the content of notification messages. With user authorization, a transportation application can automatically obtain the user's flight information. With user authorization, a social media application can automatically obtain the content of the user's chat history.

[0214] It should be noted that after obtaining user authorization, the electronic device will perform data transformation and deduplication on the acquired data, a process that can be carried out without the user's awareness.

[0215] When the trigger scenario described in step S404 above occurs, the electronic device can display as follows: Figure 7 The interface shown in (e) is shown in the image.

[0216] For example, such as Figure 7 As shown in (e), the main interface of the mobile phone terminal is displayed. This main interface is displayed when the mobile phone terminal is unlocked for the first time every morning after 7:00 AM. The main interface displays prompt message 706, which is used to prompt the user to edit or confirm the remembered data. Figure 7 The prompt message 706 shown in (e) is a notification pushed to the user via the notification bar. However, in this embodiment, the specific method of prompting the user is not limited, and it can also be a pop-up notification, a floating window notification, a voice notification, etc. In response to the user's operation on the prompt message 706, the mobile terminal can display as follows: Figure 7The GUI is shown in (f). If the user does not click on prompt message 706 for 3 consecutive days, prompt message 706 will not be pushed to the user for the next 8 days, and will be pushed to the user again after 8 days to prevent disturbing the user.

[0217] like Figure 7 As shown in (f), in response to the user's operation on prompt information 706, the mobile terminal displays a memory confirmation window 707. Within the memory confirmation window, the user can edit or confirm the memory. The memory confirmation window may display the memory source, for example, displaying "Synced via Gallery," indicating that the following memory was obtained and generated by the electronic device from the gallery application. The memory confirmation window includes multiple memory windows, including Memory 1 window 708 and Memory 2 window. Each memory window displays the main data of that memory; for example, Memory 1 window 708 displays "My ID Card Information," including the specific ID number "110xxxxxxxxxxxxxxx." Each memory window also includes an editing control to prompt the user to edit it. For example, the editing control 709 in Memory 1 window 708. The memory confirmation window 708 also includes a confirmation control 710; when the user clicks the confirmation control 710, it indicates that the user confirms multiple memories within the memory confirmation window 707. In response to the user's operation on the editing control 709, the mobile terminal may display as follows: Figure 7 The GUI shown in (g) is shown in the image.

[0218] like Figure 7 As shown in (g), in response to the user's operation on the editing control 709, the mobile terminal displays a memory editing window 711. The user can edit the specific content of the memory data in the memory editing window. The specific content of the memory data can be understood as fields, including the associated person field, the ID number field, the ID effective date field, and the ID expiration date field. From the memory editing window 711, it can be seen that the memory is generated from the user's ID card image in the gallery application. The specific content includes the associated person being user A and the ID number "110xxxxxxxxxxxxxxx". However, the ID effective date and ID expiration date are not generated. It is possible that the gallery application only stores the back image of the user's ID card (the side with the user's photo) and not the front image, resulting in the missing ID effective date and ID expiration date information. In response to the user's operation on the ID effective date option 712 and the ID expiration date option 713, the mobile terminal can display as follows: Figure 7 The GUI shown in (h) is shown in the image.

[0219] like Figure 7As shown in (h), in response to the user's operation on the document validity date option 712 and the document expiration date option 713, the mobile terminal displays a memory editing window 711. The user's operation on the document validity date option 712 and the document expiration date option 713 can be manual input of the document validity date and document expiration date. After the user's editing, in Figure 7 The document validity date is displayed in option 712 (h) and the document expiration date is displayed in option 713. In response to the user's operation on the confirmation control 714, the user's editing of memory 1 is completed, and the mobile terminal can display as follows: Figure 7 The GUI shown in (f) is shown in the image.

[0220] The above Figure 7 (g) in Figure 7 The description in (h) uses user operation as an example, meaning that the content displayed in the document validity date option 712 and document expiration date option 713 is manually added by the user. Optionally, the content displayed in the document validity date option 712 and document expiration date option 713 can also be automatically added by the electronic device in the background.

[0221] For example, the mobile terminal obtains a front image of the user's ID card from a photo library application. The front image of the ID card includes the document's effective date and expiration date. The mobile terminal performs OCR conversion and large-scale model conversion on the ID card image to obtain structured data including the document's effective date and expiration date, and updates the content displayed in the document's effective date option 712 and document expiration date option 713 to obtain, as shown... Figure 7 The GUI shown in (h) is shown in the image.

[0222] In such Figure 7 In the GUI shown in (f), in response to the user's operation on the confirmation control 710, the edited memory 1 is confirmed as the official memory data.

[0223] like Figure 7 As shown in (i), a voice assistant interface is displayed. In response to the user waking up the voice assistant, the mobile terminal can display the voice assistant interface 715. In the voice assistant interface, the user can ask the voice assistant about their schedule, and the voice assistant provides schedule memory information 716. It is understandable that, combined with... Figure 7 In the source management interface shown in (d), the authorization control 705 of the memo application is closed, meaning the memo application has not obtained user authorization, and the schedule memory information 716 can be generated by the user-instructed voice assistant. In such... Figure 7In the memory usage scenario shown in (i), since the memo application has not obtained prior user authorization, a prompt message 717 is displayed on the voice assistant interface 715. The prompt message 717 is used to prompt the user to authorize the memo application to form a memory. In response to the user's operation on the control 718, the mobile terminal can display as follows: Figure 7 The GUI shown in (j) is shown in the image.

[0224] like Figure 7 As shown in (j), in response to the user's operation on control 718, the mobile terminal can display the voice assistant interface 715. The prompt message 718 indicates that control 718 is open, signifying that the memo application has obtained user authorization, and the mobile terminal can automatically obtain user data from the memo application.

[0225] If the memo application has obtained user authorization, in response to the user activating the voice assistant, the mobile terminal can display something like this: Figure 7 The GUI is shown in (k). In the voice assistant interface, the user can ask the voice assistant about their schedule, and the voice assistant provides schedule memory information 716. Multiple memory entries can be displayed in schedule memory information 716, including "attend an online meeting," "go to the supermarket to buy daily necessities," and "concert." Next to the memory entry "concert," a prompt label 719 is displayed. Prompt label 719 indicates to the user that the "concert" memory entry was generated automatically by the electronic device from user data obtained from the memo application, based on user authorization.

[0226] It is understandable that memory usage scenarios are not limited to those using voice assistants. For example, when a user fills in their identity information, if prior authorization has not been obtained, the system can prompt the user to authorize the gallery application or other applications that may access the user's identity information through pop-up prompts, voice prompts, or notification push notifications.

[0227] The above Figure 7 The GUI shown in (k) illustrates a scenario where a user uses memory information, specifically, a voice assistant provides the user with schedule memory information 716 to remind them of their schedule. Schedule memory information 716 includes "Attend an online meeting 8:00-10:00". The mobile terminal can remind the user before the specific event on the schedule arrives.

[0228] For example, such as Figure 7 As shown in (l), in response to a specific event in the schedule (e.g., 8 o'clock), the mobile terminal displays a prompt message 720, which prompts the user to attend an online meeting.

[0229] It is understandable that memory scenarios can include, for example Figure 7 The voice assistant shown in (i) can prompt the user's schedule and may also include, for example, Figure 7 The scene shown in (m) is as follows.

[0230] For example, such as Figure 7 As shown in (m), the "Add Frequently Used Passenger" interface 721 on the mobile terminal is illustrated. On this interface, users can add frequently used passengers by entering their user identity information. The interface displays an ID number option 722 and an input box 723. When the user wants to enter an ID number, in response to the user clicking the ID number option 722, an autofill control 724 is displayed in the input box 723. When the user clicks the autofill control 724, the mobile terminal can automatically enter the ID number in the ID number option 722. Furthermore, if the application related to the identity information has not been authorized by the user, the user can be prompted to enable authorization for the application when they want to use the identity information. Assuming the application related to the user's identity information is a gallery application, a prompt message 725 is displayed on the "Add Frequently Used Passenger" interface 721 to prompt the user to authorize the gallery application to remember the data. In response to the user's operation of control 726, control 726 is opened, indicating that the gallery application has been authorized by the user.

[0231] like Figure 8 The diagram shows a schematic flowchart of a data processing method provided in this application, which can be applied to devices such as mobile terminals, personal computers, and NAS. The method is described in detail below.

[0232] S801, displays the first interface, which includes the first control.

[0233] It should be noted that the first control is used to authorize the electronic device to remember the user data of the first application.

[0234] For example, the first interface can be as follows: Figure 6 The source management interface shown in (a) includes authorization controls for multiple applications, such as authorization controls for the Gallery application, the SMS application, the Transportation application, the Social application, and the Notes application. When a user opens the authorization control for an application, it means that the electronic device can automatically obtain the user data of that application and automatically generate a memory based on that user data.

[0235] S802, It was detected that the user authorized the electronic device to memorize user data of the first application through the first control.

[0236] For example, in response to a user opening the authorization control of a gallery application, an electronic device can automatically obtain data such as videos and images stored in the gallery application, and memorize the video and image data to obtain structured data.

[0237] It is understood that users may open the application's authorization control in ways including but not limited to manual clicking, voice control, etc., and this application embodiment does not limit this.

[0238] It should be noted that user data may be of different types in different applications.

[0239] For example, the user data of the first application belongs to any of the following: structured data, image and audio data, and unstructured data.

[0240] For example, user data for a photo gallery application can be image and video data, user data for a transportation application can be structured data, and data for a text messaging application can be unstructured data.

[0241] It should be noted that, after obtaining user authorization, the process by which the electronic device obtains user data from the first application is done without the user's knowledge.

[0242] It should be noted that user data of the first application can be obtained through proactive or passive means. Proactive means include sandbox data subscription and system capability data subscription, while passive means include intent framework donation.

[0243] For example, different types of user data can be obtained in different ways.

[0244] For example, when the user data of the first application is structured data, it can be obtained through intent framework donation; when the user data of the first application is audio-visual image data, it can be obtained through sandbox data subscription; when the user data of the first application is unstructured data, it can be obtained through system capability data subscription.

[0245] S803, by memorizing the first user data of the first application, obtains the first structured data.

[0246] For example, the first user data of the first application belongs to the user data of the first application.

[0247] It should be noted that the electronic device's memorization of the first user data acquired from the first application can be understood as the electronic device performing data transformation on the first user data of the first application. This process can be imperceptible to the user.

[0248] For example, specific methods of data transformation may include one or more of the following: data mapping, OSR, ASR, and large model transformation. The data obtained after data transformation is structured data.

[0249] It should be noted that the data transformation methods for first-user data of different types of first-applications may differ.

[0250] For example, when the first user data of the first application is structured data, data transformation can be performed through data mapping and large model transformation; when the first user data of the first application is audio-visual image data, data transformation can be performed through OSR, ASR, and large model transformation; when the first user data of the first application is unstructured data, data transformation can be performed through large model transformation.

[0251] S804, in response to a first instruction from the user, obtains a first memory entry based on first structured data.

[0252] For example, memory entries can be displayed in any of the following ways: cards, controls, labels, options, bullet comments, dialog boxes, or floating windows.

[0253] It is understood that the embodiments of this application do not limit the specific display method of memory entries.

[0254] It should be noted that the first instruction is used to instruct the user to confirm that the first structured data is accurate.

[0255] In other words, to further ensure the accuracy of the first structured data obtained after the large model transformation, users need to further confirm or edit it.

[0256] In one implementation, after receiving a first instruction to instruct the user to confirm the accuracy of the first structured data, the electronic device can confirm the first structured data as the first memory entry.

[0257] In another implementation, if a user believes that the structured data processed by the electronic device is inaccurate, or does not want the electronic device to store certain private data, the user can edit the structured data.

[0258] Optionally, second structured data is obtained by memorizing second user data of the first application; in response to a second user instruction, a second interface is displayed, which is an editing interface for the second structured data; in response to the user's operation on the second interface, the second structured data is modified into third structured data; and a second memory entry is obtained based on the third structured data.

[0259] For example, in response to a user click such Figure 7The editing control 709 shown in (f) allows the electronic device to receive a second instruction. For example... Figure 7 The interface shown in (g) is the second interface, where users can edit the second structured data to obtain the third structured data. The third structured data can contain more or fewer fields than the second structured data. For example, Figure 7 The fields shown in (h) – “Associated Person” and its contents (User A), “ID Number” and its contents (110xxxxxxxxxxxxxxx), “ID Effective Date” and its contents (June 1, 2024), and “ID Expiry Date” and its contents (June 1, 2034) – can all be understood as fields in structured data.

[0260] It should be noted that, in order to avoid frequently prompting users to edit or confirm structured data, electronic devices can also preset certain trigger scenarios. Under the preset scenarios, the electronic device will remind users to edit or confirm structured data.

[0261] Optionally, in a preset scenario, a third interface is displayed. The third interface includes a first prompt message, which prompts the user to confirm the first structured data. The preset scenario is related to the usage status of the electronic device and / or the status of the structured data.

[0262] The usage status of an electronic device can be understood as the status of the electronic device itself (e.g., whether the electronic device is unlocked or locked), or the status of the user's interaction with the electronic device (e.g., whether the user responds to prompts issued by the electronic device). The status of structured data can be understood as the usage status of the structured data (e.g., scenarios where memory is used, where the electronic device accesses memory entries), or the amount of structured data to be verified.

[0263] Optionally, when the preset scenario is related to the usage status of the electronic device, the preset scenario includes at least one of the following: when the electronic device is unlocked for the first time each day, or after a first period of time when the electronic device does not detect the user's feedback operation on the first prompt information; when the preset scenario is related to the status of structured receipts, the preset scenario includes at least one of the following: when the electronic device calls a memory entry, or when the number of structured data to be confirmed reaches a preset threshold.

[0264] Scenario 1: The first time an electronic device is unlocked each day. For example, when an electronic device is unlocked for the first time after 6 a.m. each day, the user is prompted to edit or confirm.

[0265] Scenario 2: After the electronic device has not detected any user feedback on the initial prompt message for a certain period of time. For example, if the user does not open the confirmation memory interface for 3 consecutive days (i.e., the user has not responded to the initial prompt message), the electronic device will default to not prompting again for 7 days, and will remind the user to confirm again after 7 days.

[0266] Scenario 3: When an electronic device accesses a memory entry. For example, when a user accesses a memory entry (or memory information) by waking up a voice assistant or opening the memory homepage (e.g., the interface or prompt of a memory application), the electronic device prompts the user to edit or confirm.

[0267] Scenario 4: When the number of structured data items awaiting confirmation reaches a preset threshold. For example, when the accumulated structured data items awaiting confirmation reach 20, the electronic device prompts the user to edit or confirm.

[0268] It should be noted that the specific methods by which electronic devices prompt users to edit or confirm structured memory data may include voice prompts, pop-up prompts, prompt boxes, or push notifications, etc. The embodiments of this application do not limit the specific methods of prompting.

[0269] Of course, if the first structured data obtained after the large model conversion is accurate, the electronic device can directly use the obtained first structured data as the first memory entry without user confirmation.

[0270] It should be noted that, as Figure 7 In the GUI shown in (h), the contents of document validity date options 712 and 713 can be edited manually by the user or automatically by the electronic device.

[0271] Optionally, by memorizing the first user data of the first application, N fields are obtained from M fields, where M is greater than N and N is a positive integer greater than or equal to 1; third user data of the first application is obtained, which is associated with the first user data; and L fields are obtained by memorizing the third user data of the first application, where L fields include at least a portion of the fields other than N fields from the M fields, and L is a positive integer greater than or equal to 1.

[0272] For example, such as Figure 7In the GUI shown in (g), the first structured data should fully contain four fields: "Associated Person" and its content, "ID Number" and its content, "ID Effective Date" and its content, and "ID Expiry Date" and its content. When the electronic device memorizes the back image of an ID card in the gallery application (the first user data of the first application), it can obtain the first structured data containing two fields: "Associated Person" and its content (User A) and "ID Number" and its content (110xxxxxxxxxxxxxxx). When the electronic device memorizes the front image of an ID card in the gallery application (the third user data of the first application), it can obtain the remaining two fields: "ID Effective Date" and its content (June 1, 2024) and "ID Expiry Date" and its content (June 1, 2034).

[0273] It is understandable that by memorizing the first user data and the third user data, the memory identifiers of the structured data obtained are the same, but the field contents may be different.

[0274] For example, a driver's license consists of two images. The electronic device retrieves the first image of the driver's license through a photo library application, obtaining fields containing information such as name, address, and date of birth. The electronic device then retrieves the second image of the driver's license through the same photo library application, obtaining fields containing information about the probationary period.

[0275] It should be noted that the structured memory data proposed in the embodiments of this application is structured data.

[0276] It should be noted that the process of electronic devices memorizing user data requires a significant amount of power. Therefore, memorizing the initial user data can be done during the charging process of the electronic device. Additionally, sometimes it is necessary to memorize user data through a server; therefore, memorizing the initial user data can be done when the electronic device is connected to a wireless network (Wi-Fi).

[0277] In scenarios where users are using memory, if the application's authorization switch has not been turned on beforehand, the electronic device can also prompt the user to turn on the collection switch.

[0278] Optionally, in response to a third instruction from the user, a fourth interface is displayed. The fourth interface includes a second prompt message that prompts the user to authorize the electronic device to memorize user data of the second application. The third instruction is used to invoke a third memory entry that is associated with the second application.

[0279] For example, if the user has not previously enabled the authorization switch for the second application, the third instruction could be an instruction from the user requesting to retrieve a memory entry in a memory usage scenario, or it could be understood as an instruction from the user requesting to retrieve at least some fields in structured data in a memory usage scenario. For example, such as Figure 7 The GUI shown in (i) can call structured data or memory entries that can contain the complete "See online meeting" field and the meeting time "8:00-10:00" field, or it can contain part of the "Go to supermarket to buy daily necessities" field.

[0280] In addition, in scenarios where users use memory, tags can be used to distinguish whether memory entries are automatically generated by electronic devices after authorization or generated without authorization.

[0281] Optionally, the first memory entry includes indication information indicating that the memory information originates from the first application.

[0282] For example, such as Figure 7 In the voice assistant interface described in (k), the first memory entry is "concert" memory information. Next to the "concert" memory information, a prompt label 719 is displayed, showing "memory memory". This indicates that the user authorizes the electronic device to remember user data from the memory application, so the electronic device can automatically generate "concert" memory information. In other words, the "concert" memory information originates from the memory application.

[0283] Based on the above scheme, electronic devices can obtain user data from applications with the user's authorization, process the user data to generate memories, and this process can be imperceptible to the user, bringing more surprises to the user experience.

[0284] This application provides a computer program product that, when run on a device, causes the device to execute the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar to those of the related embodiments described above, and will not be repeated here.

[0285] This application provides a readable storage medium containing instructions that, when executed on a device, cause the device to perform the technical solutions described in the above embodiments. The implementation principle and technical effects are similar and will not be repeated here.

[0286] This application provides a chip for executing instructions. When the chip is running, it executes the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar and will not be repeated here.

[0287] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this application.

[0288] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the above-described apparatus and unit (module) can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0289] In the several embodiments provided in this application, it should be understood that the disclosed devices, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0290] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0291] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0292] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0293] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A data processing method, characterized in that, The method includes: When a user authorizes an electronic device to obtain user data from an application, the electronic device automatically obtains the user data from the application. If the user has not authorized the electronic device to access the user data of the application, in response to the scenario where the user manages memory or uses memory, the electronic device prompts the user to authorize the electronic device to access the user data of the application; The electronic device generates structured memory data to be confirmed based on the acquired user data; In response to a pre-set trigger scenario, the electronic device prompts the user to edit or confirm the structured memory data to be confirmed; Memory entries are generated based on the structured memory data edited or confirmed by the user.

2. The method according to claim 1, characterized in that, The pre-set trigger scenario is related to the usage state of the electronic device and / or the state of the structured memory data.

3. The method according to claim 2, characterized in that, When the preset trigger scenario is related to the usage state of the electronic device, the preset trigger scenario includes: When unlocking the electronic device for the first time each day; When the preset trigger scenario is related to the state of the structured memory data, the preset trigger scenario includes: When the electronic device calls the structured memory data, or when the number of structured memory data to be confirmed reaches a preset threshold.

4. The method according to any one of claims 1 to 3, characterized in that, The electronic device generates structured memory data to be confirmed based on the acquired user data during the charging process of the electronic device and / or when the electronic device is connected to a wireless network (WiFi).

5. The method according to any one of claims 1 to 3, characterized in that, The memory entry includes indication information that indicates the memory information originates from the application.

6. The method according to any one of claims 1 to 3, characterized in that, The memory entries are displayed in any of the following ways: Cards, controls, labels, options, bullet comments, pop-ups, dialog boxes, or floating windows.

7. The method according to any one of claims 1 to 3, characterized in that, The application includes a first application and a second application. The structured memory data to be confirmed includes N fields generated based on user data from the first application and L fields generated based on user data from the second application, where N is a positive integer greater than or equal to 1 and L is a positive integer greater than or equal to 1.

8. An electronic device, characterized in that, include: One or more processors; One or more memory units; The one or more memories store one or more computer programs, the one or more computer programs including instructions that, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1 to 7.

9. A data processing apparatus, characterized in that, include: A processor coupled to a memory for storing a computer program, the processor for running the computer program such that the data processing apparatus performs the method as described in any one of claims 1 to 7.

10. The data processing apparatus according to claim 9, characterized in that, It also includes one or more of the memory and transceiver, the transceiver being used to receive and / or transmit signals.

11. A computer-readable storage medium, characterized in that, It stores a computer program thereon, which, when executed by a computer, causes the computer to perform the method as described in any one of claims 1 to 7.

12. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1 to 7.

13. A chip, characterized in that, The chip includes a processor and a data interface, wherein the processor reads instructions stored in the memory through the data interface to execute the method as described in any one of claims 1 to 7.

Images